2024-09-17T05:49:47.084 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T05:49:47.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T05:49:47.215 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} email: pdonnell@redhat.com first_in_suite: false job_id: '7908652' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 mds: mds oft prefetch dirfrags: true mds_sleep_rank_change: 5000000.0 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - but it is still running - objects unfound and apparently lost - MDS_SLOW_METADATA_IO - MDS_TRIM sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 476 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 320/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyi7ITscgugwyq/5k558dp/NcELUWVlNIpwAfLXgztQQpB4Oqx4Ulq80xh4zx8ar3VsmF7cpK7QFkDH7VeVtHM= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5b9fr2gnIw1Ti66H/LbKlWLMoTlvgo3L6C5zvGVbGyvHaDvCnjAn5IjNk3qXuVw78ir30VLIxEJyhDf3KxyV8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - thrashosds: null - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_02:09:51 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T05:49:47.215 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T05:49:47.216 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T05:49:47.216 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T05:49:47.218 INFO:teuthology.task.internal:Checking packages... 2024-09-17T05:49:47.240 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T05:49:47.240 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T05:49:47.240 INFO:teuthology.packaging:ref: None 2024-09-17T05:49:47.240 INFO:teuthology.packaging:tag: None 2024-09-17T05:49:47.240 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T05:49:47.240 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T05:49:47.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T05:49:47.380 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989-gce1b342b-1jammy 2024-09-17T05:49:47.381 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T05:49:47.392 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T05:49:47.392 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T05:49:47.410 INFO:teuthology.task.internal:Saving configuration 2024-09-17T05:49:47.428 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T05:49:47.434 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T05:49:47.448 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 05:44:03.914538', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIvuyCODbLFlPiCNqK4EksgN6LFoJeoNRmiTr4AceGaz'} 2024-09-17T05:49:47.467 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 05:44:03.915879', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFaqni3EmopevonDQaLLhkF+E3QRYnI+YSn+cm5lCqg6'} 2024-09-17T05:49:47.467 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T05:49:47.472 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-17T05:49:47.472 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-17T05:49:47.473 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T05:49:47.527 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa5d51f3ac0>, signals=[15]) 2024-09-17T05:49:47.527 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T05:49:47.532 INFO:teuthology.task.internal:Opening connections... 2024-09-17T05:49:47.532 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T05:49:47.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:49:47.614 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-09-17T05:49:47.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:49:47.696 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T05:49:47.702 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-09-17T05:49:47.707 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-09-17T05:49:47.707 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-09-17T05:49:47.752 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T05:49:47.752 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Ubuntu" 2024-09-17T05:49:47.752 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="22.04" 2024-09-17T05:49:47.752 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T05:49:47.752 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_CODENAME=jammy 2024-09-17T05:49:47.753 INFO:teuthology.orchestra.run.smithi122.stdout:ID=ubuntu 2024-09-17T05:49:47.753 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE=debian 2024-09-17T05:49:47.753 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T05:49:47.753 INFO:teuthology.orchestra.run.smithi122.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T05:49:47.753 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T05:49:47.753 INFO:teuthology.orchestra.run.smithi122.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T05:49:47.753 INFO:teuthology.orchestra.run.smithi122.stdout:UBUNTU_CODENAME=jammy 2024-09-17T05:49:47.754 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-09-17T05:49:47.773 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-09-17T05:49:47.778 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-09-17T05:49:47.778 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-09-17T05:49:47.824 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T05:49:47.824 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Ubuntu" 2024-09-17T05:49:47.825 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="22.04" 2024-09-17T05:49:47.825 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T05:49:47.825 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_CODENAME=jammy 2024-09-17T05:49:47.825 INFO:teuthology.orchestra.run.smithi173.stdout:ID=ubuntu 2024-09-17T05:49:47.825 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE=debian 2024-09-17T05:49:47.825 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T05:49:47.825 INFO:teuthology.orchestra.run.smithi173.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T05:49:47.825 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T05:49:47.825 INFO:teuthology.orchestra.run.smithi173.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T05:49:47.825 INFO:teuthology.orchestra.run.smithi173.stdout:UBUNTU_CODENAME=jammy 2024-09-17T05:49:47.826 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-09-17T05:49:47.882 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T05:49:47.891 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T05:49:47.896 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T05:49:47.896 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-09-17T05:49:47.899 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-09-17T05:49:47.903 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T05:49:47.909 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T05:49:47.909 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-09-17T05:49:47.946 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-09-17T05:49:48.031 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T05:49:48.076 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T05:49:48.090 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T05:49:48.091 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T05:49:48.091 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T05:49:48.091 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T05:49:48.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:49:48.096 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-09-17T05:49:48.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:49:48.097 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-09-17T05:49:48.145 INFO:teuthology.orchestra.run.smithi122.stdout:5.15.0-56-generic 2024-09-17T05:49:48.145 INFO:teuthology.task.kernel:Running kernel on smithi122: 5.15.0-56-generic 2024-09-17T05:49:48.145 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get clean 2024-09-17T05:49:48.146 INFO:teuthology.orchestra.run.smithi173.stdout:5.15.0-56-generic 2024-09-17T05:49:48.147 INFO:teuthology.task.kernel:Running kernel on smithi173: 5.15.0-56-generic 2024-09-17T05:49:48.147 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get clean 2024-09-17T05:49:48.260 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-09-17T05:49:48.281 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2024-09-17T05:49:48.411 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T05:49:48.414 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T05:49:48.510 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T05:49:48.516 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T05:49:48.592 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T05:49:48.598 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T05:49:48.618 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T05:49:48.633 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T05:49:48.689 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T05:49:48.701 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T05:49:48.726 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T05:49:48.729 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T05:49:48.729 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T05:49:48.729 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T05:49:48.738 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T05:49:48.740 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T05:49:48.740 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T05:49:48.747 INFO:teuthology.orchestra.run.smithi122.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T05:49:48.750 INFO:teuthology.orchestra.run.smithi122.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T05:49:48.750 INFO:teuthology.orchestra.run.smithi122.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T05:49:48.759 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T05:49:48.760 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T05:49:48.762 INFO:teuthology.orchestra.run.smithi122.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T05:49:48.763 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T05:49:48.763 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T05:49:48.766 INFO:teuthology.orchestra.run.smithi122.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T05:49:48.767 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T05:49:48.768 INFO:teuthology.orchestra.run.smithi122.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T05:49:48.768 INFO:teuthology.orchestra.run.smithi122.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T05:49:48.768 INFO:teuthology.orchestra.run.smithi122.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T05:49:48.770 INFO:teuthology.orchestra.run.smithi122.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T05:49:48.773 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T05:49:48.775 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T05:49:48.775 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T05:49:48.775 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T05:49:48.783 INFO:teuthology.orchestra.run.smithi122.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T05:49:48.792 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T05:49:48.792 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T05:49:48.948 INFO:teuthology.orchestra.run.smithi122.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T05:49:48.955 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T05:49:49.095 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T05:49:49.098 INFO:teuthology.orchestra.run.smithi122.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T05:49:49.291 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T05:49:49.293 INFO:teuthology.orchestra.run.smithi122.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T05:49:49.452 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T05:49:49.453 INFO:teuthology.orchestra.run.smithi122.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T05:49:49.466 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T05:49:49.466 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T05:49:49.467 INFO:teuthology.orchestra.run.smithi122.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T05:49:49.468 INFO:teuthology.orchestra.run.smithi122.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T05:49:49.468 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T05:49:49.537 INFO:teuthology.orchestra.run.smithi122.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T05:49:49.538 INFO:teuthology.orchestra.run.smithi122.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T05:49:49.541 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T05:49:49.552 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T05:49:49.552 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T05:49:49.554 INFO:teuthology.orchestra.run.smithi122.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T05:49:49.555 INFO:teuthology.orchestra.run.smithi122.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T05:49:49.577 INFO:teuthology.orchestra.run.smithi122.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T05:49:49.587 INFO:teuthology.orchestra.run.smithi173.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T05:49:49.605 INFO:teuthology.orchestra.run.smithi122.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T05:49:49.605 INFO:teuthology.orchestra.run.smithi173.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T05:49:49.612 INFO:teuthology.orchestra.run.smithi173.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T05:49:49.612 INFO:teuthology.orchestra.run.smithi122.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-17T05:49:49.616 INFO:teuthology.orchestra.run.smithi173.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T05:49:49.618 INFO:teuthology.orchestra.run.smithi173.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T05:49:49.618 INFO:teuthology.orchestra.run.smithi173.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T05:49:49.618 INFO:teuthology.orchestra.run.smithi122.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T05:49:49.618 INFO:teuthology.orchestra.run.smithi122.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T05:49:49.689 INFO:teuthology.orchestra.run.smithi122.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T05:49:49.689 INFO:teuthology.orchestra.run.smithi122.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T05:49:49.689 INFO:teuthology.orchestra.run.smithi122.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T05:49:49.689 INFO:teuthology.orchestra.run.smithi122.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T05:49:49.690 INFO:teuthology.orchestra.run.smithi122.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T05:49:49.694 INFO:teuthology.orchestra.run.smithi173.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T05:49:49.695 INFO:teuthology.orchestra.run.smithi173.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T05:49:49.696 INFO:teuthology.orchestra.run.smithi173.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T05:49:49.697 INFO:teuthology.orchestra.run.smithi173.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T05:49:49.698 INFO:teuthology.orchestra.run.smithi173.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T05:49:49.698 INFO:teuthology.orchestra.run.smithi173.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T05:49:49.699 INFO:teuthology.orchestra.run.smithi122.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T05:49:49.699 INFO:teuthology.orchestra.run.smithi122.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T05:49:49.699 INFO:teuthology.orchestra.run.smithi173.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T05:49:49.699 INFO:teuthology.orchestra.run.smithi122.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T05:49:49.779 INFO:teuthology.orchestra.run.smithi173.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T05:49:49.780 INFO:teuthology.orchestra.run.smithi122.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T05:49:49.780 INFO:teuthology.orchestra.run.smithi173.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T05:49:49.780 INFO:teuthology.orchestra.run.smithi122.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T05:49:54.922 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 16.1 MB in 2s (7,572 kB/s) 2024-09-17T05:49:55.001 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 16.1 MB in 2s (7,591 kB/s) 2024-09-17T05:49:56.282 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-17T05:49:56.300 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T05:49:56.354 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-17T05:49:56.379 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-17T05:49:56.396 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T05:49:56.450 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-17T05:49:56.541 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-09-17T05:49:56.541 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-09-17T05:49:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-09-17T05:49:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-09-17T05:49:56.712 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T05:49:56.712 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T05:49:56.712 INFO:teuthology.orchestra.run.smithi173.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T05:49:56.712 INFO:teuthology.orchestra.run.smithi173.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T05:49:56.713 INFO:teuthology.orchestra.run.smithi173.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T05:49:56.713 INFO:teuthology.orchestra.run.smithi173.stdout: python2.7-minimal 2024-09-17T05:49:56.713 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T05:49:56.714 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2024-09-17T05:49:56.714 INFO:teuthology.orchestra.run.smithi173.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T05:49:56.714 INFO:teuthology.orchestra.run.smithi173.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T05:49:56.714 INFO:teuthology.orchestra.run.smithi173.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T05:49:56.715 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2024-09-17T05:49:56.716 INFO:teuthology.orchestra.run.smithi173.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T05:49:56.716 INFO:teuthology.orchestra.run.smithi173.stdout:Recommended packages: 2024-09-17T05:49:56.716 INFO:teuthology.orchestra.run.smithi173.stdout: thermald 2024-09-17T05:49:56.751 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2024-09-17T05:49:56.751 INFO:teuthology.orchestra.run.smithi173.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T05:49:56.751 INFO:teuthology.orchestra.run.smithi173.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T05:49:56.752 INFO:teuthology.orchestra.run.smithi173.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T05:49:56.753 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages will be upgraded: 2024-09-17T05:49:56.753 INFO:teuthology.orchestra.run.smithi173.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T05:49:56.803 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T05:49:56.803 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T05:49:56.803 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T05:49:56.804 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T05:49:56.804 INFO:teuthology.orchestra.run.smithi122.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T05:49:56.804 INFO:teuthology.orchestra.run.smithi122.stdout: python2.7-minimal 2024-09-17T05:49:56.804 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T05:49:56.805 INFO:teuthology.orchestra.run.smithi173.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T05:49:56.805 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 113 MB of archives. 2024-09-17T05:49:56.805 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T05:49:56.805 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T05:49:56.805 INFO:teuthology.orchestra.run.smithi122.stdout:The following additional packages will be installed: 2024-09-17T05:49:56.806 INFO:teuthology.orchestra.run.smithi122.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T05:49:56.806 INFO:teuthology.orchestra.run.smithi122.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T05:49:56.806 INFO:teuthology.orchestra.run.smithi122.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T05:49:56.807 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-09-17T05:49:56.807 INFO:teuthology.orchestra.run.smithi122.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T05:49:56.807 INFO:teuthology.orchestra.run.smithi122.stdout:Recommended packages: 2024-09-17T05:49:56.807 INFO:teuthology.orchestra.run.smithi122.stdout: thermald 2024-09-17T05:49:56.856 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-09-17T05:49:56.856 INFO:teuthology.orchestra.run.smithi122.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T05:49:56.857 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T05:49:56.857 INFO:teuthology.orchestra.run.smithi122.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T05:49:56.857 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages will be upgraded: 2024-09-17T05:49:56.857 INFO:teuthology.orchestra.run.smithi122.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T05:49:57.037 INFO:teuthology.orchestra.run.smithi122.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T05:49:57.037 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 113 MB of archives. 2024-09-17T05:49:57.038 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T05:49:57.038 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T05:49:57.222 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T05:49:57.312 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T05:49:58.116 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T05:49:58.117 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T05:49:58.117 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T05:49:58.236 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T05:49:58.256 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T05:49:58.552 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T05:49:58.723 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 113 MB in 2s (72.5 MB/s) 2024-09-17T05:49:58.909 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T05:49:58.910 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T05:50:00.971 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T05:50:00.976 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T05:50:01.159 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T05:50:01.159 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T05:50:01.159 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T05:50:01.190 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:01.511 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T05:50:01.596 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T05:50:01.978 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 113 MB in 5s (23.9 MB/s) 2024-09-17T05:50:02.146 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T05:50:03.367 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T05:50:03.388 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T05:50:03.482 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:03.969 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T05:50:03.990 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T05:50:04.119 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:04.148 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T05:50:04.152 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T05:50:04.210 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:06.304 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T05:50:06.325 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T05:50:06.413 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:06.957 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T05:50:06.977 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T05:50:07.188 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:10.643 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T05:50:10.770 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T05:50:11.119 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T05:50:11.248 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T05:50:11.518 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T05:50:11.540 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T05:50:11.576 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T05:50:13.986 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T05:50:14.110 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T05:50:14.452 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T05:50:14.580 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T05:50:14.883 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T05:50:14.905 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T05:50:14.949 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T05:50:17.599 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T05:50:17.635 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T05:50:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:20.367 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T05:50:20.492 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T05:50:20.513 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T05:50:20.551 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T05:50:20.596 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:20.842 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T05:50:20.964 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:21.073 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T05:50:21.185 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:22.518 INFO:teuthology.orchestra.run.smithi173.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:50:22.518 INFO:teuthology.orchestra.run.smithi173.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T05:50:22.518 INFO:teuthology.orchestra.run.smithi173.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T05:50:22.518 INFO:teuthology.orchestra.run.smithi173.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T05:50:22.687 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:23.273 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T05:50:23.400 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T05:50:23.742 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T05:50:24.722 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T05:50:24.824 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:24.847 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T05:50:24.940 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T05:50:25.007 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:25.069 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:26.378 INFO:teuthology.orchestra.run.smithi122.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:50:26.378 INFO:teuthology.orchestra.run.smithi122.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T05:50:26.378 INFO:teuthology.orchestra.run.smithi122.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T05:50:26.378 INFO:teuthology.orchestra.run.smithi122.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T05:50:26.409 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:26.479 INFO:teuthology.orchestra.run.smithi173.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T05:50:26.479 INFO:teuthology.orchestra.run.smithi173.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T05:50:26.546 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:27.939 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T05:50:28.048 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T05:50:28.174 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:29.576 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T05:50:29.642 INFO:teuthology.orchestra.run.smithi122.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T05:50:29.642 INFO:teuthology.orchestra.run.smithi122.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T05:50:40.862 INFO:teuthology.orchestra.run.smithi173.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T05:50:40.862 INFO:teuthology.orchestra.run.smithi173.stdout:Sourcing file `/etc/default/grub' 2024-09-17T05:50:40.877 INFO:teuthology.orchestra.run.smithi173.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T05:50:40.900 INFO:teuthology.orchestra.run.smithi173.stdout:Generating grub configuration file ... 2024-09-17T05:50:41.198 INFO:teuthology.orchestra.run.smithi173.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T05:50:41.221 INFO:teuthology.orchestra.run.smithi173.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T05:50:41.527 INFO:teuthology.orchestra.run.smithi173.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:50:41.533 INFO:teuthology.orchestra.run.smithi173.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T05:50:41.602 INFO:teuthology.orchestra.run.smithi173.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T05:50:41.608 INFO:teuthology.orchestra.run.smithi173.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T05:50:41.769 INFO:teuthology.orchestra.run.smithi173.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T05:50:41.769 INFO:teuthology.orchestra.run.smithi173.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T05:50:41.769 INFO:teuthology.orchestra.run.smithi173.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T05:50:41.811 INFO:teuthology.orchestra.run.smithi173.stdout:done 2024-09-17T05:50:42.376 DEBUG:teuthology.orchestra.run.smithi173:> dpkg -s linux-image-generic 2024-09-17T05:50:42.447 INFO:teuthology.orchestra.run.smithi173.stdout:Package: linux-image-generic 2024-09-17T05:50:42.447 INFO:teuthology.orchestra.run.smithi173.stdout:Status: install ok installed 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout:Priority: optional 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout:Section: kernel 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout:Installed-Size: 21 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: amd64 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout:Source: linux-meta 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout:Version: 5.15.0.122.122 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout:Recommends: thermald 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout:Description: Generic Linux kernel image 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout: This package will always depend on the latest generic kernel image 2024-09-17T05:50:42.448 INFO:teuthology.orchestra.run.smithi173.stdout: available. 2024-09-17T05:50:42.449 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T05:50:42.449 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T05:50:42.449 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T05:50:42.449 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-17T05:50:42.449 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T05:50:42.449 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get clean 2024-09-17T05:50:42.620 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2024-09-17T05:50:42.753 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T05:50:42.761 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T05:50:42.778 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T05:50:42.851 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T05:50:43.781 INFO:teuthology.orchestra.run.smithi122.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T05:50:43.781 INFO:teuthology.orchestra.run.smithi122.stdout:Sourcing file `/etc/default/grub' 2024-09-17T05:50:43.791 INFO:teuthology.orchestra.run.smithi122.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T05:50:43.819 INFO:teuthology.orchestra.run.smithi122.stdout:Generating grub configuration file ... 2024-09-17T05:50:44.066 INFO:teuthology.orchestra.run.smithi122.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T05:50:44.080 INFO:teuthology.orchestra.run.smithi122.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T05:50:44.182 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-17T05:50:44.200 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T05:50:44.264 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-17T05:50:44.376 INFO:teuthology.orchestra.run.smithi122.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:50:44.382 INFO:teuthology.orchestra.run.smithi122.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T05:50:44.448 INFO:teuthology.orchestra.run.smithi122.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T05:50:44.453 INFO:teuthology.orchestra.run.smithi122.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T05:50:44.474 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-09-17T05:50:44.475 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-09-17T05:50:44.594 INFO:teuthology.orchestra.run.smithi122.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T05:50:44.594 INFO:teuthology.orchestra.run.smithi122.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T05:50:44.594 INFO:teuthology.orchestra.run.smithi122.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T05:50:44.627 INFO:teuthology.orchestra.run.smithi122.stdout:done 2024-09-17T05:50:44.665 INFO:teuthology.orchestra.run.smithi173.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T05:50:44.665 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T05:50:44.665 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T05:50:44.665 INFO:teuthology.orchestra.run.smithi173.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T05:50:44.666 INFO:teuthology.orchestra.run.smithi173.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T05:50:44.666 INFO:teuthology.orchestra.run.smithi173.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T05:50:44.666 INFO:teuthology.orchestra.run.smithi173.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T05:50:44.666 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T05:50:44.706 INFO:teuthology.orchestra.run.smithi173.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T05:50:44.708 DEBUG:teuthology.orchestra.run.smithi173:> dpkg -s linux-image-generic 2024-09-17T05:50:44.723 INFO:teuthology.orchestra.run.smithi173.stdout:Package: linux-image-generic 2024-09-17T05:50:44.723 INFO:teuthology.orchestra.run.smithi173.stdout:Status: install ok installed 2024-09-17T05:50:44.724 INFO:teuthology.orchestra.run.smithi173.stdout:Priority: optional 2024-09-17T05:50:44.724 INFO:teuthology.orchestra.run.smithi173.stdout:Section: kernel 2024-09-17T05:50:44.724 INFO:teuthology.orchestra.run.smithi173.stdout:Installed-Size: 21 2024-09-17T05:50:44.724 INFO:teuthology.orchestra.run.smithi173.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T05:50:44.724 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: amd64 2024-09-17T05:50:44.724 INFO:teuthology.orchestra.run.smithi173.stdout:Source: linux-meta 2024-09-17T05:50:44.724 INFO:teuthology.orchestra.run.smithi173.stdout:Version: 5.15.0.122.122 2024-09-17T05:50:44.724 INFO:teuthology.orchestra.run.smithi173.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T05:50:44.724 INFO:teuthology.orchestra.run.smithi173.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T05:50:44.724 INFO:teuthology.orchestra.run.smithi173.stdout:Recommends: thermald 2024-09-17T05:50:44.724 INFO:teuthology.orchestra.run.smithi173.stdout:Description: Generic Linux kernel image 2024-09-17T05:50:44.724 INFO:teuthology.orchestra.run.smithi173.stdout: This package will always depend on the latest generic kernel image 2024-09-17T05:50:44.725 INFO:teuthology.orchestra.run.smithi173.stdout: available. 2024-09-17T05:50:44.725 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-09-17T05:50:44.772 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.2v2r5l6XE6 2024-09-17T05:50:44.772 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub/grub.cfg /tmp/tmp.2v2r5l6XE6 2024-09-17T05:50:44.828 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.2v2r5l6XE6 2024-09-17T05:50:44.957 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.2v2r5l6XE6 is 10KB 2024-09-17T05:50:44.970 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.2v2r5l6XE6 2024-09-17T05:50:44.976 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T05:50:45.032 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T05:50:45.032 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T05:50:45.032 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T05:50:45.099 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T05:50:45.099 DEBUG:teuthology.orchestra.run.smithi173:> sudo update-grub 2024-09-17T05:50:45.136 DEBUG:teuthology.orchestra.run.smithi122:> dpkg -s linux-image-generic 2024-09-17T05:50:45.162 INFO:teuthology.orchestra.run.smithi122.stdout:Package: linux-image-generic 2024-09-17T05:50:45.162 INFO:teuthology.orchestra.run.smithi122.stdout:Status: install ok installed 2024-09-17T05:50:45.162 INFO:teuthology.orchestra.run.smithi122.stdout:Priority: optional 2024-09-17T05:50:45.162 INFO:teuthology.orchestra.run.smithi122.stdout:Section: kernel 2024-09-17T05:50:45.162 INFO:teuthology.orchestra.run.smithi122.stdout:Installed-Size: 21 2024-09-17T05:50:45.163 INFO:teuthology.orchestra.run.smithi122.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T05:50:45.163 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: amd64 2024-09-17T05:50:45.163 INFO:teuthology.orchestra.run.smithi122.stdout:Source: linux-meta 2024-09-17T05:50:45.163 INFO:teuthology.orchestra.run.smithi122.stdout:Version: 5.15.0.122.122 2024-09-17T05:50:45.163 INFO:teuthology.orchestra.run.smithi122.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T05:50:45.163 INFO:teuthology.orchestra.run.smithi122.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T05:50:45.163 INFO:teuthology.orchestra.run.smithi122.stdout:Recommends: thermald 2024-09-17T05:50:45.163 INFO:teuthology.orchestra.run.smithi122.stdout:Description: Generic Linux kernel image 2024-09-17T05:50:45.163 INFO:teuthology.orchestra.run.smithi122.stdout: This package will always depend on the latest generic kernel image 2024-09-17T05:50:45.164 INFO:teuthology.orchestra.run.smithi122.stdout: available. 2024-09-17T05:50:45.164 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T05:50:45.164 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T05:50:45.164 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T05:50:45.164 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-17T05:50:45.165 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi122.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T05:50:45.165 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get clean 2024-09-17T05:50:45.322 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-09-17T05:50:45.433 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T05:50:45.564 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T05:50:45.638 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T05:50:45.728 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T05:50:46.356 INFO:teuthology.orchestra.run.smithi173.stderr:Sourcing file `/etc/default/grub' 2024-09-17T05:50:46.358 INFO:teuthology.orchestra.run.smithi173.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T05:50:46.360 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2024-09-17T05:50:46.538 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T05:50:46.544 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T05:50:46.783 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:50:46.788 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T05:50:46.827 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-17T05:50:46.829 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T05:50:46.835 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T05:50:46.846 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T05:50:46.909 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-17T05:50:46.953 INFO:teuthology.orchestra.run.smithi173.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T05:50:46.954 INFO:teuthology.orchestra.run.smithi173.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T05:50:46.954 INFO:teuthology.orchestra.run.smithi173.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T05:50:46.976 INFO:teuthology.orchestra.run.smithi173.stderr:done 2024-09-17T05:50:46.986 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2024-09-17T05:50:47.104 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-09-17T05:50:47.105 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-09-17T05:50:47.281 INFO:teuthology.orchestra.run.smithi122.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T05:50:47.281 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T05:50:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T05:50:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T05:50:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T05:50:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T05:50:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T05:50:47.282 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T05:50:47.322 INFO:teuthology.orchestra.run.smithi122.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T05:50:47.324 DEBUG:teuthology.orchestra.run.smithi122:> dpkg -s linux-image-generic 2024-09-17T05:50:47.336 INFO:teuthology.orchestra.run.smithi122.stdout:Package: linux-image-generic 2024-09-17T05:50:47.336 INFO:teuthology.orchestra.run.smithi122.stdout:Status: install ok installed 2024-09-17T05:50:47.336 INFO:teuthology.orchestra.run.smithi122.stdout:Priority: optional 2024-09-17T05:50:47.336 INFO:teuthology.orchestra.run.smithi122.stdout:Section: kernel 2024-09-17T05:50:47.336 INFO:teuthology.orchestra.run.smithi122.stdout:Installed-Size: 21 2024-09-17T05:50:47.336 INFO:teuthology.orchestra.run.smithi122.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T05:50:47.337 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: amd64 2024-09-17T05:50:47.337 INFO:teuthology.orchestra.run.smithi122.stdout:Source: linux-meta 2024-09-17T05:50:47.337 INFO:teuthology.orchestra.run.smithi122.stdout:Version: 5.15.0.122.122 2024-09-17T05:50:47.337 INFO:teuthology.orchestra.run.smithi122.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T05:50:47.337 INFO:teuthology.orchestra.run.smithi122.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T05:50:47.337 INFO:teuthology.orchestra.run.smithi122.stdout:Recommends: thermald 2024-09-17T05:50:47.337 INFO:teuthology.orchestra.run.smithi122.stdout:Description: Generic Linux kernel image 2024-09-17T05:50:47.337 INFO:teuthology.orchestra.run.smithi122.stdout: This package will always depend on the latest generic kernel image 2024-09-17T05:50:47.337 INFO:teuthology.orchestra.run.smithi122.stdout: available. 2024-09-17T05:50:47.337 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-09-17T05:50:47.385 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.F4kCVM0FKz 2024-09-17T05:50:47.385 DEBUG:teuthology.orchestra.run.smithi122:> sudo cp /boot/grub/grub.cfg /tmp/tmp.F4kCVM0FKz 2024-09-17T05:50:47.438 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.F4kCVM0FKz 2024-09-17T05:50:47.553 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.F4kCVM0FKz is 10KB 2024-09-17T05:50:47.566 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.F4kCVM0FKz 2024-09-17T05:50:47.571 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T05:50:47.623 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T05:50:47.623 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T05:50:47.623 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T05:50:47.700 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T05:50:47.701 DEBUG:teuthology.orchestra.run.smithi122:> sudo update-grub 2024-09-17T05:50:49.029 INFO:teuthology.orchestra.run.smithi122.stderr:Sourcing file `/etc/default/grub' 2024-09-17T05:50:49.030 INFO:teuthology.orchestra.run.smithi122.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T05:50:49.031 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-09-17T05:50:49.215 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T05:50:49.221 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T05:50:49.496 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:50:49.501 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T05:50:49.545 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T05:50:49.550 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T05:50:49.672 INFO:teuthology.orchestra.run.smithi122.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T05:50:49.673 INFO:teuthology.orchestra.run.smithi122.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T05:50:49.673 INFO:teuthology.orchestra.run.smithi122.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T05:50:49.687 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-09-17T05:50:49.689 DEBUG:teuthology.orchestra.run.smithi122:> sudo shutdown -r now 2024-09-17T05:51:17.013 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-17T05:51:17.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-17T05:51:17.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:51:19.694 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-17T05:51:19.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-17T05:51:19.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:51:51.613 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-09-17T05:51:54.173 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-09-17T05:52:00.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-17T05:52:00.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:52:03.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-17T05:52:03.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:52:21.565 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-09-17T05:52:32.061 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-09-17T05:52:33.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-17T05:52:33.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:52:34.223 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-17T05:52:34.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-17T05:52:34.955 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-17T05:52:34.955 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-09-17T05:52:34.960 INFO:teuthology.orchestra.run.smithi122.stdout:5.15.0-122-generic 2024-09-17T05:52:34.960 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T05:52:34.960 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T05:52:34.960 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T05:52:35.961 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-17T05:52:35.961 DEBUG:teuthology.orchestra.run.smithi122:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T05:52:36.053 INFO:teuthology.orchestra.run.smithi122.stdout:ttyS1 2024-09-17T05:52:36.098 DEBUG:teuthology.parallel:result is None 2024-09-17T05:52:44.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-17T05:52:44.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:52:44.351 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-09-17T05:52:44.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-17T05:52:44.908 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-122-generic"... 2024-09-17T05:52:44.908 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-09-17T05:52:44.952 INFO:teuthology.orchestra.run.smithi173.stdout:5.15.0-122-generic 2024-09-17T05:52:44.953 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T05:52:44.953 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T05:52:44.953 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T05:52:45.954 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-17T05:52:45.954 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T05:52:46.040 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2024-09-17T05:52:46.070 DEBUG:teuthology.parallel:result is None 2024-09-17T05:52:46.070 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T05:52:46.078 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T05:52:46.078 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T05:52:46.081 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T05:52:46.086 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T05:52:46.093 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T05:52:46.103 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T05:52:46.103 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T05:52:46.129 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T05:52:46.182 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T05:52:46.189 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T05:52:46.189 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T05:52:46.191 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T05:52:46.213 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:52:46.213 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:52:46.217 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:52:46.218 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:52:46.220 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T05:52:46.227 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T05:52:46.227 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T05:52:46.266 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T05:52:46.285 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T05:52:46.295 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T05:52:46.295 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T05:52:46.321 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T05:52:46.333 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:52:46.373 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:52:46.421 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T05:52:46.421 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T05:52:46.487 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:52:46.494 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:52:46.541 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T05:52:46.541 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T05:52:46.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-09-17T05:52:46.606 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-09-17T05:52:46.675 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T05:52:46.682 INFO:teuthology.task.internal:Starting timer... 2024-09-17T05:52:46.682 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T05:52:46.694 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T05:52:46.707 DEBUG:teuthology.task.selinux:Excluding smithi122: OS 'ubuntu' does not support SELinux 2024-09-17T05:52:46.708 DEBUG:teuthology.task.selinux:Excluding smithi173: OS 'ubuntu' does not support SELinux 2024-09-17T05:52:46.708 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T05:52:46.708 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-17T05:52:46.708 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T05:52:46.708 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T05:52:46.717 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T05:52:46.728 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T05:52:46.729 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi122.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T06:00:14.930 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi122.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2024-09-17T06:00:14.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-17T06:00:14.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T06:00:15.015 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-17T06:00:15.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-17T06:00:15.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-17T06:00:15.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T06:00:15.170 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-09-17T06:00:15.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-17T06:00:15.246 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T06:00:15.257 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T06:00:15.258 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T06:00:15.259 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T06:00:15.262 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T06:00:15.262 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T06:00:15.291 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T06:00:15.291 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: Command line: ntpd -gq 2024-09-17T06:00:15.291 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: ---------------------------------------------------- 2024-09-17T06:00:15.291 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T06:00:15.291 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T06:00:15.291 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: corporation. Support and training for ntp-4 are 2024-09-17T06:00:15.291 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: available at https://www.nwtime.org/support 2024-09-17T06:00:15.291 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: ---------------------------------------------------- 2024-09-17T06:00:15.291 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: proto: precision = 0.059 usec (-24) 2024-09-17T06:00:15.291 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: basedate set to 2022-02-04 2024-09-17T06:00:15.291 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: gps base set to 2022-02-06 (week 2196) 2024-09-17T06:00:15.292 INFO:teuthology.orchestra.run.smithi122.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T06:00:15.292 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T06:00:15.292 INFO:teuthology.orchestra.run.smithi122.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T06:00:15.293 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T06:00:15.293 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T06:00:15.293 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T06:00:15.293 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T06:00:15.294 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: Listen normally on 3 enp3s0f1 172.21.15.122:123 2024-09-17T06:00:15.294 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: Listen normally on 4 lo [::1]:123 2024-09-17T06:00:15.294 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d515%5]:123 2024-09-17T06:00:15.294 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:15 ntpd[18487]: Listening on routing socket on fd #22 for interface updates 2024-09-17T06:00:15.315 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T06:00:15.315 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: Command line: ntpd -gq 2024-09-17T06:00:15.315 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: ---------------------------------------------------- 2024-09-17T06:00:15.316 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T06:00:15.316 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T06:00:15.316 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: corporation. Support and training for ntp-4 are 2024-09-17T06:00:15.316 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: available at https://www.nwtime.org/support 2024-09-17T06:00:15.316 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: ---------------------------------------------------- 2024-09-17T06:00:15.317 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: proto: precision = 0.057 usec (-24) 2024-09-17T06:00:15.317 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: basedate set to 2022-02-04 2024-09-17T06:00:15.317 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: gps base set to 2022-02-06 (week 2196) 2024-09-17T06:00:15.317 INFO:teuthology.orchestra.run.smithi173.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T06:00:15.318 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T06:00:15.318 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T06:00:15.318 INFO:teuthology.orchestra.run.smithi173.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T06:00:15.319 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T06:00:15.319 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T06:00:15.319 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T06:00:15.319 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: Listen normally on 3 enp3s0f1 172.21.15.173:123 2024-09-17T06:00:15.319 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: Listen normally on 4 lo [::1]:123 2024-09-17T06:00:15.319 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7259%5]:123 2024-09-17T06:00:15.319 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:15 ntpd[18470]: Listening on routing socket on fd #22 for interface updates 2024-09-17T06:00:16.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:16.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:16.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:16.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:16.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:16.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:16.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:16.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:16.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:16.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:16.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:16.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:16.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:16.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:16.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:16.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:16.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:16.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:16 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:16.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:16 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:16.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:16 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:16.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:16 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:16.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:16 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:16.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:16 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:16.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:16 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:16.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:16 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:16.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:16 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:17.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:17 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:17.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:17 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:17.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:17 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:17.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:17 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:17.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:17 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:17.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:17 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:18.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:18.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:18 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:18 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:18 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:18 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:18 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:18 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:18 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:19.290 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:19 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:19.291 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:19 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:19 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:19 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:19 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:19 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:19 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:19 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:19 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:19 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:19 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:19 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:19.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:19 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:19.318 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:19 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:20.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:20.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:20.293 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:20.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:20.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:20.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:20.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:20.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:20.295 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:20.295 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:20.295 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:20.295 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:20.295 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:20.295 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:20.295 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:20.296 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:20.296 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:20.296 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:20 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:20.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:20 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:20.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:20 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:20.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:20 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:20.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:20 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:20.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:20 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:20.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:20 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:21.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:21 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:21.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:21 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:21.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:21 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:21.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:21 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:21.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:21 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:21.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:21 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:21.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:21 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:21.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:21 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:21.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:21 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:21.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:21 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:21.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:21 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:21.318 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:21 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:22.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:22.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:22 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:22.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:22.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:22 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:22.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:22.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:22 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:22.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:22.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:22 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:22.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:22.292 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:22 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:22.293 INFO:teuthology.orchestra.run.smithi122.stdout:17 Sep 06:00:22 ntpd[18487]: ntpd: time slew -0.001206 s 2024-09-17T06:00:22.293 INFO:teuthology.orchestra.run.smithi122.stdout:ntpd: time slew -0.001206s 2024-09-17T06:00:22.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T06:00:22.294 INFO:teuthology.orchestra.run.smithi122.stderr:17 Sep 06:00:22 ntpd[18487]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T06:00:22.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:22 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:22.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:22 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:22.316 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:22 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T06:00:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:22 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T06:00:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:22 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T06:00:22.317 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:22 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T06:00:22.317 INFO:teuthology.orchestra.run.smithi173.stdout:17 Sep 06:00:22 ntpd[18470]: ntpd: time slew -0.000060 s 2024-09-17T06:00:22.317 INFO:teuthology.orchestra.run.smithi173.stdout:ntpd: time slew -0.000060s 2024-09-17T06:00:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:22 ntpd[18470]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T06:00:22.318 INFO:teuthology.orchestra.run.smithi173.stderr:17 Sep 06:00:22 ntpd[18470]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T06:00:22.346 INFO:teuthology.orchestra.run.smithi122.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T06:00:22.346 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================== 2024-09-17T06:00:22.346 INFO:teuthology.orchestra.run.smithi122.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T06:00:22.346 INFO:teuthology.orchestra.run.smithi122.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T06:00:22.346 INFO:teuthology.orchestra.run.smithi122.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T06:00:22.346 INFO:teuthology.orchestra.run.smithi122.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T06:00:22.373 INFO:teuthology.orchestra.run.smithi173.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T06:00:22.373 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================== 2024-09-17T06:00:22.373 INFO:teuthology.orchestra.run.smithi173.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T06:00:22.373 INFO:teuthology.orchestra.run.smithi173.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T06:00:22.373 INFO:teuthology.orchestra.run.smithi173.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T06:00:22.373 INFO:teuthology.orchestra.run.smithi173.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T06:00:22.374 INFO:teuthology.run_tasks:Running task install... 2024-09-17T06:00:22.387 DEBUG:teuthology.task.install:project ceph 2024-09-17T06:00:22.387 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T06:00:22.387 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T06:00:22.387 INFO:teuthology.task.install:Using flavor: default 2024-09-17T06:00:22.396 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T06:00:22.396 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T06:00:22.397 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-key list | grep Ceph 2024-09-17T06:00:22.397 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-key list | grep Ceph 2024-09-17T06:00:22.451 INFO:teuthology.orchestra.run.smithi122.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T06:00:22.474 INFO:teuthology.orchestra.run.smithi173.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T06:00:22.477 INFO:teuthology.orchestra.run.smithi122.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T06:00:22.477 INFO:teuthology.orchestra.run.smithi122.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T06:00:22.478 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-17T06:00:22.478 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-17T06:00:22.479 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T06:00:22.505 INFO:teuthology.orchestra.run.smithi173.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T06:00:22.505 INFO:teuthology.orchestra.run.smithi173.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T06:00:22.505 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-17T06:00:22.505 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-17T06:00:22.506 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T06:00:22.636 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default/ 2024-09-17T06:00:22.636 INFO:teuthology.task.install.deb:Package version is 19.3.0-4989-gce1b342b-1jammy 2024-09-17T06:00:22.655 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default/ 2024-09-17T06:00:22.655 INFO:teuthology.task.install.deb:Package version is 19.3.0-4989-gce1b342b-1jammy 2024-09-17T06:00:22.761 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:00:22.761 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T06:00:22.770 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:00:22.770 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T06:00:22.776 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-09-17T06:00:22.784 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2024-09-17T06:00:22.944 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T06:00:22.951 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T06:00:22.998 INFO:teuthology.orchestra.run.smithi122.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T06:00:23.005 INFO:teuthology.orchestra.run.smithi173.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T06:00:23.019 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-17T06:00:23.026 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-17T06:00:23.041 INFO:teuthology.orchestra.run.smithi122.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T06:00:23.048 INFO:teuthology.orchestra.run.smithi173.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T06:00:23.062 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-17T06:00:23.065 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T06:00:23.069 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-09-17T06:00:23.074 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T06:00:23.095 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-09-17T06:00:23.096 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-17T06:00:23.146 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T06:00:23.154 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T06:00:23.228 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T06:00:23.235 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T06:00:23.374 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 29.2 kB in 0s (70.2 kB/s) 2024-09-17T06:00:23.377 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 29.2 kB in 0s (71.2 kB/s) 2024-09-17T06:00:24.390 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-17T06:00:24.406 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4989-gce1b342b-1jammy cephadm=19.3.0-4989-gce1b342b-1jammy ceph-mds=19.3.0-4989-gce1b342b-1jammy ceph-mgr=19.3.0-4989-gce1b342b-1jammy ceph-common=19.3.0-4989-gce1b342b-1jammy ceph-fuse=19.3.0-4989-gce1b342b-1jammy ceph-test=19.3.0-4989-gce1b342b-1jammy ceph-volume=19.3.0-4989-gce1b342b-1jammy radosgw=19.3.0-4989-gce1b342b-1jammy python3-rados=19.3.0-4989-gce1b342b-1jammy python3-rgw=19.3.0-4989-gce1b342b-1jammy python3-cephfs=19.3.0-4989-gce1b342b-1jammy python3-rbd=19.3.0-4989-gce1b342b-1jammy libcephfs2=19.3.0-4989-gce1b342b-1jammy libcephfs-dev=19.3.0-4989-gce1b342b-1jammy librados2=19.3.0-4989-gce1b342b-1jammy librbd1=19.3.0-4989-gce1b342b-1jammy rbd-fuse=19.3.0-4989-gce1b342b-1jammy python3-cephfs=19.3.0-4989-gce1b342b-1jammy cephfs-shell=19.3.0-4989-gce1b342b-1jammy cephfs-top=19.3.0-4989-gce1b342b-1jammy cephfs-mirror=19.3.0-4989-gce1b342b-1jammy 2024-09-17T06:00:24.433 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-17T06:00:24.451 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4989-gce1b342b-1jammy cephadm=19.3.0-4989-gce1b342b-1jammy ceph-mds=19.3.0-4989-gce1b342b-1jammy ceph-mgr=19.3.0-4989-gce1b342b-1jammy ceph-common=19.3.0-4989-gce1b342b-1jammy ceph-fuse=19.3.0-4989-gce1b342b-1jammy ceph-test=19.3.0-4989-gce1b342b-1jammy ceph-volume=19.3.0-4989-gce1b342b-1jammy radosgw=19.3.0-4989-gce1b342b-1jammy python3-rados=19.3.0-4989-gce1b342b-1jammy python3-rgw=19.3.0-4989-gce1b342b-1jammy python3-cephfs=19.3.0-4989-gce1b342b-1jammy python3-rbd=19.3.0-4989-gce1b342b-1jammy libcephfs2=19.3.0-4989-gce1b342b-1jammy libcephfs-dev=19.3.0-4989-gce1b342b-1jammy librados2=19.3.0-4989-gce1b342b-1jammy librbd1=19.3.0-4989-gce1b342b-1jammy rbd-fuse=19.3.0-4989-gce1b342b-1jammy python3-cephfs=19.3.0-4989-gce1b342b-1jammy cephfs-shell=19.3.0-4989-gce1b342b-1jammy cephfs-top=19.3.0-4989-gce1b342b-1jammy cephfs-mirror=19.3.0-4989-gce1b342b-1jammy 2024-09-17T06:00:24.473 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-17T06:00:24.513 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-17T06:00:24.694 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-09-17T06:00:24.694 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-09-17T06:00:24.724 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-09-17T06:00:24.725 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-09-17T06:00:24.911 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T06:00:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T06:00:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T06:00:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T06:00:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T06:00:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T06:00:24.912 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T06:00:24.913 INFO:teuthology.orchestra.run.smithi122.stdout:The following additional packages will be installed: 2024-09-17T06:00:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T06:00:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T06:00:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T06:00:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-17T06:00:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-17T06:00:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-17T06:00:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-17T06:00:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-17T06:00:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-17T06:00:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-17T06:00:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-17T06:00:24.916 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-09-17T06:00:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T06:00:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T06:00:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T06:00:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T06:00:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T06:00:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T06:00:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T06:00:24.917 INFO:teuthology.orchestra.run.smithi122.stdout:Recommended packages: 2024-09-17T06:00:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: btrfs-tools 2024-09-17T06:00:24.920 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T06:00:24.920 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T06:00:24.921 INFO:teuthology.orchestra.run.smithi173.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T06:00:24.921 INFO:teuthology.orchestra.run.smithi173.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T06:00:24.921 INFO:teuthology.orchestra.run.smithi173.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T06:00:24.921 INFO:teuthology.orchestra.run.smithi173.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T06:00:24.921 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T06:00:24.922 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2024-09-17T06:00:24.922 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T06:00:24.922 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T06:00:24.922 INFO:teuthology.orchestra.run.smithi173.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T06:00:24.922 INFO:teuthology.orchestra.run.smithi173.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-17T06:00:24.923 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-17T06:00:24.923 INFO:teuthology.orchestra.run.smithi173.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-17T06:00:24.923 INFO:teuthology.orchestra.run.smithi173.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-17T06:00:24.924 INFO:teuthology.orchestra.run.smithi173.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-17T06:00:24.925 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-17T06:00:24.925 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-17T06:00:24.925 INFO:teuthology.orchestra.run.smithi173.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-17T06:00:24.925 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2024-09-17T06:00:24.925 INFO:teuthology.orchestra.run.smithi173.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T06:00:24.925 INFO:teuthology.orchestra.run.smithi173.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T06:00:24.925 INFO:teuthology.orchestra.run.smithi173.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T06:00:24.925 INFO:teuthology.orchestra.run.smithi173.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T06:00:24.925 INFO:teuthology.orchestra.run.smithi173.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T06:00:24.925 INFO:teuthology.orchestra.run.smithi173.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T06:00:24.925 INFO:teuthology.orchestra.run.smithi173.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T06:00:24.926 INFO:teuthology.orchestra.run.smithi173.stdout:Recommended packages: 2024-09-17T06:00:24.926 INFO:teuthology.orchestra.run.smithi173.stdout: btrfs-tools 2024-09-17T06:00:25.027 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-09-17T06:00:25.027 INFO:teuthology.orchestra.run.smithi122.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T06:00:25.027 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T06:00:25.027 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-17T06:00:25.027 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-17T06:00:25.027 INFO:teuthology.orchestra.run.smithi122.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T06:00:25.027 INFO:teuthology.orchestra.run.smithi122.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T06:00:25.028 INFO:teuthology.orchestra.run.smithi122.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T06:00:25.029 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-17T06:00:25.029 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-17T06:00:25.029 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-17T06:00:25.029 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T06:00:25.029 INFO:teuthology.orchestra.run.smithi122.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T06:00:25.029 INFO:teuthology.orchestra.run.smithi122.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T06:00:25.029 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T06:00:25.029 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-17T06:00:25.029 INFO:teuthology.orchestra.run.smithi122.stdout: socat unzip xmlstarlet zip 2024-09-17T06:00:25.033 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2024-09-17T06:00:25.033 INFO:teuthology.orchestra.run.smithi173.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T06:00:25.033 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T06:00:25.033 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-17T06:00:25.033 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-17T06:00:25.035 INFO:teuthology.orchestra.run.smithi173.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T06:00:25.035 INFO:teuthology.orchestra.run.smithi173.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-17T06:00:25.035 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-17T06:00:25.035 INFO:teuthology.orchestra.run.smithi173.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-17T06:00:25.035 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T06:00:25.035 INFO:teuthology.orchestra.run.smithi173.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T06:00:25.035 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-17T06:00:25.035 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-17T06:00:25.035 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-17T06:00:25.035 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T06:00:25.035 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-17T06:00:25.036 INFO:teuthology.orchestra.run.smithi173.stdout: socat unzip xmlstarlet zip 2024-09-17T06:00:25.086 INFO:teuthology.orchestra.run.smithi122.stdout:0 upgraded, 125 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T06:00:25.086 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 239 MB of archives. 2024-09-17T06:00:25.086 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 986 MB of additional disk space will be used. 2024-09-17T06:00:25.086 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-17T06:00:25.104 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T06:00:25.113 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-17T06:00:25.154 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T06:00:25.169 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4989-gce1b342b-1jammy [3,591 kB] 2024-09-17T06:00:25.175 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T06:00:25.178 INFO:teuthology.orchestra.run.smithi173.stdout:0 upgraded, 125 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T06:00:25.178 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 239 MB of archives. 2024-09-17T06:00:25.178 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 986 MB of additional disk space will be used. 2024-09-17T06:00:25.178 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4989-gce1b342b-1jammy [3,591 kB] 2024-09-17T06:00:25.178 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T06:00:25.189 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T06:00:25.224 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-17T06:00:25.237 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T06:00:25.242 INFO:teuthology.orchestra.run.smithi122.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T06:00:25.253 INFO:teuthology.orchestra.run.smithi122.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T06:00:25.257 INFO:teuthology.orchestra.run.smithi122.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-17T06:00:25.258 INFO:teuthology.orchestra.run.smithi122.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T06:00:25.259 INFO:teuthology.orchestra.run.smithi122.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T06:00:25.266 INFO:teuthology.orchestra.run.smithi122.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T06:00:25.269 INFO:teuthology.orchestra.run.smithi122.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T06:00:25.270 INFO:teuthology.orchestra.run.smithi122.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T06:00:25.272 INFO:teuthology.orchestra.run.smithi122.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T06:00:25.275 INFO:teuthology.orchestra.run.smithi122.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T06:00:25.278 INFO:teuthology.orchestra.run.smithi122.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T06:00:25.280 INFO:teuthology.orchestra.run.smithi122.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T06:00:25.292 INFO:teuthology.orchestra.run.smithi122.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T06:00:25.293 INFO:teuthology.orchestra.run.smithi122.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T06:00:25.294 INFO:teuthology.orchestra.run.smithi122.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T06:00:25.295 INFO:teuthology.orchestra.run.smithi122.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T06:00:25.295 INFO:teuthology.orchestra.run.smithi122.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T06:00:25.295 INFO:teuthology.orchestra.run.smithi122.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T06:00:25.296 INFO:teuthology.orchestra.run.smithi122.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T06:00:25.306 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T06:00:25.309 INFO:teuthology.orchestra.run.smithi122.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T06:00:25.310 INFO:teuthology.orchestra.run.smithi122.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T06:00:25.310 INFO:teuthology.orchestra.run.smithi122.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T06:00:25.326 INFO:teuthology.orchestra.run.smithi122.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T06:00:25.327 INFO:teuthology.orchestra.run.smithi122.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T06:00:25.327 INFO:teuthology.orchestra.run.smithi122.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T06:00:25.328 INFO:teuthology.orchestra.run.smithi122.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T06:00:25.329 INFO:teuthology.orchestra.run.smithi122.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T06:00:25.329 INFO:teuthology.orchestra.run.smithi122.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T06:00:25.329 INFO:teuthology.orchestra.run.smithi122.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T06:00:25.343 INFO:teuthology.orchestra.run.smithi122.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T06:00:25.344 INFO:teuthology.orchestra.run.smithi122.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T06:00:25.344 INFO:teuthology.orchestra.run.smithi122.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T06:00:25.352 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-17T06:00:25.361 INFO:teuthology.orchestra.run.smithi122.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T06:00:25.361 INFO:teuthology.orchestra.run.smithi122.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T06:00:25.364 INFO:teuthology.orchestra.run.smithi122.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T06:00:25.364 INFO:teuthology.orchestra.run.smithi122.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T06:00:25.365 INFO:teuthology.orchestra.run.smithi122.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T06:00:25.367 INFO:teuthology.orchestra.run.smithi122.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T06:00:25.367 INFO:teuthology.orchestra.run.smithi122.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T06:00:25.369 INFO:teuthology.orchestra.run.smithi122.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4989-gce1b342b-1jammy [3,368 kB] 2024-09-17T06:00:25.379 INFO:teuthology.orchestra.run.smithi122.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T06:00:25.380 INFO:teuthology.orchestra.run.smithi122.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T06:00:25.381 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4989-gce1b342b-1jammy [3,368 kB] 2024-09-17T06:00:25.384 INFO:teuthology.orchestra.run.smithi122.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T06:00:25.395 INFO:teuthology.orchestra.run.smithi122.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T06:00:25.396 INFO:teuthology.orchestra.run.smithi122.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T06:00:25.399 INFO:teuthology.orchestra.run.smithi122.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T06:00:25.449 INFO:teuthology.orchestra.run.smithi122.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T06:00:25.450 INFO:teuthology.orchestra.run.smithi122.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T06:00:25.451 INFO:teuthology.orchestra.run.smithi122.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T06:00:25.451 INFO:teuthology.orchestra.run.smithi122.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T06:00:25.452 INFO:teuthology.orchestra.run.smithi122.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T06:00:25.463 INFO:teuthology.orchestra.run.smithi122.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4989-gce1b342b-1jammy [733 kB] 2024-09-17T06:00:25.470 INFO:teuthology.orchestra.run.smithi122.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T06:00:25.472 INFO:teuthology.orchestra.run.smithi122.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T06:00:25.472 INFO:teuthology.orchestra.run.smithi122.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T06:00:25.480 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4989-gce1b342b-1jammy [733 kB] 2024-09-17T06:00:25.486 INFO:teuthology.orchestra.run.smithi122.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T06:00:25.486 INFO:teuthology.orchestra.run.smithi122.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T06:00:25.487 INFO:teuthology.orchestra.run.smithi122.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T06:00:25.507 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4989-gce1b342b-1jammy [356 kB] 2024-09-17T06:00:25.515 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4989-gce1b342b-1jammy [32.8 kB] 2024-09-17T06:00:25.516 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4989-gce1b342b-1jammy [180 kB] 2024-09-17T06:00:25.520 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4989-gce1b342b-1jammy [71.3 kB] 2024-09-17T06:00:25.522 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4989-gce1b342b-1jammy [337 kB] 2024-09-17T06:00:25.530 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4989-gce1b342b-1jammy [8,847 kB] 2024-09-17T06:00:25.549 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T06:00:25.572 INFO:teuthology.orchestra.run.smithi122.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T06:00:25.572 INFO:teuthology.orchestra.run.smithi122.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4989-gce1b342b-1jammy [356 kB] 2024-09-17T06:00:25.572 INFO:teuthology.orchestra.run.smithi122.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T06:00:25.573 INFO:teuthology.orchestra.run.smithi122.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T06:00:25.573 INFO:teuthology.orchestra.run.smithi122.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T06:00:25.573 INFO:teuthology.orchestra.run.smithi122.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T06:00:25.576 INFO:teuthology.orchestra.run.smithi122.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T06:00:25.578 INFO:teuthology.orchestra.run.smithi122.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T06:00:25.580 INFO:teuthology.orchestra.run.smithi122.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4989-gce1b342b-1jammy [32.8 kB] 2024-09-17T06:00:25.580 INFO:teuthology.orchestra.run.smithi122.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T06:00:25.580 INFO:teuthology.orchestra.run.smithi122.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4989-gce1b342b-1jammy [180 kB] 2024-09-17T06:00:25.584 INFO:teuthology.orchestra.run.smithi122.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4989-gce1b342b-1jammy [71.3 kB] 2024-09-17T06:00:25.585 INFO:teuthology.orchestra.run.smithi122.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4989-gce1b342b-1jammy [337 kB] 2024-09-17T06:00:25.589 INFO:teuthology.orchestra.run.smithi122.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T06:00:25.592 INFO:teuthology.orchestra.run.smithi122.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4989-gce1b342b-1jammy [8,847 kB] 2024-09-17T06:00:25.597 INFO:teuthology.orchestra.run.smithi122.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T06:00:25.600 INFO:teuthology.orchestra.run.smithi122.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-17T06:00:25.600 INFO:teuthology.orchestra.run.smithi122.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T06:00:25.601 INFO:teuthology.orchestra.run.smithi122.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T06:00:25.601 INFO:teuthology.orchestra.run.smithi122.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T06:00:25.605 INFO:teuthology.orchestra.run.smithi122.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T06:00:25.605 INFO:teuthology.orchestra.run.smithi122.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T06:00:25.609 INFO:teuthology.orchestra.run.smithi122.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T06:00:25.609 INFO:teuthology.orchestra.run.smithi122.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T06:00:25.623 INFO:teuthology.orchestra.run.smithi122.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T06:00:25.623 INFO:teuthology.orchestra.run.smithi122.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T06:00:25.625 INFO:teuthology.orchestra.run.smithi122.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T06:00:25.625 INFO:teuthology.orchestra.run.smithi122.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T06:00:25.631 INFO:teuthology.orchestra.run.smithi122.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T06:00:25.640 INFO:teuthology.orchestra.run.smithi122.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T06:00:25.640 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T06:00:25.640 INFO:teuthology.orchestra.run.smithi122.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T06:00:25.642 INFO:teuthology.orchestra.run.smithi122.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T06:00:25.643 INFO:teuthology.orchestra.run.smithi122.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T06:00:25.653 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T06:00:25.703 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T06:00:25.816 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4989-gce1b342b-1jammy [112 kB] 2024-09-17T06:00:25.819 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4989-gce1b342b-1jammy [478 kB] 2024-09-17T06:00:25.828 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4989-gce1b342b-1jammy [29.1 MB] 2024-09-17T06:00:25.838 INFO:teuthology.orchestra.run.smithi122.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4989-gce1b342b-1jammy [112 kB] 2024-09-17T06:00:25.841 INFO:teuthology.orchestra.run.smithi122.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4989-gce1b342b-1jammy [478 kB] 2024-09-17T06:00:25.851 INFO:teuthology.orchestra.run.smithi122.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4989-gce1b342b-1jammy [29.1 MB] 2024-09-17T06:00:25.881 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T06:00:25.890 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T06:00:25.917 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T06:00:25.925 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-17T06:00:25.927 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T06:00:25.928 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T06:00:25.945 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T06:00:25.949 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T06:00:25.953 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T06:00:25.964 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T06:00:26.038 INFO:teuthology.orchestra.run.smithi173.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T06:00:26.042 INFO:teuthology.orchestra.run.smithi173.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T06:00:26.047 INFO:teuthology.orchestra.run.smithi173.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T06:00:26.051 INFO:teuthology.orchestra.run.smithi173.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T06:00:26.053 INFO:teuthology.orchestra.run.smithi173.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T06:00:26.054 INFO:teuthology.orchestra.run.smithi173.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T06:00:26.056 INFO:teuthology.orchestra.run.smithi173.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T06:00:26.056 INFO:teuthology.orchestra.run.smithi173.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T06:00:26.057 INFO:teuthology.orchestra.run.smithi173.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T06:00:26.127 INFO:teuthology.orchestra.run.smithi173.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T06:00:26.140 INFO:teuthology.orchestra.run.smithi173.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T06:00:26.140 INFO:teuthology.orchestra.run.smithi173.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T06:00:26.141 INFO:teuthology.orchestra.run.smithi173.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T06:00:26.146 INFO:teuthology.orchestra.run.smithi173.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T06:00:26.147 INFO:teuthology.orchestra.run.smithi173.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T06:00:26.209 INFO:teuthology.orchestra.run.smithi173.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T06:00:26.210 INFO:teuthology.orchestra.run.smithi173.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T06:00:26.212 INFO:teuthology.orchestra.run.smithi173.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T06:00:26.212 INFO:teuthology.orchestra.run.smithi173.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T06:00:26.290 INFO:teuthology.orchestra.run.smithi173.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T06:00:26.293 INFO:teuthology.orchestra.run.smithi173.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T06:00:26.294 INFO:teuthology.orchestra.run.smithi173.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T06:00:26.295 INFO:teuthology.orchestra.run.smithi173.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T06:00:26.306 INFO:teuthology.orchestra.run.smithi173.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T06:00:26.372 INFO:teuthology.orchestra.run.smithi173.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T06:00:26.373 INFO:teuthology.orchestra.run.smithi173.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T06:00:26.374 INFO:teuthology.orchestra.run.smithi173.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T06:00:26.376 INFO:teuthology.orchestra.run.smithi173.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T06:00:26.381 INFO:teuthology.orchestra.run.smithi173.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T06:00:26.453 INFO:teuthology.orchestra.run.smithi173.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T06:00:26.456 INFO:teuthology.orchestra.run.smithi173.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T06:00:26.457 INFO:teuthology.orchestra.run.smithi173.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T06:00:26.462 INFO:teuthology.orchestra.run.smithi173.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T06:00:26.463 INFO:teuthology.orchestra.run.smithi173.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T06:00:26.535 INFO:teuthology.orchestra.run.smithi173.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T06:00:26.540 INFO:teuthology.orchestra.run.smithi173.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T06:00:26.705 INFO:teuthology.orchestra.run.smithi173.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T06:00:26.706 INFO:teuthology.orchestra.run.smithi173.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T06:00:26.709 INFO:teuthology.orchestra.run.smithi173.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T06:00:26.709 INFO:teuthology.orchestra.run.smithi173.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T06:00:26.712 INFO:teuthology.orchestra.run.smithi173.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T06:00:26.748 INFO:teuthology.orchestra.run.smithi173.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T06:00:26.861 INFO:teuthology.orchestra.run.smithi173.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T06:00:26.861 INFO:teuthology.orchestra.run.smithi173.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T06:00:26.864 INFO:teuthology.orchestra.run.smithi173.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4989-gce1b342b-1jammy [5,020 kB] 2024-09-17T06:00:26.889 INFO:teuthology.orchestra.run.smithi173.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T06:00:26.921 INFO:teuthology.orchestra.run.smithi122.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4989-gce1b342b-1jammy [5,020 kB] 2024-09-17T06:00:26.983 INFO:teuthology.orchestra.run.smithi173.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T06:00:26.984 INFO:teuthology.orchestra.run.smithi173.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4989-gce1b342b-1jammy [251 kB] 2024-09-17T06:00:26.984 INFO:teuthology.orchestra.run.smithi173.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T06:00:26.985 INFO:teuthology.orchestra.run.smithi173.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T06:00:26.986 INFO:teuthology.orchestra.run.smithi173.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T06:00:26.986 INFO:teuthology.orchestra.run.smithi173.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4989-gce1b342b-1jammy [126 kB] 2024-09-17T06:00:26.987 INFO:teuthology.orchestra.run.smithi173.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T06:00:26.988 INFO:teuthology.orchestra.run.smithi173.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T06:00:26.988 INFO:teuthology.orchestra.run.smithi173.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4989-gce1b342b-1jammy [1,551 kB] 2024-09-17T06:00:26.989 INFO:teuthology.orchestra.run.smithi173.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T06:00:26.995 INFO:teuthology.orchestra.run.smithi173.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T06:00:26.998 INFO:teuthology.orchestra.run.smithi122.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4989-gce1b342b-1jammy [251 kB] 2024-09-17T06:00:27.001 INFO:teuthology.orchestra.run.smithi122.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4989-gce1b342b-1jammy [126 kB] 2024-09-17T06:00:27.004 INFO:teuthology.orchestra.run.smithi173.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4989-gce1b342b-1jammy [6,200 kB] 2024-09-17T06:00:27.004 INFO:teuthology.orchestra.run.smithi122.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4989-gce1b342b-1jammy [1,551 kB] 2024-09-17T06:00:27.039 INFO:teuthology.orchestra.run.smithi122.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4989-gce1b342b-1jammy [6,200 kB] 2024-09-17T06:00:27.066 INFO:teuthology.orchestra.run.smithi173.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T06:00:27.080 INFO:teuthology.orchestra.run.smithi173.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T06:00:27.082 INFO:teuthology.orchestra.run.smithi173.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T06:00:27.090 INFO:teuthology.orchestra.run.smithi173.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T06:00:27.096 INFO:teuthology.orchestra.run.smithi173.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-17T06:00:27.097 INFO:teuthology.orchestra.run.smithi173.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T06:00:27.148 INFO:teuthology.orchestra.run.smithi173.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T06:00:27.149 INFO:teuthology.orchestra.run.smithi173.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T06:00:27.160 INFO:teuthology.orchestra.run.smithi173.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T06:00:27.162 INFO:teuthology.orchestra.run.smithi173.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T06:00:27.188 INFO:teuthology.orchestra.run.smithi173.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4989-gce1b342b-1jammy [22.9 MB] 2024-09-17T06:00:27.229 INFO:teuthology.orchestra.run.smithi173.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T06:00:27.229 INFO:teuthology.orchestra.run.smithi173.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T06:00:27.231 INFO:teuthology.orchestra.run.smithi173.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T06:00:27.231 INFO:teuthology.orchestra.run.smithi173.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T06:00:27.236 INFO:teuthology.orchestra.run.smithi173.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T06:00:27.255 INFO:teuthology.orchestra.run.smithi122.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4989-gce1b342b-1jammy [22.9 MB] 2024-09-17T06:00:27.310 INFO:teuthology.orchestra.run.smithi173.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T06:00:27.327 INFO:teuthology.orchestra.run.smithi173.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T06:00:27.328 INFO:teuthology.orchestra.run.smithi173.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T06:00:27.329 INFO:teuthology.orchestra.run.smithi173.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T06:00:27.334 INFO:teuthology.orchestra.run.smithi173.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T06:00:27.391 INFO:teuthology.orchestra.run.smithi173.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T06:00:27.993 INFO:teuthology.orchestra.run.smithi173.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4989-gce1b342b-1jammy [14.0 kB] 2024-09-17T06:00:28.050 INFO:teuthology.orchestra.run.smithi173.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4989-gce1b342b-1jammy [865 kB] 2024-09-17T06:00:28.066 INFO:teuthology.orchestra.run.smithi173.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4989-gce1b342b-1jammy [2,386 kB] 2024-09-17T06:00:28.107 INFO:teuthology.orchestra.run.smithi173.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4989-gce1b342b-1jammy [814 kB] 2024-09-17T06:00:28.116 INFO:teuthology.orchestra.run.smithi122.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4989-gce1b342b-1jammy [14.0 kB] 2024-09-17T06:00:28.117 INFO:teuthology.orchestra.run.smithi122.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4989-gce1b342b-1jammy [865 kB] 2024-09-17T06:00:28.118 INFO:teuthology.orchestra.run.smithi173.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4989-gce1b342b-1jammy [160 kB] 2024-09-17T06:00:28.120 INFO:teuthology.orchestra.run.smithi173.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4989-gce1b342b-1jammy [61.5 MB] 2024-09-17T06:00:28.134 INFO:teuthology.orchestra.run.smithi122.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4989-gce1b342b-1jammy [2,386 kB] 2024-09-17T06:00:28.175 INFO:teuthology.orchestra.run.smithi122.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4989-gce1b342b-1jammy [814 kB] 2024-09-17T06:00:28.185 INFO:teuthology.orchestra.run.smithi122.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4989-gce1b342b-1jammy [160 kB] 2024-09-17T06:00:28.187 INFO:teuthology.orchestra.run.smithi122.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4989-gce1b342b-1jammy [61.5 MB] 2024-09-17T06:00:30.285 INFO:teuthology.orchestra.run.smithi173.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4989-gce1b342b-1jammy [8,625 kB] 2024-09-17T06:00:30.393 INFO:teuthology.orchestra.run.smithi173.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4989-gce1b342b-1jammy [14.2 kB] 2024-09-17T06:00:30.394 INFO:teuthology.orchestra.run.smithi173.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4989-gce1b342b-1jammy [40.9 MB] 2024-09-17T06:00:30.459 INFO:teuthology.orchestra.run.smithi122.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4989-gce1b342b-1jammy [8,625 kB] 2024-09-17T06:00:30.667 INFO:teuthology.orchestra.run.smithi122.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4989-gce1b342b-1jammy [14.2 kB] 2024-09-17T06:00:30.668 INFO:teuthology.orchestra.run.smithi122.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4989-gce1b342b-1jammy [40.9 MB] 2024-09-17T06:00:31.788 INFO:teuthology.orchestra.run.smithi173.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4989-gce1b342b-1jammy [130 kB] 2024-09-17T06:00:31.791 INFO:teuthology.orchestra.run.smithi173.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4989-gce1b342b-1jammy [237 kB] 2024-09-17T06:00:31.796 INFO:teuthology.orchestra.run.smithi173.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4989-gce1b342b-1jammy [33.9 kB] 2024-09-17T06:00:31.797 INFO:teuthology.orchestra.run.smithi173.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4989-gce1b342b-1jammy [23.4 kB] 2024-09-17T06:00:31.798 INFO:teuthology.orchestra.run.smithi173.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4989-gce1b342b-1jammy [39.0 kB] 2024-09-17T06:00:31.799 INFO:teuthology.orchestra.run.smithi173.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4989-gce1b342b-1jammy [17.6 MB] 2024-09-17T06:00:32.091 INFO:teuthology.orchestra.run.smithi122.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4989-gce1b342b-1jammy [130 kB] 2024-09-17T06:00:32.094 INFO:teuthology.orchestra.run.smithi122.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4989-gce1b342b-1jammy [237 kB] 2024-09-17T06:00:32.099 INFO:teuthology.orchestra.run.smithi122.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4989-gce1b342b-1jammy [33.9 kB] 2024-09-17T06:00:32.100 INFO:teuthology.orchestra.run.smithi122.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4989-gce1b342b-1jammy [23.4 kB] 2024-09-17T06:00:32.100 INFO:teuthology.orchestra.run.smithi122.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4989-gce1b342b-1jammy [39.0 kB] 2024-09-17T06:00:32.101 INFO:teuthology.orchestra.run.smithi122.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4989-gce1b342b-1jammy [17.6 MB] 2024-09-17T06:00:32.266 INFO:teuthology.orchestra.run.smithi173.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4989-gce1b342b-1jammy [93.1 kB] 2024-09-17T06:00:32.488 INFO:teuthology.orchestra.run.smithi122.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4989-gce1b342b-1jammy [93.1 kB] 2024-09-17T06:00:32.899 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 239 MB in 7s (33.1 MB/s) 2024-09-17T06:00:33.011 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-17T06:00:33.100 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T06:00:33.106 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-17T06:00:33.118 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 239 MB in 7s (32.1 MB/s) 2024-09-17T06:00:33.144 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-17T06:00:33.232 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-17T06:00:33.321 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T06:00:33.327 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-17T06:00:33.364 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-17T06:00:33.430 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T06:00:33.456 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T06:00:33.496 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T06:00:33.651 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T06:00:33.677 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T06:00:33.717 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T06:00:33.916 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cmd2. 2024-09-17T06:00:33.942 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-17T06:00:33.983 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-17T06:00:34.046 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cmd2. 2024-09-17T06:00:34.072 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-17T06:00:34.112 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-17T06:00:34.336 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T06:00:34.362 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T06:00:34.444 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T06:00:34.457 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T06:00:34.483 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T06:00:34.566 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T06:00:34.781 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T06:00:34.807 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T06:00:34.847 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T06:00:34.861 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T06:00:34.887 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T06:00:34.928 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T06:00:35.176 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T06:00:35.202 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T06:00:35.233 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T06:00:35.265 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T06:00:35.291 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T06:00:35.332 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T06:00:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T06:00:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T06:00:35.754 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T06:00:35.785 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T06:00:35.811 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T06:00:35.860 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T06:00:36.148 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T06:00:36.175 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T06:00:36.215 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T06:00:36.247 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T06:00:36.274 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T06:00:36.314 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T06:00:36.560 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T06:00:36.586 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T06:00:36.626 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T06:00:36.659 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T06:00:36.685 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T06:00:36.726 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T06:00:36.963 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T06:00:36.989 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T06:00:37.029 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T06:00:37.080 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T06:00:37.094 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T06:00:37.129 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T06:00:37.357 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librados2. 2024-09-17T06:00:37.384 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../010-librados2_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:37.423 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librados2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:37.441 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librados2. 2024-09-17T06:00:37.467 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../010-librados2_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:37.508 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librados2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:37.943 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libnbd0. 2024-09-17T06:00:37.969 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-17T06:00:38.010 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-17T06:00:38.094 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libnbd0. 2024-09-17T06:00:38.121 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-17T06:00:38.294 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-17T06:00:38.312 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librbd1. 2024-09-17T06:00:38.339 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../012-librbd1_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:38.379 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librbd1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:38.739 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librbd1. 2024-09-17T06:00:38.765 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../012-librbd1_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:38.806 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librbd1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:39.140 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T06:00:39.166 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:39.198 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libcephfs2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:39.284 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T06:00:39.310 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:39.351 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libcephfs2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:39.493 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rados. 2024-09-17T06:00:39.519 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../014-python3-rados_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:39.559 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rados (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:39.679 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rados. 2024-09-17T06:00:39.705 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../014-python3-rados_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:39.762 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rados (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:39.887 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T06:00:39.913 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:00:39.953 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-ceph-argparse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:40.082 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T06:00:40.108 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:00:40.148 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-ceph-argparse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:40.206 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T06:00:40.232 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:40.273 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cephfs (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:40.401 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T06:00:40.427 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:40.468 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cephfs (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:40.567 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T06:00:40.594 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:00:40.625 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:40.838 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T06:00:40.864 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:00:40.912 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T06:00:40.912 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:40.927 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T06:00:40.961 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T06:00:41.214 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T06:00:41.229 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:41.272 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rbd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:41.291 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T06:00:41.317 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T06:00:41.358 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T06:00:41.617 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T06:00:41.618 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T06:00:41.634 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:41.643 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T06:00:41.677 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rbd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:41.683 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T06:00:41.970 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T06:00:41.985 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T06:00:42.028 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T06:00:42.031 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T06:00:42.057 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T06:00:42.106 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T06:00:42.339 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T06:00:42.354 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T06:00:42.397 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T06:00:42.433 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T06:00:42.449 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T06:00:42.500 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T06:00:42.751 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package lua5.1. 2024-09-17T06:00:42.777 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T06:00:42.803 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T06:00:42.808 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T06:00:42.830 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T06:00:42.870 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T06:00:43.137 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package lua-any. 2024-09-17T06:00:43.163 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-17T06:00:43.203 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T06:00:43.216 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua5.1. 2024-09-17T06:00:43.242 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T06:00:43.282 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T06:00:43.447 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package zip. 2024-09-17T06:00:43.474 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-17T06:00:43.514 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T06:00:43.678 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua-any. 2024-09-17T06:00:43.704 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-17T06:00:43.744 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T06:00:43.868 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package unzip. 2024-09-17T06:00:43.894 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T06:00:43.934 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T06:00:43.999 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package zip. 2024-09-17T06:00:44.014 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-17T06:00:44.057 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T06:00:44.313 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package luarocks. 2024-09-17T06:00:44.339 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T06:00:44.396 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T06:00:44.419 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package unzip. 2024-09-17T06:00:44.445 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T06:00:44.494 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T06:00:44.737 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librgw2. 2024-09-17T06:00:44.764 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../028-librgw2_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:44.795 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librgw2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:44.907 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package luarocks. 2024-09-17T06:00:44.933 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T06:00:44.973 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T06:00:45.349 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librgw2. 2024-09-17T06:00:45.364 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../028-librgw2_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:45.399 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librgw2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:45.548 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T06:00:45.574 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:45.614 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:45.959 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T06:00:45.985 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T06:00:46.025 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T06:00:46.107 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T06:00:46.133 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:46.177 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:46.320 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T06:00:46.346 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:46.386 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libradosstriper1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:46.521 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T06:00:46.548 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T06:00:46.588 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T06:00:46.832 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-common. 2024-09-17T06:00:46.858 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../032-ceph-common_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:46.891 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T06:00:46.897 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:46.918 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:46.950 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libradosstriper1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:47.345 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-common. 2024-09-17T06:00:47.371 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../032-ceph-common_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:47.411 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:48.628 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-base. 2024-09-17T06:00:48.655 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../033-ceph-base_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:48.705 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-base (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:49.251 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-base. 2024-09-17T06:00:49.277 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../033-ceph-base_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:00:49.327 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-base (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:00:49.499 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T06:00:49.525 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T06:00:49.565 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T06:00:49.862 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T06:00:49.888 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T06:00:49.928 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T06:00:49.948 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T06:00:49.974 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T06:00:50.022 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T06:00:50.279 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T06:00:50.306 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T06:00:50.334 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T06:00:50.348 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T06:00:50.349 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T06:00:50.392 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T06:00:50.651 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T06:00:50.677 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T06:00:50.704 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T06:00:50.717 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T06:00:50.730 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T06:00:50.771 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T06:00:50.970 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T06:00:50.997 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T06:00:51.028 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T06:00:51.099 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T06:00:51.125 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T06:00:51.174 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T06:00:51.339 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T06:00:51.366 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T06:00:51.406 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T06:00:51.519 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T06:00:51.545 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T06:00:51.585 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T06:00:51.709 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-portend. 2024-09-17T06:00:51.735 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-17T06:00:51.775 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T06:00:51.897 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T06:00:51.923 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T06:00:51.964 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T06:00:52.053 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T06:00:52.080 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T06:00:52.120 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T06:00:52.293 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-portend. 2024-09-17T06:00:52.318 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-17T06:00:52.367 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T06:00:52.381 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T06:00:52.407 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T06:00:52.447 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T06:00:52.737 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T06:00:52.763 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T06:00:52.793 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T06:00:52.803 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T06:00:52.819 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T06:00:52.859 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T06:00:53.098 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T06:00:53.125 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T06:00:53.165 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T06:00:53.179 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T06:00:53.205 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T06:00:53.245 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T06:00:53.498 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T06:00:53.513 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T06:00:53.519 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T06:00:53.545 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T06:00:53.548 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T06:00:53.586 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T06:00:53.867 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-mako. 2024-09-17T06:00:53.894 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T06:00:53.897 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T06:00:53.924 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T06:00:53.934 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T06:00:53.964 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T06:00:54.254 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T06:00:54.280 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T06:00:54.309 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T06:00:54.312 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T06:00:54.324 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T06:00:54.367 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T06:00:54.615 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T06:00:54.642 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T06:00:54.670 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-mako. 2024-09-17T06:00:54.682 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T06:00:54.697 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T06:00:54.737 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T06:00:54.968 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-webob. 2024-09-17T06:00:54.994 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T06:00:55.035 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T06:00:55.108 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T06:00:55.134 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T06:00:55.174 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T06:00:55.379 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T06:00:55.406 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T06:00:55.444 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T06:00:55.449 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T06:00:55.459 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T06:00:55.494 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T06:00:55.723 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T06:00:55.750 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T06:00:55.772 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-webob. 2024-09-17T06:00:55.790 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T06:00:55.799 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T06:00:55.839 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T06:00:56.034 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-paste. 2024-09-17T06:00:56.061 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T06:00:56.092 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T06:00:56.217 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T06:00:56.244 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T06:00:56.287 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T06:00:56.412 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T06:00:56.428 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T06:00:56.472 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T06:00:56.579 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T06:00:56.606 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T06:00:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T06:00:56.715 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T06:00:56.742 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T06:00:56.773 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T06:00:56.899 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-paste. 2024-09-17T06:00:56.926 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T06:00:56.965 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T06:00:57.059 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T06:00:57.075 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T06:00:57.117 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T06:00:57.288 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T06:00:57.301 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T06:00:57.344 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T06:00:57.437 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T06:00:57.464 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T06:00:57.504 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T06:00:57.630 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T06:00:57.656 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T06:00:57.697 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T06:00:57.875 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T06:00:57.902 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T06:00:57.966 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T06:00:57.967 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T06:00:57.982 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T06:00:58.017 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T06:00:59.208 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-idna. 2024-09-17T06:00:59.235 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T06:00:59.278 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T06:00:59.463 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T06:00:59.490 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T06:00:59.529 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T06:00:59.723 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T06:00:59.750 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T06:00:59.789 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T06:00:59.893 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T06:00:59.920 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T06:00:59.976 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T06:01:00.093 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-requests. 2024-09-17T06:01:00.120 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T06:01:00.159 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T06:01:00.305 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-idna. 2024-09-17T06:01:00.331 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T06:01:00.371 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T06:01:00.479 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T06:01:00.506 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T06:01:00.545 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T06:01:00.641 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T06:01:00.668 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T06:01:00.708 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T06:01:00.832 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T06:01:00.848 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:00.890 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:00.995 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-requests. 2024-09-17T06:01:01.022 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T06:01:01.061 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T06:01:01.245 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T06:01:01.272 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:01.311 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:01.365 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T06:01:01.391 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T06:01:01.431 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T06:01:01.597 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T06:01:01.624 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T06:01:01.664 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T06:01:01.685 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T06:01:01.700 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:01.743 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:02.000 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T06:01:02.027 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T06:01:02.066 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T06:01:02.132 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T06:01:02.158 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:02.198 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:02.420 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T06:01:02.447 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:02.468 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T06:01:02.486 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:02.491 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T06:01:02.526 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T06:01:02.821 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T06:01:02.831 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T06:01:02.847 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T06:01:02.857 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:02.887 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T06:01:02.888 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mon (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:03.224 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T06:01:03.251 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:03.291 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:03.517 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T06:01:03.545 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:03.584 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-osd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:03.670 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T06:01:03.696 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:03.728 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mon (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:04.349 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T06:01:04.375 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:04.415 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-osd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:04.679 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph. 2024-09-17T06:01:04.706 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../069-ceph_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:04.745 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:05.031 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T06:01:05.057 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:05.097 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:05.426 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T06:01:05.452 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:05.469 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph. 2024-09-17T06:01:05.492 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mds (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:05.495 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../069-ceph_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:05.535 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:05.797 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T06:01:05.823 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:05.855 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:05.937 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephadm. 2024-09-17T06:01:05.963 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../072-cephadm_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:06.003 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:06.217 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T06:01:06.243 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:06.292 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mds (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:06.331 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T06:01:06.357 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T06:01:06.397 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T06:01:06.695 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package cephadm. 2024-09-17T06:01:06.722 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../072-cephadm_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:06.725 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T06:01:06.752 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T06:01:06.761 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:06.791 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T06:01:07.040 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T06:01:07.066 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T06:01:07.097 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T06:01:07.426 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T06:01:07.441 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T06:01:07.484 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T06:01:07.838 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-babel. 2024-09-17T06:01:07.853 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T06:01:07.888 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T06:01:08.174 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T06:01:08.201 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T06:01:08.240 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T06:01:08.523 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-babel. 2024-09-17T06:01:08.550 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T06:01:08.560 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T06:01:08.587 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:08.589 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T06:01:08.626 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:08.877 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T06:01:08.892 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T06:01:08.905 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T06:01:08.921 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T06:01:08.926 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T06:01:08.963 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T06:01:09.238 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T06:01:09.249 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-routes. 2024-09-17T06:01:09.265 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:09.276 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T06:01:09.305 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:09.315 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T06:01:09.642 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T06:01:09.669 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T06:01:09.677 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T06:01:09.704 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:09.717 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T06:01:09.902 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:09.978 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-routes. 2024-09-17T06:01:09.994 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T06:01:10.028 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T06:01:10.340 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T06:01:10.368 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:10.398 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:12.574 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T06:01:12.591 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T06:01:12.623 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T06:01:13.060 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T06:01:13.076 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T06:01:13.189 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T06:01:13.206 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T06:01:13.212 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T06:01:13.247 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T06:01:13.558 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T06:01:13.585 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T06:01:13.616 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T06:01:13.734 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T06:01:13.762 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T06:01:13.878 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T06:01:13.902 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T06:01:13.929 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T06:01:13.969 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T06:01:14.216 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T06:01:14.232 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T06:01:14.274 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T06:01:14.561 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T06:01:14.589 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T06:01:14.644 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T06:01:14.661 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T06:01:14.689 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:14.719 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:15.613 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T06:01:15.641 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:15.679 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:15.739 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T06:01:15.766 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T06:01:15.805 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T06:01:16.075 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T06:01:16.103 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T06:01:16.133 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T06:01:16.411 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T06:01:16.428 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T06:01:16.461 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T06:01:16.650 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T06:01:16.677 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T06:01:16.716 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T06:01:16.773 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T06:01:16.801 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-17T06:01:16.839 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T06:01:16.978 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T06:01:17.005 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T06:01:17.044 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T06:01:17.168 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T06:01:17.195 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T06:01:17.234 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T06:01:17.373 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T06:01:17.401 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T06:01:17.439 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T06:01:17.571 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T06:01:17.599 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T06:01:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T06:01:17.760 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T06:01:17.787 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-17T06:01:17.826 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T06:01:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T06:01:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T06:01:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T06:01:18.106 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T06:01:18.133 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T06:01:18.172 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T06:01:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T06:01:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T06:01:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T06:01:18.493 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T06:01:18.520 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T06:01:18.559 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T06:01:18.871 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T06:01:18.899 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T06:01:18.937 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T06:01:19.032 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T06:01:19.049 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:19.090 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:19.266 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T06:01:19.294 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T06:01:19.333 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T06:01:19.418 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T06:01:19.446 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T06:01:19.484 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T06:01:19.937 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T06:01:19.989 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T06:01:20.004 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T06:01:20.164 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T06:01:20.181 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:20.225 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:20.473 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package jq. 2024-09-17T06:01:20.502 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T06:01:20.540 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T06:01:20.550 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T06:01:20.578 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T06:01:20.617 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T06:01:20.793 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package socat. 2024-09-17T06:01:20.820 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T06:01:20.859 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T06:01:20.913 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T06:01:20.940 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T06:01:20.970 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T06:01:21.170 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T06:01:21.187 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T06:01:21.224 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package jq. 2024-09-17T06:01:21.228 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T06:01:21.251 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T06:01:21.290 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T06:01:21.543 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package socat. 2024-09-17T06:01:21.559 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T06:01:21.582 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-test. 2024-09-17T06:01:21.599 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../100-ceph-test_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:21.603 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T06:01:21.641 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-test (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:21.915 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T06:01:21.931 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T06:01:21.973 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T06:01:22.311 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-test. 2024-09-17T06:01:22.327 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../100-ceph-test_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:22.369 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-test (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:23.787 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T06:01:23.815 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:23.853 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-volume (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:24.241 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-17T06:01:24.269 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:24.315 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephfs-mirror (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:24.482 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T06:01:24.509 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:24.548 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-volume (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:24.685 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-colorama. 2024-09-17T06:01:24.713 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-17T06:01:24.760 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-17T06:01:24.911 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-17T06:01:24.938 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:24.977 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking cephfs-mirror (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:25.104 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephfs-shell. 2024-09-17T06:01:25.132 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:25.179 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephfs-shell (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:25.305 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-colorama. 2024-09-17T06:01:25.333 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-17T06:01:25.371 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-17T06:01:25.440 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephfs-top. 2024-09-17T06:01:25.456 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:25.498 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephfs-top (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:25.624 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package cephfs-shell. 2024-09-17T06:01:25.648 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:25.682 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking cephfs-shell (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:25.767 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T06:01:25.783 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:25.825 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libcephfs-dev (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:25.901 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package cephfs-top. 2024-09-17T06:01:25.914 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T06:01:25.951 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking cephfs-top (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:26.195 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T06:01:26.204 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T06:01:26.223 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T06:01:26.231 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:26.270 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T06:01:26.278 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libcephfs-dev (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:26.598 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T06:01:26.626 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T06:01:26.633 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T06:01:26.661 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T06:01:26.664 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T06:01:26.707 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T06:01:27.011 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T06:01:27.039 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T06:01:27.077 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T06:01:27.086 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T06:01:27.115 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T06:01:27.161 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T06:01:27.423 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T06:01:27.451 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T06:01:27.489 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T06:01:27.608 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package pkg-config. 2024-09-17T06:01:27.636 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T06:01:27.666 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T06:01:27.886 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T06:01:27.894 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package pkg-config. 2024-09-17T06:01:27.902 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T06:01:27.922 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T06:01:27.944 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T06:01:27.961 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T06:01:28.214 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T06:01:28.242 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T06:01:28.280 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T06:01:28.366 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T06:01:28.395 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T06:01:28.432 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T06:01:28.700 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T06:01:28.729 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T06:01:28.752 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T06:01:28.766 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T06:01:28.781 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T06:01:28.818 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T06:01:29.069 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T06:01:29.098 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T06:01:29.136 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T06:01:29.156 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T06:01:29.184 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T06:01:29.222 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T06:01:29.473 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T06:01:29.492 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T06:01:29.501 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T06:01:29.520 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T06:01:29.539 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T06:01:29.559 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T06:01:29.851 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T06:01:29.878 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T06:01:29.904 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-py. 2024-09-17T06:01:29.917 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T06:01:29.920 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-17T06:01:29.962 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T06:01:30.253 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-py. 2024-09-17T06:01:30.258 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T06:01:30.281 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-17T06:01:30.286 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T06:01:30.315 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T06:01:30.328 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T06:01:30.762 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T06:01:30.765 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T06:01:30.791 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T06:01:30.793 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T06:01:30.828 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T06:01:30.964 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T06:01:31.157 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-toml. 2024-09-17T06:01:31.185 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-17T06:01:31.223 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T06:01:31.394 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T06:01:31.422 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T06:01:31.460 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T06:01:31.526 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T06:01:31.555 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T06:01:31.592 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T06:01:31.746 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-toml. 2024-09-17T06:01:31.775 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-17T06:01:31.821 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T06:01:31.947 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T06:01:31.975 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T06:01:32.013 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T06:01:32.108 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T06:01:32.135 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T06:01:32.173 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T06:01:32.299 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T06:01:32.316 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T06:01:32.358 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T06:01:32.494 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T06:01:32.522 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T06:01:32.560 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T06:01:32.821 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T06:01:32.838 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T06:01:32.888 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T06:01:33.104 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package radosgw. 2024-09-17T06:01:33.133 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../123-radosgw_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:33.170 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking radosgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:33.642 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package radosgw. 2024-09-17T06:01:33.670 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../123-radosgw_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:33.708 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking radosgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:34.332 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T06:01:34.349 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:34.390 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking rbd-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:34.704 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T06:01:34.861 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T06:01:34.890 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T06:01:34.927 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking rbd-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:34.938 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T06:01:35.072 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T06:01:35.212 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T06:01:35.332 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T06:01:35.450 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T06:01:35.567 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T06:01:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T06:01:35.829 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T06:01:36.143 INFO:teuthology.orchestra.run.smithi173.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T06:01:36.155 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T06:01:36.216 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:36.580 INFO:teuthology.orchestra.run.smithi122.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T06:01:36.660 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:36.691 INFO:teuthology.orchestra.run.smithi173.stdout:Adding system user cephadm....done 2024-09-17T06:01:36.823 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T06:01:37.091 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T06:01:37.245 INFO:teuthology.orchestra.run.smithi122.stdout:Adding system user cephadm....done 2024-09-17T06:01:37.342 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T06:01:37.410 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T06:01:37.468 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T06:01:37.711 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T06:01:37.905 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T06:01:37.962 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T06:01:38.089 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T06:01:38.163 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T06:01:38.289 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T06:01:38.390 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T06:01:38.573 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T06:01:38.752 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T06:01:38.850 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T06:01:38.975 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T06:01:38.995 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-17T06:01:39.254 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T06:01:39.277 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T06:01:39.531 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T06:01:39.638 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T06:01:39.782 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T06:01:39.897 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-17T06:01:40.034 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T06:01:40.140 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T06:01:40.276 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T06:01:40.400 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T06:01:40.519 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-ceph-argparse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:40.643 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T06:01:40.762 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T06:01:40.888 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-17T06:01:40.968 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T06:01:41.014 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T06:01:41.141 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-17T06:01:41.320 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T06:01:41.400 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T06:01:41.526 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T06:01:41.588 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-ceph-argparse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:41.794 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T06:01:41.856 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T06:01:41.982 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-17T06:01:42.108 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T06:01:42.158 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T06:01:42.191 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T06:01:42.242 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-17T06:01:42.264 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T06:01:42.391 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T06:01:42.493 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T06:01:42.619 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T06:01:42.742 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T06:01:42.868 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T06:01:42.870 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T06:01:43.136 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T06:01:43.245 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T06:01:43.276 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T06:01:43.340 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T06:01:43.370 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T06:01:43.466 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T06:01:43.688 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T06:01:43.823 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T06:01:43.834 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T06:01:43.960 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T06:01:44.227 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T06:01:44.459 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T06:01:44.487 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T06:01:44.718 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T06:01:44.819 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T06:01:44.821 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T06:01:44.920 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T06:01:44.939 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T06:01:45.213 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T06:01:45.574 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T06:01:45.615 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T06:01:45.834 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T06:01:45.857 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T06:01:45.960 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T06:01:46.136 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T06:01:46.234 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T06:01:46.527 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-17T06:01:46.612 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T06:01:46.804 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T06:01:46.988 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T06:01:47.138 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T06:01:47.239 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T06:01:47.398 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T06:01:47.524 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:47.599 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T06:01:47.834 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T06:01:47.884 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-17T06:01:48.160 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T06:01:48.193 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T06:01:48.519 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T06:01:48.770 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T06:01:48.905 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:49.214 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T06:01:49.325 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T06:01:49.516 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T06:01:49.577 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T06:01:49.686 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T06:01:49.920 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T06:01:50.038 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T06:01:50.165 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T06:01:50.475 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T06:01:50.679 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T06:01:50.734 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T06:01:50.940 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T06:01:50.977 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T06:01:51.049 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T06:01:51.078 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T06:01:51.283 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T06:01:51.363 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T06:01:51.409 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T06:01:51.535 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T06:01:51.656 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T06:01:51.820 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T06:01:51.941 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T06:01:52.071 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T06:01:52.192 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T06:01:52.322 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T06:01:52.443 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T06:01:52.448 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T06:01:52.702 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T06:01:52.741 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T06:01:52.804 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T06:01:52.984 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T06:01:53.080 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T06:01:53.206 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T06:01:53.235 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T06:01:53.477 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T06:01:53.499 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T06:01:53.729 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T06:01:53.817 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T06:01:53.996 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T06:01:54.076 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T06:01:54.131 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T06:01:54.186 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T06:01:54.287 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T06:01:54.369 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T06:01:54.398 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T06:01:54.499 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T06:01:54.606 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T06:01:54.732 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T06:01:54.776 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T06:01:55.060 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T06:01:55.117 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T06:01:55.311 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T06:01:55.377 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T06:01:55.437 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T06:01:55.478 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T06:01:55.571 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T06:01:55.661 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T06:01:55.754 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T06:01:55.888 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T06:01:55.898 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T06:01:55.999 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T06:01:56.206 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T06:01:56.376 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T06:01:56.499 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T06:01:56.618 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T06:01:56.744 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T06:01:56.886 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T06:01:56.995 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T06:01:56.996 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T06:01:57.121 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T06:01:57.273 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T06:01:57.447 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T06:01:57.549 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T06:01:57.757 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T06:01:57.817 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T06:01:58.127 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T06:01:58.202 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T06:01:58.244 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T06:01:58.462 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T06:01:58.512 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T06:01:58.781 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T06:01:58.790 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T06:01:58.916 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librados2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:59.031 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T06:01:59.042 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:59.168 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T06:01:59.400 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T06:01:59.471 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libcephfs2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:59.597 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libradosstriper1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:01:59.660 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T06:01:59.723 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T06:01:59.979 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T06:02:00.000 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librbd1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:00.126 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-modules-core (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:00.130 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librados2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:00.235 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:00.256 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:00.382 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T06:02:00.438 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T06:02:00.438 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T06:02:00.677 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libcephfs2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:00.786 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libradosstriper1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:00.912 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libcephfs-dev (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:00.912 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T06:02:01.029 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rados (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:01.155 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librgw2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:01.188 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librbd1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:01.290 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephfs-top (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:01.314 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-modules-core (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:01.416 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T06:02:01.465 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:01.681 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T06:02:01.681 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T06:02:02.209 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libcephfs-dev (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:02.310 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rados (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:02.411 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librgw2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:02.537 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up cephfs-top (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:02.637 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rbd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:02.663 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T06:02:02.755 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up rbd-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:02.881 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:03.015 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cephfs (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:03.142 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephfs-shell (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:03.293 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:03.786 INFO:teuthology.orchestra.run.smithi173.stdout:Adding group ceph....done 2024-09-17T06:02:03.875 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rbd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:04.001 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up rbd-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:04.127 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:04.138 INFO:teuthology.orchestra.run.smithi173.stdout:Adding system user ceph....done 2024-09-17T06:02:04.253 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cephfs (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:04.307 INFO:teuthology.orchestra.run.smithi173.stdout:Setting system user ceph properties....done 2024-09-17T06:02:04.322 INFO:teuthology.orchestra.run.smithi173.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T06:02:04.378 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up cephfs-shell (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:04.454 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T06:02:04.505 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:04.788 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T06:02:05.006 INFO:teuthology.orchestra.run.smithi122.stdout:Adding group ceph....done 2024-09-17T06:02:05.270 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephfs-mirror (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:05.332 INFO:teuthology.orchestra.run.smithi122.stdout:Adding system user ceph....done 2024-09-17T06:02:05.467 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-17T06:02:05.467 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-17T06:02:05.492 INFO:teuthology.orchestra.run.smithi122.stdout:Setting system user ceph properties....done 2024-09-17T06:02:05.510 INFO:teuthology.orchestra.run.smithi122.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T06:02:05.646 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T06:02:05.955 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-test (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:05.959 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T06:02:06.090 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up radosgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:06.456 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up cephfs-mirror (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:06.552 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T06:02:06.552 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T06:02:06.648 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-17T06:02:06.649 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-17T06:02:07.040 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-base (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:07.149 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-test (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:07.267 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up radosgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:07.412 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T06:02:07.733 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T06:02:07.733 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T06:02:07.910 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mds (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:08.126 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T06:02:08.126 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T06:02:08.239 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-base (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:08.587 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:08.684 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T06:02:08.810 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T06:02:08.810 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T06:02:09.188 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mds (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:09.305 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-osd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:09.412 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T06:02:09.413 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T06:02:09.581 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T06:02:09.581 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T06:02:09.898 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:10.007 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:10.091 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T06:02:10.091 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T06:02:10.116 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:10.268 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mon (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:10.480 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T06:02:10.480 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T06:02:10.566 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-osd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:10.847 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T06:02:10.848 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T06:02:10.953 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:11.120 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:11.246 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-dashboard (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:11.326 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:11.406 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-volume (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:11.444 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:11.595 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mon (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:11.751 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T06:02:11.807 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T06:02:11.807 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T06:02:11.860 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T06:02:12.004 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T06:02:12.324 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:12.476 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:12.601 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-dashboard (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:12.744 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-volume (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T06:02:13.048 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T06:02:13.105 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T06:02:13.206 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T06:02:13.359 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T06:02:13.693 INFO:teuthology.orchestra.run.smithi173.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T06:02:13.696 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-17T06:02:13.752 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-17T06:02:13.965 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-09-17T06:02:13.965 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-09-17T06:02:14.125 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T06:02:14.164 INFO:teuthology.orchestra.run.smithi173.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-17T06:02:14.164 INFO:teuthology.orchestra.run.smithi173.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T06:02:14.164 INFO:teuthology.orchestra.run.smithi173.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T06:02:14.164 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T06:02:14.164 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T06:02:14.164 INFO:teuthology.orchestra.run.smithi173.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T06:02:14.164 INFO:teuthology.orchestra.run.smithi173.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T06:02:14.165 INFO:teuthology.orchestra.run.smithi173.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T06:02:14.165 INFO:teuthology.orchestra.run.smithi173.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T06:02:14.165 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T06:02:14.165 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2024-09-17T06:02:14.165 INFO:teuthology.orchestra.run.smithi173.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-17T06:02:14.165 INFO:teuthology.orchestra.run.smithi173.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-17T06:02:14.166 INFO:teuthology.orchestra.run.smithi173.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-17T06:02:14.166 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-17T06:02:14.166 INFO:teuthology.orchestra.run.smithi173.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-17T06:02:14.167 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2024-09-17T06:02:14.167 INFO:teuthology.orchestra.run.smithi173.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-17T06:02:14.167 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-17T06:02:14.168 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-17T06:02:14.210 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2024-09-17T06:02:14.210 INFO:teuthology.orchestra.run.smithi173.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-17T06:02:14.210 INFO:teuthology.orchestra.run.smithi173.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-17T06:02:14.211 INFO:teuthology.orchestra.run.smithi173.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-17T06:02:14.211 INFO:teuthology.orchestra.run.smithi173.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-17T06:02:14.211 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-17T06:02:14.211 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-17T06:02:14.211 INFO:teuthology.orchestra.run.smithi173.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-17T06:02:14.212 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages will be upgraded: 2024-09-17T06:02:14.213 INFO:teuthology.orchestra.run.smithi173.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-17T06:02:14.413 INFO:teuthology.orchestra.run.smithi173.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-17T06:02:14.413 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 55.8 MB of archives. 2024-09-17T06:02:14.413 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-17T06:02:14.413 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-17T06:02:14.781 INFO:teuthology.orchestra.run.smithi122.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T06:02:14.784 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-17T06:02:14.839 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-17T06:02:15.037 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T06:02:15.052 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-09-17T06:02:15.053 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T06:02:15.053 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-09-17T06:02:15.177 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T06:02:15.178 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T06:02:15.179 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T06:02:15.207 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-17T06:02:15.209 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-17T06:02:15.213 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-17T06:02:15.215 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T06:02:15.217 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-17T06:02:15.219 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T06:02:15.252 INFO:teuthology.orchestra.run.smithi122.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-17T06:02:15.252 INFO:teuthology.orchestra.run.smithi122.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T06:02:15.252 INFO:teuthology.orchestra.run.smithi122.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T06:02:15.252 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T06:02:15.252 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T06:02:15.253 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T06:02:15.253 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T06:02:15.253 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T06:02:15.253 INFO:teuthology.orchestra.run.smithi122.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T06:02:15.253 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T06:02:15.254 INFO:teuthology.orchestra.run.smithi122.stdout:The following additional packages will be installed: 2024-09-17T06:02:15.254 INFO:teuthology.orchestra.run.smithi122.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-17T06:02:15.254 INFO:teuthology.orchestra.run.smithi122.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-17T06:02:15.255 INFO:teuthology.orchestra.run.smithi122.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-17T06:02:15.255 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-17T06:02:15.255 INFO:teuthology.orchestra.run.smithi122.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-17T06:02:15.256 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-09-17T06:02:15.256 INFO:teuthology.orchestra.run.smithi122.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-17T06:02:15.256 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-17T06:02:15.256 INFO:teuthology.orchestra.run.smithi122.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-17T06:02:15.280 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T06:02:15.281 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T06:02:15.281 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-17T06:02:15.297 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-09-17T06:02:15.297 INFO:teuthology.orchestra.run.smithi122.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-17T06:02:15.297 INFO:teuthology.orchestra.run.smithi122.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-17T06:02:15.298 INFO:teuthology.orchestra.run.smithi122.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-17T06:02:15.298 INFO:teuthology.orchestra.run.smithi122.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-17T06:02:15.298 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-17T06:02:15.298 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-17T06:02:15.298 INFO:teuthology.orchestra.run.smithi122.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-17T06:02:15.299 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages will be upgraded: 2024-09-17T06:02:15.300 INFO:teuthology.orchestra.run.smithi122.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-17T06:02:15.351 INFO:teuthology.orchestra.run.smithi122.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-17T06:02:15.351 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 55.8 MB of archives. 2024-09-17T06:02:15.351 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-17T06:02:15.351 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-17T06:02:15.362 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-17T06:02:15.486 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T06:02:15.490 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T06:02:15.526 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T06:02:15.527 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T06:02:15.528 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T06:02:15.539 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-17T06:02:15.540 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-17T06:02:15.542 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-17T06:02:15.543 INFO:teuthology.orchestra.run.smithi122.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T06:02:15.544 INFO:teuthology.orchestra.run.smithi122.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-17T06:02:15.545 INFO:teuthology.orchestra.run.smithi122.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T06:02:15.546 INFO:teuthology.orchestra.run.smithi122.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T06:02:15.562 INFO:teuthology.orchestra.run.smithi122.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T06:02:15.562 INFO:teuthology.orchestra.run.smithi122.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-17T06:02:15.563 INFO:teuthology.orchestra.run.smithi122.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-17T06:02:15.885 INFO:teuthology.orchestra.run.smithi122.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-17T06:02:15.886 INFO:teuthology.orchestra.run.smithi122.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-17T06:02:15.886 INFO:teuthology.orchestra.run.smithi122.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-17T06:02:15.889 INFO:teuthology.orchestra.run.smithi122.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-17T06:02:15.889 INFO:teuthology.orchestra.run.smithi122.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-17T06:02:15.893 INFO:teuthology.orchestra.run.smithi122.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-17T06:02:15.895 INFO:teuthology.orchestra.run.smithi122.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-17T06:02:15.902 INFO:teuthology.orchestra.run.smithi122.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-17T06:02:15.902 INFO:teuthology.orchestra.run.smithi122.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T06:02:15.923 INFO:teuthology.orchestra.run.smithi122.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-17T06:02:15.923 INFO:teuthology.orchestra.run.smithi122.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-17T06:02:15.932 INFO:teuthology.orchestra.run.smithi122.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-17T06:02:15.953 INFO:teuthology.orchestra.run.smithi122.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-17T06:02:15.956 INFO:teuthology.orchestra.run.smithi122.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-17T06:02:15.957 INFO:teuthology.orchestra.run.smithi122.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-17T06:02:15.957 INFO:teuthology.orchestra.run.smithi122.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-17T06:02:15.957 INFO:teuthology.orchestra.run.smithi122.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-17T06:02:15.968 INFO:teuthology.orchestra.run.smithi122.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-17T06:02:15.970 INFO:teuthology.orchestra.run.smithi122.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-17T06:02:16.149 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-17T06:02:16.153 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-17T06:02:16.153 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-17T06:02:16.159 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-17T06:02:16.160 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-17T06:02:16.170 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-17T06:02:16.171 INFO:teuthology.orchestra.run.smithi122.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-17T06:02:16.171 INFO:teuthology.orchestra.run.smithi122.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-17T06:02:16.171 INFO:teuthology.orchestra.run.smithi122.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-17T06:02:16.172 INFO:teuthology.orchestra.run.smithi122.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-17T06:02:16.172 INFO:teuthology.orchestra.run.smithi122.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-17T06:02:16.172 INFO:teuthology.orchestra.run.smithi122.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-17T06:02:16.174 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-17T06:02:16.183 INFO:teuthology.orchestra.run.smithi122.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-17T06:02:16.183 INFO:teuthology.orchestra.run.smithi122.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-17T06:02:16.190 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-17T06:02:16.190 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T06:02:16.254 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-17T06:02:16.275 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-17T06:02:16.297 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-17T06:02:16.366 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-17T06:02:16.372 INFO:teuthology.orchestra.run.smithi173.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-17T06:02:16.373 INFO:teuthology.orchestra.run.smithi173.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-17T06:02:16.374 INFO:teuthology.orchestra.run.smithi173.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-17T06:02:16.375 INFO:teuthology.orchestra.run.smithi173.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-17T06:02:16.404 INFO:teuthology.orchestra.run.smithi173.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-17T06:02:16.407 INFO:teuthology.orchestra.run.smithi173.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-17T06:02:16.591 INFO:teuthology.orchestra.run.smithi122.stdout:Preconfiguring packages ... 2024-09-17T06:02:16.751 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 55.8 MB in 1s (63.6 MB/s) 2024-09-17T06:02:16.958 INFO:teuthology.orchestra.run.smithi173.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-17T06:02:16.958 INFO:teuthology.orchestra.run.smithi173.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-17T06:02:16.959 INFO:teuthology.orchestra.run.smithi173.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-17T06:02:16.959 INFO:teuthology.orchestra.run.smithi173.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-17T06:02:16.959 INFO:teuthology.orchestra.run.smithi173.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-17T06:02:16.960 INFO:teuthology.orchestra.run.smithi173.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-17T06:02:16.988 INFO:teuthology.orchestra.run.smithi173.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-17T06:02:16.989 INFO:teuthology.orchestra.run.smithi173.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-17T06:02:17.012 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176353 files and directories currently installed.) 2024-09-17T06:02:17.018 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T06:02:17.139 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T06:02:17.409 INFO:teuthology.orchestra.run.smithi173.stdout:Preconfiguring packages ... 2024-09-17T06:02:17.558 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 55.8 MB in 3s (20.1 MB/s) 2024-09-17T06:02:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176353 files and directories currently installed.) 2024-09-17T06:02:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T06:02:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T06:02:18.073 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-17T06:02:18.904 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-17T06:02:19.044 INFO:teuthology.orchestra.run.smithi122.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-17T06:02:19.308 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package flex. 2024-09-17T06:02:19.379 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176353 files and directories currently installed.) 2024-09-17T06:02:19.384 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T06:02:19.422 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T06:02:19.805 INFO:teuthology.orchestra.run.smithi173.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-17T06:02:19.948 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T06:02:20.073 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package flex. 2024-09-17T06:02:20.128 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T06:02:20.177 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176353 files and directories currently installed.) 2024-09-17T06:02:20.183 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T06:02:20.221 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T06:02:20.531 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T06:02:20.755 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T06:02:20.910 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T06:02:21.102 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176426 files and directories currently installed.) 2024-09-17T06:02:21.108 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T06:02:21.245 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T06:02:21.304 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T06:02:21.679 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T06:02:21.810 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T06:02:21.848 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176426 files and directories currently installed.) 2024-09-17T06:02:21.853 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T06:02:21.976 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T06:02:22.146 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T06:02:22.377 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T06:02:22.503 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package bison. 2024-09-17T06:02:22.540 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T06:02:22.608 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176426 files and directories currently installed.) 2024-09-17T06:02:22.614 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T06:02:22.663 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T06:02:22.892 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T06:02:23.080 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-17T06:02:23.108 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-17T06:02:23.147 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-17T06:02:23.476 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package bison. 2024-09-17T06:02:23.483 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package dump. 2024-09-17T06:02:23.511 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-17T06:02:23.558 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking dump (0.4b47-3) ... 2024-09-17T06:02:23.583 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176426 files and directories currently installed.) 2024-09-17T06:02:23.589 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T06:02:23.636 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T06:02:23.871 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package indent. 2024-09-17T06:02:23.898 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T06:02:23.945 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-17T06:02:24.045 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-17T06:02:24.073 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-17T06:02:24.112 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-17T06:02:24.248 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T06:02:24.264 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T06:02:24.306 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T06:02:24.431 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package dump. 2024-09-17T06:02:24.459 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-17T06:02:24.539 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking dump (0.4b47-3) ... 2024-09-17T06:02:24.669 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-17T06:02:24.697 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-17T06:02:24.736 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-17T06:02:24.826 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package indent. 2024-09-17T06:02:24.855 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T06:02:24.893 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-17T06:02:25.038 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T06:02:25.066 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T06:02:25.113 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T06:02:25.162 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T06:02:25.191 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T06:02:25.229 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T06:02:25.492 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T06:02:25.507 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-17T06:02:25.520 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T06:02:25.524 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-17T06:02:25.558 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-17T06:02:25.558 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T06:02:25.811 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T06:02:25.819 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T06:02:25.827 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T06:02:25.847 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T06:02:25.872 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T06:02:25.885 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T06:02:26.122 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libjson-perl. 2024-09-17T06:02:26.139 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-17T06:02:26.189 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-17T06:02:26.230 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T06:02:26.259 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T06:02:26.314 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T06:02:26.549 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T06:02:26.566 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T06:02:26.599 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T06:02:26.717 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-17T06:02:26.745 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-17T06:02:26.801 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-17T06:02:26.827 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjson-perl. 2024-09-17T06:02:26.855 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-17T06:02:26.894 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-17T06:02:27.172 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-17T06:02:27.188 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-17T06:02:27.222 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-17T06:02:28.487 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-17T06:02:28.515 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-17T06:02:28.554 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T06:02:28.815 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-17T06:02:28.832 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-17T06:02:28.873 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T06:02:28.901 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-17T06:02:28.929 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-17T06:02:28.968 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T06:02:29.237 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-17T06:02:29.253 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-17T06:02:29.276 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-17T06:02:29.295 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T06:02:29.304 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-17T06:02:29.351 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T06:02:29.690 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-17T06:02:29.704 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-17T06:02:29.718 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-17T06:02:29.732 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-17T06:02:29.764 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T06:02:29.770 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-17T06:02:30.098 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-17T06:02:30.127 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-17T06:02:30.165 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-17T06:02:30.218 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-17T06:02:30.246 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-17T06:02:30.284 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-17T06:02:30.585 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-17T06:02:30.612 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-17T06:02:30.613 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T06:02:30.640 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-17T06:02:30.660 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T06:02:30.679 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-17T06:02:31.004 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-17T06:02:31.033 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T06:02:31.071 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T06:02:31.090 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-17T06:02:31.118 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T06:02:31.173 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T06:02:31.357 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-17T06:02:31.373 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T06:02:31.415 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T06:02:31.576 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-17T06:02:31.604 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T06:02:31.651 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T06:02:31.693 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T06:02:31.721 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T06:02:31.768 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T06:02:31.937 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-17T06:02:31.965 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T06:02:32.004 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T06:02:32.264 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T06:02:32.281 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T06:02:32.305 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-17T06:02:32.331 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T06:02:32.333 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-17T06:02:32.380 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-17T06:02:32.733 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package modemmanager. 2024-09-17T06:02:32.761 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-17T06:02:32.800 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T06:02:32.910 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-17T06:02:32.938 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-17T06:02:32.976 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-17T06:02:33.329 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package modemmanager. 2024-09-17T06:02:33.357 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-17T06:02:33.396 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T06:02:33.474 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package network-manager. 2024-09-17T06:02:33.502 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-17T06:02:33.548 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-17T06:02:34.181 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ppp. 2024-09-17T06:02:34.209 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-17T06:02:34.479 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-17T06:02:34.522 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package network-manager. 2024-09-17T06:02:34.550 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-17T06:02:34.596 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-17T06:02:34.828 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package pptp-linux. 2024-09-17T06:02:34.857 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-17T06:02:34.903 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-17T06:02:35.206 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-17T06:02:35.234 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-17T06:02:35.281 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-17T06:02:35.329 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ppp. 2024-09-17T06:02:35.358 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-17T06:02:35.576 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-17T06:02:35.592 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-17T06:02:35.633 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql-client-common (238) ... 2024-09-17T06:02:35.635 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-17T06:02:35.938 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-17T06:02:35.966 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T06:02:36.004 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T06:02:36.076 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package pptp-linux. 2024-09-17T06:02:36.104 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-17T06:02:36.151 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-17T06:02:36.462 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-17T06:02:36.490 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-17T06:02:36.528 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-17T06:02:36.626 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql-common. 2024-09-17T06:02:36.654 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-17T06:02:36.711 INFO:teuthology.orchestra.run.smithi122.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-17T06:02:36.741 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql-common (238) ... 2024-09-17T06:02:36.831 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-17T06:02:36.860 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-17T06:02:36.898 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-client-common (238) ... 2024-09-17T06:02:37.158 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql-14. 2024-09-17T06:02:37.186 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T06:02:37.219 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T06:02:37.243 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-17T06:02:37.272 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T06:02:37.318 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T06:02:38.023 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-common. 2024-09-17T06:02:38.051 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-17T06:02:38.125 INFO:teuthology.orchestra.run.smithi173.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-17T06:02:38.145 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-common (238) ... 2024-09-17T06:02:38.545 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql. 2024-09-17T06:02:38.562 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-17T06:02:38.594 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql (14+238) ... 2024-09-17T06:02:38.697 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-14. 2024-09-17T06:02:38.725 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T06:02:38.775 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T06:02:38.838 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql-client. 2024-09-17T06:02:38.855 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-17T06:02:38.897 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql-client (14+238) ... 2024-09-17T06:02:39.140 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-17T06:02:39.157 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-17T06:02:39.199 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-17T06:02:39.518 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package tcl8.6. 2024-09-17T06:02:39.546 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-17T06:02:39.585 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-17T06:02:39.854 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package tcl. 2024-09-17T06:02:39.883 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-17T06:02:39.925 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-17T06:02:40.274 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package wpasupplicant. 2024-09-17T06:02:40.302 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-17T06:02:40.340 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-17T06:02:40.711 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-17T06:02:40.725 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql. 2024-09-17T06:02:40.728 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-17T06:02:40.754 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-17T06:02:40.769 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-17T06:02:40.791 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql (14+238) ... 2024-09-17T06:02:41.060 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-client. 2024-09-17T06:02:41.073 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-17T06:02:41.088 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-17T06:02:41.101 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-17T06:02:41.135 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-client (14+238) ... 2024-09-17T06:02:41.139 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-17T06:02:41.413 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-17T06:02:41.429 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-17T06:02:41.462 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-17T06:02:41.470 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql-client-common (238) ... 2024-09-17T06:02:41.704 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T06:02:41.707 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package tcl8.6. 2024-09-17T06:02:41.735 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-17T06:02:41.773 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-17T06:02:41.855 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-17T06:02:42.006 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T06:02:42.084 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package tcl. 2024-09-17T06:02:42.112 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-17T06:02:42.132 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-17T06:02:42.165 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-17T06:02:42.258 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T06:02:42.384 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T06:02:42.571 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package wpasupplicant. 2024-09-17T06:02:42.599 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-17T06:02:42.637 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-17T06:02:42.854 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-17T06:02:42.965 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-17T06:02:42.999 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-17T06:02:43.016 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-17T06:02:43.058 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-17T06:02:43.503 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-17T06:02:43.531 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-17T06:02:43.577 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-17T06:02:43.867 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-17T06:02:43.867 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-17T06:02:43.916 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-client-common (238) ... 2024-09-17T06:02:44.125 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T06:02:44.376 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T06:02:44.503 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-17T06:02:44.604 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T06:02:44.668 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-17T06:02:44.721 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-17T06:02:44.794 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T06:02:44.847 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T06:02:44.920 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-17T06:02:44.973 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T06:02:45.030 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T06:02:45.099 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-17T06:02:45.131 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T06:02:45.225 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-17T06:02:45.587 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-17T06:02:45.678 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-17T06:02:45.831 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-17T06:02:45.957 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up dump (0.4b47-3) ... 2024-09-17T06:02:46.051 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-17T06:02:46.056 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-17T06:02:46.056 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-17T06:02:46.117 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T06:02:46.243 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-17T06:02:46.369 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-17T06:02:46.495 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-17T06:02:46.523 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T06:02:46.613 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T06:02:46.648 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-17T06:02:46.720 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T06:02:46.775 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T06:02:46.789 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-17T06:02:46.901 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-17T06:02:46.915 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-17T06:02:47.035 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T06:02:47.092 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-17T06:02:47.161 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T06:02:47.218 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T06:02:47.270 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-17T06:02:47.344 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-17T06:02:47.371 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-17T06:02:47.545 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql-client (14+238) ... 2024-09-17T06:02:47.705 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-17T06:02:47.985 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-17T06:02:48.111 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up dump (0.4b47-3) ... 2024-09-17T06:02:48.191 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:02:48.192 INFO:teuthology.orchestra.run.smithi122.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-17T06:02:48.192 INFO:teuthology.orchestra.run.smithi122.stdout:which means they are currently configured by ifupdown: 2024-09-17T06:02:48.192 INFO:teuthology.orchestra.run.smithi122.stdout:- enp3s0f1 2024-09-17T06:02:48.192 INFO:teuthology.orchestra.run.smithi122.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-17T06:02:48.192 INFO:teuthology.orchestra.run.smithi122.stdout:remove their configuration from /etc/network/interfaces. 2024-09-17T06:02:48.192 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:02:48.198 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-17T06:02:48.263 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T06:02:48.313 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-17T06:02:48.364 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-17T06:02:48.465 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-17T06:02:48.591 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-17T06:02:48.629 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-17T06:02:48.717 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T06:02:48.807 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T06:02:48.877 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-17T06:02:49.003 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-17T06:02:49.171 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-17T06:02:49.183 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-17T06:02:49.272 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T06:02:49.373 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-17T06:02:49.541 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-client (14+238) ... 2024-09-17T06:02:49.699 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T06:02:49.700 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-17T06:02:49.842 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T06:02:49.968 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-17T06:02:50.113 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql-common (238) ... 2024-09-17T06:02:50.191 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:02:50.191 INFO:teuthology.orchestra.run.smithi173.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-17T06:02:50.191 INFO:teuthology.orchestra.run.smithi173.stdout:which means they are currently configured by ifupdown: 2024-09-17T06:02:50.191 INFO:teuthology.orchestra.run.smithi173.stdout:- enp3s0f1 2024-09-17T06:02:50.191 INFO:teuthology.orchestra.run.smithi173.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-17T06:02:50.191 INFO:teuthology.orchestra.run.smithi173.stdout:remove their configuration from /etc/network/interfaces. 2024-09-17T06:02:50.191 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:02:50.308 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-17T06:02:50.629 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-17T06:02:50.954 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-17T06:02:51.033 INFO:teuthology.orchestra.run.smithi122.stdout:Adding user postgres to group ssl-cert 2024-09-17T06:02:51.272 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:02:51.272 INFO:teuthology.orchestra.run.smithi122.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-17T06:02:51.462 INFO:teuthology.orchestra.run.smithi122.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-17T06:02:51.462 INFO:teuthology.orchestra.run.smithi122.stdout:Removing obsolete dictionary files: 2024-09-17T06:02:51.469 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T06:02:51.621 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T06:02:51.747 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-17T06:02:51.873 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-common (238) ... 2024-09-17T06:02:52.024 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-17T06:02:52.424 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T06:02:52.740 INFO:teuthology.orchestra.run.smithi122.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-17T06:02:52.758 INFO:teuthology.orchestra.run.smithi122.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-17T06:02:52.791 INFO:teuthology.orchestra.run.smithi173.stdout:Adding user postgres to group ssl-cert 2024-09-17T06:02:52.807 INFO:teuthology.orchestra.run.smithi122.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-17T06:02:52.807 INFO:teuthology.orchestra.run.smithi122.stdout:This user must also own the server process. 2024-09-17T06:02:52.807 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:02:52.807 INFO:teuthology.orchestra.run.smithi122.stdout:The database cluster will be initialized with locale "en_US". 2024-09-17T06:02:52.807 INFO:teuthology.orchestra.run.smithi122.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-17T06:02:52.807 INFO:teuthology.orchestra.run.smithi122.stdout:The default text search configuration will be set to "english". 2024-09-17T06:02:52.807 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:02:52.807 INFO:teuthology.orchestra.run.smithi122.stdout:Data page checksums are disabled. 2024-09-17T06:02:52.807 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:02:52.807 INFO:teuthology.orchestra.run.smithi122.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-17T06:02:52.808 INFO:teuthology.orchestra.run.smithi122.stdout:creating subdirectories ... ok 2024-09-17T06:02:52.808 INFO:teuthology.orchestra.run.smithi122.stdout:selecting dynamic shared memory implementation ... posix 2024-09-17T06:02:52.819 INFO:teuthology.orchestra.run.smithi122.stdout:selecting default max_connections ... 100 2024-09-17T06:02:52.840 INFO:teuthology.orchestra.run.smithi122.stdout:selecting default shared_buffers ... 128MB 2024-09-17T06:02:52.850 INFO:teuthology.orchestra.run.smithi122.stdout:selecting default time zone ... Etc/UTC 2024-09-17T06:02:52.851 INFO:teuthology.orchestra.run.smithi122.stdout:creating configuration files ... ok 2024-09-17T06:02:52.964 INFO:teuthology.orchestra.run.smithi122.stdout:running bootstrap script ... ok 2024-09-17T06:02:53.033 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:02:53.033 INFO:teuthology.orchestra.run.smithi173.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-17T06:02:53.228 INFO:teuthology.orchestra.run.smithi173.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-17T06:02:53.228 INFO:teuthology.orchestra.run.smithi173.stdout:Removing obsolete dictionary files: 2024-09-17T06:02:53.651 INFO:teuthology.orchestra.run.smithi122.stdout:performing post-bootstrap initialization ... ok 2024-09-17T06:02:53.776 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-17T06:02:54.150 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T06:02:54.301 INFO:teuthology.orchestra.run.smithi122.stdout:syncing data to disk ... ok 2024-09-17T06:02:54.478 INFO:teuthology.orchestra.run.smithi173.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-17T06:02:54.492 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-17T06:02:54.535 INFO:teuthology.orchestra.run.smithi173.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-17T06:02:54.535 INFO:teuthology.orchestra.run.smithi173.stdout:This user must also own the server process. 2024-09-17T06:02:54.535 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:02:54.535 INFO:teuthology.orchestra.run.smithi173.stdout:The database cluster will be initialized with locale "en_US". 2024-09-17T06:02:54.536 INFO:teuthology.orchestra.run.smithi173.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-17T06:02:54.536 INFO:teuthology.orchestra.run.smithi173.stdout:The default text search configuration will be set to "english". 2024-09-17T06:02:54.536 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:02:54.536 INFO:teuthology.orchestra.run.smithi173.stdout:Data page checksums are disabled. 2024-09-17T06:02:54.536 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:02:54.536 INFO:teuthology.orchestra.run.smithi173.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-17T06:02:54.536 INFO:teuthology.orchestra.run.smithi173.stdout:creating subdirectories ... ok 2024-09-17T06:02:54.536 INFO:teuthology.orchestra.run.smithi173.stdout:selecting dynamic shared memory implementation ... posix 2024-09-17T06:02:54.550 INFO:teuthology.orchestra.run.smithi173.stdout:selecting default max_connections ... 100 2024-09-17T06:02:54.569 INFO:teuthology.orchestra.run.smithi173.stdout:selecting default shared_buffers ... 128MB 2024-09-17T06:02:54.577 INFO:teuthology.orchestra.run.smithi173.stdout:selecting default time zone ... Etc/UTC 2024-09-17T06:02:54.577 INFO:teuthology.orchestra.run.smithi173.stdout:creating configuration files ... ok 2024-09-17T06:02:54.691 INFO:teuthology.orchestra.run.smithi173.stdout:running bootstrap script ... ok 2024-09-17T06:02:54.708 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-17T06:02:55.332 INFO:teuthology.orchestra.run.smithi173.stdout:performing post-bootstrap initialization ... ok 2024-09-17T06:02:56.305 INFO:teuthology.orchestra.run.smithi173.stdout:syncing data to disk ... ok 2024-09-17T06:02:56.699 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-17T06:02:57.480 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T06:02:57.615 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-17T06:02:57.741 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up postgresql (14+238) ... 2024-09-17T06:02:57.867 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T06:02:57.993 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T06:02:58.248 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-17T06:02:58.248 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-17T06:02:58.837 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T06:02:58.947 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-17T06:02:59.274 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T06:02:59.426 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T06:02:59.558 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T06:02:59.684 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-17T06:02:59.811 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql (14+238) ... 2024-09-17T06:02:59.936 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T06:03:00.062 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T06:03:00.306 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-17T06:03:00.307 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-17T06:03:00.804 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-17T06:03:00.856 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T06:03:00.895 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T06:03:00.948 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-17T06:03:01.293 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T06:03:01.397 INFO:teuthology.orchestra.run.smithi122.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T06:03:01.403 DEBUG:teuthology.parallel:result is None 2024-09-17T06:03:01.470 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T06:03:02.789 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-17T06:03:02.897 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T06:03:03.421 INFO:teuthology.orchestra.run.smithi173.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T06:03:03.426 DEBUG:teuthology.parallel:result is None 2024-09-17T06:03:03.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T06:03:03.568 DEBUG:teuthology.orchestra.run.smithi122:> dpkg-query -W -f '${Version}' ceph 2024-09-17T06:03:03.588 INFO:teuthology.orchestra.run.smithi122.stdout:19.3.0-4989-gce1b342b-1jammy 2024-09-17T06:03:03.588 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989-gce1b342b-1jammy 2024-09-17T06:03:03.588 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989-gce1b342b-1jammy is installed. 2024-09-17T06:03:03.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T06:03:03.726 DEBUG:teuthology.orchestra.run.smithi173:> dpkg-query -W -f '${Version}' ceph 2024-09-17T06:03:03.746 INFO:teuthology.orchestra.run.smithi173.stdout:19.3.0-4989-gce1b342b-1jammy 2024-09-17T06:03:03.746 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989-gce1b342b-1jammy 2024-09-17T06:03:03.746 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989-gce1b342b-1jammy is installed. 2024-09-17T06:03:03.748 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T06:03:03.748 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:03.748 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T06:03:03.763 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:03.763 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T06:03:03.801 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T06:03:03.801 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:03.801 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T06:03:03.817 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T06:03:03.873 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:03.873 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T06:03:03.886 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T06:03:03.940 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T06:03:03.941 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:03.941 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T06:03:03.954 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T06:03:04.010 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:04.010 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T06:03:04.023 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T06:03:04.080 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T06:03:04.080 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:04.080 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T06:03:04.094 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T06:03:04.149 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:04.149 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T06:03:04.163 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T06:03:04.219 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T06:03:04.298 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T06:03:04.298 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /var/log/ceph 2024-09-17T06:03:04.301 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /var/log/ceph 2024-09-17T06:03:04.313 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T06:03:04.313 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T06:03:04.355 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T06:03:04.368 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T06:03:04.368 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T06:03:04.407 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T06:03:04.429 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T06:03:04.429 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T06:03:04.429 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T06:03:04.430 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:04.430 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T06:03:04.466 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T06:03:04.540 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:04.541 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T06:03:04.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T06:03:04.625 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T06:03:04.625 INFO:tasks.ceph:config {'conf': {'client': {'client_shutdown_timeout': 120}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T06:03:04.626 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652', 'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7908652', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 476, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'sleep_before_teardown': 0, 'subset': '320/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240916.200549-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi122.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyi7ITscgugwyq/5k558dp/NcELUWVlNIpwAfLXgztQQpB4Oqx4Ulq80xh4zx8ar3VsmF7cpK7QFkDH7VeVtHM=', 'smithi173.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5b9fr2gnIw1Ti66H/LbKlWLMoTlvgo3L6C5zvGVbGyvHaDvCnjAn5IjNk3qXuVw78ir30VLIxEJyhDf3KxyV8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'thrashosds': None}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_02:09:51', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T06:03:04.626 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T06:03:04.629 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T06:03:04.668 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T06:03:04.675 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T06:03:04.724 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:04.724 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T06:03:04.734 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T06:03:04.734 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-09-17T06:03:04.782 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T06:03:04.783 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T06:03:04.783 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-17T06:03:04.783 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T06:03:04.783 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-17 05:56:45.841347389 +0000 2024-09-17T06:03:04.783 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-17 05:56:45.565349855 +0000 2024-09-17T06:03:04.783 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-17 05:56:45.565349855 +0000 2024-09-17T06:03:04.783 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-09-17T06:03:04.783 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T06:03:04.836 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-17T06:03:04.836 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-17T06:03:04.836 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.00045425 s, 1.1 MB/s 2024-09-17T06:03:04.837 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T06:03:04.887 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-09-17T06:03:04.934 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T06:03:04.934 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T06:03:04.934 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-17T06:03:04.934 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T06:03:04.934 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-17 05:56:46.077345281 +0000 2024-09-17T06:03:04.934 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-17 05:56:46.073345316 +0000 2024-09-17T06:03:04.934 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-17 05:56:46.073345316 +0000 2024-09-17T06:03:04.934 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-09-17T06:03:04.934 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T06:03:04.989 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-17T06:03:04.989 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-17T06:03:04.989 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000372402 s, 1.4 MB/s 2024-09-17T06:03:04.990 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T06:03:05.039 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-09-17T06:03:05.086 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T06:03:05.086 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T06:03:05.086 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-09-17T06:03:05.086 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T06:03:05.086 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-17 05:56:46.833338527 +0000 2024-09-17T06:03:05.087 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-17 05:56:46.593340672 +0000 2024-09-17T06:03:05.087 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-17 05:56:46.593340672 +0000 2024-09-17T06:03:05.087 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-09-17T06:03:05.087 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T06:03:05.140 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-17T06:03:05.140 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-17T06:03:05.141 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000386267 s, 1.3 MB/s 2024-09-17T06:03:05.142 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T06:03:05.192 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-09-17T06:03:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T06:03:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T06:03:05.238 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 943 Links: 1 2024-09-17T06:03:05.239 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T06:03:05.239 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-17 05:56:47.381333633 +0000 2024-09-17T06:03:05.239 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-17 05:56:47.105336099 +0000 2024-09-17T06:03:05.239 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-17 05:56:47.105336099 +0000 2024-09-17T06:03:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-09-17T06:03:05.239 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T06:03:05.293 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-17T06:03:05.293 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-17T06:03:05.293 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000379947 s, 1.3 MB/s 2024-09-17T06:03:05.294 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T06:03:05.347 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T06:03:05.347 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:05.347 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T06:03:05.354 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T06:03:05.354 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-09-17T06:03:05.401 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T06:03:05.401 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T06:03:05.401 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-09-17T06:03:05.401 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T06:03:05.401 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-17 05:56:45.890152029 +0000 2024-09-17T06:03:05.401 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-17 05:56:45.602154602 +0000 2024-09-17T06:03:05.401 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-17 05:56:45.602154602 +0000 2024-09-17T06:03:05.401 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2024-09-17T06:03:05.402 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T06:03:05.455 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-17T06:03:05.455 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-17T06:03:05.455 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000440054 s, 1.2 MB/s 2024-09-17T06:03:05.457 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T06:03:05.506 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-09-17T06:03:05.552 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T06:03:05.552 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T06:03:05.552 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-17T06:03:05.552 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T06:03:05.552 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-17 05:56:46.422147277 +0000 2024-09-17T06:03:05.552 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-17 05:56:46.150149707 +0000 2024-09-17T06:03:05.552 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-17 05:56:46.150149707 +0000 2024-09-17T06:03:05.553 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2024-09-17T06:03:05.553 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T06:03:05.607 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-17T06:03:05.607 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-17T06:03:05.607 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000402629 s, 1.3 MB/s 2024-09-17T06:03:05.608 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T06:03:05.657 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-09-17T06:03:05.704 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T06:03:05.704 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T06:03:05.704 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-09-17T06:03:05.704 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T06:03:05.704 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-17 05:56:46.918142846 +0000 2024-09-17T06:03:05.704 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-17 05:56:46.658145169 +0000 2024-09-17T06:03:05.704 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-17 05:56:46.658145169 +0000 2024-09-17T06:03:05.704 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2024-09-17T06:03:05.705 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T06:03:05.758 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-17T06:03:05.759 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-17T06:03:05.759 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000424856 s, 1.2 MB/s 2024-09-17T06:03:05.760 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T06:03:05.809 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-09-17T06:03:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T06:03:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T06:03:05.856 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-09-17T06:03:05.856 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T06:03:05.856 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-17 05:56:47.154140738 +0000 2024-09-17T06:03:05.857 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-17 05:56:47.150140774 +0000 2024-09-17T06:03:05.857 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-17 05:56:47.150140774 +0000 2024-09-17T06:03:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2024-09-17T06:03:05.857 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T06:03:05.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-17T06:03:05.910 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-17T06:03:05.910 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000344335 s, 1.5 MB/s 2024-09-17T06:03:05.912 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T06:03:05.961 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T06:03:05.962 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T06:03:05.962 INFO:tasks.ceph:Generating config... 2024-09-17T06:03:05.963 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-17T06:03:05.963 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-09-17T06:03:05.963 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-09-17T06:03:05.963 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T06:03:05.963 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T06:03:05.963 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T06:03:05.963 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T06:03:05.963 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T06:03:05.963 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T06:03:05.964 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-17T06:03:05.965 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T06:03:05.965 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T06:03:05.965 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T06:03:06.029 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T06:03:06.042 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T06:03:06.109 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T06:03:06.119 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.122'), ('mon.b', '172.21.15.173'), ('mon.c', '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]')] 2024-09-17T06:03:06.119 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.122,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client_shutdown_timeout': 120}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0}} 2024-09-17T06:03:06.120 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:06.120 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T06:03:06.165 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.122 --add b 172.21.15.173 --addv c '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:06.274 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:06.274 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: generated fsid 5aff0fc3-254a-48aa-be08-0081a34bd09c 2024-09-17T06:03:06.274 INFO:teuthology.orchestra.run.smithi122.stdout:setting min_mon_release = quincy 2024-09-17T06:03:06.274 INFO:teuthology.orchestra.run.smithi122.stdout:epoch 0 2024-09-17T06:03:06.274 INFO:teuthology.orchestra.run.smithi122.stdout:fsid 5aff0fc3-254a-48aa-be08-0081a34bd09c 2024-09-17T06:03:06.274 INFO:teuthology.orchestra.run.smithi122.stdout:last_changed 2024-09-17T06:03:06.277007+0000 2024-09-17T06:03:06.274 INFO:teuthology.orchestra.run.smithi122.stdout:created 2024-09-17T06:03:06.277007+0000 2024-09-17T06:03:06.274 INFO:teuthology.orchestra.run.smithi122.stdout:min_mon_release 17 (quincy) 2024-09-17T06:03:06.275 INFO:teuthology.orchestra.run.smithi122.stdout:election_strategy: 1 2024-09-17T06:03:06.275 INFO:teuthology.orchestra.run.smithi122.stdout:0: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.a 2024-09-17T06:03:06.275 INFO:teuthology.orchestra.run.smithi122.stdout:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-09-17T06:03:06.275 INFO:teuthology.orchestra.run.smithi122.stdout:2: [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] mon.c 2024-09-17T06:03:06.275 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T06:03:06.279 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T06:03:06.284 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5aff0fc3-254a-48aa-be08-0081a34bd09c... 2024-09-17T06:03:06.285 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T06:03:06.327 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T06:03:06.349 INFO:teuthology.orchestra.run.smithi122.stdout:[global] 2024-09-17T06:03:06.350 INFO:teuthology.orchestra.run.smithi122.stdout: chdir = "" 2024-09-17T06:03:06.350 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T06:03:06.350 INFO:teuthology.orchestra.run.smithi122.stdout: auth supported = cephx 2024-09-17T06:03:06.350 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.350 INFO:teuthology.orchestra.run.smithi122.stdout: filestore xattr use omap = true 2024-09-17T06:03:06.350 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.350 INFO:teuthology.orchestra.run.smithi122.stdout: mon clock drift allowed = 1.000 2024-09-17T06:03:06.350 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.350 INFO:teuthology.orchestra.run.smithi122.stdout: osd crush chooseleaf type = 0 2024-09-17T06:03:06.350 INFO:teuthology.orchestra.run.smithi122.stdout: auth debug = true 2024-09-17T06:03:06.350 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on old message = true 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on bug = true 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: mon pg warn max object skew = 0 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default size = 2 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow primary affinity = true 2024-09-17T06:03:06.351 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow pg remap = true 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on legacy crush tunables = false 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on crush straw calc version zero = false 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on no sortbitwise = false 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on osd down out interval zero = false 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on too few osds = false 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: mon_allow_pool_size_one = true 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: osd default data pool replay window = 5 2024-09-17T06:03:06.352 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout: mon allow pool delete = true 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout: mon cluster log file level = debug 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout: debug asserts on shutdown = true 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout: mon health detail to clog = false 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout: mon host = "172.21.15.122,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout: fsid = 5aff0fc3-254a-48aa-be08-0081a34bd09c 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout:[osd] 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout: osd journal size = 100 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub load threshold = 5.0 2024-09-17T06:03:06.353 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub max interval = 600 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: osd mclock profile = high_recovery_ops 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: osd recover clone overlap = true 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: osd recovery max chunk = 1048576 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug shutdown = true 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug op order = true 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug verify stray on activate = true 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug trim objects = true 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: osd open classes on start = true 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug pg log writeout = true 2024-09-17T06:03:06.354 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: osd deep scrub update digest min age = 30 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: osd map max advance = 10 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: journal zero on create = true 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: filestore ondisk finisher threads = 3 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: filestore apply finisher threads = 3 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: bdev debug aio = true 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug misdirected ops = true 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore block size = 96636764160 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore fsck on mount = True 2024-09-17T06:03:06.355 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluefs = 20 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluestore = 20 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout: debug osd = 20 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout: debug rocksdb = 10 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd full ratio = 0.9 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd nearfull ratio = 0.8 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout: osd blocked scrub grace period = 3600 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout: osd failsafe full ratio = 0.95 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout: osd max markdown count = 1000 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout: osd objectstore = bluestore 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.356 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr] 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgr = 20 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: mgr/telemetry/nag = false 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout:[mon] 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: debug paxos = 20 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-09-17T06:03:06.357 INFO:teuthology.orchestra.run.smithi122.stdout: mon data avail warn = 5 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: mon mgr mkfs grace = 240 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd reporter subtree level = osd 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd prime pg temp = true 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T06:03:06.358 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout: # 1m isn't quite enough 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout: mon_down_mkfs_grace = 2m 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_filestore_osds = false 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout: mon down mkfs grace = 300 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout:[client] 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout: rgw cache enabled = true 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable ops log = true 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable usage log = true 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout: client_shutdown_timeout = 120 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.a] 2024-09-17T06:03:06.359 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.b] 2024-09-17T06:03:06.360 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.c] 2024-09-17T06:03:06.360 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2024-09-17T06:03:06.360 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.c] 2024-09-17T06:03:06.360 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.e] 2024-09-17T06:03:06.360 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.b] 2024-09-17T06:03:06.360 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.d] 2024-09-17T06:03:06.360 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.f] 2024-09-17T06:03:06.360 INFO:teuthology.orchestra.run.smithi122.stdout:[mds] 2024-09-17T06:03:06.360 INFO:teuthology.orchestra.run.smithi122.stdout: mds oft prefetch dirfrags = True 2024-09-17T06:03:06.360 INFO:teuthology.orchestra.run.smithi122.stdout: mds_sleep_rank_change = 5000000.0 2024-09-17T06:03:06.361 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2024-09-17T06:03:06.361 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2024-09-17T06:03:06.361 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T06:03:06.361 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2024-09-17T06:03:06.361 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.361 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2024-09-17T06:03:06.361 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.361 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2024-09-17T06:03:06.361 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.361 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2024-09-17T06:03:06.361 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2024-09-17T06:03:06.361 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2024-09-17T06:03:06.362 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2024-09-17T06:03:06.363 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.364 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2024-09-17T06:03:06.364 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.364 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2024-09-17T06:03:06.364 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2024-09-17T06:03:06.364 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2024-09-17T06:03:06.364 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.122,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2024-09-17T06:03:06.364 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = 5aff0fc3-254a-48aa-be08-0081a34bd09c 2024-09-17T06:03:06.364 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.364 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2024-09-17T06:03:06.364 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2024-09-17T06:03:06.364 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.364 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug trim objects = true 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2024-09-17T06:03:06.365 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2024-09-17T06:03:06.366 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 20 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 20 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 10 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout: osd blocked scrub grace period = 3600 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout: osd max markdown count = 1000 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.367 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2024-09-17T06:03:06.368 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T06:03:06.369 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: mon down mkfs grace = 300 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T06:03:06.370 INFO:teuthology.orchestra.run.smithi173.stdout: client_shutdown_timeout = 120 2024-09-17T06:03:06.371 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2024-09-17T06:03:06.371 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2024-09-17T06:03:06.371 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2024-09-17T06:03:06.371 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2024-09-17T06:03:06.371 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2024-09-17T06:03:06.371 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.e] 2024-09-17T06:03:06.371 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2024-09-17T06:03:06.371 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2024-09-17T06:03:06.371 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.f] 2024-09-17T06:03:06.371 INFO:teuthology.orchestra.run.smithi173.stdout:[mds] 2024-09-17T06:03:06.371 INFO:teuthology.orchestra.run.smithi173.stdout: mds oft prefetch dirfrags = True 2024-09-17T06:03:06.371 INFO:teuthology.orchestra.run.smithi173.stdout: mds_sleep_rank_change = 5000000.0 2024-09-17T06:03:06.373 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T06:03:06.373 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T06:03:06.494 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T06:03:06.494 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:06.495 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T06:03:06.499 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:06.500 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T06:03:06.545 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T06:03:06.546 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:06.546 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T06:03:06.546 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T06:03:06.609 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:06.609 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:06.654 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi173.front.sepia.ceph.com 2024-09-17T06:03:06.654 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:06.654 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T06:03:06.654 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T06:03:06.677 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:06.677 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:06.724 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T06:03:06.724 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T06:03:06.725 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T06:03:06.797 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T06:03:06.804 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T06:03:06.878 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T06:03:06.890 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T06:03:06.890 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T06:03:06.963 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T06:03:06.969 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T06:03:06.983 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T06:03:07.086 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T06:03:07.092 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T06:03:07.103 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-17T06:03:07.204 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-17T06:03:07.211 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-17T06:03:07.221 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T06:03:07.297 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T06:03:07.303 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T06:03:07.314 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T06:03:07.418 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T06:03:07.424 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T06:03:07.435 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-09-17T06:03:07.536 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-09-17T06:03:07.542 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-09-17T06:03:07.551 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T06:03:07.551 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T06:03:07.617 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T06:03:07.630 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T06:03:07.630 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T06:03:07.631 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T06:03:07.642 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T06:03:07.642 INFO:tasks.ceph:role: osd.0 2024-09-17T06:03:07.642 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T06:03:07.643 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T06:03:07.710 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T06:03:07.710 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T06:03:07.710 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T06:03:07.710 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T06:03:07.710 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T06:03:07.710 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-09-17T06:03:07.710 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T06:03:07.710 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T06:03:07.711 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T06:03:07.711 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T06:03:08.166 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-09-17T06:03:08.168 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-09-17T06:03:08.168 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T06:03:08.253 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T06:03:08.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T06:03:08.305 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T06:03:08.305 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T06:03:08.361 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T06:03:08.361 INFO:tasks.ceph:role: osd.1 2024-09-17T06:03:08.361 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T06:03:08.361 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T06:03:08.423 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T06:03:08.423 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T06:03:08.423 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T06:03:08.423 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T06:03:08.423 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T06:03:08.423 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-09-17T06:03:08.423 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T06:03:08.423 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T06:03:08.423 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T06:03:08.423 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T06:03:08.909 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-09-17T06:03:08.911 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-09-17T06:03:08.912 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T06:03:09.066 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T06:03:09.078 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T06:03:09.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T06:03:09.079 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T06:03:09.134 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T06:03:09.134 INFO:tasks.ceph:role: osd.2 2024-09-17T06:03:09.134 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T06:03:09.134 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T06:03:09.202 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T06:03:09.202 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T06:03:09.202 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T06:03:09.202 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T06:03:09.203 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T06:03:09.203 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-09-17T06:03:09.203 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T06:03:09.203 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T06:03:09.203 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T06:03:09.203 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T06:03:09.657 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-09-17T06:03:09.659 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-09-17T06:03:09.659 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T06:03:09.798 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T06:03:09.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T06:03:09.810 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T06:03:09.810 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T06:03:09.866 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T06:03:09.866 INFO:tasks.ceph:role: osd.3 2024-09-17T06:03:09.866 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T06:03:09.866 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T06:03:09.930 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T06:03:09.930 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T06:03:09.930 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T06:03:09.930 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T06:03:09.930 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T06:03:09.930 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-09-17T06:03:09.930 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T06:03:09.930 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T06:03:09.930 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T06:03:09.931 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T06:03:10.356 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-09-17T06:03:10.358 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-09-17T06:03:10.359 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T06:03:10.452 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T06:03:10.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T06:03:10.462 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T06:03:10.462 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:10.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:10.607+0000 7f8b949367c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T06:03:10.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:10.611+0000 7f8b949367c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T06:03:10.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:10.611+0000 7f8b949367c0 -1 bdev(0x561e700eaa00 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T06:03:10.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:10.611+0000 7f8b949367c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T06:03:13.771 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T06:03:13.785 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:13.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:13.899+0000 7f88ae71c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T06:03:13.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:13.899+0000 7f88ae71c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T06:03:13.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:13.903+0000 7f88ae71c7c0 -1 bdev(0x5629cbe92a00 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T06:03:13.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:13.903+0000 7f88ae71c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T06:03:17.041 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T06:03:17.055 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:17.167 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:17.167+0000 7f7f98b517c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T06:03:17.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:17.167+0000 7f7f98b517c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T06:03:17.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:17.167+0000 7f7f98b517c0 -1 bdev(0x560fb8494a00 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T06:03:17.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:17.167+0000 7f7f98b517c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T06:03:20.321 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T06:03:20.333 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:20.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:20.447+0000 7fdc0c9fe7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T06:03:20.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:20.447+0000 7fdc0c9fe7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T06:03:20.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:20.447+0000 7fdc0c9fe7c0 -1 bdev(0x562dfbcd8a00 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T06:03:20.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:20.447+0000 7fdc0c9fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T06:03:23.582 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T06:03:23.596 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T06:03:23.611 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T06:03:23.611 INFO:tasks.ceph:role: osd.4 2024-09-17T06:03:23.611 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-17T06:03:23.611 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T06:03:23.675 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T06:03:23.675 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T06:03:23.676 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T06:03:23.676 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T06:03:23.676 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T06:03:23.676 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-09-17T06:03:23.676 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T06:03:23.676 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T06:03:23.676 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T06:03:23.676 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T06:03:24.167 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-09-17T06:03:24.170 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-09-17T06:03:24.170 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T06:03:24.313 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T06:03:24.325 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T06:03:24.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T06:03:24.326 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T06:03:24.380 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T06:03:24.380 INFO:tasks.ceph:role: osd.5 2024-09-17T06:03:24.380 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-17T06:03:24.381 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T06:03:24.444 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T06:03:24.444 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T06:03:24.444 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T06:03:24.444 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T06:03:24.444 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T06:03:24.444 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-09-17T06:03:24.444 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T06:03:24.444 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T06:03:24.444 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T06:03:24.445 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T06:03:24.892 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-09-17T06:03:24.894 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-09-17T06:03:24.895 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T06:03:24.981 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T06:03:25.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T06:03:25.034 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T06:03:25.034 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T06:03:25.087 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T06:03:25.087 INFO:tasks.ceph:role: osd.6 2024-09-17T06:03:25.087 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-17T06:03:25.087 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T06:03:25.152 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T06:03:25.152 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T06:03:25.152 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T06:03:25.152 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T06:03:25.152 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T06:03:25.152 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-09-17T06:03:25.152 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T06:03:25.152 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T06:03:25.152 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T06:03:25.153 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T06:03:25.604 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-09-17T06:03:25.606 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-09-17T06:03:25.606 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T06:03:25.736 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T06:03:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T06:03:25.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T06:03:25.748 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T06:03:25.804 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T06:03:25.804 INFO:tasks.ceph:role: osd.7 2024-09-17T06:03:25.804 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-17T06:03:25.804 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T06:03:25.868 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T06:03:25.868 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T06:03:25.868 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T06:03:25.868 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T06:03:25.868 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T06:03:25.868 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-09-17T06:03:25.868 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T06:03:25.868 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T06:03:25.868 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T06:03:25.869 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T06:03:26.360 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-09-17T06:03:26.362 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-09-17T06:03:26.362 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T06:03:26.499 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T06:03:26.510 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T06:03:26.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T06:03:26.511 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:26.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:26.658+0000 7f4b4f78c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T06:03:26.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:26.662+0000 7f4b4f78c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T06:03:26.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:26.662+0000 7f4b4f78c7c0 -1 bdev(0x56374c0e4a00 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T06:03:26.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:26.662+0000 7f4b4f78c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T06:03:29.780 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T06:03:29.793 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:29.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:29.902+0000 7f01163847c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T06:03:29.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:29.902+0000 7f01163847c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T06:03:29.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:29.902+0000 7f01163847c0 -1 bdev(0x56451a808a00 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T06:03:29.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:29.902+0000 7f01163847c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T06:03:33.024 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T06:03:33.037 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:33.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:33.146+0000 7f2a1df357c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T06:03:33.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:33.150+0000 7f2a1df357c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T06:03:33.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:33.150+0000 7f2a1df357c0 -1 bdev(0x55f62e296a00 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T06:03:33.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:33.150+0000 7f2a1df357c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T06:03:34.627 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:03:34.630 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:03:36.285 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T06:03:36.300 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:36.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:36.410+0000 7fc1e27737c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T06:03:36.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:36.410+0000 7fc1e27737c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T06:03:36.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:36.410+0000 7fc1e27737c0 -1 bdev(0x5618f32c2a00 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T06:03:36.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:36.410+0000 7fc1e27737c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T06:03:39.550 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T06:03:39.563 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T06:03:39.563 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:39.563 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T06:03:39.577 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:39.578 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T06:03:39.633 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:39.633 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T06:03:39.690 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:39.690 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-17T06:03:39.745 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:39.745 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T06:03:39.801 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:39.801 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T06:03:39.857 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:39.857 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T06:03:39.915 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:39.915 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T06:03:39.969 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:39.969 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T06:03:39.983 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:39.983 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T06:03:40.039 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:40.039 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T06:03:40.095 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:40.095 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-09-17T06:03:40.150 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:40.150 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T06:03:40.208 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:40.208 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T06:03:40.263 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:40.263 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T06:03:40.318 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:40.318 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T06:03:40.370 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:40.370 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T06:03:40.376 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T06:03:40.376 DEBUG:teuthology.orchestra.run.smithi122:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T06:03:40.419 DEBUG:teuthology.orchestra.run.smithi173:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T06:03:40.428 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.y] 2024-09-17T06:03:40.428 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCaG+lmX920LxAAbUfyOrfRY7oeFdXSKNLzBg== 2024-09-17T06:03:40.428 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2024-09-17T06:03:40.429 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCaG+lmfKiXORAA6r8TWqSx/ByM8WNczz2E0w== 2024-09-17T06:03:40.429 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.c] 2024-09-17T06:03:40.429 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCbG+lmSipRBRAAzabaO4Y3dq5oF2Wz/c18WA== 2024-09-17T06:03:40.429 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.e] 2024-09-17T06:03:40.429 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCbG+lmZWdfDBAAZ0dU3KlU8sADRqFAlUlJSA== 2024-09-17T06:03:40.429 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.0] 2024-09-17T06:03:40.429 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCeG+lm7rJgJBAAk+jbZbt9/oSCLT1bi8E6Lw== 2024-09-17T06:03:40.429 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.1] 2024-09-17T06:03:40.429 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQChG+lmHRLlNRAAWOTu18nYNqzdSmEBjX8U4A== 2024-09-17T06:03:40.429 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.2] 2024-09-17T06:03:40.429 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQClG+lmYJEpChAAEw9qMjIV4WIGYZ90iWbD/A== 2024-09-17T06:03:40.429 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.3] 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCoG+lmPRjaGhAAQF8KVMRYTthSG+jVI7fSNA== 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.x] 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCaG+lmiAGONBAAKCwMQP+zUMlfWArt3LWCMg== 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.b] 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCbG+lmQADkERAAXwYq7XHceMm0JSshIsGlWQ== 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.d] 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCbG+lmNtgXGRAABRIh4A5hjA1+UXUU2j25YQ== 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.f] 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCbG+lmX/4iIBAAjxayqgc2fhvXP9/Tf/03qg== 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.4] 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCuG+lmllKRJxAAs4wCqT3BgEI/t7dJHq5ItA== 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.5] 2024-09-17T06:03:40.430 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCxG+lm9QUWNhAAZLay+/CYYwTenizO+WzzCA== 2024-09-17T06:03:40.431 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.6] 2024-09-17T06:03:40.431 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC1G+lmsY0yCRAAqmCUJYNSmhyZESrxeBQDoQ== 2024-09-17T06:03:40.431 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.7] 2024-09-17T06:03:40.431 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC4G+lm7NnLGBAAj5973eaPf9/AwPFIv/wARQ== 2024-09-17T06:03:40.431 INFO:teuthology.orchestra.run.smithi122.stdout:[client.0] 2024-09-17T06:03:40.431 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCbG+lmANLqJBAAiteouKql0Gy+2XjVvZlhQg== 2024-09-17T06:03:40.432 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.y] 2024-09-17T06:03:40.432 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCaG+lmX920LxAAbUfyOrfRY7oeFdXSKNLzBg== 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCaG+lmfKiXORAA6r8TWqSx/ByM8WNczz2E0w== 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCbG+lmSipRBRAAzabaO4Y3dq5oF2Wz/c18WA== 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.e] 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCbG+lmZWdfDBAAZ0dU3KlU8sADRqFAlUlJSA== 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.0] 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCeG+lm7rJgJBAAk+jbZbt9/oSCLT1bi8E6Lw== 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.1] 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQChG+lmHRLlNRAAWOTu18nYNqzdSmEBjX8U4A== 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.2] 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQClG+lmYJEpChAAEw9qMjIV4WIGYZ90iWbD/A== 2024-09-17T06:03:40.433 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.3] 2024-09-17T06:03:40.434 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCoG+lmPRjaGhAAQF8KVMRYTthSG+jVI7fSNA== 2024-09-17T06:03:40.434 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.x] 2024-09-17T06:03:40.434 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCaG+lmiAGONBAAKCwMQP+zUMlfWArt3LWCMg== 2024-09-17T06:03:40.434 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2024-09-17T06:03:40.434 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCbG+lmQADkERAAXwYq7XHceMm0JSshIsGlWQ== 2024-09-17T06:03:40.434 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2024-09-17T06:03:40.434 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCbG+lmNtgXGRAABRIh4A5hjA1+UXUU2j25YQ== 2024-09-17T06:03:40.434 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.f] 2024-09-17T06:03:40.434 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCbG+lmX/4iIBAAjxayqgc2fhvXP9/Tf/03qg== 2024-09-17T06:03:40.434 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.4] 2024-09-17T06:03:40.434 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCuG+lmllKRJxAAs4wCqT3BgEI/t7dJHq5ItA== 2024-09-17T06:03:40.434 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.5] 2024-09-17T06:03:40.435 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCxG+lm9QUWNhAAZLay+/CYYwTenizO+WzzCA== 2024-09-17T06:03:40.435 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.6] 2024-09-17T06:03:40.435 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQC1G+lmsY0yCRAAqmCUJYNSmhyZESrxeBQDoQ== 2024-09-17T06:03:40.435 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.7] 2024-09-17T06:03:40.435 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQC4G+lm7NnLGBAAj5973eaPf9/AwPFIv/wARQ== 2024-09-17T06:03:40.435 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-09-17T06:03:40.435 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCbG+lmANLqJBAAiteouKql0Gy+2XjVvZlhQg== 2024-09-17T06:03:40.435 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T06:03:40.475 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T06:03:40.554 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T06:03:40.557 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T06:03:40.631 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T06:03:40.634 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T06:03:40.706 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T06:03:40.709 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T06:03:40.782 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:40.784 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:40.855 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:40.857 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:40.928 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:40.930 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:40.999 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:41.002 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:41.071 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T06:03:41.073 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T06:03:41.147 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T06:03:41.149 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T06:03:41.226 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T06:03:41.228 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T06:03:41.305 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T06:03:41.307 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T06:03:41.379 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:41.382 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:41.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:41.457 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:41.526 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:41.528 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:41.597 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:41.599 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T06:03:41.670 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T06:03:41.672 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T06:03:41.744 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T06:03:41.744 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T06:03:41.754 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T06:03:41.868 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T06:03:41.878 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T06:03:41.891 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T06:03:42.019 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T06:03:42.029 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T06:03:42.080 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T06:03:42.198 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T06:03:42.207 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:42.209 DEBUG:teuthology.orchestra.run.smithi173:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T06:03:42.255 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T06:03:42.255 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T06:03:42.255 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T06:03:42.258 INFO:tasks.ceph.mon.a:Started 2024-09-17T06:03:42.259 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T06:03:42.259 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T06:03:42.300 INFO:tasks.ceph.mon.b:Started 2024-09-17T06:03:42.300 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T06:03:42.301 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T06:03:42.302 INFO:tasks.ceph.mon.c:Started 2024-09-17T06:03:42.303 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T06:03:42.303 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T06:03:42.303 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T06:03:42.305 INFO:tasks.ceph.mgr.y:Started 2024-09-17T06:03:42.305 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T06:03:42.306 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T06:03:42.309 INFO:tasks.ceph.mgr.x:Started 2024-09-17T06:03:42.310 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T06:03:42.310 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T06:03:42.313 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T06:03:42.313 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T06:03:42.358 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T06:03:42.358 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T06:03:42.402 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T06:03:42.402 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T06:03:42.446 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T06:03:42.446 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T06:03:42.494 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T06:03:42.494 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T06:03:42.542 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T06:03:42.542 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T06:03:42.586 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T06:03:42.586 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T06:03:42.630 INFO:tasks.ceph:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-17T06:03:42.630 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds mds_bal_fragment_size_max 10000 2024-09-17T06:03:42.678 INFO:tasks.ceph:setting config [mds] mds_bal_merge_size = 5 2024-09-17T06:03:42.678 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-17T06:03:42.722 INFO:tasks.ceph:setting config [mds] mds_bal_split_bits = 3 2024-09-17T06:03:42.722 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds mds_bal_split_bits 3 2024-09-17T06:03:42.766 INFO:tasks.ceph:setting config [mds] mds_bal_split_size = 100 2024-09-17T06:03:42.766 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-17T06:03:42.810 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T06:03:42.810 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T06:03:42.854 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T06:03:42.854 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T06:03:42.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.878+0000 7fd9ba255640 1 -- 172.21.15.122:0/605739999 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd994005090 con 0x7fd9b4158860 2024-09-17T06:03:42.881 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T06:03:42.881 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T06:03:42.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.886+0000 7fd9a9ffb640 1 -- 172.21.15.122:0/605739999 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd9b001a970 con 0x7fd9b4158860 2024-09-17T06:03:42.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.886+0000 7f16c9c65640 1 -- 172.21.15.122:0/1458314041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16c4156b40 msgr2=0x7f16c4156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:42.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.886+0000 7f16c9c65640 1 --2- 172.21.15.122:0/1458314041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16c4156b40 0x7f16c4156f50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f16c40cafa0 tx=0x7f16bc00ed20 comp rx=0 tx=0).stop 2024-09-17T06:03:42.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.886+0000 7f77899c5640 1 -- 172.21.15.122:0/667212625 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f7764000e70 con 0x7f7784151100 2024-09-17T06:03:42.887 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T06:03:42.887 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T06:03:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.886+0000 7f16c9c65640 1 -- 172.21.15.122:0/1458314041 shutdown_connections 2024-09-17T06:03:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.886+0000 7f16c9c65640 1 --2- 172.21.15.122:0/1458314041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16c4156b40 0x7f16c4156f50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.886+0000 7f16c9c65640 1 --2- 172.21.15.122:0/1458314041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16c4155c10 0x7f16c414b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.886+0000 7f16c9c65640 1 --2- 172.21.15.122:0/1458314041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f16c406d7e0 0x7f16c414af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.886+0000 7f16c9c65640 1 -- 172.21.15.122:0/1458314041 >> 172.21.15.122:0/1458314041 conn(0x7f16c40cd4f0 msgr2=0x7f16c40c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.886+0000 7f16c9c65640 1 -- 172.21.15.122:0/1458314041 shutdown_connections 2024-09-17T06:03:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.886+0000 7f16c9c65640 1 -- 172.21.15.122:0/1458314041 wait complete. 2024-09-17T06:03:42.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.890+0000 7f62227fc640 1 -- 172.21.15.122:0/2072244983 <== mon.0 v2:172.21.15.122:3300/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7f622400a3c0 con 0x7f622c13d0d0 2024-09-17T06:03:42.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.890+0000 7fd9a9ffb640 1 -- 172.21.15.122:0/605739999 <== mon.0 v2:172.21.15.122:3300/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7fd9b001ab50 con 0x7fd9b4158860 2024-09-17T06:03:42.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.890+0000 7f046f736640 1 -- 172.21.15.122:0/2387892839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04680c70b0 msgr2=0x7f04680ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:42.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.890+0000 7f046f736640 1 --2- 172.21.15.122:0/2387892839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04680c70b0 0x7f04680ccb60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0460009c80 tx=0x7f046001f3e0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.894+0000 7f76237fe640 1 -- 172.21.15.122:0/2390264846 <== mon.2 v2:172.21.15.173:3301/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7f76300af620 con 0x7f763c0c3ae0 2024-09-17T06:03:42.895 INFO:tasks.ceph:setting config [mds] mds_dir_prefetch = True 2024-09-17T06:03:42.896 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds mds_dir_prefetch True 2024-09-17T06:03:42.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.894+0000 7f046f736640 1 -- 172.21.15.122:0/2387892839 shutdown_connections 2024-09-17T06:03:42.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.894+0000 7f046f736640 1 --2- 172.21.15.122:0/2387892839 >> v2:172.21.15.122:3300/0 conn(0x7f04680cd0a0 0x7f0468150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.894+0000 7f046f736640 1 --2- 172.21.15.122:0/2387892839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04680c70b0 0x7f04680ccb60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.894+0000 7f76237fe640 1 -- 172.21.15.122:0/2390264846 <== mon.2 v2:172.21.15.173:3301/0 9 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v3)=0 v3) ==== 114+0+0 (secure 0 0 0) 0x7f763c1554d0 con 0x7f763c0c3ae0 2024-09-17T06:03:42.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.894+0000 7f776bfff640 1 -- 172.21.15.122:0/667212625 <== mon.1 v2:172.21.15.173:3300/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7f777801cb40 con 0x7f7784151100 2024-09-17T06:03:42.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.894+0000 7f046f736640 1 -- 172.21.15.122:0/2387892839 >> 172.21.15.122:0/2387892839 conn(0x7f0468071e70 msgr2=0x7f0468072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:42.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.894+0000 7f046f736640 1 -- 172.21.15.122:0/2387892839 shutdown_connections 2024-09-17T06:03:42.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.894+0000 7f046f736640 1 -- 172.21.15.122:0/2387892839 wait complete. 2024-09-17T06:03:42.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.894+0000 7f57c97fa640 1 -- 172.21.15.122:0/1177147469 <== mon.1 v2:172.21.15.173:3300/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7f57c40103c0 con 0x7f57cc156af0 2024-09-17T06:03:42.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7ff31ffff640 1 -- 172.21.15.122:0/838429523 <== mon.1 v2:172.21.15.173:3300/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7ff330011bb0 con 0x7ff3380c6bc0 2024-09-17T06:03:42.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f046f736640 1 Processor -- start 2024-09-17T06:03:42.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f57d2cd8640 1 -- 172.21.15.122:0/1177147469 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f57a4005110 con 0x7f57cc156af0 2024-09-17T06:03:42.900 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T06:03:42.900 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T06:03:42.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f046f736640 1 -- start start 2024-09-17T06:03:42.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f046f736640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04680c70b0 0x7f046815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:42.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f046f736640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04680c9bb0 0x7f0468147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:42.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f046d4d2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04680c70b0 0x7f046815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:42.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f046ccd1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04680c9bb0 0x7f0468147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:42.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f046ccd1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04680c9bb0 0x7f0468147390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44460/0 (socket says 172.21.15.122:44460) 2024-09-17T06:03:42.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f046d4d2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04680c70b0 0x7f046815b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:44440/0 (socket says 172.21.15.122:44440) 2024-09-17T06:03:42.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f046ccd1640 1 -- 172.21.15.122:0/1809818474 learned_addr learned my addr 172.21.15.122:0/1809818474 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:42.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f046f736640 1 --2- 172.21.15.122:0/1809818474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04680cd0a0 0x7f04681598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:42.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f046f736640 1 -- 172.21.15.122:0/1809818474 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f04680c6ab0 con 0x7f04680c9bb0 2024-09-17T06:03:42.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.898+0000 7f046f736640 1 -- 172.21.15.122:0/1809818474 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f04680c67d0 con 0x7f04680cd0a0 2024-09-17T06:03:42.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f046f736640 1 -- 172.21.15.122:0/1809818474 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f04680cc640 con 0x7f04680c70b0 2024-09-17T06:03:42.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f046dcd3640 1 --2- 172.21.15.122:0/1809818474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04680cd0a0 0x7f04681598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:42.903 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T06:03:42.903 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T06:03:42.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f046ccd1640 1 -- 172.21.15.122:0/1809818474 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04680c70b0 msgr2=0x7f046815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:42.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f046ccd1640 1 --2- 172.21.15.122:0/1809818474 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04680c70b0 0x7f046815b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f046ccd1640 1 -- 172.21.15.122:0/1809818474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04680cd0a0 msgr2=0x7f04681598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:42.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f046ccd1640 1 --2- 172.21.15.122:0/1809818474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04680cd0a0 0x7f04681598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f046ccd1640 1 -- 172.21.15.122:0/1809818474 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04680cce50 con 0x7f04680c9bb0 2024-09-17T06:03:42.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f046ccd1640 1 --2- 172.21.15.122:0/1809818474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04680c9bb0 0x7f0468147390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f046001fc80 tx=0x7f046001c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:42.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f76237fe640 1 -- 172.21.15.122:0/2390264846 <== mon.2 v2:172.21.15.173:3301/0 10 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f76300af890 con 0x7f763c0c3ae0 2024-09-17T06:03:42.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f62227fc640 1 -- 172.21.15.122:0/2072244983 <== mon.0 v2:172.21.15.122:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f62240aed80 con 0x7f622c13d0d0 2024-09-17T06:03:42.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f776bfff640 1 -- 172.21.15.122:0/667212625 <== mon.1 v2:172.21.15.173:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f777801cdf0 con 0x7f7784151100 2024-09-17T06:03:42.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f776bfff640 1 -- 172.21.15.122:0/667212625 <== mon.1 v2:172.21.15.173:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v4)=0 v4) ==== 123+0+0 (secure 0 0 0) 0x7f77780107f0 con 0x7f7784151100 2024-09-17T06:03:42.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7f57c97fa640 1 -- 172.21.15.122:0/1177147469 <== mon.1 v2:172.21.15.173:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f57c40105f0 con 0x7f57cc156af0 2024-09-17T06:03:42.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7ff31ffff640 1 -- 172.21.15.122:0/838429523 <== mon.1 v2:172.21.15.173:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7ff330011de0 con 0x7ff3380c6bc0 2024-09-17T06:03:42.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.902+0000 7fd9a9ffb640 1 -- 172.21.15.122:0/605739999 <== mon.0 v2:172.21.15.122:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fd9b001ad00 con 0x7fd9b4158860 2024-09-17T06:03:42.907 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T06:03:42.907 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T06:03:42.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.906+0000 7f77899c5640 1 -- 172.21.15.122:0/667212625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7784151100 msgr2=0x7f7784200ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:42.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.906+0000 7f77899c5640 1 --2- 172.21.15.122:0/667212625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7784151100 0x7f7784200ea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f77840c4830 tx=0x7f777800daf0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f045dffb640 1 -- 172.21.15.122:0/1809818474 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04600b4070 con 0x7f04680c9bb0 2024-09-17T06:03:42.911 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-17T06:03:42.911 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-17T06:03:42.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f77899c5640 1 -- 172.21.15.122:0/667212625 shutdown_connections 2024-09-17T06:03:42.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f77899c5640 1 --2- 172.21.15.122:0/667212625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77842013e0 0x7f77840c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f77899c5640 1 --2- 172.21.15.122:0/667212625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7784151100 0x7f7784200ea0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f77899c5640 1 --2- 172.21.15.122:0/667212625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f776c004d50 0x7f7784204040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f045dffb640 1 -- 172.21.15.122:0/1809818474 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f04600b5040 con 0x7f04680c9bb0 2024-09-17T06:03:42.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f046f736640 1 -- 172.21.15.122:0/1809818474 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046815b540 con 0x7f04680c9bb0 2024-09-17T06:03:42.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f046f736640 1 -- 172.21.15.122:0/1809818474 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0468151700 con 0x7f04680c9bb0 2024-09-17T06:03:42.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f045dffb640 1 -- 172.21.15.122:0/1809818474 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0460004030 con 0x7f04680c9bb0 2024-09-17T06:03:42.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f77899c5640 1 -- 172.21.15.122:0/667212625 >> 172.21.15.122:0/667212625 conn(0x7f7784070e40 msgr2=0x7f77840c5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:42.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f77899c5640 1 -- 172.21.15.122:0/667212625 shutdown_connections 2024-09-17T06:03:42.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f77899c5640 1 -- 172.21.15.122:0/667212625 wait complete. 2024-09-17T06:03:42.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f045dffb640 1 -- 172.21.15.122:0/1809818474 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f04600c1020 con 0x7f04680c9bb0 2024-09-17T06:03:42.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.910+0000 7f045dffb640 1 -- 172.21.15.122:0/1809818474 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f04600ba420 con 0x7f04680c9bb0 2024-09-17T06:03:42.915 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-17T06:03:42.915 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-17T06:03:42.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.914+0000 7f62227fc640 1 -- 172.21.15.122:0/2072244983 <== mon.0 v2:172.21.15.122:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f62240baa90 con 0x7f622c13d0d0 2024-09-17T06:03:42.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.914+0000 7fd9a9ffb640 1 -- 172.21.15.122:0/605739999 <== mon.0 v2:172.21.15.122:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fd9b0010440 con 0x7fd9b4158860 2024-09-17T06:03:42.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.914+0000 7f045dffb640 1 -- 172.21.15.122:0/1809818474 <== mon.0 v2:172.21.15.122:3300/0 6 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f04600ba6f0 con 0x7f04680c9bb0 2024-09-17T06:03:42.918 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-17T06:03:42.918 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-17T06:03:42.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.918+0000 7f57c97fa640 1 -- 172.21.15.122:0/1177147469 <== mon.1 v2:172.21.15.173:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f57c40195c0 con 0x7f57cc156af0 2024-09-17T06:03:42.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.918+0000 7f57c97fa640 1 -- 172.21.15.122:0/1177147469 <== mon.1 v2:172.21.15.173:3300/0 11 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f57c4019820 con 0x7f57cc156af0 2024-09-17T06:03:42.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.918+0000 7ff31ffff640 1 -- 172.21.15.122:0/838429523 <== mon.1 v2:172.21.15.173:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7ff330004040 con 0x7ff3380c6bc0 2024-09-17T06:03:42.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.918+0000 7f76237fe640 1 -- 172.21.15.122:0/2390264846 <== mon.2 v2:172.21.15.173:3301/0 11 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f76300afb90 con 0x7f763c0c3ae0 2024-09-17T06:03:42.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.918+0000 7f57d2cd8640 1 -- 172.21.15.122:0/1177147469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57cc156af0 msgr2=0x7f57cc148d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:42.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.918+0000 7f57d2cd8640 1 --2- 172.21.15.122:0/1177147469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57cc156af0 0x7f57cc148d20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f57c4002240 tx=0x7f57c40064f0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.921 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-17T06:03:42.921 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-17T06:03:42.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.922+0000 7f62341e3640 1 -- 172.21.15.122:0/2072244983 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f6208005110 con 0x7f622c13d0d0 2024-09-17T06:03:42.925 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T06:03:42.925 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T06:03:42.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.926+0000 7f7641020640 1 -- 172.21.15.122:0/2390264846 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f763c0c3ae0 msgr2=0x7f763c13d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:42.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.926+0000 7f7641020640 1 --2- 172.21.15.122:0/2390264846 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f763c0c3ae0 0x7f763c13d170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f763001cbb0 tx=0x7f7624005840 comp rx=0 tx=0).stop 2024-09-17T06:03:42.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.926+0000 7f046f736640 1 -- 172.21.15.122:0/1809818474 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0440005090 con 0x7f04680c9bb0 2024-09-17T06:03:42.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.926+0000 7f7641020640 1 -- 172.21.15.122:0/2390264846 shutdown_connections 2024-09-17T06:03:42.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.926+0000 7f7641020640 1 --2- 172.21.15.122:0/2390264846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f763c13d6b0 0x7f763c155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.926+0000 7f7641020640 1 --2- 172.21.15.122:0/2390264846 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f763c0c3ae0 0x7f763c13d170 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.926+0000 7f7641020640 1 --2- 172.21.15.122:0/2390264846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76240040e0 0x7f763c157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.926+0000 7f7641020640 1 -- 172.21.15.122:0/2390264846 >> 172.21.15.122:0/2390264846 conn(0x7f763c0ca380 msgr2=0x7f763c13f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:42.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.926+0000 7f7641020640 1 -- 172.21.15.122:0/2390264846 shutdown_connections 2024-09-17T06:03:42.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.926+0000 7f7641020640 1 -- 172.21.15.122:0/2390264846 wait complete. 2024-09-17T06:03:42.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.934+0000 7f62227fc640 1 -- 172.21.15.122:0/2072244983 <== mon.0 v2:172.21.15.122:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f622c0700a0 con 0x7f622c13d0d0 2024-09-17T06:03:42.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.934+0000 7f62227fc640 1 -- 172.21.15.122:0/2072244983 <== mon.0 v2:172.21.15.122:3300/0 12 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62240bad90 con 0x7f622c13d0d0 2024-09-17T06:03:42.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.934+0000 7fd9a9ffb640 1 -- 172.21.15.122:0/605739999 <== mon.0 v2:172.21.15.122:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9b0010880 con 0x7fd9b4158860 2024-09-17T06:03:42.938 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T06:03:42.938 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T06:03:42.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.938+0000 7ff31ffff640 1 -- 172.21.15.122:0/838429523 <== mon.1 v2:172.21.15.173:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3300042d0 con 0x7ff3380c6bc0 2024-09-17T06:03:42.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.942+0000 7f57d2cd8640 1 -- 172.21.15.122:0/1177147469 shutdown_connections 2024-09-17T06:03:42.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.942+0000 7f57d2cd8640 1 --2- 172.21.15.122:0/1177147469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57cc156af0 0x7f57cc148d20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.942+0000 7f57d2cd8640 1 --2- 172.21.15.122:0/1177147469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f57cc156130 0x7f57cc1487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.942+0000 7f57d2cd8640 1 --2- 172.21.15.122:0/1177147469 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57bc004810 0x7f57cc15ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.942+0000 7f57d2cd8640 1 -- 172.21.15.122:0/1177147469 >> 172.21.15.122:0/1177147469 conn(0x7f57cc070c10 msgr2=0x7f57cc150c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:42.942 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T06:03:42.942 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T06:03:42.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.942+0000 7f57d2cd8640 1 -- 172.21.15.122:0/1177147469 shutdown_connections 2024-09-17T06:03:42.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.942+0000 7f57d2cd8640 1 -- 172.21.15.122:0/1177147469 wait complete. 2024-09-17T06:03:42.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.946+0000 7f045dffb640 1 -- 172.21.15.122:0/1809818474 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f04600c8020 con 0x7f04680c9bb0 2024-09-17T06:03:42.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.946+0000 7f045dffb640 1 -- 172.21.15.122:0/1809818474 <== mon.0 v2:172.21.15.122:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04600098a0 con 0x7f04680c9bb0 2024-09-17T06:03:42.947 DEBUG:tasks.ceph:set 27 configs 2024-09-17T06:03:42.948 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi122') 2024-09-17T06:03:42.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.954+0000 7f620ffff640 1 -- 172.21.15.122:0/2072244983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f622c13d0d0 msgr2=0x7f622c13d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:42.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.954+0000 7f620ffff640 1 --2- 172.21.15.122:0/2072244983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f622c13d0d0 0x7f622c13d4e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6224098eb0 tx=0x7f622401a160 comp rx=0 tx=0).stop 2024-09-17T06:03:42.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.962+0000 7f620ffff640 1 -- 172.21.15.122:0/2072244983 shutdown_connections 2024-09-17T06:03:42.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.962+0000 7f620ffff640 1 --2- 172.21.15.122:0/2072244983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f622c13d0d0 0x7f622c13d4e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.962+0000 7f620ffff640 1 --2- 172.21.15.122:0/2072244983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f622c0c28a0 0x7f622c0c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.962+0000 7f620ffff640 1 --2- 172.21.15.122:0/2072244983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f622c0c3d10 0x7f622c15ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:42.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.962+0000 7f620ffff640 1 -- 172.21.15.122:0/2072244983 >> 172.21.15.122:0/2072244983 conn(0x7f622c0ca380 msgr2=0x7f622c153190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:42.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.962+0000 7f620ffff640 1 -- 172.21.15.122:0/2072244983 shutdown_connections 2024-09-17T06:03:42.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.962+0000 7f620ffff640 1 -- 172.21.15.122:0/2072244983 wait complete. 2024-09-17T06:03:42.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.974+0000 7ff33dfcc640 1 -- 172.21.15.122:0/838429523 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7ff310005300 con 0x7ff3380c6bc0 2024-09-17T06:03:42.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:42.990+0000 7ff31ffff640 1 -- 172.21.15.122:0/838429523 <== mon.1 v2:172.21.15.173:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7ff330019430 con 0x7ff3380c6bc0 2024-09-17T06:03:43.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.022+0000 7ff33dfcc640 1 -- 172.21.15.122:0/838429523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3380c6bc0 msgr2=0x7ff338139fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.022+0000 7ff33dfcc640 1 --2- 172.21.15.122:0/838429523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3380c6bc0 0x7ff338139fa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff33000f770 tx=0x7ff33000fb70 comp rx=0 tx=0).stop 2024-09-17T06:03:43.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.026+0000 7ff33dfcc640 1 -- 172.21.15.122:0/838429523 shutdown_connections 2024-09-17T06:03:43.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.026+0000 7ff33dfcc640 1 --2- 172.21.15.122:0/838429523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3380c6bc0 0x7ff338139fa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.026+0000 7ff33dfcc640 1 --2- 172.21.15.122:0/838429523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3381f32d0 0x7ff3380c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.026+0000 7ff33dfcc640 1 --2- 172.21.15.122:0/838429523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff320004810 0x7ff3381563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.026+0000 7ff33dfcc640 1 -- 172.21.15.122:0/838429523 >> 172.21.15.122:0/838429523 conn(0x7ff3380ca380 msgr2=0x7ff33813dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.026+0000 7ff33dfcc640 1 -- 172.21.15.122:0/838429523 shutdown_connections 2024-09-17T06:03:43.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.026+0000 7ff33dfcc640 1 -- 172.21.15.122:0/838429523 wait complete. 2024-09-17T06:03:43.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.030+0000 7ff4e58c2640 1 -- 172.21.15.122:0/1930028676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4e0164b60 msgr2=0x7ff4e0166f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.030+0000 7ff4e58c2640 1 --2- 172.21.15.122:0/1930028676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4e0164b60 0x7ff4e0166f80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009bc0 tx=0x7ff4d801c8e0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.034 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.034 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.034 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.054+0000 7ff4e58c2640 1 -- 172.21.15.122:0/1930028676 shutdown_connections 2024-09-17T06:03:43.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.054+0000 7ff4e58c2640 1 --2- 172.21.15.122:0/1930028676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4e0164b60 0x7ff4e0166f80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.054+0000 7ff4e58c2640 1 -- 172.21.15.122:0/1930028676 >> 172.21.15.122:0/1930028676 conn(0x7ff4e006d290 msgr2=0x7ff4e006d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.054+0000 7ff4e58c2640 1 -- 172.21.15.122:0/1930028676 shutdown_connections 2024-09-17T06:03:43.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.054+0000 7ff4e58c2640 1 -- 172.21.15.122:0/1930028676 wait complete. 2024-09-17T06:03:43.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.054+0000 7ff4e58c2640 1 Processor -- start 2024-09-17T06:03:43.058 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.058 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.054+0000 7ff4e58c2640 1 -- start start 2024-09-17T06:03:43.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4e58c2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4e00c5e60 0x7ff4e015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4e58c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e01551b0 0x7ff4e00ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4e58c2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4e0164b60 0x7ff4e014d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4e58c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e00c7740 con 0x7ff4e01551b0 2024-09-17T06:03:43.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4e58c2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e00c75c0 con 0x7ff4e0164b60 2024-09-17T06:03:43.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4dffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e01551b0 0x7ff4e00ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4e58c2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff4e00c7e70 con 0x7ff4e00c5e60 2024-09-17T06:03:43.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4dffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e01551b0 0x7ff4e00ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44462/0 (socket says 172.21.15.122:44462) 2024-09-17T06:03:43.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4dffff640 1 -- 172.21.15.122:0/2139234913 learned_addr learned my addr 172.21.15.122:0/2139234913 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4e48c0640 1 --2- 172.21.15.122:0/2139234913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4e00c5e60 0x7ff4e015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4e50c1640 1 --2- 172.21.15.122:0/2139234913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4e0164b60 0x7ff4e014d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4dffff640 1 -- 172.21.15.122:0/2139234913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4e00c5e60 msgr2=0x7ff4e015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4dffff640 1 --2- 172.21.15.122:0/2139234913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4e00c5e60 0x7ff4e015a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4dffff640 1 -- 172.21.15.122:0/2139234913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4e0164b60 msgr2=0x7ff4e014d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4dffff640 1 --2- 172.21.15.122:0/2139234913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4e0164b60 0x7ff4e014d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4dffff640 1 -- 172.21.15.122:0/2139234913 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e00cb990 con 0x7ff4e01551b0 2024-09-17T06:03:43.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.058+0000 7ff4dffff640 1 --2- 172.21.15.122:0/2139234913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e01551b0 0x7ff4e00ccd40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400c530 tx=0x7ff4d400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.074+0000 7ff4dd7fa640 1 -- 172.21.15.122:0/2139234913 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4017070 con 0x7ff4e01551b0 2024-09-17T06:03:43.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.074+0000 7ff4dd7fa640 1 -- 172.21.15.122:0/2139234913 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4d4003600 con 0x7ff4e01551b0 2024-09-17T06:03:43.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.074+0000 7ff4dd7fa640 1 -- 172.21.15.122:0/2139234913 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4003a50 con 0x7ff4e01551b0 2024-09-17T06:03:43.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.074+0000 7ff4e58c2640 1 -- 172.21.15.122:0/2139234913 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e00cbc70 con 0x7ff4e01551b0 2024-09-17T06:03:43.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.074+0000 7ff4e58c2640 1 -- 172.21.15.122:0/2139234913 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e0159d50 con 0x7ff4e01551b0 2024-09-17T06:03:43.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.082+0000 7ff4dd7fa640 1 -- 172.21.15.122:0/2139234913 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff4d401a070 con 0x7ff4e01551b0 2024-09-17T06:03:43.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.082+0000 7ff4dd7fa640 1 -- 172.21.15.122:0/2139234913 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff4d4012740 con 0x7ff4e01551b0 2024-09-17T06:03:43.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.090+0000 7ff4e58c2640 1 -- 172.21.15.122:0/2139234913 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4bc0052a0 con 0x7ff4e01551b0 2024-09-17T06:03:43.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.094+0000 7ff4dd7fa640 1 -- 172.21.15.122:0/2139234913 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff4d4021020 con 0x7ff4e01551b0 2024-09-17T06:03:43.115 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.170+0000 7fc77480a640 1 -- 172.21.15.122:0/124766930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7700c7a00 msgr2=0x7fc7700c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.170+0000 7fc77480a640 1 --2- 172.21.15.122:0/124766930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7700c7a00 0x7fc7700c9a30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc760009840 tx=0x7fc76001c2d0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.170+0000 7fc77480a640 1 -- 172.21.15.122:0/124766930 shutdown_connections 2024-09-17T06:03:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.170+0000 7fc77480a640 1 --2- 172.21.15.122:0/124766930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7700c7a00 0x7fc7700c9a30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.170+0000 7fc77480a640 1 -- 172.21.15.122:0/124766930 >> 172.21.15.122:0/124766930 conn(0x7fc77006d290 msgr2=0x7fc77006d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.170+0000 7fc77480a640 1 -- 172.21.15.122:0/124766930 shutdown_connections 2024-09-17T06:03:43.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.170+0000 7fc77480a640 1 -- 172.21.15.122:0/124766930 wait complete. 2024-09-17T06:03:43.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.174+0000 7fc77480a640 1 Processor -- start 2024-09-17T06:03:43.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.174+0000 7fc77480a640 1 -- start start 2024-09-17T06:03:43.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.174+0000 7fc77480a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc770071690 0x7fc7701588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc77480a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7700c7a00 0x7fc770155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc77480a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7700c9620 0x7fc77014a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc77480a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc7700c6b60 con 0x7fc7700c7a00 2024-09-17T06:03:43.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc76f7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc770071690 0x7fc7701588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc77480a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc7700c6060 con 0x7fc7700c9620 2024-09-17T06:03:43.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc76f7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc770071690 0x7fc7701588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:44456/0 (socket says 172.21.15.122:44456) 2024-09-17T06:03:43.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc77480a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc770167940 con 0x7fc770071690 2024-09-17T06:03:43.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc76f7fe640 1 -- 172.21.15.122:0/3406617386 learned_addr learned my addr 172.21.15.122:0/3406617386 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc76effd640 1 --2- 172.21.15.122:0/3406617386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7700c7a00 0x7fc770155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc76ffff640 1 --2- 172.21.15.122:0/3406617386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7700c9620 0x7fc77014a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc76effd640 1 -- 172.21.15.122:0/3406617386 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc770071690 msgr2=0x7fc7701588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc76effd640 1 --2- 172.21.15.122:0/3406617386 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc770071690 0x7fc7701588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc76effd640 1 -- 172.21.15.122:0/3406617386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7700c9620 msgr2=0x7fc77014a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc76effd640 1 --2- 172.21.15.122:0/3406617386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7700c9620 0x7fc77014a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc76effd640 1 -- 172.21.15.122:0/3406617386 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7701562f0 con 0x7fc7700c7a00 2024-09-17T06:03:43.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.178+0000 7fc76effd640 1 --2- 172.21.15.122:0/3406617386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7700c7a00 0x7fc770155db0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc7700740f0 tx=0x7fc76400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.186+0000 7fc757fff640 1 -- 172.21.15.122:0/3406617386 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc764018070 con 0x7fc7700c7a00 2024-09-17T06:03:43.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.186+0000 7fc77480a640 1 -- 172.21.15.122:0/3406617386 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc770157840 con 0x7fc7700c7a00 2024-09-17T06:03:43.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.186+0000 7fc77480a640 1 -- 172.21.15.122:0/3406617386 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc770155890 con 0x7fc7700c7a00 2024-09-17T06:03:43.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.186+0000 7fc757fff640 1 -- 172.21.15.122:0/3406617386 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc764007030 con 0x7fc7700c7a00 2024-09-17T06:03:43.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.186+0000 7fc757fff640 1 -- 172.21.15.122:0/3406617386 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc764007480 con 0x7fc7700c7a00 2024-09-17T06:03:43.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.186+0000 7fc757fff640 1 -- 172.21.15.122:0/3406617386 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc76401b070 con 0x7fc7700c7a00 2024-09-17T06:03:43.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.186+0000 7fc757fff640 1 -- 172.21.15.122:0/3406617386 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc764003d90 con 0x7fc7700c7a00 2024-09-17T06:03:43.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.198+0000 7fc77480a640 1 -- 172.21.15.122:0/3406617386 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7500052a0 con 0x7fc7700c7a00 2024-09-17T06:03:43.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.202+0000 7fc757fff640 1 -- 172.21.15.122:0/3406617386 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc764022080 con 0x7fc7700c7a00 2024-09-17T06:03:43.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.218+0000 7f046f736640 1 -- 172.21.15.122:0/1809818474 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f0440005650 con 0x7f04680c9bb0 2024-09-17T06:03:43.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.226+0000 7f045dffb640 1 -- 172.21.15.122:0/1809818474 <== mon.0 v2:172.21.15.122:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v8)=0 v8) ==== 106+0+0 (secure 0 0 0) 0x7f04680cd4b0 con 0x7f04680c9bb0 2024-09-17T06:03:43.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.246+0000 7f046f736640 1 -- 172.21.15.122:0/1809818474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04680c9bb0 msgr2=0x7f0468147390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.246+0000 7f046f736640 1 --2- 172.21.15.122:0/1809818474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04680c9bb0 0x7f0468147390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f046001fc80 tx=0x7f046001c180 comp rx=0 tx=0).stop 2024-09-17T06:03:43.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.246+0000 7f046f736640 1 -- 172.21.15.122:0/1809818474 shutdown_connections 2024-09-17T06:03:43.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.246+0000 7f046f736640 1 --2- 172.21.15.122:0/1809818474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04680cd0a0 0x7f04681598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.246+0000 7f046f736640 1 --2- 172.21.15.122:0/1809818474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04680c9bb0 0x7f0468147390 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.246+0000 7f046f736640 1 --2- 172.21.15.122:0/1809818474 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04680c70b0 0x7f046815b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.246+0000 7f046f736640 1 -- 172.21.15.122:0/1809818474 >> 172.21.15.122:0/1809818474 conn(0x7f0468071e70 msgr2=0x7f04680c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.246+0000 7f046f736640 1 -- 172.21.15.122:0/1809818474 shutdown_connections 2024-09-17T06:03:43.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.246+0000 7f046f736640 1 -- 172.21.15.122:0/1809818474 wait complete. 2024-09-17T06:03:43.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.294+0000 7fd9ba255640 1 -- 172.21.15.122:0/605739999 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fd98c005300 con 0x7fd9b4158860 2024-09-17T06:03:43.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.298+0000 7fd9a9ffb640 1 -- 172.21.15.122:0/605739999 <== mon.0 v2:172.21.15.122:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v9)=0 v9) ==== 117+0+0 (secure 0 0 0) 0x7fd9b0010b10 con 0x7fd9b4158860 2024-09-17T06:03:43.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.318+0000 7fa797fff640 1 -- 172.21.15.122:0/2802901297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7980cc5d0 msgr2=0x7fa7980cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.318+0000 7fa797fff640 1 --2- 172.21.15.122:0/2802901297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7980cc5d0 0x7fa7980cc9e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa790009bc0 tx=0x7fa79001ca50 comp rx=0 tx=0).stop 2024-09-17T06:03:43.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.318+0000 7fa797fff640 1 -- 172.21.15.122:0/2802901297 shutdown_connections 2024-09-17T06:03:43.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.318+0000 7fa797fff640 1 --2- 172.21.15.122:0/2802901297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7980cc5d0 0x7fa7980cc9e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.318+0000 7fa797fff640 1 --2- 172.21.15.122:0/2802901297 >> v2:172.21.15.173:3300/0 conn(0x7fa7980c4590 0x7fa798151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.318+0000 7fa797fff640 1 -- 172.21.15.122:0/2802901297 >> 172.21.15.122:0/2802901297 conn(0x7fa798071cc0 msgr2=0x7fa7980720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.318+0000 7fa797fff640 1 -- 172.21.15.122:0/2802901297 shutdown_connections 2024-09-17T06:03:43.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.318+0000 7fa797fff640 1 -- 172.21.15.122:0/2802901297 wait complete. 2024-09-17T06:03:43.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.318+0000 7fa797fff640 1 Processor -- start 2024-09-17T06:03:43.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.318+0000 7fa797fff640 1 -- start start 2024-09-17T06:03:43.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa797fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7980c4590 0x7fa798147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa797fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7980c6870 0x7fa798150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa797fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7980cc5d0 0x7fa798144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa797fff640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa7980c7040 con 0x7fa7980c6870 2024-09-17T06:03:43.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa797fff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa7980c9de0 con 0x7fa7980c4590 2024-09-17T06:03:43.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa797fff640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa798147c10 con 0x7fa7980cc5d0 2024-09-17T06:03:43.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa7967fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7980c6870 0x7fa798150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa7967fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7980c6870 0x7fa798150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44512/0 (socket says 172.21.15.122:44512) 2024-09-17T06:03:43.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa7967fc640 1 -- 172.21.15.122:0/1892440817 learned_addr learned my addr 172.21.15.122:0/1892440817 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa796ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7980c4590 0x7fa798147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa7977fe640 1 --2- 172.21.15.122:0/1892440817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7980cc5d0 0x7fa798144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa796ffd640 1 -- 172.21.15.122:0/1892440817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7980cc5d0 msgr2=0x7fa798144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa796ffd640 1 --2- 172.21.15.122:0/1892440817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7980cc5d0 0x7fa798144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa796ffd640 1 -- 172.21.15.122:0/1892440817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7980c6870 msgr2=0x7fa798150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa796ffd640 1 --2- 172.21.15.122:0/1892440817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7980c6870 0x7fa798150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa796ffd640 1 -- 172.21.15.122:0/1892440817 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa798147740 con 0x7fa7980c4590 2024-09-17T06:03:43.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa7977fe640 1 --2- 172.21.15.122:0/1892440817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7980cc5d0 0x7fa798144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:03:43.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa7967fc640 1 --2- 172.21.15.122:0/1892440817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7980c6870 0x7fa798150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:03:43.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.322+0000 7fa796ffd640 1 --2- 172.21.15.122:0/1892440817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7980c4590 0x7fa798147200 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa78800c520 tx=0x7fa78800c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.326+0000 7fd9ba255640 1 -- 172.21.15.122:0/605739999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9b4158860 msgr2=0x7fd9b4147f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.326+0000 7fd9ba255640 1 --2- 172.21.15.122:0/605739999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9b4158860 0x7fd9b4147f30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000c310 tx=0x7fd9b000c7d0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.326+0000 7fa77f7fe640 1 -- 172.21.15.122:0/1892440817 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788017070 con 0x7fa7980c4590 2024-09-17T06:03:43.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.326+0000 7fa77f7fe640 1 -- 172.21.15.122:0/1892440817 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa788003600 con 0x7fa7980c4590 2024-09-17T06:03:43.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.326+0000 7fa77f7fe640 1 -- 172.21.15.122:0/1892440817 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788003a50 con 0x7fa7980c4590 2024-09-17T06:03:43.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.326+0000 7fa797fff640 1 -- 172.21.15.122:0/1892440817 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79814d7f0 con 0x7fa7980c4590 2024-09-17T06:03:43.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.326+0000 7fa797fff640 1 -- 172.21.15.122:0/1892440817 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7980c31d0 con 0x7fa7980c4590 2024-09-17T06:03:43.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.326+0000 7f8547827640 1 -- 172.21.15.122:0/2265067353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85400c5670 msgr2=0x7f85400c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.326+0000 7f8547827640 1 --2- 172.21.15.122:0/2265067353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85400c5670 0x7f85400c65b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f85400c8370 tx=0x7f853c01c900 comp rx=0 tx=0).stop 2024-09-17T06:03:43.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.326+0000 7fa77f7fe640 1 -- 172.21.15.122:0/1892440817 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa78801a070 con 0x7fa7980c4590 2024-09-17T06:03:43.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.326+0000 7fa77f7fe640 1 -- 172.21.15.122:0/1892440817 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa788012740 con 0x7fa7980c4590 2024-09-17T06:03:43.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fd9ba255640 1 -- 172.21.15.122:0/605739999 shutdown_connections 2024-09-17T06:03:43.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fa2f7544640 1 -- 172.21.15.122:0/2364931085 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f014db30 msgr2=0x7fa2f0157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fa2f7544640 1 --2- 172.21.15.122:0/2364931085 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f014db30 0x7fa2f0157a10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0073f90 tx=0x7fa2e801f5c0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fd9ba255640 1 --2- 172.21.15.122:0/605739999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9b4158860 0x7fd9b4147f30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fd9ba255640 1 --2- 172.21.15.122:0/605739999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9b4158450 0x7fd9b414d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fd9ba255640 1 --2- 172.21.15.122:0/605739999 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9b414e820 0x7fd9b41eef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fd9ba255640 1 -- 172.21.15.122:0/605739999 >> 172.21.15.122:0/605739999 conn(0x7fd9b406d290 msgr2=0x7fd9b40ca5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fa2f7544640 1 -- 172.21.15.122:0/2364931085 shutdown_connections 2024-09-17T06:03:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fa2f7544640 1 --2- 172.21.15.122:0/2364931085 >> v2:172.21.15.122:3300/0 conn(0x7fa2f00c59b0 0x7fa2f0161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fa2f7544640 1 --2- 172.21.15.122:0/2364931085 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f014db30 0x7fa2f0157a10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fa2f7544640 1 -- 172.21.15.122:0/2364931085 >> 172.21.15.122:0/2364931085 conn(0x7fa2f006d290 msgr2=0x7fa2f006d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7f8547827640 1 -- 172.21.15.122:0/2265067353 shutdown_connections 2024-09-17T06:03:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7f8547827640 1 --2- 172.21.15.122:0/2265067353 >> v2:172.21.15.173:3300/0 conn(0x7f85401588b0 0x7f85400ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7f8547827640 1 --2- 172.21.15.122:0/2265067353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85400c5670 0x7f85400c65b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7f8547827640 1 -- 172.21.15.122:0/2265067353 >> 172.21.15.122:0/2265067353 conn(0x7f854006d290 msgr2=0x7f854006d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fd9ba255640 1 -- 172.21.15.122:0/605739999 shutdown_connections 2024-09-17T06:03:43.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fa2f7544640 1 -- 172.21.15.122:0/2364931085 shutdown_connections 2024-09-17T06:03:43.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fd9ba255640 1 -- 172.21.15.122:0/605739999 wait complete. 2024-09-17T06:03:43.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7f8547827640 1 -- 172.21.15.122:0/2265067353 shutdown_connections 2024-09-17T06:03:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7f8547827640 1 -- 172.21.15.122:0/2265067353 wait complete. 2024-09-17T06:03:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.330+0000 7fa2f7544640 1 -- 172.21.15.122:0/2364931085 wait complete. 2024-09-17T06:03:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.334+0000 7fa2f7544640 1 Processor -- start 2024-09-17T06:03:43.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.334+0000 7fa2f7544640 1 -- start start 2024-09-17T06:03:43.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.334+0000 7f8547827640 1 Processor -- start 2024-09-17T06:03:43.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.334+0000 7fa2f7544640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f00c55a0 0x7fa2f01ef670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f7544640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2f00c59b0 0x7fa2f01edc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f52e0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f00c55a0 0x7fa2f01ef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f52e0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f00c55a0 0x7fa2f01ef670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:38670/0 (socket says 172.21.15.122:38670) 2024-09-17T06:03:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.334+0000 7f8547827640 1 -- start start 2024-09-17T06:03:43.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f8547827640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85400c5670 0x7f85401592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f4adf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2f00c59b0 0x7fa2f01edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f52e0640 1 -- 172.21.15.122:0/2397439331 learned_addr learned my addr 172.21.15.122:0/2397439331 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f7544640 1 --2- 172.21.15.122:0/2397439331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f014db30 0x7fa2f01507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f7544640 1 -- 172.21.15.122:0/2397439331 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f01517b0 con 0x7fa2f00c59b0 2024-09-17T06:03:43.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f7544640 1 -- 172.21.15.122:0/2397439331 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f01571a0 con 0x7fa2f00c55a0 2024-09-17T06:03:43.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f8547827640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85400cd0c0 0x7f8540151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f8547827640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85401588b0 0x7f8540154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f5ae1640 1 --2- 172.21.15.122:0/2397439331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f014db30 0x7fa2f01507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f7544640 1 -- 172.21.15.122:0/2397439331 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f014df40 con 0x7fa2f014db30 2024-09-17T06:03:43.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f85455c3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85400c5670 0x7f85401592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f85455c3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85400c5670 0x7f85401592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:38682/0 (socket says 172.21.15.122:38682) 2024-09-17T06:03:43.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f85455c3640 1 -- 172.21.15.122:0/1075809516 learned_addr learned my addr 172.21.15.122:0/1075809516 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f8547827640 1 -- 172.21.15.122:0/1075809516 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f85401523e0 con 0x7f85400cd0c0 2024-09-17T06:03:43.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f8547827640 1 -- 172.21.15.122:0/1075809516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8540158cc0 con 0x7f85400c5670 2024-09-17T06:03:43.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f8545dc4640 1 --2- 172.21.15.122:0/1075809516 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85401588b0 0x7f8540154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f8547827640 1 -- 172.21.15.122:0/1075809516 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8540162fc0 con 0x7f85401588b0 2024-09-17T06:03:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f4adf640 1 -- 172.21.15.122:0/2397439331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f014db30 msgr2=0x7fa2f01507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f4adf640 1 --2- 172.21.15.122:0/2397439331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f014db30 0x7fa2f01507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f4adf640 1 -- 172.21.15.122:0/2397439331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f00c55a0 msgr2=0x7fa2f01ef670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f4adf640 1 --2- 172.21.15.122:0/2397439331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f00c55a0 0x7fa2f01ef670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f4adf640 1 -- 172.21.15.122:0/2397439331 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f01eeed0 con 0x7fa2f00c59b0 2024-09-17T06:03:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f5ae1640 1 --2- 172.21.15.122:0/2397439331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f014db30 0x7fa2f01507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:03:43.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7fa2f4adf640 1 --2- 172.21.15.122:0/2397439331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2f00c59b0 0x7fa2f01edc70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000b410 tx=0x7fa2e000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f85455c3640 1 -- 172.21.15.122:0/1075809516 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85401588b0 msgr2=0x7f8540154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f85455c3640 1 --2- 172.21.15.122:0/1075809516 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85401588b0 0x7f8540154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f85455c3640 1 -- 172.21.15.122:0/1075809516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85400cd0c0 msgr2=0x7f8540151b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T06:03:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f85455c3640 1 --2- 172.21.15.122:0/1075809516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85400cd0c0 0x7f8540151b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f85455c3640 1 -- 172.21.15.122:0/1075809516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8540159810 con 0x7f85400c5670 2024-09-17T06:03:43.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.338+0000 7f85455c3640 1 --2- 172.21.15.122:0/1075809516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85400c5670 0x7f85401592d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f853c000c10 tx=0x7f853c004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.342+0000 7f8535ffb640 1 -- 172.21.15.122:0/1075809516 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c0b2040 con 0x7f85400c5670 2024-09-17T06:03:43.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.342+0000 7f8535ffb640 1 -- 172.21.15.122:0/1075809516 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f853c0ba070 con 0x7f85400c5670 2024-09-17T06:03:43.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.342+0000 7f8547827640 1 -- 172.21.15.122:0/1075809516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85400ccd80 con 0x7f85400c5670 2024-09-17T06:03:43.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.342+0000 7f8547827640 1 -- 172.21.15.122:0/1075809516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85401555f0 con 0x7f85400c5670 2024-09-17T06:03:43.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.346+0000 7f852b7fe640 1 -- 172.21.15.122:0/1075809516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8540163470 con 0x7f85400c5670 2024-09-17T06:03:43.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.350+0000 7f8535ffb640 1 -- 172.21.15.122:0/1075809516 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c005280 con 0x7f85400c5670 2024-09-17T06:03:43.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.350+0000 7fa77d7fa640 1 -- 172.21.15.122:0/1892440817 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7780052a0 con 0x7fa7980c4590 2024-09-17T06:03:43.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.350+0000 7f8535ffb640 1 -- 172.21.15.122:0/1075809516 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f853c004a60 con 0x7f85400c5670 2024-09-17T06:03:43.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.350+0000 7f8535ffb640 1 -- 172.21.15.122:0/1075809516 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f853c0b6930 con 0x7f85400c5670 2024-09-17T06:03:43.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.354+0000 7f8535ffb640 1 -- 172.21.15.122:0/1075809516 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f853c0cc020 con 0x7f85400c5670 2024-09-17T06:03:43.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.354+0000 7fa77f7fe640 1 -- 172.21.15.122:0/1892440817 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa788021020 con 0x7fa7980c4590 2024-09-17T06:03:43.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.362+0000 7fa2e5ffb640 1 -- 172.21.15.122:0/2397439331 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0015020 con 0x7fa2f00c59b0 2024-09-17T06:03:43.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.362+0000 7fa2e5ffb640 1 -- 172.21.15.122:0/2397439331 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2e0011920 con 0x7fa2f00c59b0 2024-09-17T06:03:43.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.362+0000 7fa2e5ffb640 1 -- 172.21.15.122:0/2397439331 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0011d70 con 0x7fa2f00c59b0 2024-09-17T06:03:43.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.362+0000 7fa2f7544640 1 -- 172.21.15.122:0/2397439331 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f01ee910 con 0x7fa2f00c59b0 2024-09-17T06:03:43.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.362+0000 7fa2f7544640 1 -- 172.21.15.122:0/2397439331 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f01eca60 con 0x7fa2f00c59b0 2024-09-17T06:03:43.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.366+0000 7fa2e5ffb640 1 -- 172.21.15.122:0/2397439331 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa2e0018020 con 0x7fa2f00c59b0 2024-09-17T06:03:43.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.366+0000 7fa2f7544640 1 -- 172.21.15.122:0/2397439331 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f015a7e0 con 0x7fa2f00c59b0 2024-09-17T06:03:43.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.366+0000 7fa2e5ffb640 1 -- 172.21.15.122:0/2397439331 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa2e00198d0 con 0x7fa2f00c59b0 2024-09-17T06:03:43.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.370+0000 7fa2e5ffb640 1 -- 172.21.15.122:0/2397439331 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa2e001f020 con 0x7fa2f00c59b0 2024-09-17T06:03:43.407 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.408 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.410+0000 7fb915a42640 1 -- 172.21.15.122:0/2350807087 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9100c6f60 msgr2=0x7fb9100c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.410+0000 7fb915a42640 1 --2- 172.21.15.122:0/2350807087 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9100c6f60 0x7fb9100c52c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb908009bc0 tx=0x7fb90801cbe0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.430+0000 7fb915a42640 1 -- 172.21.15.122:0/2350807087 shutdown_connections 2024-09-17T06:03:43.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.430+0000 7fb915a42640 1 --2- 172.21.15.122:0/2350807087 >> v2:172.21.15.122:3300/0 conn(0x7fb91015b1e0 0x7fb910150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.430+0000 7fb915a42640 1 --2- 172.21.15.122:0/2350807087 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9100c6f60 0x7fb9100c52c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.430+0000 7fb915a42640 1 -- 172.21.15.122:0/2350807087 >> 172.21.15.122:0/2350807087 conn(0x7fb91006d290 msgr2=0x7fb91006d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.430+0000 7fb915a42640 1 -- 172.21.15.122:0/2350807087 shutdown_connections 2024-09-17T06:03:43.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.430+0000 7fb915a42640 1 -- 172.21.15.122:0/2350807087 wait complete. 2024-09-17T06:03:43.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.430+0000 7fb915a42640 1 Processor -- start 2024-09-17T06:03:43.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.430+0000 7fb915a42640 1 -- start start 2024-09-17T06:03:43.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb915a42640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9100c6f60 0x7fb9101fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb915a42640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9100c7470 0x7fb910154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb915a42640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb91015b1e0 0x7fb91014f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb915a42640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb9100c68b0 con 0x7fb9100c6f60 2024-09-17T06:03:43.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb915a42640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb910153be0 con 0x7fb91015b1e0 2024-09-17T06:03:43.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb915a42640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb910155ad0 con 0x7fb9100c7470 2024-09-17T06:03:43.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb90effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9100c6f60 0x7fb9101fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb90effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9100c6f60 0x7fb9101fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44546/0 (socket says 172.21.15.122:44546) 2024-09-17T06:03:43.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb90effd640 1 -- 172.21.15.122:0/2794557738 learned_addr learned my addr 172.21.15.122:0/2794557738 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb90f7fe640 1 --2- 172.21.15.122:0/2794557738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb91015b1e0 0x7fb91014f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb90e7fc640 1 --2- 172.21.15.122:0/2794557738 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9100c7470 0x7fb910154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb90e7fc640 1 -- 172.21.15.122:0/2794557738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb91015b1e0 msgr2=0x7fb91014f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb90e7fc640 1 --2- 172.21.15.122:0/2794557738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb91015b1e0 0x7fb91014f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb90e7fc640 1 -- 172.21.15.122:0/2794557738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9100c6f60 msgr2=0x7fb9101fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb90e7fc640 1 --2- 172.21.15.122:0/2794557738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9100c6f60 0x7fb9101fcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb90e7fc640 1 -- 172.21.15.122:0/2794557738 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9101fc340 con 0x7fb9100c7470 2024-09-17T06:03:43.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.434+0000 7fb90e7fc640 1 --2- 172.21.15.122:0/2794557738 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9100c7470 0x7fb910154270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb910074e50 tx=0x7fb90400c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.454+0000 7fb8fffff640 1 -- 172.21.15.122:0/2794557738 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904017070 con 0x7fb9100c7470 2024-09-17T06:03:43.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.454+0000 7fb915a42640 1 -- 172.21.15.122:0/2794557738 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91016b060 con 0x7fb9100c7470 2024-09-17T06:03:43.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.454+0000 7fb915a42640 1 -- 172.21.15.122:0/2794557738 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9101fc8c0 con 0x7fb9100c7470 2024-09-17T06:03:43.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.454+0000 7fb8fffff640 1 -- 172.21.15.122:0/2794557738 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb904003600 con 0x7fb9100c7470 2024-09-17T06:03:43.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.454+0000 7fb8fffff640 1 -- 172.21.15.122:0/2794557738 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904003a50 con 0x7fb9100c7470 2024-09-17T06:03:43.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.454+0000 7fb8fffff640 1 -- 172.21.15.122:0/2794557738 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb90401a070 con 0x7fb9100c7470 2024-09-17T06:03:43.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.454+0000 7fb8fffff640 1 -- 172.21.15.122:0/2794557738 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb904012400 con 0x7fb9100c7470 2024-09-17T06:03:43.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.478+0000 7fb915a42640 1 -- 172.21.15.122:0/2794557738 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ec0052a0 con 0x7fb9100c7470 2024-09-17T06:03:43.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.482+0000 7fb8fffff640 1 -- 172.21.15.122:0/2794557738 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb904021020 con 0x7fb9100c7470 2024-09-17T06:03:43.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.514+0000 7f852b7fe640 1 -- 172.21.15.122:0/1075809516 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f854006db90 con 0x7f85400c5670 2024-09-17T06:03:43.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.522+0000 7f0db9e19640 1 -- 172.21.15.122:0/2129539080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db4165480 msgr2=0x7f0db40cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.522+0000 7f0db9e19640 1 --2- 172.21.15.122:0/2129539080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db4165480 0x7f0db40cc5d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009840 tx=0x7f0da401e960 comp rx=0 tx=0).stop 2024-09-17T06:03:43.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.522+0000 7f0db9e19640 1 -- 172.21.15.122:0/2129539080 shutdown_connections 2024-09-17T06:03:43.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.522+0000 7f0db9e19640 1 --2- 172.21.15.122:0/2129539080 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0db40c3cf0 0x7f0db40c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.522+0000 7f0db9e19640 1 --2- 172.21.15.122:0/2129539080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db4165480 0x7f0db40cc5d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.522+0000 7f0db9e19640 1 -- 172.21.15.122:0/2129539080 >> 172.21.15.122:0/2129539080 conn(0x7f0db4071cc0 msgr2=0x7f0db40720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.522+0000 7f0db9e19640 1 -- 172.21.15.122:0/2129539080 shutdown_connections 2024-09-17T06:03:43.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.522+0000 7f0db9e19640 1 -- 172.21.15.122:0/2129539080 wait complete. 2024-09-17T06:03:43.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f0db9e19640 1 Processor -- start 2024-09-17T06:03:43.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f8535ffb640 1 -- 172.21.15.122:0/1075809516 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v10)=0 v10) ==== 119+0+0 (secure 0 0 0) 0x7f853c0164f0 con 0x7f85400c5670 2024-09-17T06:03:43.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f0db9e19640 1 -- start start 2024-09-17T06:03:43.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f0db9e19640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0db40c3cf0 0x7f0db4209500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f0db9e19640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0db40ccb10 0x7f0db41604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f0db9e19640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db4165480 0x7f0db40c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f0db8e17640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0db40c3cf0 0x7f0db4209500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f0db8e17640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0db40c3cf0 0x7f0db4209500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44558/0 (socket says 172.21.15.122:44558) 2024-09-17T06:03:43.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7fc77480a640 1 -- 172.21.15.122:0/3406617386 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fc750005590 con 0x7fc7700c7a00 2024-09-17T06:03:43.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f0db8e17640 1 -- 172.21.15.122:0/722058762 learned_addr learned my addr 172.21.15.122:0/722058762 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f0db9e19640 1 -- 172.21.15.122:0/722058762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4074e10 con 0x7f0db40c3cf0 2024-09-17T06:03:43.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f0db9e19640 1 -- 172.21.15.122:0/722058762 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4074c90 con 0x7f0db4165480 2024-09-17T06:03:43.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f0db9e19640 1 -- 172.21.15.122:0/722058762 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0db40c5860 con 0x7f0db40ccb10 2024-09-17T06:03:43.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.526+0000 7f0db9618640 1 --2- 172.21.15.122:0/722058762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db4165480 0x7f0db40c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f0db9618640 1 -- 172.21.15.122:0/722058762 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0db40ccb10 msgr2=0x7f0db41604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f0db9618640 1 --2- 172.21.15.122:0/722058762 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0db40ccb10 0x7f0db41604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f0db9618640 1 -- 172.21.15.122:0/722058762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0db40c3cf0 msgr2=0x7f0db4209500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f0db9618640 1 --2- 172.21.15.122:0/722058762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0db40c3cf0 0x7f0db4209500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f0db9618640 1 -- 172.21.15.122:0/722058762 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db40c2cb0 con 0x7f0db4165480 2024-09-17T06:03:43.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f1be496b640 1 -- 172.21.15.122:0/1471648254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8003b00 msgr2=0x7f1bc8003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f1be496b640 1 --2- 172.21.15.122:0/1471648254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8003b00 0x7f1bc8003f70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8001cf0 tx=0x7f1bd801ca30 comp rx=0 tx=0).stop 2024-09-17T06:03:43.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f1be496b640 1 -- 172.21.15.122:0/1471648254 shutdown_connections 2024-09-17T06:03:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f1be496b640 1 --2- 172.21.15.122:0/1471648254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8003b00 0x7f1bc8003f70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f1be496b640 1 -- 172.21.15.122:0/1471648254 >> 172.21.15.122:0/1471648254 conn(0x7f1be006d290 msgr2=0x7f1be006d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f0db9618640 1 --2- 172.21.15.122:0/722058762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db4165480 0x7f0db40c1b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0da8005fd0 tx=0x7f0da800fb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f1be496b640 1 -- 172.21.15.122:0/1471648254 shutdown_connections 2024-09-17T06:03:43.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f1be496b640 1 -- 172.21.15.122:0/1471648254 wait complete. 2024-09-17T06:03:43.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f1be496b640 1 Processor -- start 2024-09-17T06:03:43.533 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7fc757fff640 1 -- 172.21.15.122:0/3406617386 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v11)=0 v11) ==== 116+0+0 (secure 0 0 0) 0x7fc764003600 con 0x7fc7700c7a00 2024-09-17T06:03:43.535 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.530+0000 7f1be496b640 1 -- start start 2024-09-17T06:03:43.535 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1be496b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8003b00 0x7f1be0152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.535 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1be496b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be014f280 0x7f1be00bb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.535 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1be496b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be00bb660 0x7f1be01f0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.535 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1be496b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1be00c68b0 con 0x7f1be00bb660 2024-09-17T06:03:43.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1be496b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1be00c60b0 con 0x7f1bc8003b00 2024-09-17T06:03:43.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1be496b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1be01543c0 con 0x7f1be014f280 2024-09-17T06:03:43.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1bde59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8003b00 0x7f1be0152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1bddd9b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be014f280 0x7f1be00bb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1bde59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8003b00 0x7f1be0152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:38752/0 (socket says 172.21.15.122:38752) 2024-09-17T06:03:43.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1bde59c640 1 -- 172.21.15.122:0/274277904 learned_addr learned my addr 172.21.15.122:0/274277904 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.536 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1bded9d640 1 --2- 172.21.15.122:0/274277904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be00bb660 0x7f1be01f0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1bde59c640 1 -- 172.21.15.122:0/274277904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be014f280 msgr2=0x7f1be00bb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1bde59c640 1 --2- 172.21.15.122:0/274277904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be014f280 0x7f1be00bb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1bde59c640 1 -- 172.21.15.122:0/274277904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be00bb660 msgr2=0x7f1be01f0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1bde59c640 1 --2- 172.21.15.122:0/274277904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be00bb660 0x7f1be01f0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1bde59c640 1 -- 172.21.15.122:0/274277904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be01ee850 con 0x7f1bc8003b00 2024-09-17T06:03:43.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7f1bde59c640 1 --2- 172.21.15.122:0/274277904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8003b00 0x7f1be0152c50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ab040 tx=0x7f1bd80a5d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7fc755ffb640 1 -- 172.21.15.122:0/3406617386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7700c7a00 msgr2=0x7fc770155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7fc755ffb640 1 --2- 172.21.15.122:0/3406617386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7700c7a00 0x7fc770155db0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc7700740f0 tx=0x7fc76400c960 comp rx=0 tx=0).stop 2024-09-17T06:03:43.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7fc755ffb640 1 -- 172.21.15.122:0/3406617386 shutdown_connections 2024-09-17T06:03:43.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7fc755ffb640 1 --2- 172.21.15.122:0/3406617386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7700c9620 0x7fc77014a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7fc755ffb640 1 --2- 172.21.15.122:0/3406617386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7700c7a00 0x7fc770155db0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7fc755ffb640 1 --2- 172.21.15.122:0/3406617386 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc770071690 0x7fc7701588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.534+0000 7fc755ffb640 1 -- 172.21.15.122:0/3406617386 >> 172.21.15.122:0/3406617386 conn(0x7fc77006d290 msgr2=0x7fc770072080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.538+0000 7f1bded9d640 1 --2- 172.21.15.122:0/274277904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be00bb660 0x7f1be01f0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:03:43.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.538+0000 7f0db17fa640 1 -- 172.21.15.122:0/722058762 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da800ddd0 con 0x7f0db4165480 2024-09-17T06:03:43.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.538+0000 7f0db17fa640 1 -- 172.21.15.122:0/722058762 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0da8004130 con 0x7f0db4165480 2024-09-17T06:03:43.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7f1bceffd640 1 -- 172.21.15.122:0/274277904 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8001920 con 0x7f1bc8003b00 2024-09-17T06:03:43.542 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7f1be496b640 1 -- 172.21.15.122:0/274277904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be0153190 con 0x7f1bc8003b00 2024-09-17T06:03:43.542 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7f1be496b640 1 -- 172.21.15.122:0/274277904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be0154610 con 0x7f1bc8003b00 2024-09-17T06:03:43.542 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7f1bceffd640 1 -- 172.21.15.122:0/274277904 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bd80061c0 con 0x7f1bc8003b00 2024-09-17T06:03:43.542 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7fc755ffb640 1 -- 172.21.15.122:0/3406617386 shutdown_connections 2024-09-17T06:03:43.542 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7fc755ffb640 1 -- 172.21.15.122:0/3406617386 wait complete. 2024-09-17T06:03:43.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7f0db17fa640 1 -- 172.21.15.122:0/722058762 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8005020 con 0x7f0db4165480 2024-09-17T06:03:43.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7f0db9e19640 1 -- 172.21.15.122:0/722058762 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db4209a40 con 0x7f0db4165480 2024-09-17T06:03:43.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7f0db9e19640 1 -- 172.21.15.122:0/722058762 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db415e760 con 0x7f0db4165480 2024-09-17T06:03:43.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7ff4e58c2640 1 -- 172.21.15.122:0/2139234913 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7ff4bc005590 con 0x7ff4e01551b0 2024-09-17T06:03:43.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7f1bceffd640 1 -- 172.21.15.122:0/274277904 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80065b0 con 0x7f1bc8003b00 2024-09-17T06:03:43.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7f1be496b640 1 -- 172.21.15.122:0/274277904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc40052a0 con 0x7f1bc8003b00 2024-09-17T06:03:43.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7f0db17fa640 1 -- 172.21.15.122:0/722058762 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0da80047b0 con 0x7f0db4165480 2024-09-17T06:03:43.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7f0db17fa640 1 -- 172.21.15.122:0/722058762 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0da801f3f0 con 0x7f0db4165480 2024-09-17T06:03:43.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.542+0000 7f0db9e19640 1 -- 172.21.15.122:0/722058762 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db40c7120 con 0x7f0db4165480 2024-09-17T06:03:43.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.546+0000 7f1bceffd640 1 -- 172.21.15.122:0/274277904 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1bd80ae430 con 0x7f1bc8003b00 2024-09-17T06:03:43.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.546+0000 7f1bceffd640 1 -- 172.21.15.122:0/274277904 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1bd80b7800 con 0x7f1bc8003b00 2024-09-17T06:03:43.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.546+0000 7ff4dd7fa640 1 -- 172.21.15.122:0/2139234913 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v12)=0 v12) ==== 127+0+0 (secure 0 0 0) 0x7ff4d4003da0 con 0x7ff4e01551b0 2024-09-17T06:03:43.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.550+0000 7f7b4b59e640 1 -- 172.21.15.122:0/4058491350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b4c157c50 msgr2=0x7f7b4c0c7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.550+0000 7f7b4b59e640 1 --2- 172.21.15.122:0/4058491350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b4c157c50 0x7f7b4c0c7160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0c9740 tx=0x7f7b3801c820 comp rx=0 tx=0).stop 2024-09-17T06:03:43.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.550+0000 7f7b4b59e640 1 -- 172.21.15.122:0/4058491350 shutdown_connections 2024-09-17T06:03:43.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.550+0000 7f7b4b59e640 1 --2- 172.21.15.122:0/4058491350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b4c157c50 0x7f7b4c0c7160 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.550+0000 7f7b4b59e640 1 --2- 172.21.15.122:0/4058491350 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b4c0c81d0 0x7f7b4c157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.550+0000 7f7b4b59e640 1 --2- 172.21.15.122:0/4058491350 >> v2:172.21.15.122:3300/0 conn(0x7f7b4c0c6780 0x7f7b4c151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.550+0000 7f7b4b59e640 1 -- 172.21.15.122:0/4058491350 >> 172.21.15.122:0/4058491350 conn(0x7f7b4c06d290 msgr2=0x7f7b4c06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.550+0000 7f852b7fe640 1 -- 172.21.15.122:0/1075809516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85400c5670 msgr2=0x7f85401592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.550+0000 7f852b7fe640 1 --2- 172.21.15.122:0/1075809516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85400c5670 0x7f85401592d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f853c000c10 tx=0x7f853c004040 comp rx=0 tx=0).stop 2024-09-17T06:03:43.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.550+0000 7f7b4b59e640 1 -- 172.21.15.122:0/4058491350 shutdown_connections 2024-09-17T06:03:43.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.550+0000 7f7b4b59e640 1 -- 172.21.15.122:0/4058491350 wait complete. 2024-09-17T06:03:43.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.550+0000 7f1bceffd640 1 -- 172.21.15.122:0/274277904 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1bd80b3070 con 0x7f1bc8003b00 2024-09-17T06:03:43.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f852b7fe640 1 -- 172.21.15.122:0/1075809516 shutdown_connections 2024-09-17T06:03:43.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f852b7fe640 1 --2- 172.21.15.122:0/1075809516 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85401588b0 0x7f8540154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f852b7fe640 1 --2- 172.21.15.122:0/1075809516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85400cd0c0 0x7f8540151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f852b7fe640 1 --2- 172.21.15.122:0/1075809516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85400c5670 0x7f85401592d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f852b7fe640 1 -- 172.21.15.122:0/1075809516 >> 172.21.15.122:0/1075809516 conn(0x7f854006d290 msgr2=0x7f8540074090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f7b4b59e640 1 Processor -- start 2024-09-17T06:03:43.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f7b4b59e640 1 -- start start 2024-09-17T06:03:43.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f7b4b59e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c0c6780 0x7f7b4c154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f7b4b59e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b4c0c81d0 0x7f7b4c160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f852b7fe640 1 -- 172.21.15.122:0/1075809516 shutdown_connections 2024-09-17T06:03:43.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f7b4a59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c0c6780 0x7f7b4c154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f7b4a59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c0c6780 0x7f7b4c154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44596/0 (socket says 172.21.15.122:44596) 2024-09-17T06:03:43.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f7b4b59e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b4c157c50 0x7f7b4c152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.554+0000 7f7b4a59c640 1 -- 172.21.15.122:0/2405362245 learned_addr learned my addr 172.21.15.122:0/2405362245 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b4b59e640 1 -- 172.21.15.122:0/2405362245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c0c8760 con 0x7f7b4c0c6780 2024-09-17T06:03:43.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b4b59e640 1 -- 172.21.15.122:0/2405362245 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c0c85e0 con 0x7f7b4c157c50 2024-09-17T06:03:43.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b4b59e640 1 -- 172.21.15.122:0/2405362245 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7b4c15b510 con 0x7f7b4c0c81d0 2024-09-17T06:03:43.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b49d9b640 1 --2- 172.21.15.122:0/2405362245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b4c0c81d0 0x7f7b4c160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b4ad9d640 1 --2- 172.21.15.122:0/2405362245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b4c157c50 0x7f7b4c152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b4a59c640 1 -- 172.21.15.122:0/2405362245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b4c0c81d0 msgr2=0x7f7b4c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b4a59c640 1 --2- 172.21.15.122:0/2405362245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b4c0c81d0 0x7f7b4c160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b4a59c640 1 -- 172.21.15.122:0/2405362245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b4c157c50 msgr2=0x7f7b4c152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b4a59c640 1 --2- 172.21.15.122:0/2405362245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b4c157c50 0x7f7b4c152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b4a59c640 1 -- 172.21.15.122:0/2405362245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4c154550 con 0x7f7b4c0c6780 2024-09-17T06:03:43.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b4ad9d640 1 --2- 172.21.15.122:0/2405362245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b4c157c50 0x7f7b4c152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:03:43.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b4a59c640 1 --2- 172.21.15.122:0/2405362245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c0c6780 0x7f7b4c154010 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0058d0 tx=0x7f7b3c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f852b7fe640 1 -- 172.21.15.122:0/1075809516 wait complete. 2024-09-17T06:03:43.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7ff4ceffd640 1 -- 172.21.15.122:0/2139234913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e01551b0 msgr2=0x7ff4e00ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7ff4ceffd640 1 --2- 172.21.15.122:0/2139234913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e01551b0 0x7ff4e00ccd40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400c530 tx=0x7ff4d400c9f0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7f7b42ffd640 1 -- 172.21.15.122:0/2405362245 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c017070 con 0x7f7b4c0c6780 2024-09-17T06:03:43.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7ff4ceffd640 1 -- 172.21.15.122:0/2139234913 shutdown_connections 2024-09-17T06:03:43.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7ff4ceffd640 1 --2- 172.21.15.122:0/2139234913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4e0164b60 0x7ff4e014d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7ff4ceffd640 1 --2- 172.21.15.122:0/2139234913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e01551b0 0x7ff4e00ccd40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7ff4ceffd640 1 --2- 172.21.15.122:0/2139234913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4e00c5e60 0x7ff4e015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7ff4ceffd640 1 -- 172.21.15.122:0/2139234913 >> 172.21.15.122:0/2139234913 conn(0x7ff4e006d290 msgr2=0x7ff4e014f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7ff4ceffd640 1 -- 172.21.15.122:0/2139234913 shutdown_connections 2024-09-17T06:03:43.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.558+0000 7ff4ceffd640 1 -- 172.21.15.122:0/2139234913 wait complete. 2024-09-17T06:03:43.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.570+0000 7f0db17fa640 1 -- 172.21.15.122:0/722058762 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0db40c2cb0 con 0x7f0db4165480 2024-09-17T06:03:43.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7f7b4b59e640 1 -- 172.21.15.122:0/2405362245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4c1f96c0 con 0x7f7b4c0c6780 2024-09-17T06:03:43.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7f7b4b59e640 1 -- 172.21.15.122:0/2405362245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4c1f9980 con 0x7f7b4c0c6780 2024-09-17T06:03:43.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7fae49d15640 1 -- 172.21.15.122:0/2128800844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fae4415b1e0 msgr2=0x7fae44150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7fae49d15640 1 --2- 172.21.15.122:0/2128800844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fae4415b1e0 0x7fae44150990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009840 tx=0x7fae3c01c840 comp rx=0 tx=0).stop 2024-09-17T06:03:43.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7f7b42ffd640 1 -- 172.21.15.122:0/2405362245 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b3c009d20 con 0x7f7b4c0c6780 2024-09-17T06:03:43.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7fae49d15640 1 -- 172.21.15.122:0/2128800844 shutdown_connections 2024-09-17T06:03:43.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7fae49d15640 1 --2- 172.21.15.122:0/2128800844 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fae4415b1e0 0x7fae44150990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7fae49d15640 1 --2- 172.21.15.122:0/2128800844 >> v2:172.21.15.122:3300/0 conn(0x7fae440c6f60 0x7fae440c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7f7b42ffd640 1 -- 172.21.15.122:0/2405362245 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0106c0 con 0x7f7b4c0c6780 2024-09-17T06:03:43.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7fae49d15640 1 -- 172.21.15.122:0/2128800844 >> 172.21.15.122:0/2128800844 conn(0x7fae4406d290 msgr2=0x7fae4406d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7f7b42ffd640 1 -- 172.21.15.122:0/2405362245 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7b3c01a070 con 0x7f7b4c0c6780 2024-09-17T06:03:43.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7f7b42ffd640 1 -- 172.21.15.122:0/2405362245 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7b3c01cd80 con 0x7f7b4c0c6780 2024-09-17T06:03:43.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7f7b40ff9640 1 -- 172.21.15.122:0/2405362245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b280052a0 con 0x7f7b4c0c6780 2024-09-17T06:03:43.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7fae49d15640 1 -- 172.21.15.122:0/2128800844 shutdown_connections 2024-09-17T06:03:43.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.578+0000 7fae49d15640 1 -- 172.21.15.122:0/2128800844 wait complete. 2024-09-17T06:03:43.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7fae49d15640 1 Processor -- start 2024-09-17T06:03:43.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7f41b0d96640 1 -- 172.21.15.122:0/4158040113 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41ac0c6f60 msgr2=0x7f41ac0c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7f41b0d96640 1 --2- 172.21.15.122:0/4158040113 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41ac0c6f60 0x7f41ac0c52c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009930 tx=0x7f41a001c940 comp rx=0 tx=0).stop 2024-09-17T06:03:43.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7fae49d15640 1 -- start start 2024-09-17T06:03:43.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7f41b0d96640 1 -- 172.21.15.122:0/4158040113 shutdown_connections 2024-09-17T06:03:43.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7f41b0d96640 1 --2- 172.21.15.122:0/4158040113 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41ac0c6f60 0x7f41ac0c52c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7f41b0d96640 1 -- 172.21.15.122:0/4158040113 >> 172.21.15.122:0/4158040113 conn(0x7f41ac06d290 msgr2=0x7f41ac06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7fae49d15640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fae440c6f60 0x7fae441587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7fae49d15640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440c7470 0x7fae4414eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7fae49d15640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae4415b1e0 0x7fae4414f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7fae49d15640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fae440c68b0 con 0x7fae440c7470 2024-09-17T06:03:43.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7fae49d15640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fae44153be0 con 0x7fae4415b1e0 2024-09-17T06:03:43.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7fae49d15640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fae44201d00 con 0x7fae440c6f60 2024-09-17T06:03:43.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7fae42ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440c7470 0x7fae4414eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7fae42ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440c7470 0x7fae4414eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44604/0 (socket says 172.21.15.122:44604) 2024-09-17T06:03:43.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7fae42ffd640 1 -- 172.21.15.122:0/429137871 learned_addr learned my addr 172.21.15.122:0/429137871 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.582+0000 7fae437fe640 1 --2- 172.21.15.122:0/429137871 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fae440c6f60 0x7fae441587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.586+0000 7fae43fff640 1 --2- 172.21.15.122:0/429137871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae4415b1e0 0x7fae4414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.586+0000 7fa2f7544640 1 -- 172.21.15.122:0/2397439331 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mds_dir_prefetch}] v 0) -- 0x7fa2f00c3d90 con 0x7fa2f00c59b0 2024-09-17T06:03:43.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.586+0000 7fae42ffd640 1 -- 172.21.15.122:0/429137871 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fae440c6f60 msgr2=0x7fae441587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.586+0000 7fae42ffd640 1 --2- 172.21.15.122:0/429137871 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fae440c6f60 0x7fae441587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.586+0000 7fae42ffd640 1 -- 172.21.15.122:0/429137871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae4415b1e0 msgr2=0x7fae4414f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.586+0000 7fae42ffd640 1 --2- 172.21.15.122:0/429137871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae4415b1e0 0x7fae4414f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.586+0000 7fae42ffd640 1 -- 172.21.15.122:0/429137871 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae44154f30 con 0x7fae440c7470 2024-09-17T06:03:43.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.586+0000 7fae437fe640 1 --2- 172.21.15.122:0/429137871 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fae440c6f60 0x7fae441587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:03:43.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.586+0000 7fae42ffd640 1 --2- 172.21.15.122:0/429137871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440c7470 0x7fae4414eff0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00c3a0 tx=0x7fae2c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.586+0000 7f7b42ffd640 1 -- 172.21.15.122:0/2405362245 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7b3c010860 con 0x7f7b4c0c6780 2024-09-17T06:03:43.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.590+0000 7f41b0d96640 1 -- 172.21.15.122:0/4158040113 shutdown_connections 2024-09-17T06:03:43.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.590+0000 7f41b0d96640 1 -- 172.21.15.122:0/4158040113 wait complete. 2024-09-17T06:03:43.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.590+0000 7f41b0d96640 1 Processor -- start 2024-09-17T06:03:43.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.594+0000 7fa2e5ffb640 1 -- 172.21.15.122:0/2397439331 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_dir_prefetch}]=0 v13)=0 v13) ==== 117+0+0 (secure 0 0 0) 0x7fa2e00193b0 con 0x7fa2f00c59b0 2024-09-17T06:03:43.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.594+0000 7f41b0d96640 1 -- start start 2024-09-17T06:03:43.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.594+0000 7f41b0d96640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41ac0c6f60 0x7f41ac169200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.594+0000 7f41aa59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41ac0c6f60 0x7f41ac169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.594+0000 7f41aa59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41ac0c6f60 0x7f41ac169200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44612/0 (socket says 172.21.15.122:44612) 2024-09-17T06:03:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.594+0000 7f41aa59c640 1 -- 172.21.15.122:0/2134598998 learned_addr learned my addr 172.21.15.122:0/2134598998 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.594+0000 7f41b0d96640 1 --2- 172.21.15.122:0/2134598998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41ac0c7470 0x7f41ac143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.594+0000 7f41b0d96640 1 --2- 172.21.15.122:0/2134598998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41ac15b1e0 0x7f41ac144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.594+0000 7f41a9d9b640 1 --2- 172.21.15.122:0/2134598998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41ac0c7470 0x7f41ac143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.594+0000 7f41b0d96640 1 -- 172.21.15.122:0/2134598998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f41ac0c68b0 con 0x7f41ac0c6f60 2024-09-17T06:03:43.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.598+0000 7f41aad9d640 1 --2- 172.21.15.122:0/2134598998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41ac15b1e0 0x7f41ac144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.598+0000 7f41b0d96640 1 -- 172.21.15.122:0/2134598998 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41ac154bf0 con 0x7f41ac15b1e0 2024-09-17T06:03:43.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.598+0000 7f41b0d96640 1 -- 172.21.15.122:0/2134598998 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f41ac169740 con 0x7f41ac0c7470 2024-09-17T06:03:43.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.598+0000 7f41aa59c640 1 -- 172.21.15.122:0/2134598998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41ac0c7470 msgr2=0x7f41ac143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.598+0000 7f41aa59c640 1 --2- 172.21.15.122:0/2134598998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41ac0c7470 0x7f41ac143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.598+0000 7f41aa59c640 1 -- 172.21.15.122:0/2134598998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41ac15b1e0 msgr2=0x7f41ac144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.598+0000 7f41aa59c640 1 --2- 172.21.15.122:0/2134598998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41ac15b1e0 0x7f41ac144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.598+0000 7f41aa59c640 1 -- 172.21.15.122:0/2134598998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41ac16ae90 con 0x7f41ac0c6f60 2024-09-17T06:03:43.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.598+0000 7f41aa59c640 1 --2- 172.21.15.122:0/2134598998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41ac0c6f60 0x7f41ac169200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f41a00982e0 tx=0x7f41a0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7fae3bfff640 1 -- 172.21.15.122:0/429137871 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c011790 con 0x7fae440c7470 2024-09-17T06:03:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7fae49d15640 1 -- 172.21.15.122:0/429137871 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae44155210 con 0x7fae440c7470 2024-09-17T06:03:43.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7fae49d15640 1 -- 172.21.15.122:0/429137871 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae44158290 con 0x7fae440c7470 2024-09-17T06:03:43.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7f4de2070640 1 -- 172.21.15.122:0/2811538959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ddc151e80 msgr2=0x7f4ddc152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7f4de2070640 1 --2- 172.21.15.122:0/2811538959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ddc151e80 0x7f4ddc152290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009900 tx=0x7f4dcc01c8b0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7fae3bfff640 1 -- 172.21.15.122:0/429137871 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae2c017070 con 0x7fae440c7470 2024-09-17T06:03:43.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7fae3bfff640 1 -- 172.21.15.122:0/429137871 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c011c60 con 0x7fae440c7470 2024-09-17T06:03:43.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7fae3bfff640 1 -- 172.21.15.122:0/429137871 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fae2c01c460 con 0x7fae440c7470 2024-09-17T06:03:43.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7fae3bfff640 1 -- 172.21.15.122:0/429137871 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fae2c012860 con 0x7fae440c7470 2024-09-17T06:03:43.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7f4de2070640 1 -- 172.21.15.122:0/2811538959 shutdown_connections 2024-09-17T06:03:43.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7f4de2070640 1 --2- 172.21.15.122:0/2811538959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ddc151e80 0x7f4ddc152290 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7f4de2070640 1 --2- 172.21.15.122:0/2811538959 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ddc0c8130 0x7f4ddc0c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.602+0000 7f4de2070640 1 -- 172.21.15.122:0/2811538959 >> 172.21.15.122:0/2811538959 conn(0x7f4ddc071cc0 msgr2=0x7f4ddc0720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.606+0000 7fae49d15640 1 -- 172.21.15.122:0/429137871 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae280052a0 con 0x7fae440c7470 2024-09-17T06:03:43.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.606+0000 7f4de2070640 1 -- 172.21.15.122:0/2811538959 shutdown_connections 2024-09-17T06:03:43.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.610+0000 7fa2d37fe640 1 -- 172.21.15.122:0/2397439331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2f00c59b0 msgr2=0x7fa2f01edc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.610+0000 7fa2d37fe640 1 --2- 172.21.15.122:0/2397439331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2f00c59b0 0x7fa2f01edc70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000b410 tx=0x7fa2e000b8d0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.610+0000 7f4de2070640 1 -- 172.21.15.122:0/2811538959 wait complete. 2024-09-17T06:03:43.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.610+0000 7f4de2070640 1 Processor -- start 2024-09-17T06:03:43.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.610+0000 7fae3bfff640 1 -- 172.21.15.122:0/429137871 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fae2c011e00 con 0x7fae440c7470 2024-09-17T06:03:43.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.610+0000 7f4de2070640 1 -- start start 2024-09-17T06:03:43.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7fa2d37fe640 1 -- 172.21.15.122:0/2397439331 shutdown_connections 2024-09-17T06:03:43.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7fa2d37fe640 1 --2- 172.21.15.122:0/2397439331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f014db30 0x7fa2f01507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7fa2d37fe640 1 --2- 172.21.15.122:0/2397439331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2f00c59b0 0x7fa2f01edc70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7fa2d37fe640 1 --2- 172.21.15.122:0/2397439331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f00c55a0 0x7fa2f01ef670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7fa2d37fe640 1 -- 172.21.15.122:0/2397439331 >> 172.21.15.122:0/2397439331 conn(0x7fa2f006d290 msgr2=0x7fa2f0155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de2070640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ddc0c8130 0x7f4ddc1fa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de2070640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ddc0cc5d0 0x7f4ddc153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de2070640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc151e80 0x7f4ddc151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de2070640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc0ccdf0 con 0x7f4ddc151e80 2024-09-17T06:03:43.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de2070640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc1589d0 con 0x7f4ddc0cc5d0 2024-09-17T06:03:43.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de2070640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4ddc0748e0 con 0x7f4ddc0c8130 2024-09-17T06:03:43.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de106e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ddc0c8130 0x7f4ddc1fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de106e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ddc0c8130 0x7f4ddc1fa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:44670/0 (socket says 172.21.15.122:44670) 2024-09-17T06:03:43.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de106e640 1 -- 172.21.15.122:0/1004748913 learned_addr learned my addr 172.21.15.122:0/1004748913 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de186f640 1 --2- 172.21.15.122:0/1004748913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc151e80 0x7f4ddc151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.617 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de106e640 1 -- 172.21.15.122:0/1004748913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ddc0cc5d0 msgr2=0x7f4ddc153140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T06:03:43.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de106e640 1 --2- 172.21.15.122:0/1004748913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ddc0cc5d0 0x7f4ddc153140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de106e640 1 -- 172.21.15.122:0/1004748913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc151e80 msgr2=0x7f4ddc151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de106e640 1 --2- 172.21.15.122:0/1004748913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc151e80 0x7f4ddc151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de106e640 1 -- 172.21.15.122:0/1004748913 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ddc15a840 con 0x7f4ddc0c8130 2024-09-17T06:03:43.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de186f640 1 --2- 172.21.15.122:0/1004748913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc151e80 0x7f4ddc151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:03:43.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7f4de106e640 1 --2- 172.21.15.122:0/1004748913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ddc0c8130 0x7f4ddc1fa090 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800b440 tx=0x7f4dd800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7fa2d37fe640 1 -- 172.21.15.122:0/2397439331 shutdown_connections 2024-09-17T06:03:43.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.614+0000 7fa2d37fe640 1 -- 172.21.15.122:0/2397439331 wait complete. 2024-09-17T06:03:43.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f419affd640 1 -- 172.21.15.122:0/2134598998 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a00b2040 con 0x7f41ac0c6f60 2024-09-17T06:03:43.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f4dd1ffb640 1 -- 172.21.15.122:0/1004748913 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8015020 con 0x7f4ddc0c8130 2024-09-17T06:03:43.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f41b0d96640 1 -- 172.21.15.122:0/2134598998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41ac154730 con 0x7f41ac0c6f60 2024-09-17T06:03:43.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f41b0d96640 1 -- 172.21.15.122:0/2134598998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41ac150d20 con 0x7f41ac0c6f60 2024-09-17T06:03:43.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f2183baa640 1 -- 172.21.15.122:0/1723056242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f217c1588b0 msgr2=0x7f217c0ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f2183baa640 1 --2- 172.21.15.122:0/1723056242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f217c1588b0 0x7f217c0ccb80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f217c06de50 tx=0x7f217801c8e0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f419affd640 1 -- 172.21.15.122:0/2134598998 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41a0004320 con 0x7f41ac0c6f60 2024-09-17T06:03:43.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f4de2070640 1 -- 172.21.15.122:0/1004748913 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ddc15aae0 con 0x7f4ddc0c8130 2024-09-17T06:03:43.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f4de2070640 1 -- 172.21.15.122:0/1004748913 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ddc150a10 con 0x7f4ddc0c8130 2024-09-17T06:03:43.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f419affd640 1 -- 172.21.15.122:0/2134598998 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a00044d0 con 0x7f41ac0c6f60 2024-09-17T06:03:43.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f2183baa640 1 -- 172.21.15.122:0/1723056242 shutdown_connections 2024-09-17T06:03:43.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f2183baa640 1 --2- 172.21.15.122:0/1723056242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f217c1588b0 0x7f217c0ccb80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f2183baa640 1 --2- 172.21.15.122:0/1723056242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f217c0c5670 0x7f217c0c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f2183baa640 1 -- 172.21.15.122:0/1723056242 >> 172.21.15.122:0/1723056242 conn(0x7f217c06d290 msgr2=0x7f217c06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f4dd1ffb640 1 -- 172.21.15.122:0/1004748913 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dd8011980 con 0x7f4ddc0c8130 2024-09-17T06:03:43.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f4dd1ffb640 1 -- 172.21.15.122:0/1004748913 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8011db0 con 0x7f4ddc0c8130 2024-09-17T06:03:43.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f2183baa640 1 -- 172.21.15.122:0/1723056242 shutdown_connections 2024-09-17T06:03:43.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f2183baa640 1 -- 172.21.15.122:0/1723056242 wait complete. 2024-09-17T06:03:43.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f2183baa640 1 Processor -- start 2024-09-17T06:03:43.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f4dd1ffb640 1 -- 172.21.15.122:0/1004748913 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4dd8018020 con 0x7f4ddc0c8130 2024-09-17T06:03:43.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f4dd1ffb640 1 -- 172.21.15.122:0/1004748913 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4dd8010930 con 0x7f4ddc0c8130 2024-09-17T06:03:43.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f2183baa640 1 -- start start 2024-09-17T06:03:43.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2183baa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f217c0c5670 0x7f217c154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2183baa640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f217c0cd0c0 0x7f217c14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2183baa640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c201180 0x7f217c151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2183baa640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f217c1523e0 con 0x7f217c0c5670 2024-09-17T06:03:43.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2181145640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f217c0cd0c0 0x7f217c14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2182147640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c201180 0x7f217c151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2182147640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c201180 0x7f217c151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:38792/0 (socket says 172.21.15.122:38792) 2024-09-17T06:03:43.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2182147640 1 -- 172.21.15.122:0/2634454433 learned_addr learned my addr 172.21.15.122:0/2634454433 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2183baa640 1 -- 172.21.15.122:0/2634454433 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f217c158d00 con 0x7f217c201180 2024-09-17T06:03:43.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2183baa640 1 -- 172.21.15.122:0/2634454433 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f217c164fd0 con 0x7f217c0cd0c0 2024-09-17T06:03:43.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.618+0000 7f419affd640 1 -- 172.21.15.122:0/2134598998 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f41a00a56a0 con 0x7f41ac0c6f60 2024-09-17T06:03:43.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2181145640 1 -- 172.21.15.122:0/2634454433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c201180 msgr2=0x7f217c151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2181145640 1 --2- 172.21.15.122:0/2634454433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c201180 0x7f217c151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2181145640 1 -- 172.21.15.122:0/2634454433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f217c0c5670 msgr2=0x7f217c154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2181145640 1 --2- 172.21.15.122:0/2634454433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f217c0c5670 0x7f217c154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.622+0000 7f2181145640 1 -- 172.21.15.122:0/2634454433 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c0cc2b0 con 0x7f217c0cd0c0 2024-09-17T06:03:43.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.626+0000 7f419affd640 1 -- 172.21.15.122:0/2134598998 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f41a00037b0 con 0x7f41ac0c6f60 2024-09-17T06:03:43.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.626+0000 7f2181145640 1 --2- 172.21.15.122:0/2634454433 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f217c0cd0c0 0x7f217c14ae30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f21780ac000 tx=0x7f21780051a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.626+0000 7f21727fc640 1 -- 172.21.15.122:0/2634454433 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21780ba020 con 0x7f217c0cd0c0 2024-09-17T06:03:43.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.626+0000 7f2183baa640 1 -- 172.21.15.122:0/2634454433 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217c0cb230 con 0x7f217c0cd0c0 2024-09-17T06:03:43.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.626+0000 7f2183baa640 1 -- 172.21.15.122:0/2634454433 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f217c153d60 con 0x7f217c0cd0c0 2024-09-17T06:03:43.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.630+0000 7f41b0d96640 1 -- 172.21.15.122:0/2134598998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41900052a0 con 0x7f41ac0c6f60 2024-09-17T06:03:43.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.630+0000 7f21727fc640 1 -- 172.21.15.122:0/2634454433 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2178004030 con 0x7f217c0cd0c0 2024-09-17T06:03:43.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.630+0000 7f21727fc640 1 -- 172.21.15.122:0/2634454433 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21780b2040 con 0x7f217c0cd0c0 2024-09-17T06:03:43.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.630+0000 7f21727fc640 1 -- 172.21.15.122:0/2634454433 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f21780046d0 con 0x7f217c0cd0c0 2024-09-17T06:03:43.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.630+0000 7f21727fc640 1 -- 172.21.15.122:0/2634454433 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2178003ba0 con 0x7f217c0cd0c0 2024-09-17T06:03:43.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.630+0000 7f4de2070640 1 -- 172.21.15.122:0/1004748913 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dbc0052a0 con 0x7f4ddc0c8130 2024-09-17T06:03:43.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.634+0000 7f419affd640 1 -- 172.21.15.122:0/2134598998 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f41a00c6070 con 0x7f41ac0c6f60 2024-09-17T06:03:43.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7fd8e094b640 1 -- 172.21.15.122:0/2873490568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8dc0c6780 msgr2=0x7fd8dc151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7fd8e094b640 1 --2- 172.21.15.122:0/2873490568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8dc0c6780 0x7fd8dc151880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400ad90 tx=0x7fd8d401dcd0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7fd8e094b640 1 -- 172.21.15.122:0/2873490568 shutdown_connections 2024-09-17T06:03:43.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7fd8e094b640 1 --2- 172.21.15.122:0/2873490568 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8dc0c81d0 0x7fd8dc157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7fd8e094b640 1 --2- 172.21.15.122:0/2873490568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8dc0c6780 0x7fd8dc151880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7fd8e094b640 1 -- 172.21.15.122:0/2873490568 >> 172.21.15.122:0/2873490568 conn(0x7fd8dc06d290 msgr2=0x7fd8dc06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7fd8e094b640 1 -- 172.21.15.122:0/2873490568 shutdown_connections 2024-09-17T06:03:43.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7f2f35c5e640 1 -- 172.21.15.122:0/4195886075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f30157cd0 msgr2=0x7f2f30162b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7f2f35c5e640 1 --2- 172.21.15.122:0/4195886075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f30157cd0 0x7f2f30162b20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2f300c86b0 tx=0x7f2f2801d000 comp rx=0 tx=0).stop 2024-09-17T06:03:43.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7f2f35c5e640 1 -- 172.21.15.122:0/4195886075 shutdown_connections 2024-09-17T06:03:43.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7f2f35c5e640 1 --2- 172.21.15.122:0/4195886075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f30157cd0 0x7f2f30162b20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7f2f35c5e640 1 -- 172.21.15.122:0/4195886075 >> 172.21.15.122:0/4195886075 conn(0x7f2f30070000 msgr2=0x7f2f30070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7f2f35c5e640 1 -- 172.21.15.122:0/4195886075 shutdown_connections 2024-09-17T06:03:43.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7f2f35c5e640 1 -- 172.21.15.122:0/4195886075 wait complete. 2024-09-17T06:03:43.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7f4dd1ffb640 1 -- 172.21.15.122:0/1004748913 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4dd801f030 con 0x7f4ddc0c8130 2024-09-17T06:03:43.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7fd8e094b640 1 -- 172.21.15.122:0/2873490568 wait complete. 2024-09-17T06:03:43.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.638+0000 7fd8e094b640 1 Processor -- start 2024-09-17T06:03:43.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8e094b640 1 -- start start 2024-09-17T06:03:43.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7f2f35c5e640 1 Processor -- start 2024-09-17T06:03:43.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8e094b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8dc0c81d0 0x7fd8dc1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7f2f35c5e640 1 -- start start 2024-09-17T06:03:43.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8e094b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8dc157c50 0x7fd8dc204d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8e094b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8dc203b60 0x7fd8dc0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8dad9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8dc0c81d0 0x7fd8dc1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8dad9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8dc0c81d0 0x7fd8dc1539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44672/0 (socket says 172.21.15.122:44672) 2024-09-17T06:03:43.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8e094b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc0c79f0 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8e094b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc0c7870 con 0x7fd8dc157c50 2024-09-17T06:03:43.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8e094b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd8dc0c85e0 con 0x7fd8dc203b60 2024-09-17T06:03:43.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8dad9d640 1 -- 172.21.15.122:0/1985127670 learned_addr learned my addr 172.21.15.122:0/1985127670 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8db59e640 1 --2- 172.21.15.122:0/1985127670 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8dc203b60 0x7fd8dc0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8dad9d640 1 -- 172.21.15.122:0/1985127670 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8dc203b60 msgr2=0x7fd8dc0cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8dad9d640 1 --2- 172.21.15.122:0/1985127670 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8dc203b60 0x7fd8dc0cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8dad9d640 1 -- 172.21.15.122:0/1985127670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8dc157c50 msgr2=0x7fd8dc204d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T06:03:43.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8dad9d640 1 --2- 172.21.15.122:0/1985127670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8dc157c50 0x7fd8dc204d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8dad9d640 1 -- 172.21.15.122:0/1985127670 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc153f30 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.642+0000 7fd8dad9d640 1 --2- 172.21.15.122:0/1985127670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8dc0c81d0 0x7fd8dc1539f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400ace0 tx=0x7fd8d4004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa2c1870640 1 -- 172.21.15.122:0/790281125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2bc0c9b60 msgr2=0x7fa2bc0c63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa2c1870640 1 --2- 172.21.15.122:0/790281125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2bc0c9b60 0x7fa2bc0c63a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc071420 tx=0x7fa2b401cd90 comp rx=0 tx=0).stop 2024-09-17T06:03:43.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa9f068c640 1 -- 172.21.15.122:0/44684090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e80c6f60 msgr2=0x7fa9e81652a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa9f068c640 1 --2- 172.21.15.122:0/44684090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e80c6f60 0x7fa9e81652a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0007be0 tx=0x7fa9e001d810 comp rx=0 tx=0).stop 2024-09-17T06:03:43.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa9f068c640 1 -- 172.21.15.122:0/44684090 shutdown_connections 2024-09-17T06:03:43.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa9f068c640 1 --2- 172.21.15.122:0/44684090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e80c6f60 0x7fa9e81652a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa9f068c640 1 --2- 172.21.15.122:0/44684090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9e8074ec0 0x7fa9e80c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa9f068c640 1 -- 172.21.15.122:0/44684090 >> 172.21.15.122:0/44684090 conn(0x7fa9e806d290 msgr2=0x7fa9e806d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7f2f35c5e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f300c4550 0x7f2f301f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa9f068c640 1 -- 172.21.15.122:0/44684090 shutdown_connections 2024-09-17T06:03:43.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7f2f35c5e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f3014dd50 0x7f2f300cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa9f068c640 1 -- 172.21.15.122:0/44684090 wait complete. 2024-09-17T06:03:43.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fd8c37fe640 1 -- 172.21.15.122:0/1985127670 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d40b3040 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fd8c37fe640 1 -- 172.21.15.122:0/1985127670 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8d4003c70 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fd8e094b640 1 -- 172.21.15.122:0/1985127670 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8dc149bd0 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7f2f34c5c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f300c4550 0x7f2f301f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7f2f35c5e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f30157cd0 0x7f2f3013ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7f2f34c5c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f300c4550 0x7f2f301f1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:38844/0 (socket says 172.21.15.122:38844) 2024-09-17T06:03:43.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fd8e094b640 1 -- 172.21.15.122:0/1985127670 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8dc154140 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7f2f2ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f3014dd50 0x7f2f300cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7f2f2ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f3014dd50 0x7f2f300cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44682/0 (socket says 172.21.15.122:44682) 2024-09-17T06:03:43.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7f2f35c5e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2f300c9e10 con 0x7f2f3014dd50 2024-09-17T06:03:43.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7f2f35c5e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2f30151740 con 0x7f2f300c4550 2024-09-17T06:03:43.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fd8c37fe640 1 -- 172.21.15.122:0/1985127670 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d40ae980 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7f2f34c5c640 1 -- 172.21.15.122:0/2802017554 learned_addr learned my addr 172.21.15.122:0/2802017554 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7f2f3545d640 1 --2- 172.21.15.122:0/2802017554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f30157cd0 0x7f2f3013ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7f2f35c5e640 1 -- 172.21.15.122:0/2802017554 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f2f300c9f90 con 0x7f2f30157cd0 2024-09-17T06:03:43.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fd8c37fe640 1 -- 172.21.15.122:0/1985127670 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd8d40be060 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fd8c37fe640 1 -- 172.21.15.122:0/1985127670 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd8d40047c0 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa2c1870640 1 -- 172.21.15.122:0/790281125 shutdown_connections 2024-09-17T06:03:43.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa2c1870640 1 --2- 172.21.15.122:0/790281125 >> v2:172.21.15.173:3300/0 conn(0x7fa2bc1509a0 0x7fa2bc150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa2c1870640 1 --2- 172.21.15.122:0/790281125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2bc0c9b60 0x7fa2bc0c63a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.646+0000 7fa2c1870640 1 --2- 172.21.15.122:0/790281125 >> v2:172.21.15.122:3300/0 conn(0x7fa2bc0c9750 0x7fa2bc0c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7fa2c1870640 1 -- 172.21.15.122:0/790281125 >> 172.21.15.122:0/790281125 conn(0x7fa2bc06d290 msgr2=0x7fa2bc06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7fa2c1870640 1 -- 172.21.15.122:0/790281125 shutdown_connections 2024-09-17T06:03:43.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7fa2c1870640 1 -- 172.21.15.122:0/790281125 wait complete. 2024-09-17T06:03:43.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f3545d640 1 -- 172.21.15.122:0/2802017554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f300c4550 msgr2=0x7f2f301f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f3545d640 1 --2- 172.21.15.122:0/2802017554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f300c4550 0x7f2f301f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f3545d640 1 -- 172.21.15.122:0/2802017554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f3014dd50 msgr2=0x7f2f300cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f3545d640 1 --2- 172.21.15.122:0/2802017554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f3014dd50 0x7f2f300cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f3545d640 1 -- 172.21.15.122:0/2802017554 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f301f23b0 con 0x7f2f30157cd0 2024-09-17T06:03:43.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f3545d640 1 --2- 172.21.15.122:0/2802017554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f30157cd0 0x7f2f3013ef60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2f300c4cc0 tx=0x7f2f280ac560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f2d7fa640 1 -- 172.21.15.122:0/2802017554 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f280b1070 con 0x7f2f30157cd0 2024-09-17T06:03:43.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f35c5e640 1 -- 172.21.15.122:0/2802017554 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f300cbeb0 con 0x7f2f30157cd0 2024-09-17T06:03:43.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f35c5e640 1 -- 172.21.15.122:0/2802017554 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f301f4860 con 0x7f2f30157cd0 2024-09-17T06:03:43.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f2d7fa640 1 -- 172.21.15.122:0/2802017554 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f280bc070 con 0x7f2f30157cd0 2024-09-17T06:03:43.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7fa9f068c640 1 Processor -- start 2024-09-17T06:03:43.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7fa9f068c640 1 -- start start 2024-09-17T06:03:43.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f2d7fa640 1 -- 172.21.15.122:0/2802017554 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28003980 con 0x7f2f30157cd0 2024-09-17T06:03:43.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f2d7fa640 1 -- 172.21.15.122:0/2802017554 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2f280ad020 con 0x7f2f30157cd0 2024-09-17T06:03:43.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7f2f2d7fa640 1 -- 172.21.15.122:0/2802017554 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2f280acb90 con 0x7f2f30157cd0 2024-09-17T06:03:43.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.650+0000 7fa2c1870640 1 Processor -- start 2024-09-17T06:03:43.658 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9f068c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9e8074ec0 0x7fa9e81ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9f068c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e80c61c0 0x7fa9e81f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9f068c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e80c6f60 0x7fa9e8201b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9eec29640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e80c6f60 0x7fa9e8201b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9eec29640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e80c6f60 0x7fa9e8201b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44690/0 (socket says 172.21.15.122:44690) 2024-09-17T06:03:43.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9edc27640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e80c61c0 0x7fa9e81f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9eec29640 1 -- 172.21.15.122:0/1000376366 learned_addr learned my addr 172.21.15.122:0/1000376366 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9f068c640 1 -- 172.21.15.122:0/1000376366 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e80cd070 con 0x7fa9e80c6f60 2024-09-17T06:03:43.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9f068c640 1 -- 172.21.15.122:0/1000376366 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e81657e0 con 0x7fa9e80c61c0 2024-09-17T06:03:43.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9f068c640 1 -- 172.21.15.122:0/1000376366 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa9e80cd1f0 con 0x7fa9e8074ec0 2024-09-17T06:03:43.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9eec29640 1 -- 172.21.15.122:0/1000376366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9e8074ec0 msgr2=0x7fa9e81ffa10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T06:03:43.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9eec29640 1 --2- 172.21.15.122:0/1000376366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9e8074ec0 0x7fa9e81ffa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9eec29640 1 -- 172.21.15.122:0/1000376366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e80c61c0 msgr2=0x7fa9e81f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9eec29640 1 --2- 172.21.15.122:0/1000376366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e80c61c0 0x7fa9e81f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9eec29640 1 -- 172.21.15.122:0/1000376366 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e80c3760 con 0x7fa9e80c6f60 2024-09-17T06:03:43.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa9eec29640 1 --2- 172.21.15.122:0/1000376366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e80c6f60 0x7fa9e8201b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009c90 tx=0x7fa9d800c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa2c1870640 1 -- start start 2024-09-17T06:03:43.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa2c1870640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2bc0c9750 0x7fa2bc1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa2c1870640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2bc0c9b60 0x7fa2bc169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa2c086e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2bc0c9750 0x7fa2bc1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa2c086e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2bc0c9750 0x7fa2bc1565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44706/0 (socket says 172.21.15.122:44706) 2024-09-17T06:03:43.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa2c086e640 1 -- 172.21.15.122:0/3273248500 learned_addr learned my addr 172.21.15.122:0/3273248500 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa2c1870640 1 --2- 172.21.15.122:0/3273248500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2bc1509a0 0x7fa2bc168530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa2bbfff640 1 --2- 172.21.15.122:0/3273248500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2bc0c9b60 0x7fa2bc169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa2c1870640 1 -- 172.21.15.122:0/3273248500 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc0c75c0 con 0x7fa2bc0c9750 2024-09-17T06:03:43.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.654+0000 7fa2c106f640 1 --2- 172.21.15.122:0/3273248500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2bc1509a0 0x7fa2bc168530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa2c1870640 1 -- 172.21.15.122:0/3273248500 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc151700 con 0x7fa2bc0c9b60 2024-09-17T06:03:43.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa2c1870640 1 -- 172.21.15.122:0/3273248500 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa2bc0c7740 con 0x7fa2bc1509a0 2024-09-17T06:03:43.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7f2183baa640 1 -- 172.21.15.122:0/2634454433 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21640052a0 con 0x7f217c0cd0c0 2024-09-17T06:03:43.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa2c086e640 1 -- 172.21.15.122:0/3273248500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2bc1509a0 msgr2=0x7fa2bc168530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa2c086e640 1 --2- 172.21.15.122:0/3273248500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2bc1509a0 0x7fa2bc168530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa2c086e640 1 -- 172.21.15.122:0/3273248500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2bc0c9b60 msgr2=0x7fa2bc169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa2c086e640 1 --2- 172.21.15.122:0/3273248500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2bc0c9b60 0x7fa2bc169b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa2c086e640 1 -- 172.21.15.122:0/3273248500 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2bc156b10 con 0x7fa2bc0c9750 2024-09-17T06:03:43.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa2c086e640 1 --2- 172.21.15.122:0/3273248500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2bc0c9750 0x7fa2bc1565d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00d6d0 tx=0x7fa2ac00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa9deffd640 1 -- 172.21.15.122:0/1000376366 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800cce0 con 0x7fa9e80c6f60 2024-09-17T06:03:43.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fd8e094b640 1 -- 172.21.15.122:0/1985127670 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8bc0052a0 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa9deffd640 1 -- 172.21.15.122:0/1000376366 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9d8004020 con 0x7fa9e80c6f60 2024-09-17T06:03:43.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7f2f35c5e640 1 -- 172.21.15.122:0/2802017554 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f100052a0 con 0x7f2f30157cd0 2024-09-17T06:03:43.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa9f068c640 1 -- 172.21.15.122:0/1000376366 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e8202640 con 0x7fa9e80c6f60 2024-09-17T06:03:43.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa9f068c640 1 -- 172.21.15.122:0/1000376366 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e81f3dc0 con 0x7fa9e80c6f60 2024-09-17T06:03:43.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.658+0000 7fa9deffd640 1 -- 172.21.15.122:0/1000376366 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8004470 con 0x7fa9e80c6f60 2024-09-17T06:03:43.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.662+0000 7fa9deffd640 1 -- 172.21.15.122:0/1000376366 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa9d8015d10 con 0x7fa9e80c6f60 2024-09-17T06:03:43.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.662+0000 7fa9deffd640 1 -- 172.21.15.122:0/1000376366 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa9d801e7a0 con 0x7fa9e80c6f60 2024-09-17T06:03:43.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.662+0000 7fd8c37fe640 1 -- 172.21.15.122:0/1985127670 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd8d40178c0 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.666+0000 7f21727fc640 1 -- 172.21.15.122:0/2634454433 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f21780c5020 con 0x7f217c0cd0c0 2024-09-17T06:03:43.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.666+0000 7fa9dcff9640 1 -- 172.21.15.122:0/1000376366 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d00052a0 con 0x7fa9e80c6f60 2024-09-17T06:03:43.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.670+0000 7fa9deffd640 1 -- 172.21.15.122:0/1000376366 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa9d801a030 con 0x7fa9e80c6f60 2024-09-17T06:03:43.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.670+0000 7f2f2d7fa640 1 -- 172.21.15.122:0/2802017554 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2f28016bf0 con 0x7f2f30157cd0 2024-09-17T06:03:43.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.670+0000 7f82eb265640 1 -- 172.21.15.122:0/1255307922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82e40c6870 msgr2=0x7f82e40c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.670+0000 7f82eb265640 1 --2- 172.21.15.122:0/1255307922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82e40c6870 0x7f82e40c4590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f82e4073ea0 tx=0x7f82dc01cd80 comp rx=0 tx=0).stop 2024-09-17T06:03:43.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.670+0000 7f82eb265640 1 -- 172.21.15.122:0/1255307922 shutdown_connections 2024-09-17T06:03:43.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.670+0000 7f82eb265640 1 --2- 172.21.15.122:0/1255307922 >> v2:172.21.15.173:3300/0 conn(0x7f82e40cc5d0 0x7f82e40cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.670+0000 7f82eb265640 1 --2- 172.21.15.122:0/1255307922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82e40c6870 0x7f82e40c4590 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.670+0000 7f82eb265640 1 -- 172.21.15.122:0/1255307922 >> 172.21.15.122:0/1255307922 conn(0x7f82e4071cc0 msgr2=0x7f82e40720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.678+0000 7f82eb265640 1 -- 172.21.15.122:0/1255307922 shutdown_connections 2024-09-17T06:03:43.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.678+0000 7f82eb265640 1 -- 172.21.15.122:0/1255307922 wait complete. 2024-09-17T06:03:43.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.678+0000 7f82eb265640 1 Processor -- start 2024-09-17T06:03:43.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7fa2b97fa640 1 -- 172.21.15.122:0/3273248500 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac017070 con 0x7fa2bc0c9750 2024-09-17T06:03:43.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7fa2b97fa640 1 -- 172.21.15.122:0/3273248500 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2ac009b10 con 0x7fa2bc0c9750 2024-09-17T06:03:43.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7fa2c1870640 1 -- 172.21.15.122:0/3273248500 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2bc14c270 con 0x7fa2bc0c9750 2024-09-17T06:03:43.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7fa2c1870640 1 -- 172.21.15.122:0/3273248500 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2bc14c830 con 0x7fa2bc0c9750 2024-09-17T06:03:43.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7fa2b97fa640 1 -- 172.21.15.122:0/3273248500 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac010460 con 0x7fa2bc0c9750 2024-09-17T06:03:43.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82eb265640 1 -- start start 2024-09-17T06:03:43.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82eb265640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f82e40cc5d0 0x7f82e414c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82eb265640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82e415b1e0 0x7f82e40cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82eb265640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82e4148060 0x7f82e4148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82ea263640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f82e40cc5d0 0x7f82e414c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82eb265640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f82e415b770 con 0x7f82e4148060 2024-09-17T06:03:43.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82eb265640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f82e415b5f0 con 0x7f82e415b1e0 2024-09-17T06:03:43.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82ea263640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f82e40cc5d0 0x7f82e414c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:44766/0 (socket says 172.21.15.122:44766) 2024-09-17T06:03:43.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82eb265640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f82e40c9de0 con 0x7f82e40cc5d0 2024-09-17T06:03:43.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82ea263640 1 -- 172.21.15.122:0/3521908246 learned_addr learned my addr 172.21.15.122:0/3521908246 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82e9a62640 1 --2- 172.21.15.122:0/3521908246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82e415b1e0 0x7f82e40cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82ea263640 1 -- 172.21.15.122:0/3521908246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82e415b1e0 msgr2=0x7f82e40cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82ea263640 1 --2- 172.21.15.122:0/3521908246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82e415b1e0 0x7f82e40cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82ea263640 1 -- 172.21.15.122:0/3521908246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82e4148060 msgr2=0x7f82e4148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82ea263640 1 --2- 172.21.15.122:0/3521908246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82e4148060 0x7f82e4148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82ea263640 1 -- 172.21.15.122:0/3521908246 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e40c36e0 con 0x7f82e40cc5d0 2024-09-17T06:03:43.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.682+0000 7f82ea263640 1 --2- 172.21.15.122:0/3521908246 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f82e40cc5d0 0x7f82e414c1b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009bd0 tx=0x7f82dc0a5c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.686+0000 7fa2b97fa640 1 -- 172.21.15.122:0/3273248500 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa2ac01a070 con 0x7fa2bc0c9750 2024-09-17T06:03:43.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.686+0000 7fa2b97fa640 1 -- 172.21.15.122:0/3273248500 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa2ac01cab0 con 0x7fa2bc0c9750 2024-09-17T06:03:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.694+0000 7fa77d7fa640 1 -- 172.21.15.122:0/1892440817 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fa778005590 con 0x7fa7980c4590 2024-09-17T06:03:43.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.694+0000 7fa2c1870640 1 -- 172.21.15.122:0/3273248500 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2bc0c7f00 con 0x7fa2bc0c9750 2024-09-17T06:03:43.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.698+0000 7fa2b97fa640 1 -- 172.21.15.122:0/3273248500 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa2ac010600 con 0x7fa2bc0c9750 2024-09-17T06:03:43.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.702+0000 7f82daffd640 1 -- 172.21.15.122:0/3521908246 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc0b2040 con 0x7f82e40cc5d0 2024-09-17T06:03:43.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.702+0000 7f82daffd640 1 -- 172.21.15.122:0/3521908246 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82dc003a70 con 0x7f82e40cc5d0 2024-09-17T06:03:43.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.702+0000 7f82daffd640 1 -- 172.21.15.122:0/3521908246 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc003e40 con 0x7f82e40cc5d0 2024-09-17T06:03:43.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.702+0000 7f82eb265640 1 -- 172.21.15.122:0/3521908246 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e414c6f0 con 0x7f82e40cc5d0 2024-09-17T06:03:43.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.702+0000 7f82eb265640 1 -- 172.21.15.122:0/3521908246 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e41fc560 con 0x7f82e40cc5d0 2024-09-17T06:03:43.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.706+0000 7f82daffd640 1 -- 172.21.15.122:0/3521908246 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f82dc0bd030 con 0x7f82e40cc5d0 2024-09-17T06:03:43.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.706+0000 7fa77f7fe640 1 -- 172.21.15.122:0/1892440817 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v14)=0 v14) ==== 106+0+0 (secure 0 0 0) 0x7fa788012b20 con 0x7fa7980c4590 2024-09-17T06:03:43.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.706+0000 7f82daffd640 1 -- 172.21.15.122:0/3521908246 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f82dc002020 con 0x7f82e40cc5d0 2024-09-17T06:03:43.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.718+0000 7f8622fef640 1 -- 172.21.15.122:0/3812918536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861c0c4550 msgr2=0x7f861c0721d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.718+0000 7f8622fef640 1 --2- 172.21.15.122:0/3812918536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861c0c4550 0x7f861c0721d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f861c154cd0 tx=0x7f861801d570 comp rx=0 tx=0).stop 2024-09-17T06:03:43.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.718+0000 7f82eb265640 1 -- 172.21.15.122:0/3521908246 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e41fc900 con 0x7f82e40cc5d0 2024-09-17T06:03:43.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.718+0000 7f8622fef640 1 -- 172.21.15.122:0/3812918536 shutdown_connections 2024-09-17T06:03:43.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.718+0000 7f8622fef640 1 --2- 172.21.15.122:0/3812918536 >> v2:172.21.15.173:3300/0 conn(0x7f861c14dd50 0x7f861c072710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.718+0000 7f8622fef640 1 --2- 172.21.15.122:0/3812918536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861c0c4550 0x7f861c0721d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.718+0000 7f8622fef640 1 -- 172.21.15.122:0/3812918536 >> 172.21.15.122:0/3812918536 conn(0x7f861c070000 msgr2=0x7f861c070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.722+0000 7f82daffd640 1 -- 172.21.15.122:0/3521908246 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f82e41fc900 con 0x7f82e40cc5d0 2024-09-17T06:03:43.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.726+0000 7fa77d7fa640 1 -- 172.21.15.122:0/1892440817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7980c4590 msgr2=0x7fa798147200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.726+0000 7fa77d7fa640 1 --2- 172.21.15.122:0/1892440817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7980c4590 0x7fa798147200 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa78800c520 tx=0x7fa78800c9e0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.734+0000 7fa77d7fa640 1 -- 172.21.15.122:0/1892440817 shutdown_connections 2024-09-17T06:03:43.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.734+0000 7fa77d7fa640 1 --2- 172.21.15.122:0/1892440817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7980cc5d0 0x7fa798144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.734+0000 7fa77d7fa640 1 --2- 172.21.15.122:0/1892440817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7980c6870 0x7fa798150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.734+0000 7fa77d7fa640 1 --2- 172.21.15.122:0/1892440817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7980c4590 0x7fa798147200 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.734+0000 7fa77d7fa640 1 -- 172.21.15.122:0/1892440817 >> 172.21.15.122:0/1892440817 conn(0x7fa798071cc0 msgr2=0x7fa79806d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.734+0000 7fa77d7fa640 1 -- 172.21.15.122:0/1892440817 shutdown_connections 2024-09-17T06:03:43.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.734+0000 7fa77d7fa640 1 -- 172.21.15.122:0/1892440817 wait complete. 2024-09-17T06:03:43.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.738+0000 7f8622fef640 1 -- 172.21.15.122:0/3812918536 shutdown_connections 2024-09-17T06:03:43.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.738+0000 7f8622fef640 1 -- 172.21.15.122:0/3812918536 wait complete. 2024-09-17T06:03:43.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.738+0000 7f8622fef640 1 Processor -- start 2024-09-17T06:03:43.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.738+0000 7f8622fef640 1 -- start start 2024-09-17T06:03:43.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f8622fef640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f861c0c4550 0x7f861c0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f8622fef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861c14dd50 0x7f861c0cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f8622fef640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f861c1575c0 0x7f861c1491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:43.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f8622fef640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f861c0c9e10 con 0x7f861c14dd50 2024-09-17T06:03:43.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f8622fef640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f861c151740 con 0x7f861c0c4550 2024-09-17T06:03:43.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f8622fef640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f861c0c9f90 con 0x7f861c1575c0 2024-09-17T06:03:43.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f8621fed640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f861c0c4550 0x7f861c0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f86217ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861c14dd50 0x7f861c0cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f86217ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861c14dd50 0x7f861c0cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44744/0 (socket says 172.21.15.122:44744) 2024-09-17T06:03:43.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f86217ec640 1 -- 172.21.15.122:0/4027118346 learned_addr learned my addr 172.21.15.122:0/4027118346 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:43.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f86227ee640 1 --2- 172.21.15.122:0/4027118346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f861c1575c0 0x7f861c1491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:43.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f86227ee640 1 -- 172.21.15.122:0/4027118346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f861c0c4550 msgr2=0x7f861c0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f86227ee640 1 --2- 172.21.15.122:0/4027118346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f861c0c4550 0x7f861c0ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f86227ee640 1 -- 172.21.15.122:0/4027118346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861c14dd50 msgr2=0x7f861c0cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f86227ee640 1 --2- 172.21.15.122:0/4027118346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861c14dd50 0x7f861c0cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f86227ee640 1 -- 172.21.15.122:0/4027118346 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861c14e220 con 0x7f861c1575c0 2024-09-17T06:03:43.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f86217ec640 1 --2- 172.21.15.122:0/4027118346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861c14dd50 0x7f861c0cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:03:43.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.742+0000 7f86227ee640 1 --2- 172.21.15.122:0/4027118346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f861c1575c0 0x7f861c1491a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f861400c730 tx=0x7f861400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:43.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.754+0000 7f86127fc640 1 -- 172.21.15.122:0/4027118346 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614003b80 con 0x7f861c1575c0 2024-09-17T06:03:43.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.754+0000 7f1be496b640 1 -- 172.21.15.122:0/274277904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f1bc4005860 con 0x7f1bc8003b00 2024-09-17T06:03:43.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.758+0000 7fb915a42640 1 -- 172.21.15.122:0/2794557738 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fb8ec005590 con 0x7fb9100c7470 2024-09-17T06:03:43.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.762+0000 7f1bceffd640 1 -- 172.21.15.122:0/274277904 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v15)=0 v15) ==== 115+0+0 (secure 0 0 0) 0x7f1bd8016790 con 0x7f1bc8003b00 2024-09-17T06:03:43.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.762+0000 7f8622fef640 1 -- 172.21.15.122:0/4027118346 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861c1478d0 con 0x7f861c1575c0 2024-09-17T06:03:43.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.762+0000 7f8622fef640 1 -- 172.21.15.122:0/4027118346 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f861c0cc690 con 0x7f861c1575c0 2024-09-17T06:03:43.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.762+0000 7f86127fc640 1 -- 172.21.15.122:0/4027118346 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8614003d20 con 0x7f861c1575c0 2024-09-17T06:03:43.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.762+0000 7f86127fc640 1 -- 172.21.15.122:0/4027118346 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614005330 con 0x7f861c1575c0 2024-09-17T06:03:43.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.766+0000 7f86127fc640 1 -- 172.21.15.122:0/4027118346 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f86140054d0 con 0x7f861c1575c0 2024-09-17T06:03:43.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.766+0000 7f86127fc640 1 -- 172.21.15.122:0/4027118346 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f86140127f0 con 0x7f861c1575c0 2024-09-17T06:03:43.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.770+0000 7f1be496b640 1 -- 172.21.15.122:0/274277904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8003b00 msgr2=0x7f1be0152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.770+0000 7f1be496b640 1 --2- 172.21.15.122:0/274277904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8003b00 0x7f1be0152c50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ab040 tx=0x7f1bd80a5d60 comp rx=0 tx=0).stop 2024-09-17T06:03:43.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.770+0000 7f1be496b640 1 -- 172.21.15.122:0/274277904 shutdown_connections 2024-09-17T06:03:43.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.770+0000 7f1be496b640 1 --2- 172.21.15.122:0/274277904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1be00bb660 0x7f1be01f0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.770+0000 7f1be496b640 1 --2- 172.21.15.122:0/274277904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1be014f280 0x7f1be00bb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.770+0000 7f1be496b640 1 --2- 172.21.15.122:0/274277904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc8003b00 0x7f1be0152c50 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ab040 tx=0x7f1bd80a5d60 comp rx=0 tx=0).stop 2024-09-17T06:03:43.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.770+0000 7f1be496b640 1 -- 172.21.15.122:0/274277904 >> 172.21.15.122:0/274277904 conn(0x7f1be006d290 msgr2=0x7f1be0068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.774+0000 7fb8fffff640 1 -- 172.21.15.122:0/2794557738 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v16)=0 v16) ==== 120+0+0 (secure 0 0 0) 0x7fb904003bf0 con 0x7fb9100c7470 2024-09-17T06:03:43.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.774+0000 7f8622fef640 1 -- 172.21.15.122:0/4027118346 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86040052a0 con 0x7f861c1575c0 2024-09-17T06:03:43.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.782+0000 7f86127fc640 1 -- 172.21.15.122:0/4027118346 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f861400a640 con 0x7f861c1575c0 2024-09-17T06:03:43.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.786+0000 7f1be496b640 1 -- 172.21.15.122:0/274277904 shutdown_connections 2024-09-17T06:03:43.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.786+0000 7f1be496b640 1 -- 172.21.15.122:0/274277904 wait complete. 2024-09-17T06:03:43.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.790+0000 7f7b40ff9640 1 -- 172.21.15.122:0/2405362245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f7b28005860 con 0x7f7b4c0c6780 2024-09-17T06:03:43.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.790+0000 7fb915a42640 1 -- 172.21.15.122:0/2794557738 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9100c7470 msgr2=0x7fb910154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.790+0000 7fb915a42640 1 --2- 172.21.15.122:0/2794557738 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9100c7470 0x7fb910154270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb910074e50 tx=0x7fb90400c820 comp rx=0 tx=0).stop 2024-09-17T06:03:43.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.790+0000 7fb915a42640 1 -- 172.21.15.122:0/2794557738 shutdown_connections 2024-09-17T06:03:43.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.790+0000 7fb915a42640 1 --2- 172.21.15.122:0/2794557738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb91015b1e0 0x7fb91014f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.790+0000 7fb915a42640 1 --2- 172.21.15.122:0/2794557738 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9100c7470 0x7fb910154270 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.790+0000 7fb915a42640 1 --2- 172.21.15.122:0/2794557738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9100c6f60 0x7fb9101fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.790+0000 7fb915a42640 1 -- 172.21.15.122:0/2794557738 >> 172.21.15.122:0/2794557738 conn(0x7fb91006d290 msgr2=0x7fb9100ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.790+0000 7fb915a42640 1 -- 172.21.15.122:0/2794557738 shutdown_connections 2024-09-17T06:03:43.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.790+0000 7fb915a42640 1 -- 172.21.15.122:0/2794557738 wait complete. 2024-09-17T06:03:43.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.798+0000 7f4de2070640 1 -- 172.21.15.122:0/1004748913 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f4dbc005590 con 0x7f4ddc0c8130 2024-09-17T06:03:43.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.802+0000 7f7b42ffd640 1 -- 172.21.15.122:0/2405362245 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v17)=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f7b3c010a40 con 0x7f7b4c0c6780 2024-09-17T06:03:43.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.806+0000 7f4dd1ffb640 1 -- 172.21.15.122:0/1004748913 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v18)=0 v18) ==== 111+0+0 (secure 0 0 0) 0x7f4dd800d040 con 0x7f4ddc0c8130 2024-09-17T06:03:43.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.814+0000 7f0db9e19640 1 -- 172.21.15.122:0/722058762 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f0db40c7a30 con 0x7f0db4165480 2024-09-17T06:03:43.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.814+0000 7f7b40ff9640 1 -- 172.21.15.122:0/2405362245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c0c6780 msgr2=0x7f7b4c154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.814+0000 7f7b40ff9640 1 --2- 172.21.15.122:0/2405362245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c0c6780 0x7f7b4c154010 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0058d0 tx=0x7f7b3c00dde0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.814+0000 7f7b40ff9640 1 -- 172.21.15.122:0/2405362245 shutdown_connections 2024-09-17T06:03:43.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.814+0000 7f7b40ff9640 1 --2- 172.21.15.122:0/2405362245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b4c157c50 0x7f7b4c152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.814+0000 7f7b40ff9640 1 --2- 172.21.15.122:0/2405362245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b4c0c81d0 0x7f7b4c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.814+0000 7f7b40ff9640 1 --2- 172.21.15.122:0/2405362245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4c0c6780 0x7f7b4c154010 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.814+0000 7f7b40ff9640 1 -- 172.21.15.122:0/2405362245 >> 172.21.15.122:0/2405362245 conn(0x7f7b4c06d290 msgr2=0x7f7b4c0c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.818+0000 7f7b40ff9640 1 -- 172.21.15.122:0/2405362245 shutdown_connections 2024-09-17T06:03:43.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.818+0000 7f7b40ff9640 1 -- 172.21.15.122:0/2405362245 wait complete. 2024-09-17T06:03:43.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.830+0000 7f0db17fa640 1 -- 172.21.15.122:0/722058762 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v19)=0 v19) ==== 116+0+0 (secure 0 0 0) 0x7f0da8003600 con 0x7f0db4165480 2024-09-17T06:03:43.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.830+0000 7fae49d15640 1 -- 172.21.15.122:0/429137871 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fae28005590 con 0x7fae440c7470 2024-09-17T06:03:43.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.834+0000 7fae3bfff640 1 -- 172.21.15.122:0/429137871 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7fae2c012ab0 con 0x7fae440c7470 2024-09-17T06:03:43.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f0db9e19640 1 -- 172.21.15.122:0/722058762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db4165480 msgr2=0x7f0db40c1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f4de2070640 1 -- 172.21.15.122:0/1004748913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ddc0c8130 msgr2=0x7f4ddc1fa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f4de2070640 1 --2- 172.21.15.122:0/1004748913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ddc0c8130 0x7f4ddc1fa090 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800b440 tx=0x7f4dd800b900 comp rx=0 tx=0).stop 2024-09-17T06:03:43.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f0db9e19640 1 --2- 172.21.15.122:0/722058762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db4165480 0x7f0db40c1b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0da8005fd0 tx=0x7f0da800fb70 comp rx=0 tx=0).stop 2024-09-17T06:03:43.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f4de2070640 1 -- 172.21.15.122:0/1004748913 shutdown_connections 2024-09-17T06:03:43.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f4de2070640 1 --2- 172.21.15.122:0/1004748913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ddc151e80 0x7f4ddc151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f4de2070640 1 --2- 172.21.15.122:0/1004748913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ddc0cc5d0 0x7f4ddc153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f4de2070640 1 --2- 172.21.15.122:0/1004748913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ddc0c8130 0x7f4ddc1fa090 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800b440 tx=0x7f4dd800b900 comp rx=0 tx=0).stop 2024-09-17T06:03:43.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f4de2070640 1 -- 172.21.15.122:0/1004748913 >> 172.21.15.122:0/1004748913 conn(0x7f4ddc071cc0 msgr2=0x7f4ddc156b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f4de2070640 1 -- 172.21.15.122:0/1004748913 shutdown_connections 2024-09-17T06:03:43.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f4de2070640 1 -- 172.21.15.122:0/1004748913 wait complete. 2024-09-17T06:03:43.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f0db9e19640 1 -- 172.21.15.122:0/722058762 shutdown_connections 2024-09-17T06:03:43.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f0db9e19640 1 --2- 172.21.15.122:0/722058762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0db4165480 0x7f0db40c1b90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f0db9e19640 1 --2- 172.21.15.122:0/722058762 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0db40ccb10 0x7f0db41604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f0db9e19640 1 --2- 172.21.15.122:0/722058762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0db40c3cf0 0x7f0db4209500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f0db9e19640 1 -- 172.21.15.122:0/722058762 >> 172.21.15.122:0/722058762 conn(0x7f0db4071cc0 msgr2=0x7f0db40c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f0db9e19640 1 -- 172.21.15.122:0/722058762 shutdown_connections 2024-09-17T06:03:43.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7f0db9e19640 1 -- 172.21.15.122:0/722058762 wait complete. 2024-09-17T06:03:43.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7fae49d15640 1 -- 172.21.15.122:0/429137871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440c7470 msgr2=0x7fae4414eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.850+0000 7fae49d15640 1 --2- 172.21.15.122:0/429137871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440c7470 0x7fae4414eff0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00c3a0 tx=0x7fae2c00c860 comp rx=0 tx=0).stop 2024-09-17T06:03:43.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.870+0000 7fae49d15640 1 -- 172.21.15.122:0/429137871 shutdown_connections 2024-09-17T06:03:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.870+0000 7fae49d15640 1 --2- 172.21.15.122:0/429137871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae4415b1e0 0x7fae4414f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.870+0000 7fae49d15640 1 --2- 172.21.15.122:0/429137871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae440c7470 0x7fae4414eff0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.870+0000 7fae49d15640 1 --2- 172.21.15.122:0/429137871 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fae440c6f60 0x7fae441587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.870+0000 7fae49d15640 1 -- 172.21.15.122:0/429137871 >> 172.21.15.122:0/429137871 conn(0x7fae4406d290 msgr2=0x7fae440c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.870+0000 7fae49d15640 1 -- 172.21.15.122:0/429137871 shutdown_connections 2024-09-17T06:03:43.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.870+0000 7fae49d15640 1 -- 172.21.15.122:0/429137871 wait complete. 2024-09-17T06:03:43.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.874+0000 7f41b0d96640 1 -- 172.21.15.122:0/2134598998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f4190005590 con 0x7f41ac0c6f60 2024-09-17T06:03:43.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.878+0000 7fd8e094b640 1 -- 172.21.15.122:0/1985127670 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fd8bc005590 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.878+0000 7f419affd640 1 -- 172.21.15.122:0/2134598998 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v21)=0 v21) ==== 120+0+0 (secure 0 0 0) 0x7f41a0016530 con 0x7f41ac0c6f60 2024-09-17T06:03:43.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.882+0000 7f41b0d96640 1 -- 172.21.15.122:0/2134598998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41ac0c6f60 msgr2=0x7f41ac169200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.882+0000 7f41b0d96640 1 --2- 172.21.15.122:0/2134598998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41ac0c6f60 0x7f41ac169200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f41a00982e0 tx=0x7f41a0005740 comp rx=0 tx=0).stop 2024-09-17T06:03:43.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.882+0000 7f2183baa640 1 -- 172.21.15.122:0/2634454433 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f2164005590 con 0x7f217c0cd0c0 2024-09-17T06:03:43.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.882+0000 7f41b0d96640 1 -- 172.21.15.122:0/2134598998 shutdown_connections 2024-09-17T06:03:43.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.882+0000 7f41b0d96640 1 --2- 172.21.15.122:0/2134598998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41ac15b1e0 0x7f41ac144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.882+0000 7f41b0d96640 1 --2- 172.21.15.122:0/2134598998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41ac0c7470 0x7f41ac143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.882+0000 7f41b0d96640 1 --2- 172.21.15.122:0/2134598998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41ac0c6f60 0x7f41ac169200 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.882+0000 7f41b0d96640 1 -- 172.21.15.122:0/2134598998 >> 172.21.15.122:0/2134598998 conn(0x7f41ac06d290 msgr2=0x7f41ac15a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.882+0000 7f41b0d96640 1 -- 172.21.15.122:0/2134598998 shutdown_connections 2024-09-17T06:03:43.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.882+0000 7f41b0d96640 1 -- 172.21.15.122:0/2134598998 wait complete. 2024-09-17T06:03:43.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.886+0000 7fd8c37fe640 1 -- 172.21.15.122:0/1985127670 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v22)=0 v22) ==== 108+0+0 (secure 0 0 0) 0x7fd8d40a6d70 con 0x7fd8dc0c81d0 2024-09-17T06:03:43.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.886+0000 7fa9dcff9640 1 -- 172.21.15.122:0/1000376366 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fa9d0005590 con 0x7fa9e80c6f60 2024-09-17T06:03:43.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.886+0000 7fd8e094b640 1 -- 172.21.15.122:0/1985127670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8dc0c81d0 msgr2=0x7fd8dc1539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.886+0000 7fd8e094b640 1 --2- 172.21.15.122:0/1985127670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8dc0c81d0 0x7fd8dc1539f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400ace0 tx=0x7fd8d4004bb0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.886+0000 7f2f35c5e640 1 -- 172.21.15.122:0/2802017554 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f2f10005590 con 0x7f2f30157cd0 2024-09-17T06:03:43.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.890+0000 7fd8e094b640 1 -- 172.21.15.122:0/1985127670 shutdown_connections 2024-09-17T06:03:43.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.890+0000 7fd8e094b640 1 --2- 172.21.15.122:0/1985127670 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8dc203b60 0x7fd8dc0cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.890+0000 7fd8e094b640 1 --2- 172.21.15.122:0/1985127670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8dc157c50 0x7fd8dc204d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.890+0000 7fd8e094b640 1 --2- 172.21.15.122:0/1985127670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8dc0c81d0 0x7fd8dc1539f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.890+0000 7fd8e094b640 1 -- 172.21.15.122:0/1985127670 >> 172.21.15.122:0/1985127670 conn(0x7fd8dc06d290 msgr2=0x7fd8dc165680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.890+0000 7f82eb265640 1 -- 172.21.15.122:0/3521908246 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f82e40c7e40 con 0x7f82e40cc5d0 2024-09-17T06:03:43.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.890+0000 7fd8e094b640 1 -- 172.21.15.122:0/1985127670 shutdown_connections 2024-09-17T06:03:43.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.890+0000 7fd8e094b640 1 -- 172.21.15.122:0/1985127670 wait complete. 2024-09-17T06:03:43.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.898+0000 7fa9deffd640 1 -- 172.21.15.122:0/1000376366 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v23)=0 v23) ==== 122+0+0 (secure 0 0 0) 0x7fa9d801ea50 con 0x7fa9e80c6f60 2024-09-17T06:03:43.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.898+0000 7fa9dcff9640 1 -- 172.21.15.122:0/1000376366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e80c6f60 msgr2=0x7fa9e8201b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.898+0000 7fa9dcff9640 1 --2- 172.21.15.122:0/1000376366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e80c6f60 0x7fa9e8201b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009c90 tx=0x7fa9d800c430 comp rx=0 tx=0).stop 2024-09-17T06:03:43.901 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.901 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.901 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.898+0000 7fa9dcff9640 1 -- 172.21.15.122:0/1000376366 shutdown_connections 2024-09-17T06:03:43.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.898+0000 7fa9dcff9640 1 --2- 172.21.15.122:0/1000376366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e80c6f60 0x7fa9e8201b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.898+0000 7fa9dcff9640 1 --2- 172.21.15.122:0/1000376366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e80c61c0 0x7fa9e81f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.898+0000 7fa9dcff9640 1 --2- 172.21.15.122:0/1000376366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9e8074ec0 0x7fa9e81ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.898+0000 7fa9dcff9640 1 -- 172.21.15.122:0/1000376366 >> 172.21.15.122:0/1000376366 conn(0x7fa9e806d290 msgr2=0x7fa9e80c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.898+0000 7fa9dcff9640 1 -- 172.21.15.122:0/1000376366 shutdown_connections 2024-09-17T06:03:43.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.898+0000 7fa9dcff9640 1 -- 172.21.15.122:0/1000376366 wait complete. 2024-09-17T06:03:43.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.906+0000 7f21727fc640 1 -- 172.21.15.122:0/2634454433 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v24)=0 v24) ==== 119+0+0 (secure 0 0 0) 0x7f21780164d0 con 0x7f217c0cd0c0 2024-09-17T06:03:43.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.910+0000 7f2183baa640 1 -- 172.21.15.122:0/2634454433 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f217c0cd0c0 msgr2=0x7f217c14ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.910+0000 7f2183baa640 1 --2- 172.21.15.122:0/2634454433 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f217c0cd0c0 0x7f217c14ae30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f21780ac000 tx=0x7f21780051a0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.910+0000 7f2183baa640 1 -- 172.21.15.122:0/2634454433 shutdown_connections 2024-09-17T06:03:43.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.910+0000 7f2183baa640 1 --2- 172.21.15.122:0/2634454433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f217c201180 0x7f217c151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.910+0000 7f2183baa640 1 --2- 172.21.15.122:0/2634454433 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f217c0cd0c0 0x7f217c14ae30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.910+0000 7fa2c1870640 1 -- 172.21.15.122:0/3273248500 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fa2bc1506d0 con 0x7fa2bc0c9750 2024-09-17T06:03:43.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.910+0000 7f2183baa640 1 --2- 172.21.15.122:0/2634454433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f217c0c5670 0x7f217c154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.910+0000 7f2183baa640 1 -- 172.21.15.122:0/2634454433 >> 172.21.15.122:0/2634454433 conn(0x7f217c06d290 msgr2=0x7f217c0c6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.910+0000 7f2183baa640 1 -- 172.21.15.122:0/2634454433 shutdown_connections 2024-09-17T06:03:43.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.910+0000 7f2183baa640 1 -- 172.21.15.122:0/2634454433 wait complete. 2024-09-17T06:03:43.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.914+0000 7f2f2d7fa640 1 -- 172.21.15.122:0/2802017554 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f2f280acde0 con 0x7f2f30157cd0 2024-09-17T06:03:43.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.918+0000 7f2f35c5e640 1 -- 172.21.15.122:0/2802017554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f30157cd0 msgr2=0x7f2f3013ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.918+0000 7f2f35c5e640 1 --2- 172.21.15.122:0/2802017554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f30157cd0 0x7f2f3013ef60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2f300c4cc0 tx=0x7f2f280ac560 comp rx=0 tx=0).stop 2024-09-17T06:03:43.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.918+0000 7f2f35c5e640 1 -- 172.21.15.122:0/2802017554 shutdown_connections 2024-09-17T06:03:43.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.918+0000 7f2f35c5e640 1 --2- 172.21.15.122:0/2802017554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f30157cd0 0x7f2f3013ef60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.918+0000 7f2f35c5e640 1 --2- 172.21.15.122:0/2802017554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f3014dd50 0x7f2f300cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.918+0000 7f2f35c5e640 1 --2- 172.21.15.122:0/2802017554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f300c4550 0x7f2f301f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.918+0000 7f2f35c5e640 1 -- 172.21.15.122:0/2802017554 >> 172.21.15.122:0/2802017554 conn(0x7f2f30070000 msgr2=0x7f2f300c79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.918+0000 7f2f35c5e640 1 -- 172.21.15.122:0/2802017554 shutdown_connections 2024-09-17T06:03:43.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.918+0000 7f2f35c5e640 1 -- 172.21.15.122:0/2802017554 wait complete. 2024-09-17T06:03:43.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.922+0000 7f82daffd640 1 -- 172.21.15.122:0/3521908246 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v26)=0 v26) ==== 125+0+0 (secure 0 0 0) 0x7f82dc016970 con 0x7f82e40cc5d0 2024-09-17T06:03:43.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.922+0000 7f82eb265640 1 -- 172.21.15.122:0/3521908246 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f82e40cc5d0 msgr2=0x7f82e414c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.922+0000 7f82eb265640 1 --2- 172.21.15.122:0/3521908246 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f82e40cc5d0 0x7f82e414c1b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009bd0 tx=0x7f82dc0a5c60 comp rx=0 tx=0).stop 2024-09-17T06:03:43.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.926+0000 7f82eb265640 1 -- 172.21.15.122:0/3521908246 shutdown_connections 2024-09-17T06:03:43.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.926+0000 7f82eb265640 1 --2- 172.21.15.122:0/3521908246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82e4148060 0x7f82e4148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.926+0000 7f82eb265640 1 --2- 172.21.15.122:0/3521908246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82e415b1e0 0x7f82e40cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.926+0000 7f82eb265640 1 --2- 172.21.15.122:0/3521908246 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f82e40cc5d0 0x7f82e414c1b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.926+0000 7f82eb265640 1 -- 172.21.15.122:0/3521908246 >> 172.21.15.122:0/3521908246 conn(0x7f82e4071cc0 msgr2=0x7f82e414b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.926+0000 7f82eb265640 1 -- 172.21.15.122:0/3521908246 shutdown_connections 2024-09-17T06:03:43.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.926+0000 7f82eb265640 1 -- 172.21.15.122:0/3521908246 wait complete. 2024-09-17T06:03:43.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.930+0000 7fa2b97fa640 1 -- 172.21.15.122:0/3273248500 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7fa2ac0107e0 con 0x7fa2bc0c9750 2024-09-17T06:03:43.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.930+0000 7fa2c1870640 1 -- 172.21.15.122:0/3273248500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2bc0c9750 msgr2=0x7fa2bc1565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.930+0000 7fa2c1870640 1 --2- 172.21.15.122:0/3273248500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2bc0c9750 0x7fa2bc1565d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00d6d0 tx=0x7fa2ac00db90 comp rx=0 tx=0).stop 2024-09-17T06:03:43.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.930+0000 7fa2c1870640 1 -- 172.21.15.122:0/3273248500 shutdown_connections 2024-09-17T06:03:43.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.930+0000 7fa2c1870640 1 --2- 172.21.15.122:0/3273248500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2bc1509a0 0x7fa2bc168530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.930+0000 7fa2c1870640 1 --2- 172.21.15.122:0/3273248500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2bc0c9b60 0x7fa2bc169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.930+0000 7fa2c1870640 1 --2- 172.21.15.122:0/3273248500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2bc0c9750 0x7fa2bc1565d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.930+0000 7fa2c1870640 1 -- 172.21.15.122:0/3273248500 >> 172.21.15.122:0/3273248500 conn(0x7fa2bc06d290 msgr2=0x7fa2bc159240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.930+0000 7fa2c1870640 1 -- 172.21.15.122:0/3273248500 shutdown_connections 2024-09-17T06:03:43.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.930+0000 7fa2c1870640 1 -- 172.21.15.122:0/3273248500 wait complete. 2024-09-17T06:03:43.935 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.934+0000 7f8622fef640 1 -- 172.21.15.122:0/4027118346 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f8604005590 con 0x7f861c1575c0 2024-09-17T06:03:43.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.946+0000 7f86127fc640 1 -- 172.21.15.122:0/4027118346 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f8614006b60 con 0x7f861c1575c0 2024-09-17T06:03:43.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.946+0000 7f8622fef640 1 -- 172.21.15.122:0/4027118346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f861c1575c0 msgr2=0x7f861c1491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:43.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.946+0000 7f8622fef640 1 --2- 172.21.15.122:0/4027118346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f861c1575c0 0x7f861c1491a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f861400c730 tx=0x7f861400cbf0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.950+0000 7f8622fef640 1 -- 172.21.15.122:0/4027118346 shutdown_connections 2024-09-17T06:03:43.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.950+0000 7f8622fef640 1 --2- 172.21.15.122:0/4027118346 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f861c1575c0 0x7f861c1491a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.950+0000 7f8622fef640 1 --2- 172.21.15.122:0/4027118346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f861c14dd50 0x7f861c0cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.950+0000 7f8622fef640 1 --2- 172.21.15.122:0/4027118346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f861c0c4550 0x7f861c0ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:43.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.950+0000 7f8622fef640 1 -- 172.21.15.122:0/4027118346 >> 172.21.15.122:0/4027118346 conn(0x7f861c070000 msgr2=0x7f861c155250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:43.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.950+0000 7f8622fef640 1 -- 172.21.15.122:0/4027118346 shutdown_connections 2024-09-17T06:03:43.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:43.950+0000 7f8622fef640 1 -- 172.21.15.122:0/4027118346 wait complete. 2024-09-17T06:03:43.969 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.969 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_dir_prefetch', 'True'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.969 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.969 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.970 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.970 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.970 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.970 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.970 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.970 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.970 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.970 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi122') 2024-09-17T06:03:43.971 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config dump 2024-09-17T06:03:44.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.146+0000 7f961f646640 1 -- 172.21.15.122:0/3901640982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f961806e370 msgr2=0x7f9618152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:44.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.146+0000 7f961f646640 1 --2- 172.21.15.122:0/3901640982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f961806e370 0x7f9618152190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9614009840 tx=0x7f961401c820 comp rx=0 tx=0).stop 2024-09-17T06:03:44.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.146+0000 7f961f646640 1 -- 172.21.15.122:0/3901640982 shutdown_connections 2024-09-17T06:03:44.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.146+0000 7f961f646640 1 --2- 172.21.15.122:0/3901640982 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96180c26f0 0x7f961806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.146+0000 7f961f646640 1 --2- 172.21.15.122:0/3901640982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f961806e370 0x7f9618152190 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.146+0000 7f961f646640 1 -- 172.21.15.122:0/3901640982 >> 172.21.15.122:0/3901640982 conn(0x7f96180cd4f0 msgr2=0x7f96180cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:44.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.146+0000 7f961f646640 1 -- 172.21.15.122:0/3901640982 shutdown_connections 2024-09-17T06:03:44.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.146+0000 7f961f646640 1 -- 172.21.15.122:0/3901640982 wait complete. 2024-09-17T06:03:44.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961f646640 1 Processor -- start 2024-09-17T06:03:44.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961f646640 1 -- start start 2024-09-17T06:03:44.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961f646640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f961806dd20 0x7f96180aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:44.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961f646640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f961806e370 0x7f96180ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:44.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961f646640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96180c26f0 0x7f9618150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:44.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961f646640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9618158980 con 0x7f961806e370 2024-09-17T06:03:44.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961f646640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f96181586a0 con 0x7f96180c26f0 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961f646640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f961806ed50 con 0x7f961806dd20 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961cbe1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f961806e370 0x7f96180ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961cbe1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f961806e370 0x7f96180ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44756/0 (socket says 172.21.15.122:44756) 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961cbe1640 1 -- 172.21.15.122:0/2156542987 learned_addr learned my addr 172.21.15.122:0/2156542987 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961d3e2640 1 --2- 172.21.15.122:0/2156542987 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f961806dd20 0x7f96180aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961dbe3640 1 --2- 172.21.15.122:0/2156542987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96180c26f0 0x7f9618150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961cbe1640 1 -- 172.21.15.122:0/2156542987 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f961806dd20 msgr2=0x7f96180aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961cbe1640 1 --2- 172.21.15.122:0/2156542987 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f961806dd20 0x7f96180aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961cbe1640 1 -- 172.21.15.122:0/2156542987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96180c26f0 msgr2=0x7f9618150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961cbe1640 1 --2- 172.21.15.122:0/2156542987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96180c26f0 0x7f9618150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961cbe1640 1 -- 172.21.15.122:0/2156542987 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96180adef0 con 0x7f961806e370 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961cbe1640 1 --2- 172.21.15.122:0/2156542987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f961806e370 0x7f96180ad9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f960800e9f0 tx=0x7f960800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f960dffb640 1 -- 172.21.15.122:0/2156542987 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960800ccc0 con 0x7f961806e370 2024-09-17T06:03:44.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f960dffb640 1 -- 172.21.15.122:0/2156542987 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9608004020 con 0x7f961806e370 2024-09-17T06:03:44.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961f646640 1 -- 172.21.15.122:0/2156542987 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96181f4ee0 con 0x7f961806e370 2024-09-17T06:03:44.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f960dffb640 1 -- 172.21.15.122:0/2156542987 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960800ce60 con 0x7f961806e370 2024-09-17T06:03:44.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f961f646640 1 -- 172.21.15.122:0/2156542987 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96181f54a0 con 0x7f961806e370 2024-09-17T06:03:44.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f960dffb640 1 -- 172.21.15.122:0/2156542987 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9608003990 con 0x7f961806e370 2024-09-17T06:03:44.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.150+0000 7f960dffb640 1 -- 172.21.15.122:0/2156542987 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9608018430 con 0x7f961806e370 2024-09-17T06:03:44.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.154+0000 7f961f646640 1 -- 172.21.15.122:0/2156542987 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9618152190 con 0x7f961806e370 2024-09-17T06:03:44.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.154+0000 7f960dffb640 1 -- 172.21.15.122:0/2156542987 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9608004450 con 0x7f961806e370 2024-09-17T06:03:44.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.210+0000 7f961f646640 1 -- 172.21.15.122:0/2156542987 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f96180b0970 con 0x7f961806e370 2024-09-17T06:03:44.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.210+0000 7f960dffb640 1 -- 172.21.15.122:0/2156542987 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v28) ==== 59+0+1848 (secure 0 0 0) 0x7f9608009380 con 0x7f961806e370 2024-09-17T06:03:44.213 INFO:teuthology.orchestra.run.smithi122.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T06:03:44.213 INFO:teuthology.orchestra.run.smithi122.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T06:03:44.213 INFO:teuthology.orchestra.run.smithi122.stdout:mgr advanced client_mount_timeout 30 2024-09-17T06:03:44.213 INFO:teuthology.orchestra.run.smithi122.stdout:mgr advanced debug_client 20/20 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mgr advanced debug_mgr 20/20 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mgr advanced debug_ms 1/1 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mds advanced debug_mds 20/20 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mds advanced debug_ms 2/2 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mds advanced mds_bal_merge_size 5 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mds advanced mds_bal_split_bits 3 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mds advanced mds_bal_split_size 100 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mds dev mds_debug_frag true 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mds dev mds_debug_scatterstat true 2024-09-17T06:03:44.214 INFO:teuthology.orchestra.run.smithi122.stdout:mds advanced mds_dir_prefetch true 2024-09-17T06:03:44.215 INFO:teuthology.orchestra.run.smithi122.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T06:03:44.215 INFO:teuthology.orchestra.run.smithi122.stdout:mds dev mds_verify_scatter true 2024-09-17T06:03:44.215 INFO:teuthology.orchestra.run.smithi122.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T06:03:44.215 INFO:teuthology.orchestra.run.smithi122.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T06:03:44.215 INFO:teuthology.orchestra.run.smithi122.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T06:03:44.215 INFO:teuthology.orchestra.run.smithi122.stdout:client advanced client_mount_timeout 600 2024-09-17T06:03:44.215 INFO:teuthology.orchestra.run.smithi122.stdout:client advanced debug_client 20/20 2024-09-17T06:03:44.215 INFO:teuthology.orchestra.run.smithi122.stdout:client advanced debug_ms 1/1 2024-09-17T06:03:44.215 INFO:teuthology.orchestra.run.smithi122.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T06:03:44.215 INFO:teuthology.orchestra.run.smithi122.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T06:03:44.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.214+0000 7f961f646640 1 -- 172.21.15.122:0/2156542987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f961806e370 msgr2=0x7f96180ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:44.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.214+0000 7f961f646640 1 --2- 172.21.15.122:0/2156542987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f961806e370 0x7f96180ad9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f960800e9f0 tx=0x7f960800eeb0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.214+0000 7f961f646640 1 -- 172.21.15.122:0/2156542987 shutdown_connections 2024-09-17T06:03:44.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.214+0000 7f961f646640 1 --2- 172.21.15.122:0/2156542987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96180c26f0 0x7f9618150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.214+0000 7f961f646640 1 --2- 172.21.15.122:0/2156542987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f961806e370 0x7f96180ad9b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.214+0000 7f961f646640 1 --2- 172.21.15.122:0/2156542987 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f961806dd20 0x7f96180aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.214+0000 7f961f646640 1 -- 172.21.15.122:0/2156542987 >> 172.21.15.122:0/2156542987 conn(0x7f96180cd4f0 msgr2=0x7f96180c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:44.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.214+0000 7f961f646640 1 -- 172.21.15.122:0/2156542987 shutdown_connections 2024-09-17T06:03:44.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.214+0000 7f961f646640 1 -- 172.21.15.122:0/2156542987 wait complete. 2024-09-17T06:03:44.233 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T06:03:44.233 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T06:03:44.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.374+0000 7f97d2320640 1 -- 172.21.15.122:0/3776930244 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97cc0c29c0 msgr2=0x7f97cc0c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:44.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.374+0000 7f97d2320640 1 --2- 172.21.15.122:0/3776930244 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97cc0c29c0 0x7f97cc0c8af0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009900 tx=0x7f97c001c850 comp rx=0 tx=0).stop 2024-09-17T06:03:44.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.374+0000 7f97d2320640 1 -- 172.21.15.122:0/3776930244 shutdown_connections 2024-09-17T06:03:44.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.374+0000 7f97d2320640 1 --2- 172.21.15.122:0/3776930244 >> v2:172.21.15.173:3300/0 conn(0x7f97cc0c2dd0 0x7f97cc0c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.374+0000 7f97d2320640 1 --2- 172.21.15.122:0/3776930244 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97cc0c29c0 0x7f97cc0c8af0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.374+0000 7f97d2320640 1 -- 172.21.15.122:0/3776930244 >> 172.21.15.122:0/3776930244 conn(0x7f97cc0ca380 msgr2=0x7f97cc0ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:44.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.374+0000 7f97d2320640 1 -- 172.21.15.122:0/3776930244 shutdown_connections 2024-09-17T06:03:44.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.374+0000 7f97d2320640 1 -- 172.21.15.122:0/3776930244 wait complete. 2024-09-17T06:03:44.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d2320640 1 Processor -- start 2024-09-17T06:03:44.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d2320640 1 -- start start 2024-09-17T06:03:44.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d2320640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97cc0c29c0 0x7f97cc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:44.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d2320640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97cc0c2dd0 0x7f97cc0b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:44.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d2320640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97cc158150 0x7f97cc14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:44.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d2320640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc06ff60 con 0x7f97cc158150 2024-09-17T06:03:44.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d2320640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0c9570 con 0x7f97cc0c2dd0 2024-09-17T06:03:44.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d2320640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc142ae0 con 0x7f97cc0c29c0 2024-09-17T06:03:44.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d08bd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97cc158150 0x7f97cc14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:44.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d08bd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97cc158150 0x7f97cc14fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44766/0 (socket says 172.21.15.122:44766) 2024-09-17T06:03:44.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d08bd640 1 -- 172.21.15.122:0/4087443452 learned_addr learned my addr 172.21.15.122:0/4087443452 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:44.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97cbfff640 1 --2- 172.21.15.122:0/4087443452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97cc0c29c0 0x7f97cc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:44.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97cb7fe640 1 --2- 172.21.15.122:0/4087443452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97cc0c2dd0 0x7f97cc0b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:44.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d08bd640 1 -- 172.21.15.122:0/4087443452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97cc0c29c0 msgr2=0x7f97cc0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:44.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d08bd640 1 --2- 172.21.15.122:0/4087443452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97cc0c29c0 0x7f97cc0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d08bd640 1 -- 172.21.15.122:0/4087443452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97cc0c2dd0 msgr2=0x7f97cc0b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:44.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d08bd640 1 --2- 172.21.15.122:0/4087443452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97cc0c2dd0 0x7f97cc0b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d08bd640 1 -- 172.21.15.122:0/4087443452 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc0cd460 con 0x7f97cc158150 2024-09-17T06:03:44.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d08bd640 1 --2- 172.21.15.122:0/4087443452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97cc158150 0x7f97cc14fb00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f97c400ec00 tx=0x7f97c400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:44.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97c8ff9640 1 -- 172.21.15.122:0/4087443452 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4003b80 con 0x7f97cc158150 2024-09-17T06:03:44.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97c8ff9640 1 -- 172.21.15.122:0/4087443452 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97c4003e10 con 0x7f97cc158150 2024-09-17T06:03:44.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97c8ff9640 1 -- 172.21.15.122:0/4087443452 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4004280 con 0x7f97cc158150 2024-09-17T06:03:44.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d2320640 1 -- 172.21.15.122:0/4087443452 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97cc0b3870 con 0x7f97cc158150 2024-09-17T06:03:44.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d2320640 1 -- 172.21.15.122:0/4087443452 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97cc1517a0 con 0x7f97cc158150 2024-09-17T06:03:44.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97c8ff9640 1 -- 172.21.15.122:0/4087443452 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f97c4004420 con 0x7f97cc158150 2024-09-17T06:03:44.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97c8ff9640 1 -- 172.21.15.122:0/4087443452 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f97c4018470 con 0x7f97cc158150 2024-09-17T06:03:44.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.378+0000 7f97d2320640 1 -- 172.21.15.122:0/4087443452 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97cc152240 con 0x7f97cc158150 2024-09-17T06:03:44.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.382+0000 7f97c8ff9640 1 -- 172.21.15.122:0/4087443452 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f97c4004ec0 con 0x7f97cc158150 2024-09-17T06:03:44.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.442+0000 7f97d2320640 1 -- 172.21.15.122:0/4087443452 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f97cc0c9d80 con 0x7f97cc158150 2024-09-17T06:03:44.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.446+0000 7f97c8ff9640 1 -- 172.21.15.122:0/4087443452 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f97c40050a0 con 0x7f97cc158150 2024-09-17T06:03:44.447 INFO:teuthology.orchestra.run.smithi122.stderr:adjusted tunables profile to default 2024-09-17T06:03:44.448 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.446+0000 7f97d2320640 1 -- 172.21.15.122:0/4087443452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97cc158150 msgr2=0x7f97cc14fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:44.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.446+0000 7f97d2320640 1 --2- 172.21.15.122:0/4087443452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97cc158150 0x7f97cc14fb00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f97c400ec00 tx=0x7f97c400c6a0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.446+0000 7f97d2320640 1 -- 172.21.15.122:0/4087443452 shutdown_connections 2024-09-17T06:03:44.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.446+0000 7f97d2320640 1 --2- 172.21.15.122:0/4087443452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97cc158150 0x7f97cc14fb00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.446+0000 7f97d2320640 1 --2- 172.21.15.122:0/4087443452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97cc0c2dd0 0x7f97cc0b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.446+0000 7f97d2320640 1 --2- 172.21.15.122:0/4087443452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97cc0c29c0 0x7f97cc0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:44.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.446+0000 7f97d2320640 1 -- 172.21.15.122:0/4087443452 >> 172.21.15.122:0/4087443452 conn(0x7f97cc0ca380 msgr2=0x7f97cc0712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:44.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.446+0000 7f97d2320640 1 -- 172.21.15.122:0/4087443452 shutdown_connections 2024-09-17T06:03:44.449 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:44.446+0000 7f97d2320640 1 -- 172.21.15.122:0/4087443452 wait complete. 2024-09-17T06:03:44.467 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T06:03:44.467 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T06:03:44.467 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:44.467 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T06:03:44.478 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:44.478 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T06:03:44.531 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:44.531 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T06:03:44.584 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:03:44.584 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T06:03:44.637 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:44.637 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T06:03:44.651 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:44.651 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T06:03:44.702 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:44.702 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T06:03:44.754 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-17T06:03:44.754 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T06:03:44.806 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new b8a621d5-9187-4034-ac89-5adb5b22ca7a 0 2024-09-17T06:03:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.002+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/829896116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fac0c81f0 msgr2=0x7f0fac0c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.002+0000 7f0fb0cd8640 1 --2- 172.21.15.173:0/829896116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fac0c81f0 0x7f0fac0c7710 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0cb390 tx=0x7f0f9c01c8c0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.002+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/829896116 shutdown_connections 2024-09-17T06:03:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.002+0000 7f0fb0cd8640 1 --2- 172.21.15.173:0/829896116 >> v2:172.21.15.122:3300/0 conn(0x7f0fac0cd780 0x7f0fac0cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.002+0000 7f0fb0cd8640 1 --2- 172.21.15.173:0/829896116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fac0c81f0 0x7f0fac0c7710 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.002+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/829896116 >> 172.21.15.173:0/829896116 conn(0x7f0fac0713b0 msgr2=0x7f0fac0717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.002+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/829896116 shutdown_connections 2024-09-17T06:03:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.002+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/829896116 wait complete. 2024-09-17T06:03:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.002+0000 7f0fb0cd8640 1 Processor -- start 2024-09-17T06:03:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.002+0000 7f0fb0cd8640 1 -- start start 2024-09-17T06:03:45.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fb0cd8640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fac0734e0 0x7f0fac151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:45.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fb0cd8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fac0c81f0 0x7f0fac1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:45.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fb0cd8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fac0cd780 0x7f0fac147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:45.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fb0cd8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac073c70 con 0x7f0fac0cd780 2024-09-17T06:03:45.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fb0cd8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac0c3330 con 0x7f0fac0c81f0 2024-09-17T06:03:45.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fb0cd8640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0fac0c8700 con 0x7f0fac0734e0 2024-09-17T06:03:45.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fa3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fac0c81f0 0x7f0fac1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:45.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0faa59c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fac0734e0 0x7f0fac151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0faa59c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fac0734e0 0x7f0fac151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:36260/0 (socket says 172.21.15.173:36260) 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fa3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fac0c81f0 0x7f0fac1571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50240/0 (socket says 172.21.15.173:50240) 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0faa59c640 1 -- 172.21.15.173:0/851633918 learned_addr learned my addr 172.21.15.173:0/851633918 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0faad9d640 1 --2- 172.21.15.173:0/851633918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fac0cd780 0x7f0fac147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0faa59c640 1 -- 172.21.15.173:0/851633918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fac0c81f0 msgr2=0x7f0fac1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0faa59c640 1 --2- 172.21.15.173:0/851633918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fac0c81f0 0x7f0fac1571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0faa59c640 1 -- 172.21.15.173:0/851633918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fac0cd780 msgr2=0x7f0fac147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0faa59c640 1 --2- 172.21.15.173:0/851633918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fac0cd780 0x7f0fac147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0faa59c640 1 -- 172.21.15.173:0/851633918 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fac14fe10 con 0x7f0fac0734e0 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fa3fff640 1 --2- 172.21.15.173:0/851633918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fac0c81f0 0x7f0fac1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0faa59c640 1 --2- 172.21.15.173:0/851633918 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fac0734e0 0x7f0fac151fd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0b0040 tx=0x7f0f9c0a5580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fa2ffd640 1 -- 172.21.15.173:0/851633918 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0b2040 con 0x7f0fac0734e0 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fa2ffd640 1 -- 172.21.15.173:0/851633918 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f9c0041b0 con 0x7f0fac0734e0 2024-09-17T06:03:45.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fa2ffd640 1 -- 172.21.15.173:0/851633918 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c003600 con 0x7f0fac0734e0 2024-09-17T06:03:45.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/851633918 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fac14bfc0 con 0x7f0fac0734e0 2024-09-17T06:03:45.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/851633918 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fac1517d0 con 0x7f0fac0734e0 2024-09-17T06:03:45.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fa2ffd640 1 -- 172.21.15.173:0/851633918 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0f9c0bf020 con 0x7f0fac0734e0 2024-09-17T06:03:45.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fa2ffd640 1 -- 172.21.15.173:0/851633918 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f0f9c0b8b50 con 0x7f0fac0734e0 2024-09-17T06:03:45.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.006+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/851633918 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fac0c3850 con 0x7f0fac0734e0 2024-09-17T06:03:45.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.010+0000 7f0fa2ffd640 1 -- 172.21.15.173:0/851633918 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0f9c0c6020 con 0x7f0fac0734e0 2024-09-17T06:03:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.078+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/851633918 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b8a621d5-9187-4034-ac89-5adb5b22ca7a", "id": 0} v 0) -- 0x7f0fac15c3a0 con 0x7f0fac0734e0 2024-09-17T06:03:45.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.086+0000 7f0fa2ffd640 1 -- 172.21.15.173:0/851633918 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b8a621d5-9187-4034-ac89-5adb5b22ca7a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f0f9c0164b0 con 0x7f0fac0734e0 2024-09-17T06:03:45.084 INFO:teuthology.orchestra.run.smithi173.stdout:0 2024-09-17T06:03:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.086+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/851633918 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fac0734e0 msgr2=0x7f0fac151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.086+0000 7f0fb0cd8640 1 --2- 172.21.15.173:0/851633918 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fac0734e0 0x7f0fac151fd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0b0040 tx=0x7f0f9c0a5580 comp rx=0 tx=0).stop 2024-09-17T06:03:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.086+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/851633918 shutdown_connections 2024-09-17T06:03:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.086+0000 7f0fb0cd8640 1 --2- 172.21.15.173:0/851633918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fac0cd780 0x7f0fac147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.086+0000 7f0fb0cd8640 1 --2- 172.21.15.173:0/851633918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fac0c81f0 0x7f0fac1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.086+0000 7f0fb0cd8640 1 --2- 172.21.15.173:0/851633918 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fac0734e0 0x7f0fac151fd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.086+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/851633918 >> 172.21.15.173:0/851633918 conn(0x7f0fac0713b0 msgr2=0x7f0fac0c9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.086+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/851633918 shutdown_connections 2024-09-17T06:03:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.086+0000 7f0fb0cd8640 1 -- 172.21.15.173:0/851633918 wait complete. 2024-09-17T06:03:45.102 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 992e1af1-06d0-4849-93bf-4be8fc437183 1 2024-09-17T06:03:45.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.286+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/979699188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b4406e480 msgr2=0x7f2b4406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.286+0000 7f2b4ae7c640 1 --2- 172.21.15.173:0/979699188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b4406e480 0x7f2b4406ce90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2b440738f0 tx=0x7f2b3801f0b0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.286+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/979699188 shutdown_connections 2024-09-17T06:03:45.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.286+0000 7f2b4ae7c640 1 --2- 172.21.15.173:0/979699188 >> v2:172.21.15.122:3300/0 conn(0x7f2b4415be20 0x7f2b4415e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.286+0000 7f2b4ae7c640 1 --2- 172.21.15.173:0/979699188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b4406e480 0x7f2b4406ce90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.286+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/979699188 >> 172.21.15.173:0/979699188 conn(0x7f2b44072d40 msgr2=0x7f2b44073150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:45.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.286+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/979699188 shutdown_connections 2024-09-17T06:03:45.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.286+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/979699188 wait complete. 2024-09-17T06:03:45.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.286+0000 7f2b4ae7c640 1 Processor -- start 2024-09-17T06:03:45.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b4ae7c640 1 -- start start 2024-09-17T06:03:45.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b4ae7c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b4406e480 0x7f2b440cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b4ae7c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b440c9650 0x7f2b44144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b4ae7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b4415be20 0x7f2b4415db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b4ae7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4406d3d0 con 0x7f2b4415be20 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b4ae7c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4406d550 con 0x7f2b440c9650 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b4ae7c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f2b440c27e0 con 0x7f2b4406e480 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b43fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b440c9650 0x7f2b44144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b48c18640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b4406e480 0x7f2b440cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b43fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b440c9650 0x7f2b44144400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50268/0 (socket says 172.21.15.173:50268) 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b43fff640 1 -- 172.21.15.173:0/3870849018 learned_addr learned my addr 172.21.15.173:0/3870849018 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b49419640 1 --2- 172.21.15.173:0/3870849018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b4415be20 0x7f2b4415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b43fff640 1 -- 172.21.15.173:0/3870849018 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b4406e480 msgr2=0x7f2b440cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b43fff640 1 --2- 172.21.15.173:0/3870849018 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b4406e480 0x7f2b440cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b43fff640 1 -- 172.21.15.173:0/3870849018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b4415be20 msgr2=0x7f2b4415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b43fff640 1 --2- 172.21.15.173:0/3870849018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b4415be20 0x7f2b4415db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b43fff640 1 -- 172.21.15.173:0/3870849018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b441f5d70 con 0x7f2b440c9650 2024-09-17T06:03:45.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b48c18640 1 --2- 172.21.15.173:0/3870849018 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b4406e480 0x7f2b440cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:03:45.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b43fff640 1 --2- 172.21.15.173:0/3870849018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b440c9650 0x7f2b44144400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400b410 tx=0x7f2b3400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:45.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b417fa640 1 -- 172.21.15.173:0/3870849018 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b34015030 con 0x7f2b440c9650 2024-09-17T06:03:45.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b417fa640 1 -- 172.21.15.173:0/3870849018 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b34004020 con 0x7f2b440c9650 2024-09-17T06:03:45.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/3870849018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b441f5ff0 con 0x7f2b440c9650 2024-09-17T06:03:45.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b417fa640 1 -- 172.21.15.173:0/3870849018 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b34004470 con 0x7f2b440c9650 2024-09-17T06:03:45.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/3870849018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b441f65b0 con 0x7f2b440c9650 2024-09-17T06:03:45.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b417fa640 1 -- 172.21.15.173:0/3870849018 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2b34018070 con 0x7f2b440c9650 2024-09-17T06:03:45.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b417fa640 1 -- 172.21.15.173:0/3870849018 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f2b34003be0 con 0x7f2b440c9650 2024-09-17T06:03:45.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.290+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/3870849018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b44148510 con 0x7f2b440c9650 2024-09-17T06:03:45.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.294+0000 7f2b417fa640 1 -- 172.21.15.173:0/3870849018 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2b441f5d70 con 0x7f2b440c9650 2024-09-17T06:03:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.362+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/3870849018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "992e1af1-06d0-4849-93bf-4be8fc437183", "id": 1} v 0) -- 0x7f2b440c9c40 con 0x7f2b440c9650 2024-09-17T06:03:45.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.370+0000 7f2b417fa640 1 -- 172.21.15.173:0/3870849018 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "992e1af1-06d0-4849-93bf-4be8fc437183", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f2b34003600 con 0x7f2b440c9650 2024-09-17T06:03:45.368 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-09-17T06:03:45.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.370+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/3870849018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b440c9650 msgr2=0x7f2b44144400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.370+0000 7f2b4ae7c640 1 --2- 172.21.15.173:0/3870849018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b440c9650 0x7f2b44144400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400b410 tx=0x7f2b3400b8d0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.370+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/3870849018 shutdown_connections 2024-09-17T06:03:45.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.370+0000 7f2b4ae7c640 1 --2- 172.21.15.173:0/3870849018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b4415be20 0x7f2b4415db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.370+0000 7f2b4ae7c640 1 --2- 172.21.15.173:0/3870849018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b440c9650 0x7f2b44144400 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.370+0000 7f2b4ae7c640 1 --2- 172.21.15.173:0/3870849018 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b4406e480 0x7f2b440cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.370+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/3870849018 >> 172.21.15.173:0/3870849018 conn(0x7f2b44072d40 msgr2=0x7f2b440c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:45.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.370+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/3870849018 shutdown_connections 2024-09-17T06:03:45.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.370+0000 7f2b4ae7c640 1 -- 172.21.15.173:0/3870849018 wait complete. 2024-09-17T06:03:45.387 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new e3a31b77-d4db-4ee6-af7c-60af7df4bd69 2 2024-09-17T06:03:45.528 INFO:tasks.ceph.mgr.x.smithi173.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T06:03:45.528 INFO:tasks.ceph.mgr.x.smithi173.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T06:03:45.528 INFO:tasks.ceph.mgr.x.smithi173.stderr: from numpy import show_config as show_numpy_config 2024-09-17T06:03:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.534+0000 7f68589a2640 1 -- 172.21.15.173:0/357410096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f683c005260 msgr2=0x7f683c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.534+0000 7f68589a2640 1 --2- 172.21.15.173:0/357410096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f683c005260 0x7f683c00b9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f684c0013e0 tx=0x7f684c01d2a0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.534+0000 7f68589a2640 1 -- 172.21.15.173:0/357410096 shutdown_connections 2024-09-17T06:03:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.534+0000 7f68589a2640 1 --2- 172.21.15.173:0/357410096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f683c005260 0x7f683c00b9d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.534+0000 7f68589a2640 1 -- 172.21.15.173:0/357410096 >> 172.21.15.173:0/357410096 conn(0x7f68540ca380 msgr2=0x7f68540ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.534+0000 7f68589a2640 1 -- 172.21.15.173:0/357410096 shutdown_connections 2024-09-17T06:03:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.534+0000 7f68589a2640 1 -- 172.21.15.173:0/357410096 wait complete. 2024-09-17T06:03:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f68589a2640 1 Processor -- start 2024-09-17T06:03:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f68589a2640 1 -- start start 2024-09-17T06:03:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f68589a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f683c005260 0x7f68541e3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f68589a2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541e5be0 0x7f68541f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f68589a2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68541e5460 0x7f68541e6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f68589a2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f685406e870 con 0x7f683c005260 2024-09-17T06:03:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f68589a2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f685415ba20 con 0x7f68541e5be0 2024-09-17T06:03:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f68589a2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f685406e9f0 con 0x7f68541e5460 2024-09-17T06:03:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6851d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541e5be0 0x7f68541f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6852d9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68541e5460 0x7f68541e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6851d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541e5be0 0x7f68541f2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50292/0 (socket says 172.21.15.173:50292) 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6851d9b640 1 -- 172.21.15.173:0/4125248590 learned_addr learned my addr 172.21.15.173:0/4125248590 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f685259c640 1 --2- 172.21.15.173:0/4125248590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f683c005260 0x7f68541e3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6851d9b640 1 -- 172.21.15.173:0/4125248590 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68541e5460 msgr2=0x7f68541e6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6851d9b640 1 --2- 172.21.15.173:0/4125248590 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68541e5460 0x7f68541e6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6851d9b640 1 -- 172.21.15.173:0/4125248590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f683c005260 msgr2=0x7f68541e3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6851d9b640 1 --2- 172.21.15.173:0/4125248590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f683c005260 0x7f68541e3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6851d9b640 1 -- 172.21.15.173:0/4125248590 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68541f26a0 con 0x7f68541e5be0 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6852d9d640 1 --2- 172.21.15.173:0/4125248590 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68541e5460 0x7f68541e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f685259c640 1 --2- 172.21.15.173:0/4125248590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f683c005260 0x7f68541e3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6851d9b640 1 --2- 172.21.15.173:0/4125248590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541e5be0 0x7f68541f2160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6848011850 tx=0x7f6848011d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:45.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6842ffd640 1 -- 172.21.15.173:0/4125248590 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6848004460 con 0x7f68541e5be0 2024-09-17T06:03:45.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6842ffd640 1 -- 172.21.15.173:0/4125248590 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6848016070 con 0x7f68541e5be0 2024-09-17T06:03:45.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f68589a2640 1 -- 172.21.15.173:0/4125248590 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68541e49a0 con 0x7f68541e5be0 2024-09-17T06:03:45.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.538+0000 7f6842ffd640 1 -- 172.21.15.173:0/4125248590 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684800fc50 con 0x7f68541e5be0 2024-09-17T06:03:45.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.542+0000 7f68589a2640 1 -- 172.21.15.173:0/4125248590 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68541f4fb0 con 0x7f68541e5be0 2024-09-17T06:03:45.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.542+0000 7f6842ffd640 1 -- 172.21.15.173:0/4125248590 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6848003600 con 0x7f68541e5be0 2024-09-17T06:03:45.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.542+0000 7f6842ffd640 1 -- 172.21.15.173:0/4125248590 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f684801bc00 con 0x7f68541e5be0 2024-09-17T06:03:45.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.542+0000 7f68589a2640 1 -- 172.21.15.173:0/4125248590 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68541e46f0 con 0x7f68541e5be0 2024-09-17T06:03:45.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.542+0000 7f6842ffd640 1 -- 172.21.15.173:0/4125248590 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f68541f26a0 con 0x7f68541e5be0 2024-09-17T06:03:45.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.614+0000 7f68589a2640 1 -- 172.21.15.173:0/4125248590 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e3a31b77-d4db-4ee6-af7c-60af7df4bd69", "id": 2} v 0) -- 0x7f68540c3c20 con 0x7f68541e5be0 2024-09-17T06:03:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.622+0000 7f6842ffd640 1 -- 172.21.15.173:0/4125248590 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e3a31b77-d4db-4ee6-af7c-60af7df4bd69", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f684800fdf0 con 0x7f68541e5be0 2024-09-17T06:03:45.621 INFO:teuthology.orchestra.run.smithi173.stdout:2 2024-09-17T06:03:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.622+0000 7f68589a2640 1 -- 172.21.15.173:0/4125248590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541e5be0 msgr2=0x7f68541f2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.622+0000 7f68589a2640 1 --2- 172.21.15.173:0/4125248590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541e5be0 0x7f68541f2160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6848011850 tx=0x7f6848011d10 comp rx=0 tx=0).stop 2024-09-17T06:03:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.622+0000 7f68589a2640 1 -- 172.21.15.173:0/4125248590 shutdown_connections 2024-09-17T06:03:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.622+0000 7f68589a2640 1 --2- 172.21.15.173:0/4125248590 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68541e5460 0x7f68541e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.622+0000 7f68589a2640 1 --2- 172.21.15.173:0/4125248590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68541e5be0 0x7f68541f2160 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.622+0000 7f68589a2640 1 --2- 172.21.15.173:0/4125248590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f683c005260 0x7f68541e3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.622+0000 7f68589a2640 1 -- 172.21.15.173:0/4125248590 >> 172.21.15.173:0/4125248590 conn(0x7f68540ca380 msgr2=0x7f68541e7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.622+0000 7f68589a2640 1 -- 172.21.15.173:0/4125248590 shutdown_connections 2024-09-17T06:03:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.622+0000 7f68589a2640 1 -- 172.21.15.173:0/4125248590 wait complete. 2024-09-17T06:03:45.639 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 9f473452-18cd-44a4-803a-e908e21ab405 3 2024-09-17T06:03:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.790+0000 7f342dbe5640 1 -- 172.21.15.173:0/3740806105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414004810 msgr2=0x7f3414004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.790+0000 7f342dbe5640 1 --2- 172.21.15.173:0/3740806105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414004810 0x7f3414004c20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34100016c0 tx=0x7f341001c730 comp rx=0 tx=0).stop 2024-09-17T06:03:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.790+0000 7f342dbe5640 1 -- 172.21.15.173:0/3740806105 shutdown_connections 2024-09-17T06:03:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.790+0000 7f342dbe5640 1 --2- 172.21.15.173:0/3740806105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3414004810 0x7f3414004c20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.790+0000 7f342dbe5640 1 -- 172.21.15.173:0/3740806105 >> 172.21.15.173:0/3740806105 conn(0x7f34280ca380 msgr2=0x7f34280ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.790+0000 7f342dbe5640 1 -- 172.21.15.173:0/3740806105 shutdown_connections 2024-09-17T06:03:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.790+0000 7f342dbe5640 1 -- 172.21.15.173:0/3740806105 wait complete. 2024-09-17T06:03:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.790+0000 7f342dbe5640 1 Processor -- start 2024-09-17T06:03:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.790+0000 7f342dbe5640 1 -- start start 2024-09-17T06:03:45.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f342dbe5640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3414004810 0x7f3428151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:45.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f342dbe5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342814e210 0x7f34280c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:45.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f342dbe5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342813e4e0 0x7f34281f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:45.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f342dbe5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f342806e830 con 0x7f342813e4e0 2024-09-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f342dbe5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f34280728c0 con 0x7f342814e210 2024-09-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f342dbe5640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f342814fc30 con 0x7f3414004810 2024-09-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f341ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342814e210 0x7f34280c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f34277fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3414004810 0x7f3428151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f341ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342814e210 0x7f34280c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50310/0 (socket says 172.21.15.173:50310) 2024-09-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f341ffff640 1 -- 172.21.15.173:0/4184232401 learned_addr learned my addr 172.21.15.173:0/4184232401 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f34277fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3414004810 0x7f3428151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:36304/0 (socket says 172.21.15.173:36304) 2024-09-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f3427fff640 1 --2- 172.21.15.173:0/4184232401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342813e4e0 0x7f34281f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f341ffff640 1 -- 172.21.15.173:0/4184232401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3414004810 msgr2=0x7f3428151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f341ffff640 1 --2- 172.21.15.173:0/4184232401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3414004810 0x7f3428151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f341ffff640 1 -- 172.21.15.173:0/4184232401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342813e4e0 msgr2=0x7f34281f6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f341ffff640 1 --2- 172.21.15.173:0/4184232401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342813e4e0 0x7f34281f6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f341ffff640 1 -- 172.21.15.173:0/4184232401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34281f6ac0 con 0x7f342814e210 2024-09-17T06:03:45.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f3427fff640 1 --2- 172.21.15.173:0/4184232401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342813e4e0 0x7f34281f6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:03:45.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f341ffff640 1 --2- 172.21.15.173:0/4184232401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342814e210 0x7f34280c4b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f341001ae30 tx=0x7f3410003be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:45.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f3424ff9640 1 -- 172.21.15.173:0/4184232401 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34100ad070 con 0x7f342814e210 2024-09-17T06:03:45.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f3424ff9640 1 -- 172.21.15.173:0/4184232401 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3410006500 con 0x7f342814e210 2024-09-17T06:03:45.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f342dbe5640 1 -- 172.21.15.173:0/4184232401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f342814d490 con 0x7f342814e210 2024-09-17T06:03:45.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f3424ff9640 1 -- 172.21.15.173:0/4184232401 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410001310 con 0x7f342814e210 2024-09-17T06:03:45.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f342dbe5640 1 -- 172.21.15.173:0/4184232401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f342814da50 con 0x7f342814e210 2024-09-17T06:03:45.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f3424ff9640 1 -- 172.21.15.173:0/4184232401 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f34100a7450 con 0x7f342814e210 2024-09-17T06:03:45.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f3424ff9640 1 -- 172.21.15.173:0/4184232401 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f34100bdb60 con 0x7f342814e210 2024-09-17T06:03:45.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.794+0000 7f342dbe5640 1 -- 172.21.15.173:0/4184232401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342806ffd0 con 0x7f342814e210 2024-09-17T06:03:45.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.798+0000 7f3424ff9640 1 -- 172.21.15.173:0/4184232401 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3410016490 con 0x7f342814e210 2024-09-17T06:03:45.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.866+0000 7f342dbe5640 1 -- 172.21.15.173:0/4184232401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f473452-18cd-44a4-803a-e908e21ab405", "id": 3} v 0) -- 0x7f34280c9d80 con 0x7f342814e210 2024-09-17T06:03:45.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.874+0000 7f3424ff9640 1 -- 172.21.15.173:0/4184232401 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f473452-18cd-44a4-803a-e908e21ab405", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f34100bd6d0 con 0x7f342814e210 2024-09-17T06:03:45.873 INFO:teuthology.orchestra.run.smithi173.stdout:3 2024-09-17T06:03:45.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.874+0000 7f342dbe5640 1 -- 172.21.15.173:0/4184232401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342814e210 msgr2=0x7f34280c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:45.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.874+0000 7f342dbe5640 1 --2- 172.21.15.173:0/4184232401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342814e210 0x7f34280c4b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f341001ae30 tx=0x7f3410003be0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.874+0000 7f342dbe5640 1 -- 172.21.15.173:0/4184232401 shutdown_connections 2024-09-17T06:03:45.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.874+0000 7f342dbe5640 1 --2- 172.21.15.173:0/4184232401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342813e4e0 0x7f34281f6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.874+0000 7f342dbe5640 1 --2- 172.21.15.173:0/4184232401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342814e210 0x7f34280c4b60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.874+0000 7f342dbe5640 1 --2- 172.21.15.173:0/4184232401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3414004810 0x7f3428151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:45.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.874+0000 7f342dbe5640 1 -- 172.21.15.173:0/4184232401 >> 172.21.15.173:0/4184232401 conn(0x7f34280ca380 msgr2=0x7f3428148040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:45.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.874+0000 7f342dbe5640 1 -- 172.21.15.173:0/4184232401 shutdown_connections 2024-09-17T06:03:45.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:45.874+0000 7f342dbe5640 1 -- 172.21.15.173:0/4184232401 wait complete. 2024-09-17T06:03:45.892 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new f11201b3-22f8-4b9e-873c-0ed12835e2d3 4 2024-09-17T06:03:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 -- 172.21.15.173:0/74181256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44b40c26f0 msgr2=0x7f44b406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 --2- 172.21.15.173:0/74181256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44b40c26f0 0x7f44b406d7e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009840 tx=0x7f44a801c820 comp rx=0 tx=0).stop 2024-09-17T06:03:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 -- 172.21.15.173:0/74181256 shutdown_connections 2024-09-17T06:03:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 --2- 172.21.15.173:0/74181256 >> v2:172.21.15.122:3300/0 conn(0x7f44b406dd20 0x7f44b40c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 --2- 172.21.15.173:0/74181256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44b40c26f0 0x7f44b406d7e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 -- 172.21.15.173:0/74181256 >> 172.21.15.173:0/74181256 conn(0x7f44b40cd4f0 msgr2=0x7f44b40cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:46.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 -- 172.21.15.173:0/74181256 shutdown_connections 2024-09-17T06:03:46.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 -- 172.21.15.173:0/74181256 wait complete. 2024-09-17T06:03:46.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 Processor -- start 2024-09-17T06:03:46.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 -- start start 2024-09-17T06:03:46.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44b406dd20 0x7f44b4148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:46.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b406e370 0x7f44b40c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44b40c26f0 0x7f44b40b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f44b40c3590 con 0x7f44b406dd20 2024-09-17T06:03:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f44b4158980 con 0x7f44b406e370 2024-09-17T06:03:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44bb0e6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f44b406ed50 con 0x7f44b40c26f0 2024-09-17T06:03:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44b3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b406e370 0x7f44b40c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44b3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b406e370 0x7f44b40c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50316/0 (socket says 172.21.15.173:50316) 2024-09-17T06:03:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44b3fff640 1 -- 172.21.15.173:0/2282100025 learned_addr learned my addr 172.21.15.173:0/2282100025 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-17T06:03:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44b9683640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44b40c26f0 0x7f44b40b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44b8e82640 1 --2- 172.21.15.173:0/2282100025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44b406dd20 0x7f44b4148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44b3fff640 1 -- 172.21.15.173:0/2282100025 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44b40c26f0 msgr2=0x7f44b40b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44b3fff640 1 --2- 172.21.15.173:0/2282100025 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44b40c26f0 0x7f44b40b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44b3fff640 1 -- 172.21.15.173:0/2282100025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44b406dd20 msgr2=0x7f44b4148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44b3fff640 1 --2- 172.21.15.173:0/2282100025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44b406dd20 0x7f44b4148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.046+0000 7f44b3fff640 1 -- 172.21.15.173:0/2282100025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b40c5e70 con 0x7f44b406e370 2024-09-17T06:03:46.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.050+0000 7f44b3fff640 1 --2- 172.21.15.173:0/2282100025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b406e370 0x7f44b40c54b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44a801a450 tx=0x7f44a80a5650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:46.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.050+0000 7f44b17fa640 1 -- 172.21.15.173:0/2282100025 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a80bb070 con 0x7f44b406e370 2024-09-17T06:03:46.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.050+0000 7f44b17fa640 1 -- 172.21.15.173:0/2282100025 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44a8004470 con 0x7f44b406e370 2024-09-17T06:03:46.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.050+0000 7f44bb0e6640 1 -- 172.21.15.173:0/2282100025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b41493f0 con 0x7f44b406e370 2024-09-17T06:03:46.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.050+0000 7f44b17fa640 1 -- 172.21.15.173:0/2282100025 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a80b2040 con 0x7f44b406e370 2024-09-17T06:03:46.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.050+0000 7f44bb0e6640 1 -- 172.21.15.173:0/2282100025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b40b12f0 con 0x7f44b406e370 2024-09-17T06:03:46.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.050+0000 7f44b17fa640 1 -- 172.21.15.173:0/2282100025 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f44a80be070 con 0x7f44b406e370 2024-09-17T06:03:46.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.050+0000 7f44b17fa640 1 -- 172.21.15.173:0/2282100025 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f44a8003600 con 0x7f44b406e370 2024-09-17T06:03:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.050+0000 7f44bb0e6640 1 -- 172.21.15.173:0/2282100025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b40c4910 con 0x7f44b406e370 2024-09-17T06:03:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.050+0000 7f44b17fa640 1 -- 172.21.15.173:0/2282100025 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f44b40c4910 con 0x7f44b406e370 2024-09-17T06:03:46.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.122+0000 7f44bb0e6640 1 -- 172.21.15.173:0/2282100025 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f11201b3-22f8-4b9e-873c-0ed12835e2d3", "id": 4} v 0) -- 0x7f44b40c2c40 con 0x7f44b406e370 2024-09-17T06:03:46.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.126+0000 7f44b17fa640 1 -- 172.21.15.173:0/2282100025 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f11201b3-22f8-4b9e-873c-0ed12835e2d3", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f44a8016410 con 0x7f44b406e370 2024-09-17T06:03:46.127 INFO:teuthology.orchestra.run.smithi173.stdout:4 2024-09-17T06:03:46.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.130+0000 7f44bb0e6640 1 -- 172.21.15.173:0/2282100025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b406e370 msgr2=0x7f44b40c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.130+0000 7f44bb0e6640 1 --2- 172.21.15.173:0/2282100025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b406e370 0x7f44b40c54b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44a801a450 tx=0x7f44a80a5650 comp rx=0 tx=0).stop 2024-09-17T06:03:46.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.130+0000 7f44bb0e6640 1 -- 172.21.15.173:0/2282100025 shutdown_connections 2024-09-17T06:03:46.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.130+0000 7f44bb0e6640 1 --2- 172.21.15.173:0/2282100025 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44b40c26f0 0x7f44b40b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.130+0000 7f44bb0e6640 1 --2- 172.21.15.173:0/2282100025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44b406e370 0x7f44b40c54b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.130+0000 7f44bb0e6640 1 --2- 172.21.15.173:0/2282100025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44b406dd20 0x7f44b4148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.130+0000 7f44bb0e6640 1 -- 172.21.15.173:0/2282100025 >> 172.21.15.173:0/2282100025 conn(0x7f44b40cd4f0 msgr2=0x7f44b4146550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:46.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.130+0000 7f44bb0e6640 1 -- 172.21.15.173:0/2282100025 shutdown_connections 2024-09-17T06:03:46.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.130+0000 7f44bb0e6640 1 -- 172.21.15.173:0/2282100025 wait complete. 2024-09-17T06:03:46.146 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 3f853011-9aea-4f7c-bb97-2c74fba1e33e 5 2024-09-17T06:03:46.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.294+0000 7f56d3f67640 1 -- 172.21.15.173:0/2354800498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8005260 msgr2=0x7f56b800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.294+0000 7f56d3f67640 1 --2- 172.21.15.173:0/2354800498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8005260 0x7f56b800b9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009ee0 tx=0x7f56c401d630 comp rx=0 tx=0).stop 2024-09-17T06:03:46.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.294+0000 7f56d3f67640 1 -- 172.21.15.173:0/2354800498 shutdown_connections 2024-09-17T06:03:46.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.294+0000 7f56d3f67640 1 --2- 172.21.15.173:0/2354800498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8005260 0x7f56b800b9d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.294+0000 7f56d3f67640 1 -- 172.21.15.173:0/2354800498 >> 172.21.15.173:0/2354800498 conn(0x7f56cc070e40 msgr2=0x7f56cc071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:46.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.294+0000 7f56d3f67640 1 -- 172.21.15.173:0/2354800498 shutdown_connections 2024-09-17T06:03:46.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.294+0000 7f56d3f67640 1 -- 172.21.15.173:0/2354800498 wait complete. 2024-09-17T06:03:46.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.294+0000 7f56d3f67640 1 Processor -- start 2024-09-17T06:03:46.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.294+0000 7f56d3f67640 1 -- start start 2024-09-17T06:03:46.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.294+0000 7f56d3f67640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56b8005260 0x7f56cc15d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:46.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d3f67640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56cc154700 0x7f56cc072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:46.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d3f67640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56cc0cb720 0x7f56cc0cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:46.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d3f67640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc15a160 con 0x7f56cc154700 2024-09-17T06:03:46.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d3f67640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc159c40 con 0x7f56cc0cb720 2024-09-17T06:03:46.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d3f67640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f56cc1538e0 con 0x7f56b8005260 2024-09-17T06:03:46.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d1d03640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56b8005260 0x7f56cc15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:46.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d1d03640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56b8005260 0x7f56cc15d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:36352/0 (socket says 172.21.15.173:36352) 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d1d03640 1 -- 172.21.15.173:0/3617771542 learned_addr learned my addr 172.21.15.173:0/3617771542 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d2504640 1 --2- 172.21.15.173:0/3617771542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56cc0cb720 0x7f56cc0cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d1d03640 1 -- 172.21.15.173:0/3617771542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56cc0cb720 msgr2=0x7f56cc0cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d1d03640 1 --2- 172.21.15.173:0/3617771542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56cc0cb720 0x7f56cc0cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d1502640 1 --2- 172.21.15.173:0/3617771542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56cc154700 0x7f56cc072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d1d03640 1 -- 172.21.15.173:0/3617771542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56cc154700 msgr2=0x7f56cc072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d1d03640 1 --2- 172.21.15.173:0/3617771542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56cc154700 0x7f56cc072200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d1d03640 1 -- 172.21.15.173:0/3617771542 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc0cb150 con 0x7f56b8005260 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d1d03640 1 --2- 172.21.15.173:0/3617771542 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56b8005260 0x7f56cc15d000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f56c8003f30 tx=0x7f56c8001640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56c27fc640 1 -- 172.21.15.173:0/3617771542 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8015020 con 0x7f56b8005260 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56c27fc640 1 -- 172.21.15.173:0/3617771542 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56c8011840 con 0x7f56b8005260 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d3f67640 1 -- 172.21.15.173:0/3617771542 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56cc0cc070 con 0x7f56b8005260 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56c27fc640 1 -- 172.21.15.173:0/3617771542 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8011c50 con 0x7f56b8005260 2024-09-17T06:03:46.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d3f67640 1 -- 172.21.15.173:0/3617771542 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56cc0b2cb0 con 0x7f56b8005260 2024-09-17T06:03:46.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56c27fc640 1 -- 172.21.15.173:0/3617771542 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f56c8018020 con 0x7f56b8005260 2024-09-17T06:03:46.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56c27fc640 1 -- 172.21.15.173:0/3617771542 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f56c8010b20 con 0x7f56b8005260 2024-09-17T06:03:46.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56d3f67640 1 -- 172.21.15.173:0/3617771542 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56cc0cb320 con 0x7f56b8005260 2024-09-17T06:03:46.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.298+0000 7f56c27fc640 1 -- 172.21.15.173:0/3617771542 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f56c801f020 con 0x7f56b8005260 2024-09-17T06:03:46.351 INFO:tasks.ceph.mgr.y.smithi122.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T06:03:46.351 INFO:tasks.ceph.mgr.y.smithi122.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T06:03:46.351 INFO:tasks.ceph.mgr.y.smithi122.stderr: from numpy import show_config as show_numpy_config 2024-09-17T06:03:46.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.366+0000 7f56d3f67640 1 -- 172.21.15.173:0/3617771542 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3f853011-9aea-4f7c-bb97-2c74fba1e33e", "id": 5} v 0) -- 0x7f56cc0ca2a0 con 0x7f56b8005260 2024-09-17T06:03:46.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.374+0000 7f56c27fc640 1 -- 172.21.15.173:0/3617771542 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f853011-9aea-4f7c-bb97-2c74fba1e33e", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f56c8010dc0 con 0x7f56b8005260 2024-09-17T06:03:46.375 INFO:teuthology.orchestra.run.smithi173.stdout:5 2024-09-17T06:03:46.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.378+0000 7f56d3f67640 1 -- 172.21.15.173:0/3617771542 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56b8005260 msgr2=0x7f56cc15d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.378+0000 7f56d3f67640 1 --2- 172.21.15.173:0/3617771542 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56b8005260 0x7f56cc15d000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f56c8003f30 tx=0x7f56c8001640 comp rx=0 tx=0).stop 2024-09-17T06:03:46.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.378+0000 7f56d3f67640 1 -- 172.21.15.173:0/3617771542 shutdown_connections 2024-09-17T06:03:46.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.378+0000 7f56d3f67640 1 --2- 172.21.15.173:0/3617771542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56cc0cb720 0x7f56cc0cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.378+0000 7f56d3f67640 1 --2- 172.21.15.173:0/3617771542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56cc154700 0x7f56cc072200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.378+0000 7f56d3f67640 1 --2- 172.21.15.173:0/3617771542 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56b8005260 0x7f56cc15d000 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.378+0000 7f56d3f67640 1 -- 172.21.15.173:0/3617771542 >> 172.21.15.173:0/3617771542 conn(0x7f56cc070e40 msgr2=0x7f56cc0c4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.378+0000 7f56d3f67640 1 -- 172.21.15.173:0/3617771542 shutdown_connections 2024-09-17T06:03:46.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.378+0000 7f56d3f67640 1 -- 172.21.15.173:0/3617771542 wait complete. 2024-09-17T06:03:46.394 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 445606c9-7e18-44b2-997d-68d280a3a37c 6 2024-09-17T06:03:46.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.546+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/1107679981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e140c8030 msgr2=0x7f0e14071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.546+0000 7f0e1a7cc640 1 --2- 172.21.15.173:0/1107679981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e140c8030 0x7f0e14071070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0e140b3640 tx=0x7f0e0c01c8c0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.546+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/1107679981 shutdown_connections 2024-09-17T06:03:46.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.546+0000 7f0e1a7cc640 1 --2- 172.21.15.173:0/1107679981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e140c8030 0x7f0e14071070 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.546+0000 7f0e1a7cc640 1 --2- 172.21.15.173:0/1107679981 >> v2:172.21.15.122:3300/0 conn(0x7f0e140c2110 0x7f0e140c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.546+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/1107679981 >> 172.21.15.173:0/1107679981 conn(0x7f0e140cd4f0 msgr2=0x7f0e140cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:46.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.546+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/1107679981 shutdown_connections 2024-09-17T06:03:46.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.546+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/1107679981 wait complete. 2024-09-17T06:03:46.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.546+0000 7f0e1a7cc640 1 Processor -- start 2024-09-17T06:03:46.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e1a7cc640 1 -- start start 2024-09-17T06:03:46.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e1a7cc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e140c2110 0x7f0e141f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:46.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e1a7cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e140c8030 0x7f0e1414d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:46.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e1a7cc640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e14151ad0 0x7f0e141497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e1a7cc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0e140715b0 con 0x7f0e140c8030 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e1a7cc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e14158650 con 0x7f0e140c2110 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e1a7cc640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0e14071730 con 0x7f0e14151ad0 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e13fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e140c2110 0x7f0e141f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e13fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e140c2110 0x7f0e141f29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50344/0 (socket says 172.21.15.173:50344) 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e13fff640 1 -- 172.21.15.173:0/2896095634 learned_addr learned my addr 172.21.15.173:0/2896095634 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e18d69640 1 --2- 172.21.15.173:0/2896095634 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e14151ad0 0x7f0e141497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e137fe640 1 --2- 172.21.15.173:0/2896095634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e140c8030 0x7f0e1414d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e13fff640 1 -- 172.21.15.173:0/2896095634 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e14151ad0 msgr2=0x7f0e141497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e13fff640 1 --2- 172.21.15.173:0/2896095634 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e14151ad0 0x7f0e141497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e13fff640 1 -- 172.21.15.173:0/2896095634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e140c8030 msgr2=0x7f0e1414d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e13fff640 1 --2- 172.21.15.173:0/2896095634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e140c8030 0x7f0e1414d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e13fff640 1 -- 172.21.15.173:0/2896095634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e141f2ee0 con 0x7f0e140c2110 2024-09-17T06:03:46.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e13fff640 1 --2- 172.21.15.173:0/2896095634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e140c2110 0x7f0e141f29a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400ddf0 tx=0x7f0e0400b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:46.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e10ff9640 1 -- 172.21.15.173:0/2896095634 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e04004d30 con 0x7f0e140c2110 2024-09-17T06:03:46.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e10ff9640 1 -- 172.21.15.173:0/2896095634 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e0400be40 con 0x7f0e140c2110 2024-09-17T06:03:46.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/2896095634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e140c73b0 con 0x7f0e140c2110 2024-09-17T06:03:46.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e10ff9640 1 -- 172.21.15.173:0/2896095634 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0400e8a0 con 0x7f0e140c2110 2024-09-17T06:03:46.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/2896095634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e141f30f0 con 0x7f0e140c2110 2024-09-17T06:03:46.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e10ff9640 1 -- 172.21.15.173:0/2896095634 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0e0400ea40 con 0x7f0e140c2110 2024-09-17T06:03:46.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e10ff9640 1 -- 172.21.15.173:0/2896095634 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f0e04016a30 con 0x7f0e140c2110 2024-09-17T06:03:46.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.550+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/2896095634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e141550f0 con 0x7f0e140c2110 2024-09-17T06:03:46.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.554+0000 7f0e10ff9640 1 -- 172.21.15.173:0/2896095634 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0e04036860 con 0x7f0e140c2110 2024-09-17T06:03:46.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.626+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/2896095634 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "445606c9-7e18-44b2-997d-68d280a3a37c", "id": 6} v 0) -- 0x7f0e140c7af0 con 0x7f0e140c2110 2024-09-17T06:03:46.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.630+0000 7f0e10ff9640 1 -- 172.21.15.173:0/2896095634 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "445606c9-7e18-44b2-997d-68d280a3a37c", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f0e04024020 con 0x7f0e140c2110 2024-09-17T06:03:46.629 INFO:teuthology.orchestra.run.smithi173.stdout:6 2024-09-17T06:03:46.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.630+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/2896095634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e140c2110 msgr2=0x7f0e141f29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.630+0000 7f0e1a7cc640 1 --2- 172.21.15.173:0/2896095634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e140c2110 0x7f0e141f29a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400ddf0 tx=0x7f0e0400b730 comp rx=0 tx=0).stop 2024-09-17T06:03:46.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.630+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/2896095634 shutdown_connections 2024-09-17T06:03:46.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.630+0000 7f0e1a7cc640 1 --2- 172.21.15.173:0/2896095634 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e14151ad0 0x7f0e141497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.630+0000 7f0e1a7cc640 1 --2- 172.21.15.173:0/2896095634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e140c8030 0x7f0e1414d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.630+0000 7f0e1a7cc640 1 --2- 172.21.15.173:0/2896095634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e140c2110 0x7f0e141f29a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.630+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/2896095634 >> 172.21.15.173:0/2896095634 conn(0x7f0e140cd4f0 msgr2=0x7f0e140b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:46.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.630+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/2896095634 shutdown_connections 2024-09-17T06:03:46.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.630+0000 7f0e1a7cc640 1 -- 172.21.15.173:0/2896095634 wait complete. 2024-09-17T06:03:46.647 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new ce0b67c6-0618-41b7-87e3-bf2d4c708907 7 2024-09-17T06:03:46.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.798+0000 7f4be9d80640 1 -- 172.21.15.173:0/3925205632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4be40c81f0 msgr2=0x7f4be40c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.798+0000 7f4be9d80640 1 --2- 172.21.15.173:0/3925205632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4be40c81f0 0x7f4be40c7710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4be40cb390 tx=0x7f4bd801c8c0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.798+0000 7f4be9d80640 1 -- 172.21.15.173:0/3925205632 shutdown_connections 2024-09-17T06:03:46.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.798+0000 7f4be9d80640 1 --2- 172.21.15.173:0/3925205632 >> v2:172.21.15.122:3300/0 conn(0x7f4be40734e0 0x7f4be415b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.798+0000 7f4be9d80640 1 --2- 172.21.15.173:0/3925205632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4be40c81f0 0x7f4be40c7710 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.798+0000 7f4be9d80640 1 -- 172.21.15.173:0/3925205632 >> 172.21.15.173:0/3925205632 conn(0x7f4be40713b0 msgr2=0x7f4be40717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:46.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.798+0000 7f4be9d80640 1 -- 172.21.15.173:0/3925205632 shutdown_connections 2024-09-17T06:03:46.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.798+0000 7f4be9d80640 1 -- 172.21.15.173:0/3925205632 wait complete. 2024-09-17T06:03:46.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be9d80640 1 Processor -- start 2024-09-17T06:03:46.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be9d80640 1 -- start start 2024-09-17T06:03:46.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be9d80640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4be40734e0 0x7f4be4147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:46.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be9d80640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4be40c81f0 0x7f4be4149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:46.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be9d80640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4be40cd780 0x7f4be4146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be9d80640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4be4073c70 con 0x7f4be40cd780 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be9d80640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4be40cdfa0 con 0x7f4be40734e0 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be9d80640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4be40c8700 con 0x7f4be40c81f0 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4be40734e0 0x7f4be4147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be2ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4be40c81f0 0x7f4be4149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4be40734e0 0x7f4be4147530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50362/0 (socket says 172.21.15.173:50362) 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be37fe640 1 -- 172.21.15.173:0/438680345 learned_addr learned my addr 172.21.15.173:0/438680345 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be3fff640 1 --2- 172.21.15.173:0/438680345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4be40cd780 0x7f4be4146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be2ffd640 1 -- 172.21.15.173:0/438680345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4be40734e0 msgr2=0x7f4be4147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be2ffd640 1 --2- 172.21.15.173:0/438680345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4be40734e0 0x7f4be4147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be2ffd640 1 -- 172.21.15.173:0/438680345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4be40cd780 msgr2=0x7f4be4146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be2ffd640 1 --2- 172.21.15.173:0/438680345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4be40cd780 0x7f4be4146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be2ffd640 1 -- 172.21.15.173:0/438680345 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be4151950 con 0x7f4be40c81f0 2024-09-17T06:03:46.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be37fe640 1 --2- 172.21.15.173:0/438680345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4be40734e0 0x7f4be4147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:03:46.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be2ffd640 1 --2- 172.21.15.173:0/438680345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4be40c81f0 0x7f4be4149af0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400b440 tx=0x7f4bd400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:46.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4bcbfff640 1 -- 172.21.15.173:0/438680345 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4015020 con 0x7f4be40c81f0 2024-09-17T06:03:46.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4bcbfff640 1 -- 172.21.15.173:0/438680345 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bd4011920 con 0x7f4be40c81f0 2024-09-17T06:03:46.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4bcbfff640 1 -- 172.21.15.173:0/438680345 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4011d70 con 0x7f4be40c81f0 2024-09-17T06:03:46.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be9d80640 1 -- 172.21.15.173:0/438680345 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be4147a70 con 0x7f4be40c81f0 2024-09-17T06:03:46.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be9d80640 1 -- 172.21.15.173:0/438680345 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be4162d40 con 0x7f4be40c81f0 2024-09-17T06:03:46.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4bcbfff640 1 -- 172.21.15.173:0/438680345 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4bd4018020 con 0x7f4be40c81f0 2024-09-17T06:03:46.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4bcbfff640 1 -- 172.21.15.173:0/438680345 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f4bd4019dd0 con 0x7f4be40c81f0 2024-09-17T06:03:46.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.802+0000 7f4be9d80640 1 -- 172.21.15.173:0/438680345 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be40c3850 con 0x7f4be40c81f0 2024-09-17T06:03:46.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.806+0000 7f4bcbfff640 1 -- 172.21.15.173:0/438680345 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4bd401f020 con 0x7f4be40c81f0 2024-09-17T06:03:46.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.874+0000 7f4be9d80640 1 -- 172.21.15.173:0/438680345 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ce0b67c6-0618-41b7-87e3-bf2d4c708907", "id": 7} v 0) -- 0x7f4be40c6140 con 0x7f4be40c81f0 2024-09-17T06:03:46.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.882+0000 7f4bcbfff640 1 -- 172.21.15.173:0/438680345 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce0b67c6-0618-41b7-87e3-bf2d4c708907", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f4bd401a9c0 con 0x7f4be40c81f0 2024-09-17T06:03:46.881 INFO:teuthology.orchestra.run.smithi173.stdout:7 2024-09-17T06:03:46.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.882+0000 7f4be9d80640 1 -- 172.21.15.173:0/438680345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4be40c81f0 msgr2=0x7f4be4149af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:46.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.882+0000 7f4be9d80640 1 --2- 172.21.15.173:0/438680345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4be40c81f0 0x7f4be4149af0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400b440 tx=0x7f4bd400b840 comp rx=0 tx=0).stop 2024-09-17T06:03:46.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.882+0000 7f4be9d80640 1 -- 172.21.15.173:0/438680345 shutdown_connections 2024-09-17T06:03:46.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.882+0000 7f4be9d80640 1 --2- 172.21.15.173:0/438680345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4be40cd780 0x7f4be4146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.882+0000 7f4be9d80640 1 --2- 172.21.15.173:0/438680345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4be40c81f0 0x7f4be4149af0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.882+0000 7f4be9d80640 1 --2- 172.21.15.173:0/438680345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4be40734e0 0x7f4be4147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:46.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.882+0000 7f4be9d80640 1 -- 172.21.15.173:0/438680345 >> 172.21.15.173:0/438680345 conn(0x7f4be40713b0 msgr2=0x7f4be4152240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:46.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.882+0000 7f4be9d80640 1 -- 172.21.15.173:0/438680345 shutdown_connections 2024-09-17T06:03:46.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-17T06:03:46.882+0000 7f4be9d80640 1 -- 172.21.15.173:0/438680345 wait complete. 2024-09-17T06:03:46.900 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T06:03:46.900 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T06:03:46.902 INFO:tasks.ceph.osd.0:Started 2024-09-17T06:03:46.902 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T06:03:46.902 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T06:03:46.904 INFO:tasks.ceph.osd.1:Started 2024-09-17T06:03:46.904 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T06:03:46.904 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T06:03:46.906 INFO:tasks.ceph.osd.2:Started 2024-09-17T06:03:46.906 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T06:03:46.906 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T06:03:46.908 INFO:tasks.ceph.osd.3:Started 2024-09-17T06:03:46.908 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T06:03:46.908 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T06:03:46.910 INFO:tasks.ceph.osd.4:Started 2024-09-17T06:03:46.910 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T06:03:46.911 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T06:03:46.913 INFO:tasks.ceph.osd.5:Started 2024-09-17T06:03:46.913 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T06:03:46.913 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T06:03:46.915 INFO:tasks.ceph.osd.6:Started 2024-09-17T06:03:46.915 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T06:03:46.916 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T06:03:46.917 INFO:tasks.ceph.osd.7:Started 2024-09-17T06:03:46.918 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:03:47.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.078+0000 7fede5beb640 1 -- 172.21.15.122:0/2757418869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fede006fe00 msgr2=0x7fede0158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:47.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.078+0000 7fede5beb640 1 --2- 172.21.15.122:0/2757418869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fede006fe00 0x7fede0158070 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009bf0 tx=0x7fedd401f2f0 comp rx=0 tx=0).stop 2024-09-17T06:03:47.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.078+0000 7fede5beb640 1 -- 172.21.15.122:0/2757418869 shutdown_connections 2024-09-17T06:03:47.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.078+0000 7fede5beb640 1 --2- 172.21.15.122:0/2757418869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fede006fe00 0x7fede0158070 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:47.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.078+0000 7fede5beb640 1 -- 172.21.15.122:0/2757418869 >> 172.21.15.122:0/2757418869 conn(0x7fede00ca380 msgr2=0x7fede00ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:47.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.078+0000 7fede5beb640 1 -- 172.21.15.122:0/2757418869 shutdown_connections 2024-09-17T06:03:47.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.078+0000 7fede5beb640 1 -- 172.21.15.122:0/2757418869 wait complete. 2024-09-17T06:03:47.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fede5beb640 1 Processor -- start 2024-09-17T06:03:47.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fede5beb640 1 -- start start 2024-09-17T06:03:47.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fede5beb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede006fe00 0x7fede014d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:47.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fede5beb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede00c28a0 0x7fede0146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:47.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fede5beb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fede014eb30 0x7fede00c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:47.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fede5beb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fede006f600 con 0x7fede006fe00 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fede5beb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fede014ef40 con 0x7fede00c28a0 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fede5beb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fede006f8e0 con 0x7fede014eb30 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddf7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede006fe00 0x7fede014d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddf7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede006fe00 0x7fede014d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45880/0 (socket says 172.21.15.122:45880) 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddf7fe640 1 -- 172.21.15.122:0/1964921415 learned_addr learned my addr 172.21.15.122:0/1964921415 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddeffd640 1 --2- 172.21.15.122:0/1964921415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede00c28a0 0x7fede0146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddffff640 1 --2- 172.21.15.122:0/1964921415 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fede014eb30 0x7fede00c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddf7fe640 1 -- 172.21.15.122:0/1964921415 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fede014eb30 msgr2=0x7fede00c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddf7fe640 1 --2- 172.21.15.122:0/1964921415 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fede014eb30 0x7fede00c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddf7fe640 1 -- 172.21.15.122:0/1964921415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede00c28a0 msgr2=0x7fede0146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddf7fe640 1 --2- 172.21.15.122:0/1964921415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede00c28a0 0x7fede0146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddf7fe640 1 -- 172.21.15.122:0/1964921415 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede014db90 con 0x7fede006fe00 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddffff640 1 --2- 172.21.15.122:0/1964921415 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fede014eb30 0x7fede00c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:03:47.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddeffd640 1 --2- 172.21.15.122:0/1964921415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede00c28a0 0x7fede0146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:03:47.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7feddf7fe640 1 --2- 172.21.15.122:0/1964921415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede006fe00 0x7fede014d650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fedd4000f90 tx=0x7fedd4003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:47.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fedc7fff640 1 -- 172.21.15.122:0/1964921415 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd40b4040 con 0x7fede006fe00 2024-09-17T06:03:47.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fedc7fff640 1 -- 172.21.15.122:0/1964921415 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedd4004c00 con 0x7fede006fe00 2024-09-17T06:03:47.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fede5beb640 1 -- 172.21.15.122:0/1964921415 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede01e4450 con 0x7fede006fe00 2024-09-17T06:03:47.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fedc7fff640 1 -- 172.21.15.122:0/1964921415 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd40af6a0 con 0x7fede006fe00 2024-09-17T06:03:47.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fede5beb640 1 -- 172.21.15.122:0/1964921415 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede014a700 con 0x7fede006fe00 2024-09-17T06:03:47.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fedc7fff640 1 -- 172.21.15.122:0/1964921415 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fedd40c0020 con 0x7fede006fe00 2024-09-17T06:03:47.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.082+0000 7fedc7fff640 1 -- 172.21.15.122:0/1964921415 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fedd4005700 con 0x7fede006fe00 2024-09-17T06:03:47.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.086+0000 7fede5beb640 1 -- 172.21.15.122:0/1964921415 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede00c2d00 con 0x7fede006fe00 2024-09-17T06:03:47.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.086+0000 7fedc7fff640 1 -- 172.21.15.122:0/1964921415 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fedd40c7020 con 0x7fede006fe00 2024-09-17T06:03:47.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.146+0000 7fede5beb640 1 -- 172.21.15.122:0/1964921415 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fede00702d0 con 0x7fede006fe00 2024-09-17T06:03:47.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.150+0000 7fedc7fff640 1 -- 172.21.15.122:0/1964921415 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fedd4018e50 con 0x7fede006fe00 2024-09-17T06:03:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:03:47.150 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":10,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:03:46.879949+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:03:47.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.150+0000 7fede5beb640 1 -- 172.21.15.122:0/1964921415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede006fe00 msgr2=0x7fede014d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:47.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.150+0000 7fede5beb640 1 --2- 172.21.15.122:0/1964921415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede006fe00 0x7fede014d650 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fedd4000f90 tx=0x7fedd4003f40 comp rx=0 tx=0).stop 2024-09-17T06:03:47.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.150+0000 7fede5beb640 1 -- 172.21.15.122:0/1964921415 shutdown_connections 2024-09-17T06:03:47.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.150+0000 7fede5beb640 1 --2- 172.21.15.122:0/1964921415 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fede014eb30 0x7fede00c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:47.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.150+0000 7fede5beb640 1 --2- 172.21.15.122:0/1964921415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fede00c28a0 0x7fede0146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:47.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.150+0000 7fede5beb640 1 --2- 172.21.15.122:0/1964921415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede006fe00 0x7fede014d650 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:47.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.150+0000 7fede5beb640 1 -- 172.21.15.122:0/1964921415 >> 172.21.15.122:0/1964921415 conn(0x7fede00ca380 msgr2=0x7fede0071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:47.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.150+0000 7fede5beb640 1 -- 172.21.15.122:0/1964921415 shutdown_connections 2024-09-17T06:03:47.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:03:47.150+0000 7fede5beb640 1 -- 172.21.15.122:0/1964921415 wait complete. 2024-09-17T06:03:47.171 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T06:03:47.171 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T06:03:47.977 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T06:03:48.121 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.118+0000 7ff91bd6c640 1 -- 172.21.15.122:0/1608666110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff914071630 msgr2=0x7ff914071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:48.121 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.118+0000 7ff91bd6c640 1 --2- 172.21.15.122:0/1608666110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff914071630 0x7ff914071a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009c80 tx=0x7ff90c01cda0 comp rx=0 tx=0).stop 2024-09-17T06:03:48.121 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.118+0000 7ff91bd6c640 1 -- 172.21.15.122:0/1608666110 shutdown_connections 2024-09-17T06:03:48.121 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.118+0000 7ff91bd6c640 1 --2- 172.21.15.122:0/1608666110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff914071630 0x7ff914071a40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:48.121 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.118+0000 7ff91bd6c640 1 --2- 172.21.15.122:0/1608666110 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff9140c35d0 0x7ff91415b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:48.121 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.118+0000 7ff91bd6c640 1 -- 172.21.15.122:0/1608666110 >> 172.21.15.122:0/1608666110 conn(0x7ff9140cdbf0 msgr2=0x7ff9140ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:48.121 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.118+0000 7ff91bd6c640 1 -- 172.21.15.122:0/1608666110 shutdown_connections 2024-09-17T06:03:48.122 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.118+0000 7ff91bd6c640 1 -- 172.21.15.122:0/1608666110 wait complete. 2024-09-17T06:03:48.122 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff91bd6c640 1 Processor -- start 2024-09-17T06:03:48.122 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff91bd6c640 1 -- start start 2024-09-17T06:03:48.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff91bd6c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff91406f5b0 0x7ff9141f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:48.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff91bd6c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff914071630 0x7ff91415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:48.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff91bd6c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9140c35d0 0x7ff914150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:48.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff91bd6c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff91406eee0 con 0x7ff914071630 2024-09-17T06:03:48.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff91bd6c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff9140c2810 con 0x7ff9140c35d0 2024-09-17T06:03:48.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff91bd6c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff9140c2990 con 0x7ff91406f5b0 2024-09-17T06:03:48.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff919307640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff914071630 0x7ff91415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:48.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff919307640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff914071630 0x7ff91415abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45892/0 (socket says 172.21.15.122:45892) 2024-09-17T06:03:48.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff919307640 1 -- 172.21.15.122:0/3377463833 learned_addr learned my addr 172.21.15.122:0/3377463833 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff91a309640 1 --2- 172.21.15.122:0/3377463833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9140c35d0 0x7ff914150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff919b08640 1 --2- 172.21.15.122:0/3377463833 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff91406f5b0 0x7ff9141f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff919307640 1 -- 172.21.15.122:0/3377463833 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff91406f5b0 msgr2=0x7ff9141f7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff919307640 1 --2- 172.21.15.122:0/3377463833 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff91406f5b0 0x7ff9141f7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff919307640 1 -- 172.21.15.122:0/3377463833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9140c35d0 msgr2=0x7ff914150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff919307640 1 --2- 172.21.15.122:0/3377463833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9140c35d0 0x7ff914150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff919307640 1 -- 172.21.15.122:0/3377463833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9140c58c0 con 0x7ff914071630 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff919b08640 1 --2- 172.21.15.122:0/3377463833 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff91406f5b0 0x7ff9141f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff919307640 1 --2- 172.21.15.122:0/3377463833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff914071630 0x7ff91415abe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff90800c970 tx=0x7ff90800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff9067fc640 1 -- 172.21.15.122:0/3377463833 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908007bb0 con 0x7ff914071630 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff9067fc640 1 -- 172.21.15.122:0/3377463833 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff908007e40 con 0x7ff914071630 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff9067fc640 1 -- 172.21.15.122:0/3377463833 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90800f6b0 con 0x7ff914071630 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff91bd6c640 1 -- 172.21.15.122:0/3377463833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9140c6c00 con 0x7ff914071630 2024-09-17T06:03:48.126 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff91bd6c640 1 -- 172.21.15.122:0/3377463833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff914160440 con 0x7ff914071630 2024-09-17T06:03:48.127 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff91bd6c640 1 -- 172.21.15.122:0/3377463833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9140c6970 con 0x7ff914071630 2024-09-17T06:03:48.127 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.122+0000 7ff9067fc640 1 -- 172.21.15.122:0/3377463833 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 2) ==== 48655+0+0 (secure 0 0 0) 0x7ff90800f850 con 0x7ff914071630 2024-09-17T06:03:48.127 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.126+0000 7ff9067fc640 1 -- 172.21.15.122:0/3377463833 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff90804f540 con 0x7ff914071630 2024-09-17T06:03:48.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.126+0000 7ff9067fc640 1 -- 172.21.15.122:0/3377463833 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff908014030 con 0x7ff914071630 2024-09-17T06:03:48.188 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.186+0000 7ff91bd6c640 1 -- 172.21.15.122:0/3377463833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff914071a40 con 0x7ff914071630 2024-09-17T06:03:48.188 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.186+0000 7ff9067fc640 1 -- 172.21.15.122:0/3377463833 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff908020350 con 0x7ff914071630 2024-09-17T06:03:48.189 INFO:teuthology.misc.health.smithi122.stdout: 2024-09-17T06:03:48.189 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":10,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:03:46.879949+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:03:48.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.186+0000 7ff91bd6c640 1 -- 172.21.15.122:0/3377463833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff914071630 msgr2=0x7ff91415abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:48.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.186+0000 7ff91bd6c640 1 --2- 172.21.15.122:0/3377463833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff914071630 0x7ff91415abe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff90800c970 tx=0x7ff90800ce30 comp rx=0 tx=0).stop 2024-09-17T06:03:48.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.190+0000 7ff91bd6c640 1 -- 172.21.15.122:0/3377463833 shutdown_connections 2024-09-17T06:03:48.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.190+0000 7ff91bd6c640 1 --2- 172.21.15.122:0/3377463833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff9140c35d0 0x7ff914150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:48.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.190+0000 7ff91bd6c640 1 --2- 172.21.15.122:0/3377463833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff914071630 0x7ff91415abe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:48.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.190+0000 7ff91bd6c640 1 --2- 172.21.15.122:0/3377463833 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff91406f5b0 0x7ff9141f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:48.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.190+0000 7ff91bd6c640 1 -- 172.21.15.122:0/3377463833 >> 172.21.15.122:0/3377463833 conn(0x7ff9140cdbf0 msgr2=0x7ff9140cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:48.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.190+0000 7ff91bd6c640 1 -- 172.21.15.122:0/3377463833 shutdown_connections 2024-09-17T06:03:48.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:48.190+0000 7ff91bd6c640 1 -- 172.21.15.122:0/3377463833 wait complete. 2024-09-17T06:03:48.206 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T06:03:48.361 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:03:48.362+0000 7f99de4c97c0 -1 Falling back to public interface 2024-09-17T06:03:48.423 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:03:48.422+0000 7f08bc3c07c0 -1 Falling back to public interface 2024-09-17T06:03:48.523 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-17T06:03:48.522+0000 7f6c25de0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T06:03:48.523 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-17T06:03:48.522+0000 7f6c25de0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T06:03:48.557 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:03:48.558+0000 7ffa1fd6a7c0 -1 Falling back to public interface 2024-09-17T06:03:48.596 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:03:48.598+0000 7f1406d337c0 -1 Falling back to public interface 2024-09-17T06:03:48.617 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:03:48.618+0000 7f58db3467c0 -1 Falling back to public interface 2024-09-17T06:03:48.652 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:03:48.650+0000 7f4fd16037c0 -1 Falling back to public interface 2024-09-17T06:03:48.855 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:03:48.854+0000 7f9187c497c0 -1 Falling back to public interface 2024-09-17T06:03:48.867 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:03:48.866+0000 7ffa6fef37c0 -1 Falling back to public interface 2024-09-17T06:03:52.409 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:03:52.409+0000 7f99de4c97c0 -1 osd.5 0 log_to_monitors true 2024-09-17T06:03:52.445 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:03:52.441+0000 7f08bc3c07c0 -1 osd.1 0 log_to_monitors true 2024-09-17T06:03:52.517 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:03:52.517+0000 7ffa1fd6a7c0 -1 osd.4 0 log_to_monitors true 2024-09-17T06:03:52.641 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:03:52.641+0000 7f1406d337c0 -1 osd.6 0 log_to_monitors true 2024-09-17T06:03:52.713 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:03:52.709+0000 7f4fd16037c0 -1 osd.3 0 log_to_monitors true 2024-09-17T06:03:53.086 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:03:53.085+0000 7f58db3467c0 -1 osd.7 0 log_to_monitors true 2024-09-17T06:03:53.194 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:03:53.189+0000 7ffa6fef37c0 -1 osd.0 0 log_to_monitors true 2024-09-17T06:03:53.334 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:03:53.329+0000 7f9187c497c0 -1 osd.2 0 log_to_monitors true 2024-09-17T06:03:54.417 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:03:54.417+0000 7f99da46f640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T06:03:54.449 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:03:54.449+0000 7f99d226c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T06:03:55.013 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T06:03:55.179 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.177+0000 7f56ec8bc640 1 -- 172.21.15.122:0/3403118149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e814ef30 msgr2=0x7f56e80c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:55.180 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.177+0000 7f56ec8bc640 1 --2- 172.21.15.122:0/3403118149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e814ef30 0x7f56e80c8d60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f56e8070b60 tx=0x7f56e001f540 comp rx=0 tx=0).stop 2024-09-17T06:03:55.180 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.177+0000 7f56ec8bc640 1 -- 172.21.15.122:0/3403118149 shutdown_connections 2024-09-17T06:03:55.180 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.177+0000 7f56ec8bc640 1 --2- 172.21.15.122:0/3403118149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e814ef30 0x7f56e80c8d60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:55.180 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.177+0000 7f56ec8bc640 1 --2- 172.21.15.122:0/3403118149 >> v2:172.21.15.173:3300/0 conn(0x7f56e806f5e0 0x7f56e8158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:55.180 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.177+0000 7f56ec8bc640 1 -- 172.21.15.122:0/3403118149 >> 172.21.15.122:0/3403118149 conn(0x7f56e80736e0 msgr2=0x7f56e80cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:55.180 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.177+0000 7f56ec8bc640 1 -- 172.21.15.122:0/3403118149 shutdown_connections 2024-09-17T06:03:55.180 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.177+0000 7f56ec8bc640 1 -- 172.21.15.122:0/3403118149 wait complete. 2024-09-17T06:03:55.181 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.177+0000 7f56ec8bc640 1 Processor -- start 2024-09-17T06:03:55.181 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.177+0000 7f56ec8bc640 1 -- start start 2024-09-17T06:03:55.183 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ec8bc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56e806f5e0 0x7f56e81ef870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:55.184 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ec8bc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e80c2a20 0x7f56e8148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:55.184 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ec8bc640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56e814ef30 0x7f56e814f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:55.184 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ec8bc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f56e806eb00 con 0x7f56e80c2a20 2024-09-17T06:03:55.184 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ec8bc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f56e806e820 con 0x7f56e806f5e0 2024-09-17T06:03:55.184 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ec8bc640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f56e806ede0 con 0x7f56e814ef30 2024-09-17T06:03:55.184 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ddd9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e80c2a20 0x7f56e8148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:55.184 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ddd9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e80c2a20 0x7f56e8148f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35660/0 (socket says 172.21.15.122:35660) 2024-09-17T06:03:55.184 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ddd9b640 1 -- 172.21.15.122:0/330009920 learned_addr learned my addr 172.21.15.122:0/330009920 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:03:55.184 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56e659c640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56e806f5e0 0x7f56e81ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:55.184 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56e6d9d640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56e814ef30 0x7f56e814f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:55.184 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ddd9b640 1 -- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56e814ef30 msgr2=0x7f56e814f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:55.185 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ddd9b640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56e814ef30 0x7f56e814f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:55.185 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ddd9b640 1 -- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56e806f5e0 msgr2=0x7f56e81ef870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:55.185 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ddd9b640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56e806f5e0 0x7f56e81ef870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:55.185 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ddd9b640 1 -- 172.21.15.122:0/330009920 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e81efdb0 con 0x7f56e80c2a20 2024-09-17T06:03:55.185 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ddd9b640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e80c2a20 0x7f56e8148f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b440 tx=0x7f56d000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:55.185 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56df7fe640 1 -- 172.21.15.122:0/330009920 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0015020 con 0x7f56e80c2a20 2024-09-17T06:03:55.185 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56df7fe640 1 -- 172.21.15.122:0/330009920 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56d0011980 con 0x7f56e80c2a20 2024-09-17T06:03:55.185 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ec8bc640 1 -- 172.21.15.122:0/330009920 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e81501f0 con 0x7f56e80c2a20 2024-09-17T06:03:55.185 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56df7fe640 1 -- 172.21.15.122:0/330009920 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0011dd0 con 0x7f56e80c2a20 2024-09-17T06:03:55.185 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ec8bc640 1 -- 172.21.15.122:0/330009920 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e8150770 con 0x7f56e80c2a20 2024-09-17T06:03:55.186 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56ec8bc640 1 -- 172.21.15.122:0/330009920 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e80c2e30 con 0x7f56e80c2a20 2024-09-17T06:03:55.186 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56df7fe640 1 -- 172.21.15.122:0/330009920 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 4) ==== 97178+0+0 (secure 0 0 0) 0x7f56d0018020 con 0x7f56e80c2a20 2024-09-17T06:03:55.186 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.181+0000 7f56df7fe640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f56c8073170 0x7f56c8075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:03:55.186 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.185+0000 7f56df7fe640 1 -- 172.21.15.122:0/330009920 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f56d00934d0 con 0x7f56e80c2a20 2024-09-17T06:03:55.186 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.185+0000 7f56e659c640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f56c8073170 0x7f56c8075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:03:55.187 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.185+0000 7f56e659c640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f56c8073170 0x7f56c8075680 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f56d8004630 tx=0x7f56d800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:03:55.199 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.197+0000 7f56df7fe640 1 -- 172.21.15.122:0/330009920 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f56d001f020 con 0x7f56e80c2a20 2024-09-17T06:03:55.440 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.437+0000 7f56ec8bc640 1 -- 172.21.15.122:0/330009920 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56e814ed10 con 0x7f56e80c2a20 2024-09-17T06:03:55.441 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.437+0000 7f56df7fe640 1 -- 172.21.15.122:0/330009920 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7f56d000d040 con 0x7f56e80c2a20 2024-09-17T06:03:55.441 INFO:teuthology.misc.health.smithi122.stdout: 2024-09-17T06:03:55.441 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":13,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:03:54.470621+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:03:55.443 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.441+0000 7f56ec8bc640 1 -- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f56c8073170 msgr2=0x7f56c8075680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:55.443 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.441+0000 7f56ec8bc640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f56c8073170 0x7f56c8075680 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f56d8004630 tx=0x7f56d800b2e0 comp rx=0 tx=0).stop 2024-09-17T06:03:55.443 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.441+0000 7f56ec8bc640 1 -- 172.21.15.122:0/330009920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e80c2a20 msgr2=0x7f56e8148f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:03:55.443 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.441+0000 7f56ec8bc640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e80c2a20 0x7f56e8148f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b440 tx=0x7f56d000b900 comp rx=0 tx=0).stop 2024-09-17T06:03:55.443 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.441+0000 7f56ec8bc640 1 -- 172.21.15.122:0/330009920 shutdown_connections 2024-09-17T06:03:55.444 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.441+0000 7f56ec8bc640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56e814ef30 0x7f56e814f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:55.444 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.441+0000 7f56ec8bc640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56e80c2a20 0x7f56e8148f70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:55.444 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.441+0000 7f56ec8bc640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f56c8073170 0x7f56c8075680 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:55.444 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.441+0000 7f56ec8bc640 1 --2- 172.21.15.122:0/330009920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56e806f5e0 0x7f56e81ef870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:03:55.444 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.441+0000 7f56ec8bc640 1 -- 172.21.15.122:0/330009920 >> 172.21.15.122:0/330009920 conn(0x7f56e80736e0 msgr2=0x7f56e80b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:03:55.444 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.441+0000 7f56ec8bc640 1 -- 172.21.15.122:0/330009920 shutdown_connections 2024-09-17T06:03:55.444 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:03:55.441+0000 7f56ec8bc640 1 -- 172.21.15.122:0/330009920 wait complete. 2024-09-17T06:03:55.461 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T06:03:55.552 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:03:55.549+0000 7f08b8b7b640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T06:03:55.584 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:03:55.581+0000 7f08b0163640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T06:03:56.189 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:03:56.185+0000 7f9183bef640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T06:03:56.219 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:03:56.217+0000 7f917b9ec640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T06:03:56.250 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:03:56.245+0000 7ffa6c6ae640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T06:03:56.254 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:03:56.249+0000 7f4fcd5a9640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T06:03:56.275 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:03:56.273+0000 7ffa63c96640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T06:03:56.276 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:03:56.273+0000 7f4fc53a6640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T06:03:56.276 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:03:56.273+0000 7f1402cd9640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T06:03:56.296 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:03:56.297+0000 7f13faad6640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T06:03:56.341 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:03:56.341+0000 7ffa1c525640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T06:03:56.347 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:03:56.345+0000 7f58d72ec640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T06:03:56.364 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:03:56.365+0000 7ffa13b0d640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T06:03:56.372 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:03:56.373+0000 7f58cf0e9640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T06:04:02.267 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T06:04:02.427 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.421+0000 7f763c528640 1 -- 172.21.15.122:0/2908142492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7634153210 msgr2=0x7f7634159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:02.427 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.421+0000 7f763c528640 1 --2- 172.21.15.122:0/2908142492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7634153210 0x7f7634159c10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f76340ca4d0 tx=0x7f762401c8c0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.427 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.421+0000 7f763c528640 1 -- 172.21.15.122:0/2908142492 shutdown_connections 2024-09-17T06:04:02.427 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 --2- 172.21.15.122:0/2908142492 >> v2:172.21.15.173:3300/0 conn(0x7f763415cb60 0x7f763415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.427 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 --2- 172.21.15.122:0/2908142492 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f76340c5d50 0x7f76340c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.427 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 --2- 172.21.15.122:0/2908142492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7634153210 0x7f7634159c10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.427 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 -- 172.21.15.122:0/2908142492 >> 172.21.15.122:0/2908142492 conn(0x7f763406ce90 msgr2=0x7f763406d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:02.428 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 -- 172.21.15.122:0/2908142492 shutdown_connections 2024-09-17T06:04:02.428 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 -- 172.21.15.122:0/2908142492 wait complete. 2024-09-17T06:04:02.428 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 Processor -- start 2024-09-17T06:04:02.428 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 -- start start 2024-09-17T06:04:02.430 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76340c5d50 0x7f76340c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:02.431 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7634153210 0x7f763415ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:02.431 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f763415cb60 0x7f763415b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:02.431 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f76340c36a0 con 0x7f763415cb60 2024-09-17T06:04:02.431 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f76340c7040 con 0x7f76340c5d50 2024-09-17T06:04:02.431 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763c528640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f76340c3820 con 0x7f7634153210 2024-09-17T06:04:02.431 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763aac5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f763415cb60 0x7f763415b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:02.431 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763aac5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f763415cb60 0x7f763415b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35678/0 (socket says 172.21.15.122:35678) 2024-09-17T06:04:02.431 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763aac5640 1 -- 172.21.15.122:0/2459977300 learned_addr learned my addr 172.21.15.122:0/2459977300 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:02.431 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763a2c4640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76340c5d50 0x7f76340c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:02.431 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f7639ac3640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7634153210 0x7f763415ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:02.431 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763aac5640 1 -- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7634153210 msgr2=0x7f763415ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:02.431 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763aac5640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7634153210 0x7f763415ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.432 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763aac5640 1 -- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76340c5d50 msgr2=0x7f76340c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:02.432 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763aac5640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76340c5d50 0x7f76340c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.432 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763aac5640 1 -- 172.21.15.122:0/2459977300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76340c5740 con 0x7f763415cb60 2024-09-17T06:04:02.432 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.425+0000 7f763a2c4640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76340c5d50 0x7f76340c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:04:02.432 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.429+0000 7f763aac5640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f763415cb60 0x7f763415b3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f762c00dac0 tx=0x7f762c00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:02.432 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.429+0000 7f762affd640 1 -- 172.21.15.122:0/2459977300 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c017070 con 0x7f763415cb60 2024-09-17T06:04:02.432 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.429+0000 7f762affd640 1 -- 172.21.15.122:0/2459977300 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f762c004b30 con 0x7f763415cb60 2024-09-17T06:04:02.432 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.429+0000 7f762affd640 1 -- 172.21.15.122:0/2459977300 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c005020 con 0x7f763415cb60 2024-09-17T06:04:02.433 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.429+0000 7f763c528640 1 -- 172.21.15.122:0/2459977300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f763415c1c0 con 0x7f763415cb60 2024-09-17T06:04:02.433 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.429+0000 7f763c528640 1 -- 172.21.15.122:0/2459977300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76340c44a0 con 0x7f763415cb60 2024-09-17T06:04:02.433 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.429+0000 7f763c528640 1 -- 172.21.15.122:0/2459977300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76340c4850 con 0x7f763415cb60 2024-09-17T06:04:02.433 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.429+0000 7f762affd640 1 -- 172.21.15.122:0/2459977300 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f762c0051c0 con 0x7f763415cb60 2024-09-17T06:04:02.434 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.429+0000 7f762affd640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7618073200 0x7f7618075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:02.434 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.429+0000 7f762affd640 1 -- 172.21.15.122:0/2459977300 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f762c0943a0 con 0x7f763415cb60 2024-09-17T06:04:02.434 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.429+0000 7f763a2c4640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7618073200 0x7f7618075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:02.434 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.433+0000 7f763a2c4640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7618073200 0x7f7618075710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f76240af000 tx=0x7f762401b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:02.438 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.433+0000 7f762affd640 1 -- 172.21.15.122:0/2459977300 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f762c020070 con 0x7f763415cb60 2024-09-17T06:04:02.611 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.609+0000 7f763c528640 1 -- 172.21.15.122:0/2459977300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76340717d0 con 0x7f763415cb60 2024-09-17T06:04:02.612 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.609+0000 7f762affd640 1 -- 172.21.15.122:0/2459977300 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12944 (secure 0 0 0) 0x7f762c05f710 con 0x7f763415cb60 2024-09-17T06:04:02.612 INFO:teuthology.misc.health.smithi122.stdout: 2024-09-17T06:04:02.613 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":18,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:03:59.625672+0000","last_up_change":"2024-09-17T06:03:56.580331+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6811","nonce":920798795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6813","nonce":920798795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6817","nonce":920798795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6815","nonce":920798795}]},"public_addr":"172.21.15.173:6811/920798795","cluster_addr":"172.21.15.173:6813/920798795","heartbeat_back_addr":"172.21.15.173:6817/920798795","heartbeat_front_addr":"172.21.15.173:6815/920798795","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:04:02.615 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.609+0000 7f763c528640 1 -- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7618073200 msgr2=0x7f7618075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:02.615 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.609+0000 7f763c528640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7618073200 0x7f7618075710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f76240af000 tx=0x7f762401b100 comp rx=0 tx=0).stop 2024-09-17T06:04:02.615 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.609+0000 7f763c528640 1 -- 172.21.15.122:0/2459977300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f763415cb60 msgr2=0x7f763415b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:02.615 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.609+0000 7f763c528640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f763415cb60 0x7f763415b3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f762c00dac0 tx=0x7f762c00df80 comp rx=0 tx=0).stop 2024-09-17T06:04:02.615 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.613+0000 7f763c528640 1 -- 172.21.15.122:0/2459977300 shutdown_connections 2024-09-17T06:04:02.615 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.613+0000 7f763c528640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f763415cb60 0x7f763415b3a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.615 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.613+0000 7f763c528640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7634153210 0x7f763415ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.615 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.613+0000 7f763c528640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7618073200 0x7f7618075710 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.615 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.613+0000 7f763c528640 1 --2- 172.21.15.122:0/2459977300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76340c5d50 0x7f76340c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.615 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.613+0000 7f763c528640 1 -- 172.21.15.122:0/2459977300 >> 172.21.15.122:0/2459977300 conn(0x7f763406ce90 msgr2=0x7f7634157000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:02.616 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.613+0000 7f763c528640 1 -- 172.21.15.122:0/2459977300 shutdown_connections 2024-09-17T06:04:02.616 INFO:teuthology.misc.health.smithi122.stderr:2024-09-17T06:04:02.613+0000 7f763c528640 1 -- 172.21.15.122:0/2459977300 wait complete. 2024-09-17T06:04:02.634 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T06:04:02.634 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T06:04:02.634 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T06:04:02.635 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T06:04:02.637 INFO:tasks.ceph.mds.a:Started 2024-09-17T06:04:02.637 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T06:04:02.637 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T06:04:02.639 INFO:tasks.ceph.mds.c:Started 2024-09-17T06:04:02.639 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-17T06:04:02.640 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-17T06:04:02.642 INFO:tasks.ceph.mds.e:Started 2024-09-17T06:04:02.642 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T06:04:02.642 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T06:04:02.645 INFO:tasks.ceph.mds.b:Started 2024-09-17T06:04:02.645 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T06:04:02.645 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T06:04:02.648 INFO:tasks.ceph.mds.d:Started 2024-09-17T06:04:02.648 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-17T06:04:02.648 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-09-17T06:04:02.650 INFO:tasks.ceph.mds.f:Started 2024-09-17T06:04:02.651 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T06:04:02.651 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T06:04:02.746 INFO:tasks.ceph.mds.a.smithi122.stdout:starting mds.a at 2024-09-17T06:04:02.747 INFO:tasks.ceph.mds.e.smithi122.stdout:starting mds.e at 2024-09-17T06:04:02.748 INFO:tasks.ceph.mds.c.smithi122.stdout:starting mds.c at 2024-09-17T06:04:02.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.797+0000 7fcb7f559640 1 -- 172.21.15.122:0/3149614783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb7806fc90 msgr2=0x7fcb7806d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:02.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.797+0000 7fcb7f559640 1 --2- 172.21.15.122:0/3149614783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb7806fc90 0x7fcb7806d760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb780c9e10 tx=0x7fcb7001f580 comp rx=0 tx=0).stop 2024-09-17T06:04:02.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.797+0000 7fcb7f559640 1 -- 172.21.15.122:0/3149614783 shutdown_connections 2024-09-17T06:04:02.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.797+0000 7fcb7f559640 1 --2- 172.21.15.122:0/3149614783 >> v2:172.21.15.173:3300/0 conn(0x7fcb7815d240 0x7fcb7806f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.797+0000 7fcb7f559640 1 --2- 172.21.15.122:0/3149614783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb7806fc90 0x7fcb7806d760 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.797+0000 7fcb7f559640 1 --2- 172.21.15.122:0/3149614783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb78159240 0x7fcb78142640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.797+0000 7fcb7f559640 1 -- 172.21.15.122:0/3149614783 >> 172.21.15.122:0/3149614783 conn(0x7fcb780ca380 msgr2=0x7fcb780ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:02.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.797+0000 7fcb7f559640 1 -- 172.21.15.122:0/3149614783 shutdown_connections 2024-09-17T06:04:02.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.797+0000 7fcb7f559640 1 -- 172.21.15.122:0/3149614783 wait complete. 2024-09-17T06:04:02.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.797+0000 7fcb7f559640 1 Processor -- start 2024-09-17T06:04:02.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.797+0000 7fcb7f559640 1 -- start start 2024-09-17T06:04:02.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7f559640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb7806fc90 0x7fcb781f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:02.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7f559640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb78159240 0x7fcb780c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:02.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7f559640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb7815d240 0x7fcb780c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:02.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7f559640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7815d650 con 0x7fcb7815d240 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7f559640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7806dca0 con 0x7fcb7806fc90 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7f559640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fcb780c2b60 con 0x7fcb78159240 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7daf6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb7815d240 0x7fcb780c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7daf6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb7815d240 0x7fcb780c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35760/0 (socket says 172.21.15.122:35760) 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7daf6640 1 -- 172.21.15.122:0/2980157587 learned_addr learned my addr 172.21.15.122:0/2980157587 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7daf6640 1 -- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb78159240 msgr2=0x7fcb780c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7daf6640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb78159240 0x7fcb780c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7daf6640 1 -- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb7806fc90 msgr2=0x7fcb781f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7d2f5640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb7806fc90 0x7fcb781f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7daf6640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb7806fc90 0x7fcb781f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7daf6640 1 -- 172.21.15.122:0/2980157587 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb781f2aa0 con 0x7fcb7815d240 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7daf6640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb7815d240 0x7fcb780c6c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcb700b3040 tx=0x7fcb70009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb6dffb640 1 -- 172.21.15.122:0/2980157587 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb700bf070 con 0x7fcb7815d240 2024-09-17T06:04:02.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb6dffb640 1 -- 172.21.15.122:0/2980157587 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb70004c00 con 0x7fcb7815d240 2024-09-17T06:04:02.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7f559640 1 -- 172.21.15.122:0/2980157587 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7815c0c0 con 0x7fcb7815d240 2024-09-17T06:04:02.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb6dffb640 1 -- 172.21.15.122:0/2980157587 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb700b5040 con 0x7fcb7815d240 2024-09-17T06:04:02.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7f559640 1 -- 172.21.15.122:0/2980157587 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb781f2040 con 0x7fcb7815d240 2024-09-17T06:04:02.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7f559640 1 -- 172.21.15.122:0/2980157587 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb780b0cf0 con 0x7fcb7815d240 2024-09-17T06:04:02.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb6dffb640 1 -- 172.21.15.122:0/2980157587 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcb700c2070 con 0x7fcb7815d240 2024-09-17T06:04:02.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb6dffb640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcb5c073230 0x7fcb5c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:02.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb6dffb640 1 -- 172.21.15.122:0/2980157587 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fcb701312c0 con 0x7fcb7815d240 2024-09-17T06:04:02.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.801+0000 7fcb7d2f5640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcb5c073230 0x7fcb5c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:02.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.805+0000 7fcb7d2f5640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcb5c073230 0x7fcb5c075740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009980 tx=0x7fcb74005ca0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:02.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:02.809+0000 7fcb6dffb640 1 -- 172.21.15.122:0/2980157587 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fcb700190e0 con 0x7fcb7815d240 2024-09-17T06:04:02.827 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2024-09-17T06:04:02.835 INFO:tasks.ceph.mds.f.smithi173.stdout:starting mds.f at 2024-09-17T06:04:02.840 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2024-09-17T06:04:03.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.001+0000 7fcb7f559640 1 -- 172.21.15.122:0/2980157587 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb781f1b50 con 0x7fcb7815d240 2024-09-17T06:04:03.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.001+0000 7fcb6dffb640 1 -- 172.21.15.122:0/2980157587 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7fcb700fc6c0 con 0x7fcb7815d240 2024-09-17T06:04:03.006 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:03.006 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":2,"btime":"2024-09-17T06:04:02:756222+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1552928786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1552928786},{"type":"v1","addr":"172.21.15.122:6837","nonce":1552928786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T06:04:03.006 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 2 2024-09-17T06:04:03.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.005+0000 7fcb7f559640 1 -- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcb5c073230 msgr2=0x7fcb5c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:03.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.005+0000 7fcb7f559640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcb5c073230 0x7fcb5c075740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009980 tx=0x7fcb74005ca0 comp rx=0 tx=0).stop 2024-09-17T06:04:03.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.005+0000 7fcb7f559640 1 -- 172.21.15.122:0/2980157587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb7815d240 msgr2=0x7fcb780c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:03.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.005+0000 7fcb7f559640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb7815d240 0x7fcb780c6c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcb700b3040 tx=0x7fcb70009350 comp rx=0 tx=0).stop 2024-09-17T06:04:03.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.005+0000 7fcb7f559640 1 -- 172.21.15.122:0/2980157587 shutdown_connections 2024-09-17T06:04:03.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.005+0000 7fcb7f559640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb7815d240 0x7fcb780c6c40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:03.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.005+0000 7fcb7f559640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb78159240 0x7fcb780c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:03.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.005+0000 7fcb7f559640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcb5c073230 0x7fcb5c075740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:03.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.005+0000 7fcb7f559640 1 --2- 172.21.15.122:0/2980157587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb7806fc90 0x7fcb781f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:03.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.005+0000 7fcb7f559640 1 -- 172.21.15.122:0/2980157587 >> 172.21.15.122:0/2980157587 conn(0x7fcb780ca380 msgr2=0x7fcb781570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:03.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.005+0000 7fcb7f559640 1 -- 172.21.15.122:0/2980157587 shutdown_connections 2024-09-17T06:04:03.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:03.005+0000 7fcb7f559640 1 -- 172.21.15.122:0/2980157587 wait complete. 2024-09-17T06:04:04.708 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:04:04.711 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:04:05.026 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T06:04:05.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.188+0000 7fc44efcb640 1 -- 172.21.15.122:0/4120771447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc430003a60 msgr2=0x7fc430003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.188+0000 7fc44efcb640 1 --2- 172.21.15.122:0/4120771447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc430003a60 0x7fc430003ed0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4440016f0 tx=0x7fc44401c790 comp rx=0 tx=0).stop 2024-09-17T06:04:05.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.188+0000 7fc44efcb640 1 -- 172.21.15.122:0/4120771447 shutdown_connections 2024-09-17T06:04:05.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.188+0000 7fc44efcb640 1 --2- 172.21.15.122:0/4120771447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc430003a60 0x7fc430003ed0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.188+0000 7fc44efcb640 1 -- 172.21.15.122:0/4120771447 >> 172.21.15.122:0/4120771447 conn(0x7fc44806d090 msgr2=0x7fc44806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:05.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.188+0000 7fc44efcb640 1 -- 172.21.15.122:0/4120771447 shutdown_connections 2024-09-17T06:04:05.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.188+0000 7fc44efcb640 1 -- 172.21.15.122:0/4120771447 wait complete. 2024-09-17T06:04:05.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44efcb640 1 Processor -- start 2024-09-17T06:04:05.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44efcb640 1 -- start start 2024-09-17T06:04:05.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44efcb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc430003a60 0x7fc4481f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:05.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44efcb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4480ca040 0x7fc448158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:05.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44efcb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc448158b80 0x7fc4480cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:05.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44efcb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc4480cc610 con 0x7fc430003a60 2024-09-17T06:04:05.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44efcb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc4480cd230 con 0x7fc4480ca040 2024-09-17T06:04:05.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44efcb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc4480c7490 con 0x7fc448158b80 2024-09-17T06:04:05.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44cd67640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc430003a60 0x7fc4481f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:05.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44cd67640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc430003a60 0x7fc4481f5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59610/0 (socket says 172.21.15.122:59610) 2024-09-17T06:04:05.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44cd67640 1 -- 172.21.15.122:0/1317032464 learned_addr learned my addr 172.21.15.122:0/1317032464 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:05.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc43ffff640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4480ca040 0x7fc448158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44d568640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc448158b80 0x7fc4480cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44cd67640 1 -- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc448158b80 msgr2=0x7fc4480cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44cd67640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc448158b80 0x7fc4480cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44cd67640 1 -- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4480ca040 msgr2=0x7fc448158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44cd67640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4480ca040 0x7fc448158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44cd67640 1 -- 172.21.15.122:0/1317032464 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc448158f90 con 0x7fc430003a60 2024-09-17T06:04:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44cd67640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc430003a60 0x7fc4481f5210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc44401ae90 tx=0x7fc444003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc43d7fa640 1 -- 172.21.15.122:0/1317032464 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4440ba070 con 0x7fc430003a60 2024-09-17T06:04:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc43d7fa640 1 -- 172.21.15.122:0/1317032464 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4440af040 con 0x7fc430003a60 2024-09-17T06:04:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc43d7fa640 1 -- 172.21.15.122:0/1317032464 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4440ae070 con 0x7fc430003a60 2024-09-17T06:04:05.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44efcb640 1 -- 172.21.15.122:0/1317032464 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4481f5750 con 0x7fc430003a60 2024-09-17T06:04:05.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44efcb640 1 -- 172.21.15.122:0/1317032464 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4480cf9b0 con 0x7fc430003a60 2024-09-17T06:04:05.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.192+0000 7fc44efcb640 1 -- 172.21.15.122:0/1317032464 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44815ada0 con 0x7fc430003a60 2024-09-17T06:04:05.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.196+0000 7fc43d7fa640 1 -- 172.21.15.122:0/1317032464 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc444006330 con 0x7fc430003a60 2024-09-17T06:04:05.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.196+0000 7fc43d7fa640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc434073200 0x7fc434075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:05.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.196+0000 7fc43d7fa640 1 -- 172.21.15.122:0/1317032464 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fc44412d580 con 0x7fc430003a60 2024-09-17T06:04:05.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.196+0000 7fc43ffff640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc434073200 0x7fc434075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:05.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.196+0000 7fc43ffff640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc434073200 0x7fc434075710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc4480d1b20 tx=0x7fc438005e40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:05.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.200+0000 7fc43d7fa640 1 -- 172.21.15.122:0/1317032464 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc448158f90 con 0x7fc430003a60 2024-09-17T06:04:05.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.404+0000 7fc44efcb640 1 -- 172.21.15.122:0/1317032464 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4480b5940 con 0x7fc430003a60 2024-09-17T06:04:05.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.404+0000 7fc43d7fa640 1 -- 172.21.15.122:0/1317032464 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5572 (secure 0 0 0) 0x7fc4440164f0 con 0x7fc430003a60 2024-09-17T06:04:05.410 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:05.410 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":3,"btime":"2024-09-17T06:04:03:759290+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1941177833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1941177833},{"type":"v1","addr":"172.21.15.173:6835","nonce":1941177833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3902874091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3902874091},{"type":"v1","addr":"172.21.15.122:6833","nonce":3902874091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2868113442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2868113442},{"type":"v1","addr":"172.21.15.122:6836","nonce":2868113442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1552928786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1552928786},{"type":"v1","addr":"172.21.15.122:6837","nonce":1552928786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4447,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2188047562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2188047562},{"type":"v1","addr":"172.21.15.173:6837","nonce":2188047562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/1694851531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":1694851531},{"type":"v1","addr":"172.21.15.173:6839","nonce":1694851531}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T06:04:05.410 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 3 2024-09-17T06:04:05.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.408+0000 7fc44efcb640 1 -- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc434073200 msgr2=0x7fc434075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.408+0000 7fc44efcb640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc434073200 0x7fc434075710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc4480d1b20 tx=0x7fc438005e40 comp rx=0 tx=0).stop 2024-09-17T06:04:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.408+0000 7fc44efcb640 1 -- 172.21.15.122:0/1317032464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc430003a60 msgr2=0x7fc4481f5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.408+0000 7fc44efcb640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc430003a60 0x7fc4481f5210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc44401ae90 tx=0x7fc444003c60 comp rx=0 tx=0).stop 2024-09-17T06:04:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.408+0000 7fc44efcb640 1 -- 172.21.15.122:0/1317032464 shutdown_connections 2024-09-17T06:04:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.408+0000 7fc44efcb640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc448158b80 0x7fc4480cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.408+0000 7fc44efcb640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc434073200 0x7fc434075710 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.408+0000 7fc44efcb640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4480ca040 0x7fc448158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.408+0000 7fc44efcb640 1 --2- 172.21.15.122:0/1317032464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc430003a60 0x7fc4481f5210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.408+0000 7fc44efcb640 1 -- 172.21.15.122:0/1317032464 >> 172.21.15.122:0/1317032464 conn(0x7fc44806d090 msgr2=0x7fc448151440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.408+0000 7fc44efcb640 1 -- 172.21.15.122:0/1317032464 shutdown_connections 2024-09-17T06:04:05.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.408+0000 7fc44efcb640 1 -- 172.21.15.122:0/1317032464 wait complete. 2024-09-17T06:04:05.431 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T06:04:05.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.580+0000 7f1574a33640 1 -- 172.21.15.122:0/2852012854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15700ccdb0 msgr2=0x7f15700cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.580+0000 7f1574a33640 1 --2- 172.21.15.122:0/2852012854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15700ccdb0 0x7f15700cc1e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1560009840 tx=0x7f156001c790 comp rx=0 tx=0).stop 2024-09-17T06:04:05.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.580+0000 7f1574a33640 1 -- 172.21.15.122:0/2852012854 shutdown_connections 2024-09-17T06:04:05.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.580+0000 7f1574a33640 1 --2- 172.21.15.122:0/2852012854 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f157006dab0 0x7f15700cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.580+0000 7f1574a33640 1 --2- 172.21.15.122:0/2852012854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15700ccdb0 0x7f15700cc1e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.580+0000 7f1574a33640 1 -- 172.21.15.122:0/2852012854 >> 172.21.15.122:0/2852012854 conn(0x7f157008d450 msgr2=0x7f157006ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:05.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.580+0000 7f1574a33640 1 -- 172.21.15.122:0/2852012854 shutdown_connections 2024-09-17T06:04:05.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.580+0000 7f1574a33640 1 -- 172.21.15.122:0/2852012854 wait complete. 2024-09-17T06:04:05.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f1574a33640 1 Processor -- start 2024-09-17T06:04:05.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f1574a33640 1 -- start start 2024-09-17T06:04:05.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f1574a33640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f157006dab0 0x7f15701521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:05.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f1574a33640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15700cbb40 0x7f1570149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:05.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f1574a33640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15700ccdb0 0x7f15701508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:05.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f1574a33640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1570168690 con 0x7f15700cbb40 2024-09-17T06:04:05.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f1574a33640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1570168510 con 0x7f15700ccdb0 2024-09-17T06:04:05.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f1574a33640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1570168810 con 0x7f157006dab0 2024-09-17T06:04:05.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f156dd9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15700cbb40 0x7f1570149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:05.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f156dd9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15700cbb40 0x7f1570149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59624/0 (socket says 172.21.15.122:59624) 2024-09-17T06:04:05.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f156dd9b640 1 -- 172.21.15.122:0/920465123 learned_addr learned my addr 172.21.15.122:0/920465123 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:05.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f156ed9d640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15700ccdb0 0x7f15701508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:05.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f156dd9b640 1 -- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f157006dab0 msgr2=0x7f15701521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f156dd9b640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f157006dab0 0x7f15701521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f156dd9b640 1 -- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15700ccdb0 msgr2=0x7f15701508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f156dd9b640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15700ccdb0 0x7f15701508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f156dd9b640 1 -- 172.21.15.122:0/920465123 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15700cab70 con 0x7f15700cbb40 2024-09-17T06:04:05.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f156ed9d640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15700ccdb0 0x7f15701508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:05.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.584+0000 7f156dd9b640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15700cbb40 0x7f1570149240 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f156400e710 tx=0x7f156400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:05.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.588+0000 7f155effd640 1 -- 172.21.15.122:0/920465123 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156400cab0 con 0x7f15700cbb40 2024-09-17T06:04:05.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.588+0000 7f155effd640 1 -- 172.21.15.122:0/920465123 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f156400cc50 con 0x7f15700cbb40 2024-09-17T06:04:05.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.588+0000 7f1574a33640 1 -- 172.21.15.122:0/920465123 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15700c7f00 con 0x7f15700cbb40 2024-09-17T06:04:05.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.588+0000 7f155effd640 1 -- 172.21.15.122:0/920465123 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564005280 con 0x7f15700cbb40 2024-09-17T06:04:05.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.588+0000 7f1574a33640 1 -- 172.21.15.122:0/920465123 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15700c84c0 con 0x7f15700cbb40 2024-09-17T06:04:05.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.588+0000 7f1574a33640 1 -- 172.21.15.122:0/920465123 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15701513f0 con 0x7f15700cbb40 2024-09-17T06:04:05.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.588+0000 7f155effd640 1 -- 172.21.15.122:0/920465123 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f15640047b0 con 0x7f15700cbb40 2024-09-17T06:04:05.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.588+0000 7f155effd640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1550073230 0x7f1550075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:05.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.588+0000 7f155effd640 1 -- 172.21.15.122:0/920465123 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f1564094dc0 con 0x7f15700cbb40 2024-09-17T06:04:05.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.588+0000 7f156e59c640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1550073230 0x7f1550075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:05.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.588+0000 7f156e59c640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1550073230 0x7f1550075740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15600af000 tx=0x7f1560019530 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:05.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.592+0000 7f155effd640 1 -- 172.21.15.122:0/920465123 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f15640601c0 con 0x7f15700cbb40 2024-09-17T06:04:05.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.764+0000 7f1574a33640 1 -- 172.21.15.122:0/920465123 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f157015b470 con 0x7f15700cbb40 2024-09-17T06:04:05.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.764+0000 7f155effd640 1 -- 172.21.15.122:0/920465123 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f156405fac0 con 0x7f15700cbb40 2024-09-17T06:04:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:05.768 INFO:teuthology.orchestra.run.smithi122.stdout:[ 2024-09-17T06:04:05.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: "poolnum": 1, 2024-09-17T06:04:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: "poolname": ".mgr" 2024-09-17T06:04:05.769 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:05.769 INFO:teuthology.orchestra.run.smithi122.stdout:] 2024-09-17T06:04:05.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.764+0000 7f1574a33640 1 -- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1550073230 msgr2=0x7f1550075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.764+0000 7f1574a33640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1550073230 0x7f1550075740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15600af000 tx=0x7f1560019530 comp rx=0 tx=0).stop 2024-09-17T06:04:05.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.764+0000 7f1574a33640 1 -- 172.21.15.122:0/920465123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15700cbb40 msgr2=0x7f1570149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.764+0000 7f1574a33640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15700cbb40 0x7f1570149240 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f156400e710 tx=0x7f156400ebd0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.764+0000 7f1574a33640 1 -- 172.21.15.122:0/920465123 shutdown_connections 2024-09-17T06:04:05.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.764+0000 7f1574a33640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1550073230 0x7f1550075740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.764+0000 7f1574a33640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15700ccdb0 0x7f15701508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.764+0000 7f1574a33640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15700cbb40 0x7f1570149240 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.764+0000 7f1574a33640 1 --2- 172.21.15.122:0/920465123 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f157006dab0 0x7f15701521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.764+0000 7f1574a33640 1 -- 172.21.15.122:0/920465123 >> 172.21.15.122:0/920465123 conn(0x7f157008d450 msgr2=0x7f157014c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:05.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.768+0000 7f1574a33640 1 -- 172.21.15.122:0/920465123 shutdown_connections 2024-09-17T06:04:05.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.768+0000 7f1574a33640 1 -- 172.21.15.122:0/920465123 wait complete. 2024-09-17T06:04:05.790 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T06:04:05.790 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T06:04:05.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.928+0000 7fc40a639640 1 -- 172.21.15.122:0/4108651664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4040c29c0 msgr2=0x7fc4040c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.928+0000 7fc40a639640 1 --2- 172.21.15.122:0/4108651664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4040c29c0 0x7fc4040c8af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009900 tx=0x7fc3f401c850 comp rx=0 tx=0).stop 2024-09-17T06:04:05.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.928+0000 7fc40a639640 1 -- 172.21.15.122:0/4108651664 shutdown_connections 2024-09-17T06:04:05.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.928+0000 7fc40a639640 1 --2- 172.21.15.122:0/4108651664 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4040c2dd0 0x7fc4040c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.928+0000 7fc40a639640 1 --2- 172.21.15.122:0/4108651664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4040c29c0 0x7fc4040c8af0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.928+0000 7fc40a639640 1 -- 172.21.15.122:0/4108651664 >> 172.21.15.122:0/4108651664 conn(0x7fc4040ca380 msgr2=0x7fc4040ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:05.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.928+0000 7fc40a639640 1 -- 172.21.15.122:0/4108651664 shutdown_connections 2024-09-17T06:04:05.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.928+0000 7fc40a639640 1 -- 172.21.15.122:0/4108651664 wait complete. 2024-09-17T06:04:05.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc40a639640 1 Processor -- start 2024-09-17T06:04:05.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc40a639640 1 -- start start 2024-09-17T06:04:05.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc40a639640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4040c29c0 0x7fc4041f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:05.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc40a639640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4040c2dd0 0x7fc40414c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:05.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc40a639640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc404158150 0x7fc4040c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:05.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc40a639640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc40406ff60 con 0x7fc404158150 2024-09-17T06:04:05.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc40a639640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc4040c9570 con 0x7fc4040c2dd0 2024-09-17T06:04:05.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc40a639640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc4041f83f0 con 0x7fc4040c29c0 2024-09-17T06:04:05.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc408bd6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc404158150 0x7fc4040c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:05.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc408bd6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc404158150 0x7fc4040c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59634/0 (socket says 172.21.15.122:59634) 2024-09-17T06:04:05.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc408bd6640 1 -- 172.21.15.122:0/2355925797 learned_addr learned my addr 172.21.15.122:0/2355925797 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:05.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc4037fe640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4040c2dd0 0x7fc40414c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:05.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc403fff640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4040c29c0 0x7fc4041f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:05.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc408bd6640 1 -- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4040c29c0 msgr2=0x7fc4041f79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc408bd6640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4040c29c0 0x7fc4041f79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc408bd6640 1 -- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4040c2dd0 msgr2=0x7fc40414c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:05.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc408bd6640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4040c2dd0 0x7fc40414c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:05.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc408bd6640 1 -- 172.21.15.122:0/2355925797 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4041f7f20 con 0x7fc404158150 2024-09-17T06:04:05.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc408bd6640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc404158150 0x7fc4040c33b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c920 tx=0x7fc3ec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:05.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc400ff9640 1 -- 172.21.15.122:0/2355925797 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec007bb0 con 0x7fc404158150 2024-09-17T06:04:05.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc400ff9640 1 -- 172.21.15.122:0/2355925797 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3ec004030 con 0x7fc404158150 2024-09-17T06:04:05.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc40a639640 1 -- 172.21.15.122:0/2355925797 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40414ff70 con 0x7fc404158150 2024-09-17T06:04:05.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc400ff9640 1 -- 172.21.15.122:0/2355925797 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec007e60 con 0x7fc404158150 2024-09-17T06:04:05.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc40a639640 1 -- 172.21.15.122:0/2355925797 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc404156f70 con 0x7fc404158150 2024-09-17T06:04:05.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.932+0000 7fc40a639640 1 -- 172.21.15.122:0/2355925797 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4040728c0 con 0x7fc404158150 2024-09-17T06:04:05.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.936+0000 7fc400ff9640 1 -- 172.21.15.122:0/2355925797 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc3ec005020 con 0x7fc404158150 2024-09-17T06:04:05.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.936+0000 7fc400ff9640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc3e4073200 0x7fc3e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:05.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.936+0000 7fc400ff9640 1 -- 172.21.15.122:0/2355925797 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fc3ec094690 con 0x7fc404158150 2024-09-17T06:04:05.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.936+0000 7fc403fff640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc3e4073200 0x7fc3e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:05.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.936+0000 7fc403fff640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc3e4073200 0x7fc3e4075710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009f20 tx=0x7fc3fc0094d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:05.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:05.940+0000 7fc400ff9640 1 -- 172.21.15.122:0/2355925797 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc3ec014070 con 0x7fc404158150 2024-09-17T06:04:06.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.096+0000 7fc40a639640 1 -- 172.21.15.122:0/2355925797 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc4040c9d80 con 0x7fc404158150 2024-09-17T06:04:06.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.792+0000 7fc400ff9640 1 -- 172.21.15.122:0/2355925797 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fc3ec05fb70 con 0x7fc404158150 2024-09-17T06:04:06.792 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_metadata' created 2024-09-17T06:04:06.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.796+0000 7fc40a639640 1 -- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc3e4073200 msgr2=0x7fc3e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:06.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.796+0000 7fc40a639640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc3e4073200 0x7fc3e4075710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009f20 tx=0x7fc3fc0094d0 comp rx=0 tx=0).stop 2024-09-17T06:04:06.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.796+0000 7fc40a639640 1 -- 172.21.15.122:0/2355925797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc404158150 msgr2=0x7fc4040c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:06.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.796+0000 7fc40a639640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc404158150 0x7fc4040c33b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c920 tx=0x7fc3ec00cde0 comp rx=0 tx=0).stop 2024-09-17T06:04:06.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.796+0000 7fc40a639640 1 -- 172.21.15.122:0/2355925797 shutdown_connections 2024-09-17T06:04:06.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.796+0000 7fc40a639640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc404158150 0x7fc4040c33b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:06.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.796+0000 7fc40a639640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc3e4073200 0x7fc3e4075710 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:06.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.796+0000 7fc40a639640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4040c2dd0 0x7fc40414c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:06.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.796+0000 7fc40a639640 1 --2- 172.21.15.122:0/2355925797 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4040c29c0 0x7fc4041f79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:06.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.796+0000 7fc40a639640 1 -- 172.21.15.122:0/2355925797 >> 172.21.15.122:0/2355925797 conn(0x7fc4040ca380 msgr2=0x7fc404148560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:06.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.796+0000 7fc40a639640 1 -- 172.21.15.122:0/2355925797 shutdown_connections 2024-09-17T06:04:06.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.796+0000 7fc40a639640 1 -- 172.21.15.122:0/2355925797 wait complete. 2024-09-17T06:04:06.824 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-17T06:04:06.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.992+0000 7fef444f5640 1 -- 172.21.15.122:0/1594164502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef3c0c7340 msgr2=0x7fef3c158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:06.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.992+0000 7fef444f5640 1 --2- 172.21.15.122:0/1594164502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef3c0c7340 0x7fef3c158250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009840 tx=0x7fef2c01c790 comp rx=0 tx=0).stop 2024-09-17T06:04:06.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.992+0000 7fef444f5640 1 -- 172.21.15.122:0/1594164502 shutdown_connections 2024-09-17T06:04:06.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.992+0000 7fef444f5640 1 --2- 172.21.15.122:0/1594164502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef3c0c7340 0x7fef3c158250 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:06.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.992+0000 7fef444f5640 1 -- 172.21.15.122:0/1594164502 >> 172.21.15.122:0/1594164502 conn(0x7fef3c074b30 msgr2=0x7fef3c074f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:06.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.992+0000 7fef444f5640 1 -- 172.21.15.122:0/1594164502 shutdown_connections 2024-09-17T06:04:06.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.992+0000 7fef444f5640 1 -- 172.21.15.122:0/1594164502 wait complete. 2024-09-17T06:04:06.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.992+0000 7fef444f5640 1 Processor -- start 2024-09-17T06:04:06.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.992+0000 7fef444f5640 1 -- start start 2024-09-17T06:04:06.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef444f5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef3c0c69a0 0x7fef3c152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:06.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef444f5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef3c0c7340 0x7fef3c0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:06.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef444f5640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef3c14e260 0x7fef3c1f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:06.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef444f5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c151cc0 con 0x7fef3c0c69a0 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef444f5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c15b100 con 0x7fef3c0c7340 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef444f5640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fef3c151e40 con 0x7fef3c14e260 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef42291640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef3c0c69a0 0x7fef3c152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef42291640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef3c0c69a0 0x7fef3c152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59640/0 (socket says 172.21.15.122:59640) 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef42291640 1 -- 172.21.15.122:0/1881963274 learned_addr learned my addr 172.21.15.122:0/1881963274 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef41a90640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef3c0c7340 0x7fef3c0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef42a92640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef3c14e260 0x7fef3c1f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef42291640 1 -- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef3c14e260 msgr2=0x7fef3c1f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef42291640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef3c14e260 0x7fef3c1f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef42291640 1 -- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef3c0c7340 msgr2=0x7fef3c0ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef42291640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef3c0c7340 0x7fef3c0ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef42291640 1 -- 172.21.15.122:0/1881963274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c0caa80 con 0x7fef3c0c69a0 2024-09-17T06:04:06.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef42291640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef3c0c69a0 0x7fef3c152ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fef3800c3f0 tx=0x7fef3800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:06.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef32ffd640 1 -- 172.21.15.122:0/1881963274 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38011790 con 0x7fef3c0c69a0 2024-09-17T06:04:06.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef32ffd640 1 -- 172.21.15.122:0/1881963274 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef38017070 con 0x7fef3c0c69a0 2024-09-17T06:04:06.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef444f5640 1 -- 172.21.15.122:0/1881963274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3c14ef40 con 0x7fef3c0c69a0 2024-09-17T06:04:06.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef32ffd640 1 -- 172.21.15.122:0/1881963274 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38011ce0 con 0x7fef3c0c69a0 2024-09-17T06:04:06.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef444f5640 1 -- 172.21.15.122:0/1881963274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3c1f37d0 con 0x7fef3c0c69a0 2024-09-17T06:04:06.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef444f5640 1 -- 172.21.15.122:0/1881963274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef3c0c8d70 con 0x7fef3c0c69a0 2024-09-17T06:04:06.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef32ffd640 1 -- 172.21.15.122:0/1881963274 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fef3801c460 con 0x7fef3c0c69a0 2024-09-17T06:04:06.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef32ffd640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fef20073200 0x7fef20075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:06.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef32ffd640 1 -- 172.21.15.122:0/1881963274 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7fef38093df0 con 0x7fef3c0c69a0 2024-09-17T06:04:06.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:06.996+0000 7fef41a90640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fef20073200 0x7fef20075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:06.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.000+0000 7fef41a90640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fef20073200 0x7fef20075710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0af000 tx=0x7fef2c01afd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:07.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.004+0000 7fef32ffd640 1 -- 172.21.15.122:0/1881963274 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fef3c072a00 con 0x7fef3c0c69a0 2024-09-17T06:04:07.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.172+0000 7fef444f5640 1 -- 172.21.15.122:0/1881963274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fef3c0cd2a0 con 0x7fef3c0c69a0 2024-09-17T06:04:07.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.804+0000 7fef32ffd640 1 -- 172.21.15.122:0/1881963274 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7fef3c0cd2a0 con 0x7fef3c0c69a0 2024-09-17T06:04:07.805 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_data' created 2024-09-17T06:04:07.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.808+0000 7fef444f5640 1 -- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fef20073200 msgr2=0x7fef20075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:07.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.808+0000 7fef444f5640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fef20073200 0x7fef20075710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0af000 tx=0x7fef2c01afd0 comp rx=0 tx=0).stop 2024-09-17T06:04:07.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.808+0000 7fef444f5640 1 -- 172.21.15.122:0/1881963274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef3c0c69a0 msgr2=0x7fef3c152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:07.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.808+0000 7fef444f5640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef3c0c69a0 0x7fef3c152ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fef3800c3f0 tx=0x7fef3800c8b0 comp rx=0 tx=0).stop 2024-09-17T06:04:07.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.808+0000 7fef444f5640 1 -- 172.21.15.122:0/1881963274 shutdown_connections 2024-09-17T06:04:07.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.808+0000 7fef444f5640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef3c14e260 0x7fef3c1f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:07.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.808+0000 7fef444f5640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fef20073200 0x7fef20075710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:07.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.808+0000 7fef444f5640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef3c0c7340 0x7fef3c0ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:07.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.808+0000 7fef444f5640 1 --2- 172.21.15.122:0/1881963274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef3c0c69a0 0x7fef3c152ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:07.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.808+0000 7fef444f5640 1 -- 172.21.15.122:0/1881963274 >> 172.21.15.122:0/1881963274 conn(0x7fef3c074b30 msgr2=0x7fef3c148700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:07.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.808+0000 7fef444f5640 1 -- 172.21.15.122:0/1881963274 shutdown_connections 2024-09-17T06:04:07.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:07.808+0000 7fef444f5640 1 -- 172.21.15.122:0/1881963274 wait complete. 2024-09-17T06:04:07.852 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T06:04:08.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.008+0000 7f11d8fe0640 1 -- 172.21.15.122:0/2547438119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11d40c6780 msgr2=0x7f11d4153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:08.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.008+0000 7f11d8fe0640 1 --2- 172.21.15.122:0/2547438119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11d40c6780 0x7f11d4153100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009840 tx=0x7f11c401f010 comp rx=0 tx=0).stop 2024-09-17T06:04:08.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.008+0000 7f11d8fe0640 1 -- 172.21.15.122:0/2547438119 shutdown_connections 2024-09-17T06:04:08.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.008+0000 7f11d8fe0640 1 --2- 172.21.15.122:0/2547438119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11d40c6780 0x7f11d4153100 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:08.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.008+0000 7f11d8fe0640 1 -- 172.21.15.122:0/2547438119 >> 172.21.15.122:0/2547438119 conn(0x7f11d40746d0 msgr2=0x7f11d4074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:08.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.008+0000 7f11d8fe0640 1 -- 172.21.15.122:0/2547438119 shutdown_connections 2024-09-17T06:04:08.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.008+0000 7f11d8fe0640 1 -- 172.21.15.122:0/2547438119 wait complete. 2024-09-17T06:04:08.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d8fe0640 1 Processor -- start 2024-09-17T06:04:08.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d8fe0640 1 -- start start 2024-09-17T06:04:08.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d8fe0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11d40c6780 0x7f11d4154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:08.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d8fe0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11d4159b30 0x7f11d41e38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:08.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d8fe0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11d415aa30 0x7f11d41e3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:08.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d8fe0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f11d415d470 con 0x7f11d4159b30 2024-09-17T06:04:08.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d8fe0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11d415c6a0 con 0x7f11d415aa30 2024-09-17T06:04:08.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d8fe0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f11d4159f40 con 0x7f11d40c6780 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d1d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11d4159b30 0x7f11d41e38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d1d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11d4159b30 0x7f11d41e38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59650/0 (socket says 172.21.15.122:59650) 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d1d9b640 1 -- 172.21.15.122:0/1458874694 learned_addr learned my addr 172.21.15.122:0/1458874694 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d2d9d640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11d415aa30 0x7f11d41e3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d259c640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11d40c6780 0x7f11d4154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d1d9b640 1 -- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11d40c6780 msgr2=0x7f11d4154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d1d9b640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11d40c6780 0x7f11d4154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d1d9b640 1 -- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11d415aa30 msgr2=0x7f11d41e3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d1d9b640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11d415aa30 0x7f11d41e3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d1d9b640 1 -- 172.21.15.122:0/1458874694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d4155080 con 0x7f11d4159b30 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d259c640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11d40c6780 0x7f11d4154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d1d9b640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11d4159b30 0x7f11d41e38f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00c450 tx=0x7f11bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:08.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11caffd640 1 -- 172.21.15.122:0/1458874694 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0052d0 con 0x7f11d4159b30 2024-09-17T06:04:08.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11caffd640 1 -- 172.21.15.122:0/1458874694 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11bc005470 con 0x7f11d4159b30 2024-09-17T06:04:08.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d8fe0640 1 -- 172.21.15.122:0/1458874694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d41f01d0 con 0x7f11d4159b30 2024-09-17T06:04:08.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11caffd640 1 -- 172.21.15.122:0/1458874694 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc012870 con 0x7f11d4159b30 2024-09-17T06:04:08.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d8fe0640 1 -- 172.21.15.122:0/1458874694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d4154130 con 0x7f11d4159b30 2024-09-17T06:04:08.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.012+0000 7f11d8fe0640 1 -- 172.21.15.122:0/1458874694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d4153c60 con 0x7f11d4159b30 2024-09-17T06:04:08.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.016+0000 7f11caffd640 1 -- 172.21.15.122:0/1458874694 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f11bc003600 con 0x7f11d4159b30 2024-09-17T06:04:08.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.016+0000 7f11caffd640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f11b4073200 0x7f11b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:08.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.016+0000 7f11caffd640 1 -- 172.21.15.122:0/1458874694 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f11bc094630 con 0x7f11d4159b30 2024-09-17T06:04:08.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.016+0000 7f11d259c640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f11b4073200 0x7f11b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:08.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.016+0000 7f11d259c640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f11b4073200 0x7f11b4075710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11c40b2000 tx=0x7f11c401d850 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:08.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.020+0000 7f11caffd640 1 -- 172.21.15.122:0/1458874694 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f11bc05f8b0 con 0x7f11d4159b30 2024-09-17T06:04:08.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.228+0000 7f11d8fe0640 1 -- 172.21.15.122:0/1458874694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f11d40b8cf0 con 0x7f11d4159b30 2024-09-17T06:04:08.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.808+0000 7f11caffd640 1 -- 172.21.15.122:0/1458874694 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f11bc064e20 con 0x7f11d4159b30 2024-09-17T06:04:08.808 INFO:teuthology.orchestra.run.smithi122.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T06:04:08.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.812+0000 7f11d8fe0640 1 -- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f11b4073200 msgr2=0x7f11b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:08.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.812+0000 7f11d8fe0640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f11b4073200 0x7f11b4075710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11c40b2000 tx=0x7f11c401d850 comp rx=0 tx=0).stop 2024-09-17T06:04:08.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.812+0000 7f11d8fe0640 1 -- 172.21.15.122:0/1458874694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11d4159b30 msgr2=0x7f11d41e38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:08.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.812+0000 7f11d8fe0640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11d4159b30 0x7f11d41e38f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00c450 tx=0x7f11bc00c910 comp rx=0 tx=0).stop 2024-09-17T06:04:08.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.812+0000 7f11d8fe0640 1 -- 172.21.15.122:0/1458874694 shutdown_connections 2024-09-17T06:04:08.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.812+0000 7f11d8fe0640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f11b4073200 0x7f11b4075710 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:08.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.812+0000 7f11d8fe0640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11d415aa30 0x7f11d41e3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:08.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.812+0000 7f11d8fe0640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11d4159b30 0x7f11d41e38f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:08.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.812+0000 7f11d8fe0640 1 --2- 172.21.15.122:0/1458874694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11d40c6780 0x7f11d4154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:08.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.812+0000 7f11d8fe0640 1 -- 172.21.15.122:0/1458874694 >> 172.21.15.122:0/1458874694 conn(0x7f11d40746d0 msgr2=0x7f11d41490c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:08.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.812+0000 7f11d8fe0640 1 -- 172.21.15.122:0/1458874694 shutdown_connections 2024-09-17T06:04:08.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:08.812+0000 7f11d8fe0640 1 -- 172.21.15.122:0/1458874694 wait complete. 2024-09-17T06:04:08.851 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-17T06:04:08.852 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-17T06:04:09.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.008+0000 7f7893e6a640 1 -- 172.21.15.122:0/228408601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f788c0c8560 msgr2=0x7f788c151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:09.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.008+0000 7f7893e6a640 1 --2- 172.21.15.122:0/228408601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f788c0c8560 0x7f788c151980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f788c0c7f00 tx=0x7f788801c870 comp rx=0 tx=0).stop 2024-09-17T06:04:09.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.008+0000 7f7893e6a640 1 -- 172.21.15.122:0/228408601 shutdown_connections 2024-09-17T06:04:09.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.008+0000 7f7893e6a640 1 --2- 172.21.15.122:0/228408601 >> v2:172.21.15.173:3300/0 conn(0x7f788c157a10 0x7f788c157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:09.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.008+0000 7f7893e6a640 1 --2- 172.21.15.122:0/228408601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f788c0c8560 0x7f788c151980 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:09.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.008+0000 7f7893e6a640 1 -- 172.21.15.122:0/228408601 >> 172.21.15.122:0/228408601 conn(0x7f788c0746d0 msgr2=0x7f788c074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:09.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.008+0000 7f7893e6a640 1 -- 172.21.15.122:0/228408601 shutdown_connections 2024-09-17T06:04:09.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.008+0000 7f7893e6a640 1 -- 172.21.15.122:0/228408601 wait complete. 2024-09-17T06:04:09.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7893e6a640 1 Processor -- start 2024-09-17T06:04:09.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7893e6a640 1 -- start start 2024-09-17T06:04:09.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7893e6a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f788c0c3bb0 0x7f788c1461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:09.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7893e6a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f788c0c8560 0x7f788c150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:09.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7893e6a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f788c157a10 0x7f788c141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:09.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7893e6a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f788c15b7a0 con 0x7f788c0c8560 2024-09-17T06:04:09.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7893e6a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f788c0ccd50 con 0x7f788c157a10 2024-09-17T06:04:09.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7893e6a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f788c14d750 con 0x7f788c0c3bb0 2024-09-17T06:04:09.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7891405640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f788c0c8560 0x7f788c150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:09.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7891405640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f788c0c8560 0x7f788c150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59672/0 (socket says 172.21.15.122:59672) 2024-09-17T06:04:09.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7891405640 1 -- 172.21.15.122:0/1659350264 learned_addr learned my addr 172.21.15.122:0/1659350264 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:09.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7892407640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f788c157a10 0x7f788c141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:09.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7891405640 1 -- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f788c0c3bb0 msgr2=0x7f788c1461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:09.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7891405640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f788c0c3bb0 0x7f788c1461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:09.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7891405640 1 -- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f788c157a10 msgr2=0x7f788c141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:09.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7891405640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f788c157a10 0x7f788c141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:09.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7891405640 1 -- 172.21.15.122:0/1659350264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788c147ca0 con 0x7f788c0c8560 2024-09-17T06:04:09.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7891405640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f788c0c8560 0x7f788c150590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f787c00b440 tx=0x7f787c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:09.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f78827fc640 1 -- 172.21.15.122:0/1659350264 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c015020 con 0x7f788c0c8560 2024-09-17T06:04:09.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f78827fc640 1 -- 172.21.15.122:0/1659350264 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f787c011980 con 0x7f788c0c8560 2024-09-17T06:04:09.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7893e6a640 1 -- 172.21.15.122:0/1659350264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788c1f63c0 con 0x7f788c0c8560 2024-09-17T06:04:09.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f78827fc640 1 -- 172.21.15.122:0/1659350264 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c011dd0 con 0x7f788c0c8560 2024-09-17T06:04:09.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.012+0000 7f7893e6a640 1 -- 172.21.15.122:0/1659350264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f788c1520c0 con 0x7f788c0c8560 2024-09-17T06:04:09.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.016+0000 7f7893e6a640 1 -- 172.21.15.122:0/1659350264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f788c0c6910 con 0x7f788c0c8560 2024-09-17T06:04:09.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.016+0000 7f78827fc640 1 -- 172.21.15.122:0/1659350264 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f787c018020 con 0x7f788c0c8560 2024-09-17T06:04:09.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.016+0000 7f78827fc640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7870073200 0x7f7870075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:09.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.016+0000 7f78827fc640 1 -- 172.21.15.122:0/1659350264 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f787c0940d0 con 0x7f788c0c8560 2024-09-17T06:04:09.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.016+0000 7f7891c06640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7870073200 0x7f7870075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:09.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.016+0000 7f7891c06640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7870073200 0x7f7870075710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f78880af000 tx=0x7f7888019610 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:09.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.020+0000 7f78827fc640 1 -- 172.21.15.122:0/1659350264 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f787c01f030 con 0x7f788c0c8560 2024-09-17T06:04:09.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.200+0000 7f7893e6a640 1 -- 172.21.15.122:0/1659350264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f788c155210 con 0x7f788c0c8560 2024-09-17T06:04:09.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.808+0000 7f78827fc640 1 -- 172.21.15.122:0/1659350264 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7f787c00d040 con 0x7f788c0c8560 2024-09-17T06:04:09.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.816+0000 7f7893e6a640 1 -- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7870073200 msgr2=0x7f7870075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:09.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.816+0000 7f7893e6a640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7870073200 0x7f7870075710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f78880af000 tx=0x7f7888019610 comp rx=0 tx=0).stop 2024-09-17T06:04:09.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.816+0000 7f7893e6a640 1 -- 172.21.15.122:0/1659350264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f788c0c8560 msgr2=0x7f788c150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:09.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.816+0000 7f7893e6a640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f788c0c8560 0x7f788c150590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f787c00b440 tx=0x7f787c00b900 comp rx=0 tx=0).stop 2024-09-17T06:04:09.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.816+0000 7f7893e6a640 1 -- 172.21.15.122:0/1659350264 shutdown_connections 2024-09-17T06:04:09.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.816+0000 7f7893e6a640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7870073200 0x7f7870075710 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:09.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.816+0000 7f7893e6a640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f788c157a10 0x7f788c141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:09.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.816+0000 7f7893e6a640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f788c0c8560 0x7f788c150590 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:09.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.816+0000 7f7893e6a640 1 --2- 172.21.15.122:0/1659350264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f788c0c3bb0 0x7f788c1461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:09.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.816+0000 7f7893e6a640 1 -- 172.21.15.122:0/1659350264 >> 172.21.15.122:0/1659350264 conn(0x7f788c0746d0 msgr2=0x7f788c148360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:09.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.816+0000 7f7893e6a640 1 -- 172.21.15.122:0/1659350264 shutdown_connections 2024-09-17T06:04:09.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:09.816+0000 7f7893e6a640 1 -- 172.21.15.122:0/1659350264 wait complete. 2024-09-17T06:04:09.837 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T06:04:10.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.008+0000 7f6770831640 1 -- 172.21.15.122:0/4097062831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f676c0c2800 msgr2=0x7f676c15b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:10.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.008+0000 7f6770831640 1 --2- 172.21.15.122:0/4097062831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f676c0c2800 0x7f676c15b5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f676c0b3cf0 tx=0x7f676401f370 comp rx=0 tx=0).stop 2024-09-17T06:04:10.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.008+0000 7f6770831640 1 -- 172.21.15.122:0/4097062831 shutdown_connections 2024-09-17T06:04:10.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.008+0000 7f6770831640 1 --2- 172.21.15.122:0/4097062831 >> v2:172.21.15.173:3300/0 conn(0x7f676c15bef0 0x7f676c158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:10.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.008+0000 7f6770831640 1 --2- 172.21.15.122:0/4097062831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f676c0c2800 0x7f676c15b5a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:10.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.008+0000 7f6770831640 1 -- 172.21.15.122:0/4097062831 >> 172.21.15.122:0/4097062831 conn(0x7f676c073540 msgr2=0x7f676c0ca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:10.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.008+0000 7f6770831640 1 -- 172.21.15.122:0/4097062831 shutdown_connections 2024-09-17T06:04:10.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.008+0000 7f6770831640 1 -- 172.21.15.122:0/4097062831 wait complete. 2024-09-17T06:04:10.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f6770831640 1 Processor -- start 2024-09-17T06:04:10.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f6770831640 1 -- start start 2024-09-17T06:04:10.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f6770831640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f676c0c2800 0x7f676c1f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:10.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f6770831640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f676c15bae0 0x7f676c150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:10.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f6770831640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f676c15bef0 0x7f676c142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:10.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f6770831640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f676c15c300 con 0x7f676c0c2800 2024-09-17T06:04:10.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f6770831640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f676c0b13b0 con 0x7f676c15bae0 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f6770831640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f676c0c9ec0 con 0x7f676c15bef0 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f676a59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f676c0c2800 0x7f676c1f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f676a59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f676c0c2800 0x7f676c1f2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59692/0 (socket says 172.21.15.122:59692) 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f676a59c640 1 -- 172.21.15.122:0/3110906402 learned_addr learned my addr 172.21.15.122:0/3110906402 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f6769d9b640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f676c15bae0 0x7f676c150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f676ad9d640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f676c15bef0 0x7f676c142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f676a59c640 1 -- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f676c15bef0 msgr2=0x7f676c142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f676a59c640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f676c15bef0 0x7f676c142480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f676a59c640 1 -- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f676c15bae0 msgr2=0x7f676c150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f676a59c640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f676c15bae0 0x7f676c150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f676a59c640 1 -- 172.21.15.122:0/3110906402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676c1f3310 con 0x7f676c0c2800 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f6769d9b640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f676c15bae0 0x7f676c150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:10.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f676ad9d640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f676c15bef0 0x7f676c142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:10.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f676a59c640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f676c0c2800 0x7f676c1f2dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6764000f90 tx=0x7f6764003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:10.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f675affd640 1 -- 172.21.15.122:0/3110906402 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67640b4040 con 0x7f676c0c2800 2024-09-17T06:04:10.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f675affd640 1 -- 172.21.15.122:0/3110906402 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67640bf070 con 0x7f676c0c2800 2024-09-17T06:04:10.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f675affd640 1 -- 172.21.15.122:0/3110906402 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67640b09b0 con 0x7f676c0c2800 2024-09-17T06:04:10.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f6770831640 1 -- 172.21.15.122:0/3110906402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676c14b600 con 0x7f676c0c2800 2024-09-17T06:04:10.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.012+0000 7f6770831640 1 -- 172.21.15.122:0/3110906402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676c14bb80 con 0x7f676c0c2800 2024-09-17T06:04:10.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.016+0000 7f6770831640 1 -- 172.21.15.122:0/3110906402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f676c152370 con 0x7f676c0c2800 2024-09-17T06:04:10.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.016+0000 7f675affd640 1 -- 172.21.15.122:0/3110906402 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f67640b0b50 con 0x7f676c0c2800 2024-09-17T06:04:10.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.016+0000 7f675affd640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f674c073200 0x7f674c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:10.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.016+0000 7f675affd640 1 -- 172.21.15.122:0/3110906402 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7f6764132750 con 0x7f676c0c2800 2024-09-17T06:04:10.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.016+0000 7f6769d9b640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f674c073200 0x7f674c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:10.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.016+0000 7f6769d9b640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f674c073200 0x7f674c075710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f676c14b330 tx=0x7f6760009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:10.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.020+0000 7f675affd640 1 -- 172.21.15.122:0/3110906402 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6764018ed0 con 0x7f676c0c2800 2024-09-17T06:04:10.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:10.192+0000 7f6770831640 1 -- 172.21.15.122:0/3110906402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f676c0c9a90 con 0x7f676c0c2800 2024-09-17T06:04:11.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.892+0000 7f675affd640 1 -- 172.21.15.122:0/3110906402 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7f67640fd6d0 con 0x7f676c0c2800 2024-09-17T06:04:11.895 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_data_ec' created 2024-09-17T06:04:11.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.900+0000 7f6770831640 1 -- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f674c073200 msgr2=0x7f674c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:11.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.900+0000 7f6770831640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f674c073200 0x7f674c075710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f676c14b330 tx=0x7f6760009040 comp rx=0 tx=0).stop 2024-09-17T06:04:11.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.900+0000 7f6770831640 1 -- 172.21.15.122:0/3110906402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f676c0c2800 msgr2=0x7f676c1f2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:11.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.900+0000 7f6770831640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f676c0c2800 0x7f676c1f2dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6764000f90 tx=0x7f6764003f60 comp rx=0 tx=0).stop 2024-09-17T06:04:11.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.900+0000 7f6770831640 1 -- 172.21.15.122:0/3110906402 shutdown_connections 2024-09-17T06:04:11.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.900+0000 7f6770831640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f676c15bef0 0x7f676c142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:11.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.900+0000 7f6770831640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f674c073200 0x7f674c075710 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:11.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.900+0000 7f6770831640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f676c15bae0 0x7f676c150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:11.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.900+0000 7f6770831640 1 --2- 172.21.15.122:0/3110906402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f676c0c2800 0x7f676c1f2dd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:11.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.900+0000 7f6770831640 1 -- 172.21.15.122:0/3110906402 >> 172.21.15.122:0/3110906402 conn(0x7f676c073540 msgr2=0x7f676c06dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:11.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.900+0000 7f6770831640 1 -- 172.21.15.122:0/3110906402 shutdown_connections 2024-09-17T06:04:11.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:11.900+0000 7f6770831640 1 -- 172.21.15.122:0/3110906402 wait complete. 2024-09-17T06:04:11.930 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-17T06:04:12.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.088+0000 7f42baace640 1 -- 172.21.15.122:0/1169045050 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42b4157a10 msgr2=0x7f42b4157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:12.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.088+0000 7f42baace640 1 --2- 172.21.15.122:0/1169045050 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42b4157a10 0x7f42b4157e20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00aa10 tx=0x7f42ac01dc00 comp rx=0 tx=0).stop 2024-09-17T06:04:12.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.088+0000 7f42baace640 1 -- 172.21.15.122:0/1169045050 shutdown_connections 2024-09-17T06:04:12.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.088+0000 7f42baace640 1 --2- 172.21.15.122:0/1169045050 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42b4157a10 0x7f42b4157e20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:12.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.088+0000 7f42baace640 1 --2- 172.21.15.122:0/1169045050 >> v2:172.21.15.173:3300/0 conn(0x7f42b40c8560 0x7f42b4151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:12.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.088+0000 7f42baace640 1 -- 172.21.15.122:0/1169045050 >> 172.21.15.122:0/1169045050 conn(0x7f42b40746d0 msgr2=0x7f42b4074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:12.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.088+0000 7f42baace640 1 -- 172.21.15.122:0/1169045050 shutdown_connections 2024-09-17T06:04:12.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.088+0000 7f42baace640 1 -- 172.21.15.122:0/1169045050 wait complete. 2024-09-17T06:04:12.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42baace640 1 Processor -- start 2024-09-17T06:04:12.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42baace640 1 -- start start 2024-09-17T06:04:12.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42baace640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42b40c3bb0 0x7f42b41f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:12.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42baace640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42b40c8560 0x7f42b415d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:12.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42baace640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42b4157a10 0x7f42b4160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:12.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42baace640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f42b415b7a0 con 0x7f42b4157a10 2024-09-17T06:04:12.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42baace640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f42b40ccd50 con 0x7f42b40c8560 2024-09-17T06:04:12.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42baace640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f42b41f69f0 con 0x7f42b40c3bb0 2024-09-17T06:04:12.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b906b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42b4157a10 0x7f42b4160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:12.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b906b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42b4157a10 0x7f42b4160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59698/0 (socket says 172.21.15.122:59698) 2024-09-17T06:04:12.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b906b640 1 -- 172.21.15.122:0/235590783 learned_addr learned my addr 172.21.15.122:0/235590783 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b3fff640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42b40c8560 0x7f42b415d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b886a640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42b40c3bb0 0x7f42b41f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b906b640 1 -- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42b40c3bb0 msgr2=0x7f42b41f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b906b640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42b40c3bb0 0x7f42b41f2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b906b640 1 -- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42b40c8560 msgr2=0x7f42b415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b906b640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42b40c8560 0x7f42b415d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b906b640 1 -- 172.21.15.122:0/235590783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b41f3170 con 0x7f42b4157a10 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b3fff640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42b40c8560 0x7f42b415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b906b640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42b4157a10 0x7f42b4160eb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0b1040 tx=0x7f42ac005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b17fa640 1 -- 172.21.15.122:0/235590783 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0bc070 con 0x7f42b4157a10 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b17fa640 1 -- 172.21.15.122:0/235590783 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42ac003b00 con 0x7f42b4157a10 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42baace640 1 -- 172.21.15.122:0/235590783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b41f2450 con 0x7f42b4157a10 2024-09-17T06:04:12.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42b17fa640 1 -- 172.21.15.122:0/235590783 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0b3070 con 0x7f42b4157a10 2024-09-17T06:04:12.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42baace640 1 -- 172.21.15.122:0/235590783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b415daa0 con 0x7f42b4157a10 2024-09-17T06:04:12.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.092+0000 7f42baace640 1 -- 172.21.15.122:0/235590783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b40c6910 con 0x7f42b4157a10 2024-09-17T06:04:12.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.096+0000 7f42b17fa640 1 -- 172.21.15.122:0/235590783 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f42ac0ae440 con 0x7f42b4157a10 2024-09-17T06:04:12.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.096+0000 7f42b17fa640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4294073200 0x7f4294075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:12.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.096+0000 7f42b17fa640 1 -- 172.21.15.122:0/235590783 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f42ac12ec20 con 0x7f42b4157a10 2024-09-17T06:04:12.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.096+0000 7f42b886a640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4294073200 0x7f4294075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:12.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.096+0000 7f42b886a640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4294073200 0x7f4294075710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009eb0 tx=0x7f42a4009500 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:12.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.100+0000 7f42b17fa640 1 -- 172.21.15.122:0/235590783 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f42ac0c5020 con 0x7f42b4157a10 2024-09-17T06:04:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.268+0000 7f42baace640 1 -- 172.21.15.122:0/235590783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f42b4155210 con 0x7f42b4157a10 2024-09-17T06:04:12.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.904+0000 7f42b17fa640 1 -- 172.21.15.122:0/235590783 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7f42ac017820 con 0x7f42b4157a10 2024-09-17T06:04:12.905 INFO:teuthology.orchestra.run.smithi122.stderr:set pool 4 allow_ec_overwrites to true 2024-09-17T06:04:12.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.908+0000 7f42baace640 1 -- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4294073200 msgr2=0x7f4294075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:12.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.908+0000 7f42baace640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4294073200 0x7f4294075710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009eb0 tx=0x7f42a4009500 comp rx=0 tx=0).stop 2024-09-17T06:04:12.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.908+0000 7f42baace640 1 -- 172.21.15.122:0/235590783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42b4157a10 msgr2=0x7f42b4160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:12.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.908+0000 7f42baace640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42b4157a10 0x7f42b4160eb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0b1040 tx=0x7f42ac005d60 comp rx=0 tx=0).stop 2024-09-17T06:04:12.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.908+0000 7f42baace640 1 -- 172.21.15.122:0/235590783 shutdown_connections 2024-09-17T06:04:12.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.908+0000 7f42baace640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42b4157a10 0x7f42b4160eb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:12.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.908+0000 7f42baace640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4294073200 0x7f4294075710 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:12.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.908+0000 7f42baace640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42b40c8560 0x7f42b415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:12.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.908+0000 7f42baace640 1 --2- 172.21.15.122:0/235590783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f42b40c3bb0 0x7f42b41f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:12.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.908+0000 7f42baace640 1 -- 172.21.15.122:0/235590783 >> 172.21.15.122:0/235590783 conn(0x7f42b40746d0 msgr2=0x7f42b414fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:12.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.908+0000 7f42baace640 1 -- 172.21.15.122:0/235590783 shutdown_connections 2024-09-17T06:04:12.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:12.908+0000 7f42baace640 1 -- 172.21.15.122:0/235590783 wait complete. 2024-09-17T06:04:12.948 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-17T06:04:13.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.108+0000 7fceab8f1640 1 -- 172.21.15.122:0/1568112795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea40c89d0 msgr2=0x7fcea40c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:13.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.108+0000 7fceab8f1640 1 --2- 172.21.15.122:0/1568112795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea40c89d0 0x7fcea40c8de0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcea4074290 tx=0x7fce9c01f560 comp rx=0 tx=0).stop 2024-09-17T06:04:13.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.108+0000 7fceab8f1640 1 -- 172.21.15.122:0/1568112795 shutdown_connections 2024-09-17T06:04:13.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.108+0000 7fceab8f1640 1 --2- 172.21.15.122:0/1568112795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea40c89d0 0x7fcea40c8de0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:13.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.108+0000 7fceab8f1640 1 --2- 172.21.15.122:0/1568112795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcea414eb30 0x7fcea40c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:13.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.108+0000 7fceab8f1640 1 --2- 172.21.15.122:0/1568112795 >> v2:172.21.15.173:3300/0 conn(0x7fcea406fe00 0x7fcea4158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:13.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.108+0000 7fceab8f1640 1 -- 172.21.15.122:0/1568112795 >> 172.21.15.122:0/1568112795 conn(0x7fcea40ca380 msgr2=0x7fcea40ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:13.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.108+0000 7fceab8f1640 1 -- 172.21.15.122:0/1568112795 shutdown_connections 2024-09-17T06:04:13.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.108+0000 7fceab8f1640 1 -- 172.21.15.122:0/1568112795 wait complete. 2024-09-17T06:04:13.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.108+0000 7fceab8f1640 1 Processor -- start 2024-09-17T06:04:13.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fceab8f1640 1 -- start start 2024-09-17T06:04:13.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fceab8f1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406fe00 0x7fcea414ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:13.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fceab8f1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40c89d0 0x7fcea41f1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:13.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fceab8f1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcea414eb30 0x7fcea41f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:13.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fceab8f1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcea406f320 con 0x7fcea406fe00 2024-09-17T06:04:13.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fceab8f1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcea406f040 con 0x7fcea40c89d0 2024-09-17T06:04:13.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fceab8f1640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fcea406f600 con 0x7fcea414eb30 2024-09-17T06:04:13.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fcea968d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406fe00 0x7fcea414ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:13.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fcea968d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406fe00 0x7fcea414ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59724/0 (socket says 172.21.15.122:59724) 2024-09-17T06:04:13.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fcea968d640 1 -- 172.21.15.122:0/1940640579 learned_addr learned my addr 172.21.15.122:0/1940640579 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:13.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fcea8e8c640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40c89d0 0x7fcea41f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:13.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fcea9e8e640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcea414eb30 0x7fcea41f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:13.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fcea968d640 1 -- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcea414eb30 msgr2=0x7fcea41f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:13.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fcea968d640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcea414eb30 0x7fcea41f1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:13.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fcea968d640 1 -- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40c89d0 msgr2=0x7fcea41f1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:13.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fcea968d640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40c89d0 0x7fcea41f1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:13.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fcea968d640 1 -- 172.21.15.122:0/1940640579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea41f1fa0 con 0x7fcea406fe00 2024-09-17T06:04:13.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fcea968d640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406fe00 0x7fcea414ff00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcea000d950 tx=0x7fcea000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:13.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fce99ffb640 1 -- 172.21.15.122:0/1940640579 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0017070 con 0x7fcea406fe00 2024-09-17T06:04:13.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fce99ffb640 1 -- 172.21.15.122:0/1940640579 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcea0009d20 con 0x7fcea406fe00 2024-09-17T06:04:13.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fceab8f1640 1 -- 172.21.15.122:0/1940640579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea414a6e0 con 0x7fcea406fe00 2024-09-17T06:04:13.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fce99ffb640 1 -- 172.21.15.122:0/1940640579 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea00106c0 con 0x7fcea406fe00 2024-09-17T06:04:13.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fceab8f1640 1 -- 172.21.15.122:0/1940640579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea4149c00 con 0x7fcea406fe00 2024-09-17T06:04:13.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fceab8f1640 1 -- 172.21.15.122:0/1940640579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea406f8e0 con 0x7fcea406fe00 2024-09-17T06:04:13.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.112+0000 7fce99ffb640 1 -- 172.21.15.122:0/1940640579 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcea001a070 con 0x7fcea406fe00 2024-09-17T06:04:13.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.116+0000 7fce99ffb640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fce88073230 0x7fce88075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:13.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.116+0000 7fce99ffb640 1 -- 172.21.15.122:0/1940640579 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fcea0094740 con 0x7fcea406fe00 2024-09-17T06:04:13.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.116+0000 7fcea8e8c640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fce88073230 0x7fce88075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:13.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.116+0000 7fcea8e8c640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fce88073230 0x7fce88075740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce94005d90 tx=0x7fce94005d00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:13.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.120+0000 7fce99ffb640 1 -- 172.21.15.122:0/1940640579 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fcea005f440 con 0x7fcea406fe00 2024-09-17T06:04:13.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.328+0000 7fceab8f1640 1 -- 172.21.15.122:0/1940640579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fcea414ab40 con 0x7fcea406fe00 2024-09-17T06:04:13.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.920+0000 7fce99ffb640 1 -- 172.21.15.122:0/1940640579 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7fcea005ed40 con 0x7fcea406fe00 2024-09-17T06:04:13.920 INFO:teuthology.orchestra.run.smithi122.stderr:added data pool 4 to fsmap 2024-09-17T06:04:13.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.920+0000 7fceab8f1640 1 -- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fce88073230 msgr2=0x7fce88075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:13.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.920+0000 7fceab8f1640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fce88073230 0x7fce88075740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce94005d90 tx=0x7fce94005d00 comp rx=0 tx=0).stop 2024-09-17T06:04:13.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.920+0000 7fceab8f1640 1 -- 172.21.15.122:0/1940640579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406fe00 msgr2=0x7fcea414ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:13.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.920+0000 7fceab8f1640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406fe00 0x7fcea414ff00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcea000d950 tx=0x7fcea000de10 comp rx=0 tx=0).stop 2024-09-17T06:04:13.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.920+0000 7fceab8f1640 1 -- 172.21.15.122:0/1940640579 shutdown_connections 2024-09-17T06:04:13.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.920+0000 7fceab8f1640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcea414eb30 0x7fcea41f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:13.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.920+0000 7fceab8f1640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fce88073230 0x7fce88075740 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:13.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.920+0000 7fceab8f1640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcea40c89d0 0x7fcea41f1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:13.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.924+0000 7fceab8f1640 1 --2- 172.21.15.122:0/1940640579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406fe00 0x7fcea414ff00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:13.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.924+0000 7fceab8f1640 1 -- 172.21.15.122:0/1940640579 >> 172.21.15.122:0/1940640579 conn(0x7fcea40ca380 msgr2=0x7fcea4069500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:13.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.924+0000 7fceab8f1640 1 -- 172.21.15.122:0/1940640579 shutdown_connections 2024-09-17T06:04:13.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:13.924+0000 7fceab8f1640 1 -- 172.21.15.122:0/1940640579 wait complete. 2024-09-17T06:04:13.946 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T06:04:14.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.100+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1746098135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c100052b0 msgr2=0x7f1c1000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.100+0000 7f1c2ee9f640 1 --2- 172.21.15.122:0/1746098135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c100052b0 0x7f1c1000b9d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009b30 tx=0x7f1c1801d270 comp rx=0 tx=0).stop 2024-09-17T06:04:14.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.100+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1746098135 shutdown_connections 2024-09-17T06:04:14.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.100+0000 7f1c2ee9f640 1 --2- 172.21.15.122:0/1746098135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c100052b0 0x7f1c1000b9d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.100+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1746098135 >> 172.21.15.122:0/1746098135 conn(0x7f1c280736d0 msgr2=0x7f1c280cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:14.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.100+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1746098135 shutdown_connections 2024-09-17T06:04:14.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.100+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1746098135 wait complete. 2024-09-17T06:04:14.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c2ee9f640 1 Processor -- start 2024-09-17T06:04:14.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c2ee9f640 1 -- start start 2024-09-17T06:04:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c2ee9f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c100052b0 0x7f1c281f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c2ee9f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c28157220 0x7f1c2814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c2ee9f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c28157630 0x7f1c2814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c2ee9f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1c280b2a70 con 0x7f1c28157220 2024-09-17T06:04:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c2ee9f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1c280b2d70 con 0x7f1c100052b0 2024-09-17T06:04:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c2ee9f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1c280c82f0 con 0x7f1c28157630 2024-09-17T06:04:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c27fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c28157220 0x7f1c2814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c27fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c28157220 0x7f1c2814c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59740/0 (socket says 172.21.15.122:59740) 2024-09-17T06:04:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c27fff640 1 -- 172.21.15.122:0/1222268408 learned_addr learned my addr 172.21.15.122:0/1222268408 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c2cc3b640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c100052b0 0x7f1c281f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c2d43c640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c28157630 0x7f1c2814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c27fff640 1 -- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c28157630 msgr2=0x7f1c2814cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c27fff640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c28157630 0x7f1c2814cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c27fff640 1 -- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c100052b0 msgr2=0x7f1c281f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c27fff640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c100052b0 0x7f1c281f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c27fff640 1 -- 172.21.15.122:0/1222268408 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c281f32e0 con 0x7f1c28157220 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c27fff640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c28157220 0x7f1c2814c6b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00d7b0 tx=0x7f1c1c00dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c257fa640 1 -- 172.21.15.122:0/1222268408 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c016020 con 0x7f1c28157220 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c257fa640 1 -- 172.21.15.122:0/1222268408 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c1c00b6c0 con 0x7f1c28157220 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1222268408 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c280c7820 con 0x7f1c28157220 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c257fa640 1 -- 172.21.15.122:0/1222268408 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c00baf0 con 0x7f1c28157220 2024-09-17T06:04:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.104+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1222268408 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c281f0120 con 0x7f1c28157220 2024-09-17T06:04:14.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.108+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1222268408 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c281554b0 con 0x7f1c28157220 2024-09-17T06:04:14.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.108+0000 7f1c257fa640 1 -- 172.21.15.122:0/1222268408 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1c1c019020 con 0x7f1c28157220 2024-09-17T06:04:14.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.108+0000 7f1c257fa640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1c14073200 0x7f1c14075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:14.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.108+0000 7f1c257fa640 1 -- 172.21.15.122:0/1222268408 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1c1c094480 con 0x7f1c28157220 2024-09-17T06:04:14.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.108+0000 7f1c2cc3b640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1c14073200 0x7f1c14075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:14.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.108+0000 7f1c2cc3b640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1c14073200 0x7f1c14075710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1c200015b0 tx=0x7f1c20009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:14.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.112+0000 7f1c257fa640 1 -- 172.21.15.122:0/1222268408 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1c1c020020 con 0x7f1c28157220 2024-09-17T06:04:14.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.316+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1222268408 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c2806fc40 con 0x7f1c28157220 2024-09-17T06:04:14.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.316+0000 7f1c257fa640 1 -- 172.21.15.122:0/1222268408 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6885 (secure 0 0 0) 0x7f1c1c05f220 con 0x7f1c28157220 2024-09-17T06:04:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:14.318 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":6,"btime":"2024-09-17T06:04:13:927087+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1941177833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1941177833},{"type":"v1","addr":"172.21.15.173:6835","nonce":1941177833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3902874091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3902874091},{"type":"v1","addr":"172.21.15.122:6833","nonce":3902874091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2868113442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2868113442},{"type":"v1","addr":"172.21.15.122:6836","nonce":2868113442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1552928786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1552928786},{"type":"v1","addr":"172.21.15.122:6837","nonce":1552928786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4447,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2188047562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2188047562},{"type":"v1","addr":"172.21.15.173:6837","nonce":2188047562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T06:04:08.229792+0000","modified":"2024-09-17T06:04:13.907032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4450":{"gid":4450,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6839/1694851531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":1694851531},{"type":"v1","addr":"172.21.15.173:6839","nonce":1694851531}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4450,"qdb_cluster":[4450]},"id":1}]} 2024-09-17T06:04:14.319 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 6 2024-09-17T06:04:14.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.320+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1c14073200 msgr2=0x7f1c14075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.320+0000 7f1c2ee9f640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1c14073200 0x7f1c14075710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1c200015b0 tx=0x7f1c20009040 comp rx=0 tx=0).stop 2024-09-17T06:04:14.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.320+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1222268408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c28157220 msgr2=0x7f1c2814c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.320+0000 7f1c2ee9f640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c28157220 0x7f1c2814c6b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00d7b0 tx=0x7f1c1c00dc70 comp rx=0 tx=0).stop 2024-09-17T06:04:14.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.320+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1222268408 shutdown_connections 2024-09-17T06:04:14.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.320+0000 7f1c2ee9f640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c28157630 0x7f1c2814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.320+0000 7f1c2ee9f640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c28157220 0x7f1c2814c6b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.320+0000 7f1c2ee9f640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1c14073200 0x7f1c14075710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.320+0000 7f1c2ee9f640 1 --2- 172.21.15.122:0/1222268408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c100052b0 0x7f1c281f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.320+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1222268408 >> 172.21.15.122:0/1222268408 conn(0x7f1c280736d0 msgr2=0x7f1c2814fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:14.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.320+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1222268408 shutdown_connections 2024-09-17T06:04:14.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.320+0000 7f1c2ee9f640 1 -- 172.21.15.122:0/1222268408 wait complete. 2024-09-17T06:04:14.340 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:04:14.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.496+0000 7efda33ab640 1 -- 172.21.15.122:0/4089366477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd9c14eae0 msgr2=0x7efd9c15bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.496+0000 7efda33ab640 1 --2- 172.21.15.122:0/4089366477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd9c14eae0 0x7efd9c15bd50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efd94009c80 tx=0x7efd9401cda0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.496+0000 7efda33ab640 1 -- 172.21.15.122:0/4089366477 shutdown_connections 2024-09-17T06:04:14.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.496+0000 7efda33ab640 1 --2- 172.21.15.122:0/4089366477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd9c14eae0 0x7efd9c15bd50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.496+0000 7efda33ab640 1 --2- 172.21.15.122:0/4089366477 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd9c0c68d0 0x7efd9c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.496+0000 7efda33ab640 1 -- 172.21.15.122:0/4089366477 >> 172.21.15.122:0/4089366477 conn(0x7efd9c0746d0 msgr2=0x7efd9c074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:14.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.496+0000 7efda33ab640 1 -- 172.21.15.122:0/4089366477 shutdown_connections 2024-09-17T06:04:14.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.496+0000 7efda33ab640 1 -- 172.21.15.122:0/4089366477 wait complete. 2024-09-17T06:04:14.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda33ab640 1 Processor -- start 2024-09-17T06:04:14.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda33ab640 1 -- start start 2024-09-17T06:04:14.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda33ab640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd9c0c68d0 0x7efd9c1f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:14.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda33ab640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd9c0c8df0 0x7efd9c1494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda33ab640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd9c14eae0 0x7efd9c13faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda33ab640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c152540 con 0x7efd9c14eae0 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda33ab640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c0c9f70 con 0x7efd9c0c68d0 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda33ab640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7efd9c1526c0 con 0x7efd9c0c8df0 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda1948640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd9c14eae0 0x7efd9c13faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda1948640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd9c14eae0 0x7efd9c13faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59768/0 (socket says 172.21.15.122:59768) 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda1948640 1 -- 172.21.15.122:0/2843307430 learned_addr learned my addr 172.21.15.122:0/2843307430 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda1147640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd9c0c68d0 0x7efd9c1f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda0946640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd9c0c8df0 0x7efd9c1494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda1948640 1 -- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd9c0c8df0 msgr2=0x7efd9c1494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda1948640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd9c0c8df0 0x7efd9c1494c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda1948640 1 -- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd9c0c68d0 msgr2=0x7efd9c1f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda1948640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd9c0c68d0 0x7efd9c1f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda1948640 1 -- 172.21.15.122:0/2843307430 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c0c4470 con 0x7efd9c14eae0 2024-09-17T06:04:14.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda1948640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd9c14eae0 0x7efd9c13faf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efd94009bd0 tx=0x7efd940092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:14.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efd91ffb640 1 -- 172.21.15.122:0/2843307430 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940bc070 con 0x7efd9c14eae0 2024-09-17T06:04:14.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efd91ffb640 1 -- 172.21.15.122:0/2843307430 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd940ad900 con 0x7efd9c14eae0 2024-09-17T06:04:14.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efd91ffb640 1 -- 172.21.15.122:0/2843307430 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940b2040 con 0x7efd9c14eae0 2024-09-17T06:04:14.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda33ab640 1 -- 172.21.15.122:0/2843307430 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c1f55e0 con 0x7efd9c14eae0 2024-09-17T06:04:14.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda33ab640 1 -- 172.21.15.122:0/2843307430 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c0c57f0 con 0x7efd9c14eae0 2024-09-17T06:04:14.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.500+0000 7efda33ab640 1 -- 172.21.15.122:0/2843307430 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9c072ae0 con 0x7efd9c14eae0 2024-09-17T06:04:14.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.504+0000 7efd91ffb640 1 -- 172.21.15.122:0/2843307430 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efd94004000 con 0x7efd9c14eae0 2024-09-17T06:04:14.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.504+0000 7efd91ffb640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd80073200 0x7efd80075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:14.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.504+0000 7efd91ffb640 1 -- 172.21.15.122:0/2843307430 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efd9412e640 con 0x7efd9c14eae0 2024-09-17T06:04:14.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.504+0000 7efda1147640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd80073200 0x7efd80075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:14.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.504+0000 7efda1147640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd80073200 0x7efd80075710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd980016d0 tx=0x7efd98009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:14.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.508+0000 7efd91ffb640 1 -- 172.21.15.122:0/2843307430 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efd940c5080 con 0x7efd9c14eae0 2024-09-17T06:04:14.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.680+0000 7efda33ab640 1 -- 172.21.15.122:0/2843307430 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd9c14b290 con 0x7efd9c14eae0 2024-09-17T06:04:14.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efd91ffb640 1 -- 172.21.15.122:0/2843307430 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7efd94016990 con 0x7efd9c14eae0 2024-09-17T06:04:14.684 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:14.684 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":26,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:04:13.331438+0000","last_up_change":"2024-09-17T06:03:56.580331+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6811","nonce":920798795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6813","nonce":920798795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6817","nonce":920798795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6815","nonce":920798795}]},"public_addr":"172.21.15.173:6811/920798795","cluster_addr":"172.21.15.173:6813/920798795","heartbeat_back_addr":"172.21.15.173:6817/920798795","heartbeat_front_addr":"172.21.15.173:6815/920798795","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:04:14.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efda33ab640 1 -- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd80073200 msgr2=0x7efd80075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efda33ab640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd80073200 0x7efd80075710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd980016d0 tx=0x7efd98009040 comp rx=0 tx=0).stop 2024-09-17T06:04:14.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efda33ab640 1 -- 172.21.15.122:0/2843307430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd9c14eae0 msgr2=0x7efd9c13faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efda33ab640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd9c14eae0 0x7efd9c13faf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efd94009bd0 tx=0x7efd940092c0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efda33ab640 1 -- 172.21.15.122:0/2843307430 shutdown_connections 2024-09-17T06:04:14.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efda33ab640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd9c14eae0 0x7efd9c13faf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efda33ab640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd9c0c8df0 0x7efd9c1494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efda33ab640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd80073200 0x7efd80075710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efda33ab640 1 --2- 172.21.15.122:0/2843307430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd9c0c68d0 0x7efd9c1f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efda33ab640 1 -- 172.21.15.122:0/2843307430 >> 172.21.15.122:0/2843307430 conn(0x7efd9c0746d0 msgr2=0x7efd9c0c9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:14.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efda33ab640 1 -- 172.21.15.122:0/2843307430 shutdown_connections 2024-09-17T06:04:14.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.684+0000 7efda33ab640 1 -- 172.21.15.122:0/2843307430 wait complete. 2024-09-17T06:04:14.706 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:04:14.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.860+0000 7fe8c3acb640 1 -- 172.21.15.122:0/1797517388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a8003a10 msgr2=0x7fe8a8003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.860+0000 7fe8c3acb640 1 --2- 172.21.15.122:0/1797517388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a8003a10 0x7fe8a8003e80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00bb10 tx=0x7fe8ac01cdc0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.860+0000 7fe8c2068640 1 -- 172.21.15.122:0/1797517388 reap_dead start 2024-09-17T06:04:14.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.860+0000 7fe8c3acb640 1 -- 172.21.15.122:0/1797517388 shutdown_connections 2024-09-17T06:04:14.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.860+0000 7fe8c3acb640 1 -- 172.21.15.122:0/1797517388 >> 172.21.15.122:0/1797517388 conn(0x7fe8bc0746d0 msgr2=0x7fe8bc074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:14.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.860+0000 7fe8c3acb640 1 -- 172.21.15.122:0/1797517388 shutdown_connections 2024-09-17T06:04:14.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.860+0000 7fe8c3acb640 1 -- 172.21.15.122:0/1797517388 wait complete. 2024-09-17T06:04:14.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c3acb640 1 Processor -- start 2024-09-17T06:04:14.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c3acb640 1 -- start start 2024-09-17T06:04:14.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c3acb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a8003a10 0x7fe8bc152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:14.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c3acb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8bc15ad80 0x7fe8bc156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:14.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c3acb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8bc0ccb50 0x7fe8bc0ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:14.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c3acb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc152540 con 0x7fe8bc0ccb50 2024-09-17T06:04:14.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c3acb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc0c9f70 con 0x7fe8a8003a10 2024-09-17T06:04:14.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c3acb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe8bc1526c0 con 0x7fe8bc15ad80 2024-09-17T06:04:14.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c2068640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8bc0ccb50 0x7fe8bc0ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:14.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c2068640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8bc0ccb50 0x7fe8bc0ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52570/0 (socket says 172.21.15.122:52570) 2024-09-17T06:04:14.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c2068640 1 -- 172.21.15.122:0/3883713168 learned_addr learned my addr 172.21.15.122:0/3883713168 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:14.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c1867640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a8003a10 0x7fe8bc152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:14.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c1066640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8bc15ad80 0x7fe8bc156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:14.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c2068640 1 -- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8bc15ad80 msgr2=0x7fe8bc156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c2068640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8bc15ad80 0x7fe8bc156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c2068640 1 -- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a8003a10 msgr2=0x7fe8bc152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:14.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c2068640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a8003a10 0x7fe8bc152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:14.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c2068640 1 -- 172.21.15.122:0/3883713168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8bc15a9a0 con 0x7fe8bc0ccb50 2024-09-17T06:04:14.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c1867640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a8003a10 0x7fe8bc152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:14.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c2068640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8bc0ccb50 0x7fe8bc0ccf60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc155ae0 tx=0x7fe8b400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:14.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8b27fc640 1 -- 172.21.15.122:0/3883713168 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4004b30 con 0x7fe8bc0ccb50 2024-09-17T06:04:14.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8b27fc640 1 -- 172.21.15.122:0/3883713168 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8b4004dc0 con 0x7fe8bc0ccb50 2024-09-17T06:04:14.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c3acb640 1 -- 172.21.15.122:0/3883713168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8bc1533e0 con 0x7fe8bc0ccb50 2024-09-17T06:04:14.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8b27fc640 1 -- 172.21.15.122:0/3883713168 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400cd60 con 0x7fe8bc0ccb50 2024-09-17T06:04:14.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.864+0000 7fe8c3acb640 1 -- 172.21.15.122:0/3883713168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8bc159b50 con 0x7fe8bc0ccb50 2024-09-17T06:04:14.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.868+0000 7fe8c3acb640 1 -- 172.21.15.122:0/3883713168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8bc159e50 con 0x7fe8bc0ccb50 2024-09-17T06:04:14.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.868+0000 7fe8b27fc640 1 -- 172.21.15.122:0/3883713168 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe8b401b030 con 0x7fe8bc0ccb50 2024-09-17T06:04:14.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.868+0000 7fe8b27fc640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe8a0073230 0x7fe8a0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:14.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.868+0000 7fe8b27fc640 1 -- 172.21.15.122:0/3883713168 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe8b4094010 con 0x7fe8bc0ccb50 2024-09-17T06:04:14.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.868+0000 7fe8c1867640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe8a0073230 0x7fe8a0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:14.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.868+0000 7fe8c1867640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe8a0073230 0x7fe8a0075740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0b0000 tx=0x7fe8ac019b60 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:14.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:14.872+0000 7fe8b27fc640 1 -- 172.21.15.122:0/3883713168 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe8b4022060 con 0x7fe8bc0ccb50 2024-09-17T06:04:15.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.044+0000 7fe8c3acb640 1 -- 172.21.15.122:0/3883713168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8bc072840 con 0x7fe8bc0ccb50 2024-09-17T06:04:15.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.044+0000 7fe8b27fc640 1 -- 172.21.15.122:0/3883713168 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7fe8b405ee10 con 0x7fe8bc0ccb50 2024-09-17T06:04:15.045 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:15.046 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":26,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:04:13.331438+0000","last_up_change":"2024-09-17T06:03:56.580331+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6811","nonce":920798795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6813","nonce":920798795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6817","nonce":920798795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6815","nonce":920798795}]},"public_addr":"172.21.15.173:6811/920798795","cluster_addr":"172.21.15.173:6813/920798795","heartbeat_back_addr":"172.21.15.173:6817/920798795","heartbeat_front_addr":"172.21.15.173:6815/920798795","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:04:15.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.048+0000 7fe8c3acb640 1 -- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe8a0073230 msgr2=0x7fe8a0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.048+0000 7fe8c3acb640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe8a0073230 0x7fe8a0075740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0b0000 tx=0x7fe8ac019b60 comp rx=0 tx=0).stop 2024-09-17T06:04:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.048+0000 7fe8c3acb640 1 -- 172.21.15.122:0/3883713168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8bc0ccb50 msgr2=0x7fe8bc0ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.048+0000 7fe8c3acb640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8bc0ccb50 0x7fe8bc0ccf60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc155ae0 tx=0x7fe8b400eec0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.048+0000 7fe8c3acb640 1 -- 172.21.15.122:0/3883713168 shutdown_connections 2024-09-17T06:04:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.048+0000 7fe8c3acb640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8bc0ccb50 0x7fe8bc0ccf60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.048+0000 7fe8c3acb640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe8bc15ad80 0x7fe8bc156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.048+0000 7fe8c3acb640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe8a0073230 0x7fe8a0075740 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.048+0000 7fe8c3acb640 1 --2- 172.21.15.122:0/3883713168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a8003a10 0x7fe8bc152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.048+0000 7fe8c3acb640 1 -- 172.21.15.122:0/3883713168 >> 172.21.15.122:0/3883713168 conn(0x7fe8bc0746d0 msgr2=0x7fe8bc1472c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.048+0000 7fe8c3acb640 1 -- 172.21.15.122:0/3883713168 shutdown_connections 2024-09-17T06:04:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.048+0000 7fe8c3acb640 1 -- 172.21.15.122:0/3883713168 wait complete. 2024-09-17T06:04:15.084 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T06:04:15.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.240+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/2198447523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f415b8f0 msgr2=0x7fb9f415bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:15.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.240+0000 7fb9fc4e6640 1 --2- 172.21.15.122:0/2198447523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f415b8f0 0x7fb9f415bd00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb9f40cddf0 tx=0x7fb9ec01f5a0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.240+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/2198447523 shutdown_connections 2024-09-17T06:04:15.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.240+0000 7fb9fc4e6640 1 --2- 172.21.15.122:0/2198447523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f415b8f0 0x7fb9f415bd00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.240+0000 7fb9fc4e6640 1 --2- 172.21.15.122:0/2198447523 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9f40c8740 0x7fb9f4152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.240+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/2198447523 >> 172.21.15.122:0/2198447523 conn(0x7fb9f406d8f0 msgr2=0x7fb9f406dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:15.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.240+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/2198447523 shutdown_connections 2024-09-17T06:04:15.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.240+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/2198447523 wait complete. 2024-09-17T06:04:15.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9fc4e6640 1 Processor -- start 2024-09-17T06:04:15.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9fc4e6640 1 -- start start 2024-09-17T06:04:15.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9fc4e6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9f40c2870 0x7fb9f4153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:15.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9fc4e6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9f40c8740 0x7fb9f4150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:15.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9fc4e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f415b8f0 0x7fb9f4152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:15.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9fc4e6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f415c240 con 0x7fb9f415b8f0 2024-09-17T06:04:15.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9fc4e6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f40c94f0 con 0x7fb9f40c2870 2024-09-17T06:04:15.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9fc4e6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb9f40c3290 con 0x7fb9f40c8740 2024-09-17T06:04:15.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9faa83640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f415b8f0 0x7fb9f4152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:15.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9faa83640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f415b8f0 0x7fb9f4152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52582/0 (socket says 172.21.15.122:52582) 2024-09-17T06:04:15.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9faa83640 1 -- 172.21.15.122:0/1210959041 learned_addr learned my addr 172.21.15.122:0/1210959041 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:15.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9fa282640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9f40c2870 0x7fb9f4153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:15.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9f9a81640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9f40c8740 0x7fb9f4150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:15.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9faa83640 1 -- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9f40c8740 msgr2=0x7fb9f4150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:15.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9faa83640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9f40c8740 0x7fb9f4150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9faa83640 1 -- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9f40c2870 msgr2=0x7fb9f4153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:15.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9faa83640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9f40c2870 0x7fb9f4153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9faa83640 1 -- 172.21.15.122:0/1210959041 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f40ccd60 con 0x7fb9f415b8f0 2024-09-17T06:04:15.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9faa83640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f415b8f0 0x7fb9f4152a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec01fe40 tx=0x7fb9ec003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:15.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9eaffd640 1 -- 172.21.15.122:0/1210959041 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0b6040 con 0x7fb9f415b8f0 2024-09-17T06:04:15.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9eaffd640 1 -- 172.21.15.122:0/1210959041 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9ec0bf070 con 0x7fb9f415b8f0 2024-09-17T06:04:15.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9eaffd640 1 -- 172.21.15.122:0/1210959041 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0b1e50 con 0x7fb9f415b8f0 2024-09-17T06:04:15.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/1210959041 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f40cc440 con 0x7fb9f415b8f0 2024-09-17T06:04:15.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/1210959041 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f41582c0 con 0x7fb9f415b8f0 2024-09-17T06:04:15.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.244+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/1210959041 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f406d3b0 con 0x7fb9f415b8f0 2024-09-17T06:04:15.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.248+0000 7fb9eaffd640 1 -- 172.21.15.122:0/1210959041 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb9ec004000 con 0x7fb9f415b8f0 2024-09-17T06:04:15.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.248+0000 7fb9eaffd640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb9d80733a0 0x7fb9d80758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:15.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.248+0000 7fb9eaffd640 1 -- 172.21.15.122:0/1210959041 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb9ec1333f0 con 0x7fb9f415b8f0 2024-09-17T06:04:15.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.248+0000 7fb9fa282640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb9d80733a0 0x7fb9d80758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:15.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.248+0000 7fb9fa282640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb9d80733a0 0x7fb9d80758b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00058d0 tx=0x7fb9f0005d90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:15.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.252+0000 7fb9eaffd640 1 -- 172.21.15.122:0/1210959041 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb9ec0ab070 con 0x7fb9f415b8f0 2024-09-17T06:04:15.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.460+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/1210959041 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9f40c3da0 con 0x7fb9f415b8f0 2024-09-17T06:04:15.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.460+0000 7fb9eaffd640 1 -- 172.21.15.122:0/1210959041 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6885 (secure 0 0 0) 0x7fb9ec019100 con 0x7fb9f415b8f0 2024-09-17T06:04:15.462 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:15.462 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":6,"btime":"2024-09-17T06:04:13:927087+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1941177833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1941177833},{"type":"v1","addr":"172.21.15.173:6835","nonce":1941177833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3902874091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3902874091},{"type":"v1","addr":"172.21.15.122:6833","nonce":3902874091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2868113442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2868113442},{"type":"v1","addr":"172.21.15.122:6836","nonce":2868113442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1552928786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1552928786},{"type":"v1","addr":"172.21.15.122:6837","nonce":1552928786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4447,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2188047562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2188047562},{"type":"v1","addr":"172.21.15.173:6837","nonce":2188047562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T06:04:08.229792+0000","modified":"2024-09-17T06:04:13.907032+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4450":{"gid":4450,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6839/1694851531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":1694851531},{"type":"v1","addr":"172.21.15.173:6839","nonce":1694851531}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4450,"qdb_cluster":[4450]},"id":1}]} 2024-09-17T06:04:15.462 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 6 2024-09-17T06:04:15.464 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.464+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb9d80733a0 msgr2=0x7fb9d80758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.464+0000 7fb9fc4e6640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb9d80733a0 0x7fb9d80758b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00058d0 tx=0x7fb9f0005d90 comp rx=0 tx=0).stop 2024-09-17T06:04:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.464+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/1210959041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f415b8f0 msgr2=0x7fb9f4152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.464+0000 7fb9fc4e6640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f415b8f0 0x7fb9f4152a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec01fe40 tx=0x7fb9ec003f80 comp rx=0 tx=0).stop 2024-09-17T06:04:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.464+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/1210959041 shutdown_connections 2024-09-17T06:04:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.464+0000 7fb9fc4e6640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f415b8f0 0x7fb9f4152a10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.464+0000 7fb9fc4e6640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9f40c8740 0x7fb9f4150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.464+0000 7fb9fc4e6640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb9d80733a0 0x7fb9d80758b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.464+0000 7fb9fc4e6640 1 --2- 172.21.15.122:0/1210959041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9f40c2870 0x7fb9f4153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.464+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/1210959041 >> 172.21.15.122:0/1210959041 conn(0x7fb9f406d8f0 msgr2=0x7fb9f406dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.464+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/1210959041 shutdown_connections 2024-09-17T06:04:15.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.464+0000 7fb9fc4e6640 1 -- 172.21.15.122:0/1210959041 wait complete. 2024-09-17T06:04:15.484 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:04:15.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.632+0000 7f3f2de6c640 1 -- 172.21.15.122:0/605800741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f10005260 msgr2=0x7f3f1000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:15.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.632+0000 7f3f2de6c640 1 --2- 172.21.15.122:0/605800741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f10005260 0x7f3f1000b9d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000c590 tx=0x7f3f2001d2a0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.632+0000 7f3f2de6c640 1 -- 172.21.15.122:0/605800741 shutdown_connections 2024-09-17T06:04:15.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.632+0000 7f3f2de6c640 1 --2- 172.21.15.122:0/605800741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f10005260 0x7f3f1000b9d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.632+0000 7f3f2de6c640 1 -- 172.21.15.122:0/605800741 >> 172.21.15.122:0/605800741 conn(0x7f3f280ca380 msgr2=0x7f3f280ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:15.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.632+0000 7f3f2de6c640 1 -- 172.21.15.122:0/605800741 shutdown_connections 2024-09-17T06:04:15.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.632+0000 7f3f2de6c640 1 -- 172.21.15.122:0/605800741 wait complete. 2024-09-17T06:04:15.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f2de6c640 1 Processor -- start 2024-09-17T06:04:15.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f2de6c640 1 -- start start 2024-09-17T06:04:15.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f2de6c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f10005260 0x7f3f2814fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:15.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f2de6c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f281582a0 0x7f3f28150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:15.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f2de6c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f2814b1b0 0x7f3f2814b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:15.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f2de6c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3f28070050 con 0x7f3f281582a0 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f2de6c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3f280c35b0 con 0x7f3f10005260 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f2de6c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3f2806ea30 con 0x7f3f2814b1b0 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f26ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f281582a0 0x7f3f28150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f26ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f281582a0 0x7f3f28150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52600/0 (socket says 172.21.15.122:52600) 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f26ffd640 1 -- 172.21.15.122:0/3817444967 learned_addr learned my addr 172.21.15.122:0/3817444967 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f277fe640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f10005260 0x7f3f2814fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f27fff640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f2814b1b0 0x7f3f2814b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f26ffd640 1 -- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f2814b1b0 msgr2=0x7f3f2814b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f26ffd640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f2814b1b0 0x7f3f2814b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f26ffd640 1 -- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f10005260 msgr2=0x7f3f2814fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f26ffd640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f10005260 0x7f3f2814fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f26ffd640 1 -- 172.21.15.122:0/3817444967 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f28150ea0 con 0x7f3f281582a0 2024-09-17T06:04:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f277fe640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f10005260 0x7f3f2814fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f26ffd640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f281582a0 0x7f3f28150540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00d580 tx=0x7f3f1c00da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f0ffff640 1 -- 172.21.15.122:0/3817444967 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c016020 con 0x7f3f281582a0 2024-09-17T06:04:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f0ffff640 1 -- 172.21.15.122:0/3817444967 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f1c012630 con 0x7f3f281582a0 2024-09-17T06:04:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f2de6c640 1 -- 172.21.15.122:0/3817444967 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f28151180 con 0x7f3f281582a0 2024-09-17T06:04:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f0ffff640 1 -- 172.21.15.122:0/3817444967 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c012a00 con 0x7f3f281582a0 2024-09-17T06:04:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.636+0000 7f3f2de6c640 1 -- 172.21.15.122:0/3817444967 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f280c5210 con 0x7f3f281582a0 2024-09-17T06:04:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.640+0000 7f3f2de6c640 1 -- 172.21.15.122:0/3817444967 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f28072910 con 0x7f3f281582a0 2024-09-17T06:04:15.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.640+0000 7f3f0ffff640 1 -- 172.21.15.122:0/3817444967 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3f1c019020 con 0x7f3f281582a0 2024-09-17T06:04:15.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.640+0000 7f3f0ffff640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3f14073230 0x7f3f14075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:15.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.640+0000 7f3f0ffff640 1 -- 172.21.15.122:0/3817444967 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3f1c093f60 con 0x7f3f281582a0 2024-09-17T06:04:15.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.640+0000 7f3f277fe640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3f14073230 0x7f3f14075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:15.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.640+0000 7f3f277fe640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3f14073230 0x7f3f14075740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009a20 tx=0x7f3f180091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:15.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.644+0000 7f3f0ffff640 1 -- 172.21.15.122:0/3817444967 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3f1c020030 con 0x7f3f281582a0 2024-09-17T06:04:15.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.816+0000 7f3f2de6c640 1 -- 172.21.15.122:0/3817444967 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f281518d0 con 0x7f3f281582a0 2024-09-17T06:04:15.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.816+0000 7f3f0ffff640 1 -- 172.21.15.122:0/3817444967 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7f3f1c05ece0 con 0x7f3f281582a0 2024-09-17T06:04:15.817 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:15.818 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":26,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:04:13.331438+0000","last_up_change":"2024-09-17T06:03:56.580331+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6811","nonce":920798795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6813","nonce":920798795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6817","nonce":920798795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6815","nonce":920798795}]},"public_addr":"172.21.15.173:6811/920798795","cluster_addr":"172.21.15.173:6813/920798795","heartbeat_back_addr":"172.21.15.173:6817/920798795","heartbeat_front_addr":"172.21.15.173:6815/920798795","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:04:15.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.820+0000 7f3f2de6c640 1 -- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3f14073230 msgr2=0x7f3f14075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:15.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.820+0000 7f3f2de6c640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3f14073230 0x7f3f14075740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009a20 tx=0x7f3f180091e0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.820+0000 7f3f2de6c640 1 -- 172.21.15.122:0/3817444967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f281582a0 msgr2=0x7f3f28150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:15.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.820+0000 7f3f2de6c640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f281582a0 0x7f3f28150540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00d580 tx=0x7f3f1c00da40 comp rx=0 tx=0).stop 2024-09-17T06:04:15.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.820+0000 7f3f2de6c640 1 -- 172.21.15.122:0/3817444967 shutdown_connections 2024-09-17T06:04:15.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.820+0000 7f3f2de6c640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3f2814b1b0 0x7f3f2814b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.820+0000 7f3f2de6c640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f281582a0 0x7f3f28150540 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.820+0000 7f3f2de6c640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3f14073230 0x7f3f14075740 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.820+0000 7f3f2de6c640 1 --2- 172.21.15.122:0/3817444967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f10005260 0x7f3f2814fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:15.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.820+0000 7f3f2de6c640 1 -- 172.21.15.122:0/3817444967 >> 172.21.15.122:0/3817444967 conn(0x7f3f280ca380 msgr2=0x7f3f28158f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:15.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.820+0000 7f3f2de6c640 1 -- 172.21.15.122:0/3817444967 shutdown_connections 2024-09-17T06:04:15.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:15.820+0000 7f3f2de6c640 1 -- 172.21.15.122:0/3817444967 wait complete. 2024-09-17T06:04:16.442 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T06:04:08.229792+0000', 'modified': '2024-09-17T06:04:13.907032+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4450}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4450': {'gid': 4450, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.173:6839/1694851531', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 1694851531}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 1694851531}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4450, 'qdb_cluster': [4450]} 2024-09-17T06:04:16.442 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T06:04:16.442 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T06:04:16.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1886570308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8d8005360 msgr2=0x7fc8d800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:16.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 --2- 172.21.15.122:0/1886570308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8d8005360 0x7fc8d800b9d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4009eb0 tx=0x7fc8e401d5f0 comp rx=0 tx=0).stop 2024-09-17T06:04:16.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1886570308 shutdown_connections 2024-09-17T06:04:16.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 --2- 172.21.15.122:0/1886570308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8d8005360 0x7fc8d800b9d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:16.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1886570308 >> 172.21.15.122:0/1886570308 conn(0x7fc8ec08d450 msgr2=0x7fc8ec06ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:16.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1886570308 shutdown_connections 2024-09-17T06:04:16.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1886570308 wait complete. 2024-09-17T06:04:16.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 Processor -- start 2024-09-17T06:04:16.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 -- start start 2024-09-17T06:04:16.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8d8005360 0x7fc8ec1f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:16.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8ec151490 0x7fc8ec0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:16.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8ec0cc460 0x7fc8ec149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:16.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec155970 con 0x7fc8ec151490 2024-09-17T06:04:16.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec0cb680 con 0x7fc8d8005360 2024-09-17T06:04:16.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f47ed640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc8ec0cbb40 con 0x7fc8ec0cc460 2024-09-17T06:04:16.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f1d88640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8ec151490 0x7fc8ec0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:16.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f1d88640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8ec151490 0x7fc8ec0cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52626/0 (socket says 172.21.15.122:52626) 2024-09-17T06:04:16.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f1d88640 1 -- 172.21.15.122:0/1806997030 learned_addr learned my addr 172.21.15.122:0/1806997030 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:16.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f1d88640 1 -- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8ec0cc460 msgr2=0x7fc8ec149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:16.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8ec0cc460 0x7fc8ec149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:16.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f1d88640 1 -- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8d8005360 msgr2=0x7fc8ec1f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:16.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f2589640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8d8005360 0x7fc8ec1f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:16.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8d8005360 0x7fc8ec1f2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:16.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f1d88640 1 -- 172.21.15.122:0/1806997030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ec1e5820 con 0x7fc8ec151490 2024-09-17T06:04:16.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.612+0000 7fc8f2589640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8d8005360 0x7fc8ec1f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:16.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8ec151490 0x7fc8ec0cbf20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8001610 tx=0x7fc8e800e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:16.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8e2ffd640 1 -- 172.21.15.122:0/1806997030 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8012640 con 0x7fc8ec151490 2024-09-17T06:04:16.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8e2ffd640 1 -- 172.21.15.122:0/1806997030 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8e80128d0 con 0x7fc8ec151490 2024-09-17T06:04:16.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8e2ffd640 1 -- 172.21.15.122:0/1806997030 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8012d00 con 0x7fc8ec151490 2024-09-17T06:04:16.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1806997030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8ec1f2650 con 0x7fc8ec151490 2024-09-17T06:04:16.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1806997030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8ec154de0 con 0x7fc8ec151490 2024-09-17T06:04:16.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8e2ffd640 1 -- 172.21.15.122:0/1806997030 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc8e800d030 con 0x7fc8ec151490 2024-09-17T06:04:16.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8e2ffd640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc8d0073230 0x7fc8d0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:16.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8e2ffd640 1 -- 172.21.15.122:0/1806997030 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc8e8097690 con 0x7fc8ec151490 2024-09-17T06:04:16.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8f2589640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc8d0073230 0x7fc8d0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:16.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8fbab8000 1 Processor -- start 2024-09-17T06:04:16.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8fbab8000 1 -- start start 2024-09-17T06:04:16.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.616+0000 7fc8f2589640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc8d0073230 0x7fc8d0075740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc000c10 tx=0x7fc8dc006b80 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:16.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabeef7460 0x55aabf42b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:16.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2e7950 0x55aabf42fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:16.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2d0ca0 0x55aabf430180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:16.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55aabf30d410 con 0x55aabf2e7950 2024-09-17T06:04:16.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55aabf24ab40 con 0x55aabf2d0ca0 2024-09-17T06:04:16.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x55aabf239f70 con 0x55aabeef7460 2024-09-17T06:04:16.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8f1d88640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2e7950 0x55aabf42fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:16.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8f1d88640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2e7950 0x55aabf42fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52634/0 (socket says 172.21.15.122:52634) 2024-09-17T06:04:16.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8f1d88640 1 -- 172.21.15.122:0/3747285961 learned_addr learned my addr 172.21.15.122:0/3747285961 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:16.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8f2589640 1 --2- 172.21.15.122:0/3747285961 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabeef7460 0x55aabf42b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:16.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8f1d88640 1 -- 172.21.15.122:0/3747285961 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabeef7460 msgr2=0x55aabf42b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:16.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8f2d8a640 1 --2- 172.21.15.122:0/3747285961 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2d0ca0 0x55aabf430180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:16.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/3747285961 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabeef7460 0x55aabf42b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:16.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8f1d88640 1 -- 172.21.15.122:0/3747285961 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2d0ca0 msgr2=0x55aabf430180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:16.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/3747285961 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2d0ca0 0x55aabf430180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:16.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8f1d88640 1 -- 172.21.15.122:0/3747285961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aabf2015b0 con 0x55aabf2e7950 2024-09-17T06:04:16.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/3747285961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2e7950 0x55aabf42fc40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800ebb0 tx=0x7fc8e8061780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700461401f0997a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:16.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8cffff640 1 -- 172.21.15.122:0/3747285961 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8087070 con 0x55aabf2e7950 2024-09-17T06:04:16.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8cffff640 1 -- 172.21.15.122:0/3747285961 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8e8066750 con 0x55aabf2e7950 2024-09-17T06:04:16.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8cffff640 1 -- 172.21.15.122:0/3747285961 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e806b690 con 0x55aabf2e7950 2024-09-17T06:04:16.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3747285961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2e7950 msgr2=0x55aabf42fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:16.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/3747285961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2e7950 0x55aabf42fc40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800ebb0 tx=0x7fc8e8061780 comp rx=0 tx=0).stop 2024-09-17T06:04:16.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3747285961 shutdown_connections 2024-09-17T06:04:16.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/3747285961 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2d0ca0 0x55aabf430180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:16.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/3747285961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2e7950 0x55aabf42fc40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:16.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/3747285961 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabeef7460 0x55aabf42b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:16.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3747285961 >> 172.21.15.122:0/3747285961 conn(0x55aabf3bdd90 msgr2=0x55aabf42da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:16.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3747285961 shutdown_connections 2024-09-17T06:04:16.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3747285961 wait complete. 2024-09-17T06:04:16.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 -- start start 2024-09-17T06:04:16.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.620+0000 7fc8fbab8000 1 Processor -- start 2024-09-17T06:04:16.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 0x55aabf42a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:16.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2d0ca0 0x55aabf42a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:16.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2e7950 0x55aabf42ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:16.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55aabf1d45f0 con 0x55aabeef7460 2024-09-17T06:04:16.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55aabf23dd80 con 0x55aabf2e7950 2024-09-17T06:04:16.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x55aabf1e0520 con 0x55aabf2d0ca0 2024-09-17T06:04:16.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 10 client.0 _ll_register_callbacks cb 0x55aabf1e4830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T06:04:16.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f2589640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 0x55aabf42a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f2589640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 0x55aabf42a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52648/0 (socket says 172.21.15.122:52648) 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f2589640 1 -- 172.21.15.122:0/3234121175 learned_addr learned my addr 172.21.15.122:0/3234121175 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f2d8a640 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2e7950 0x55aabf42ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2d0ca0 0x55aabf42a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f2589640 1 -- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2d0ca0 msgr2=0x55aabf42a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f2589640 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2d0ca0 0x55aabf42a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f2589640 1 -- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2e7950 msgr2=0x55aabf42ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f2589640 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2e7950 0x55aabf42ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f2589640 1 -- 172.21.15.122:0/3234121175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aabf1d8190 con 0x55aabeef7460 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f2d8a640 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2e7950 0x55aabf42ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f2589640 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 0x55aabf42a1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc012990 tx=0x7fc8dc001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb56a32d7ca3069 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-09-17T06:04:16.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8cd7fa640 1 -- 172.21.15.122:0/3234121175 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc011bc0 con 0x55aabeef7460 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8cd7fa640 1 -- 172.21.15.122:0/3234121175 <== mon.0 v2:172.21.15.122:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc8dc018040 con 0x55aabeef7460 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3234121175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aabf1d2110 con 0x55aabeef7460 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8cd7fa640 1 -- 172.21.15.122:0/3234121175 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fc8dc011d60 con 0x55aabeef7460 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 10 client.4524 fetch_fsmap learned FSMap version 6 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3234121175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55aabf2bef10 con 0x55aabeef7460 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8cd7fa640 1 -- 172.21.15.122:0/3234121175 <== mon.0 v2:172.21.15.122:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55aabf1d2110 con 0x55aabeef7460 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8cd7fa640 1 -- 172.21.15.122:0/3234121175 <== mon.0 v2:172.21.15.122:3300/0 5 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7fc8dc029680 con 0x55aabeef7460 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 10 client.4524 fetch_fsmap finished waiting for FSMap version 6 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 10 client.4524 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 20 client.4524 populate_metadata read hostname 'smithi122' 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55aabeedc7d0 0x55aabf4452e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 4 client.4524 mds_command: new command op to 4450 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3234121175 --> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aabf24ca90 con 0x55aabeedc7d0 2024-09-17T06:04:16.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55aabeedc7d0 0x55aabf4452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:16.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8cd7fa640 10 client.4524 ms_handle_connect on v2:172.21.15.173:6838/1694851531 2024-09-17T06:04:16.631 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:16.624+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55aabeedc7d0 0x55aabf4452e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87284331ac0816fd server_cookie=48d37a3d44afddee in_seq=0 out_seq=0 2024-09-17T06:04:18.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.924+0000 7fc8cd7fa640 1 -- 172.21.15.122:0/3234121175 <== mds.0 v2:172.21.15.173:6838/1694851531 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aabf24ca90 con 0x55aabeedc7d0 2024-09-17T06:04:18.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.924+0000 7fc8cd7fa640 10 client.4524 handle_command_reply: tid=0 2024-09-17T06:04:18.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.924+0000 7fc8fbab8000 1 client.4524 shutdown 2024-09-17T06:04:18.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.924+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3234121175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 msgr2=0x55aabf42a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:18.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.924+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 0x55aabf42a1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc012990 tx=0x7fc8dc001130 comp rx=0 tx=0).stop 2024-09-17T06:04:18.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.928+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3234121175 shutdown_connections 2024-09-17T06:04:18.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.928+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55aabeedc7d0 0x55aabf4452e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.928+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2e7950 0x55aabf42ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.928+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2d0ca0 0x55aabf42a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.928+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/3234121175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 0x55aabf42a1a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.928+0000 7fc8cd7fa640 0 client.4524 ms_handle_reset on v2:172.21.15.173:6838/1694851531 2024-09-17T06:04:18.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.928+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3234121175 >> 172.21.15.122:0/3234121175 conn(0x55aabf3bdd90 msgr2=0x55aabf3f4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:18.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.928+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3234121175 shutdown_connections 2024-09-17T06:04:18.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.928+0000 7fc8fbab8000 1 -- 172.21.15.122:0/3234121175 wait complete. 2024-09-17T06:04:18.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.928+0000 7fc8fbab8000 20 client.4524 trim_cache size 0 max 16384 2024-09-17T06:04:18.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8fbab8000 1 Processor -- start 2024-09-17T06:04:18.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8fbab8000 1 -- start start 2024-09-17T06:04:18.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8fbab8000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 0x55aabf43cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:18.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8fbab8000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2d0ca0 0x55aabf43d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:18.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8fbab8000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2e7950 0x55aabf43d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:18.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8fbab8000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec200b70 con 0x55aabeef7460 2024-09-17T06:04:18.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8fbab8000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec1ffa50 con 0x55aabf2e7950 2024-09-17T06:04:18.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8fbab8000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc8ec1fe050 con 0x55aabf2d0ca0 2024-09-17T06:04:18.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8f2589640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 0x55aabf43cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:18.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8f2589640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 0x55aabf43cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52658/0 (socket says 172.21.15.122:52658) 2024-09-17T06:04:18.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8f2589640 1 -- 172.21.15.122:0/401232576 learned_addr learned my addr 172.21.15.122:0/401232576 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:18.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/401232576 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2d0ca0 0x55aabf43d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:18.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.964+0000 7fc8f2d8a640 1 --2- 172.21.15.122:0/401232576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2e7950 0x55aabf43d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:18.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8f2589640 1 -- 172.21.15.122:0/401232576 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2d0ca0 msgr2=0x55aabf43d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:18.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8f2589640 1 --2- 172.21.15.122:0/401232576 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2d0ca0 0x55aabf43d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8f2589640 1 -- 172.21.15.122:0/401232576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2e7950 msgr2=0x55aabf43d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:18.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8f2589640 1 --2- 172.21.15.122:0/401232576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2e7950 0x55aabf43d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8f2589640 1 -- 172.21.15.122:0/401232576 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aabf295db0 con 0x55aabeef7460 2024-09-17T06:04:18.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8f2589640 1 --2- 172.21.15.122:0/401232576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 0x55aabf43cd10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc001040 tx=0x7fc8dc011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7eb3df30ae2eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:18.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8cf7fe640 1 -- 172.21.15.122:0/401232576 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc023030 con 0x55aabeef7460 2024-09-17T06:04:18.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8cf7fe640 1 -- 172.21.15.122:0/401232576 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8dc038020 con 0x55aabeef7460 2024-09-17T06:04:18.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8cf7fe640 1 -- 172.21.15.122:0/401232576 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc012590 con 0x55aabeef7460 2024-09-17T06:04:18.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8fbab8000 1 -- 172.21.15.122:0/401232576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 msgr2=0x55aabf43cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:18.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/401232576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 0x55aabf43cd10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc001040 tx=0x7fc8dc011800 comp rx=0 tx=0).stop 2024-09-17T06:04:18.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8fbab8000 1 -- 172.21.15.122:0/401232576 shutdown_connections 2024-09-17T06:04:18.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/401232576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabf2e7950 0x55aabf43d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/401232576 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2d0ca0 0x55aabf43d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/401232576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabeef7460 0x55aabf43cd10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8fbab8000 1 -- 172.21.15.122:0/401232576 >> 172.21.15.122:0/401232576 conn(0x55aabf3bdd90 msgr2=0x55aabf3eccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:18.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8fbab8000 1 -- 172.21.15.122:0/401232576 shutdown_connections 2024-09-17T06:04:18.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8fbab8000 1 -- 172.21.15.122:0/401232576 wait complete. 2024-09-17T06:04:18.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8fbab8000 1 -- start start 2024-09-17T06:04:18.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.968+0000 7fc8fbab8000 1 Processor -- start 2024-09-17T06:04:18.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabeef7460 0x55aabf440d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:18.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2d0ca0 0x55aabf441250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:18.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2e7950 0x55aabf46b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:18.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec1fe6a0 con 0x55aabf2d0ca0 2024-09-17T06:04:18.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec1ff380 con 0x55aabeef7460 2024-09-17T06:04:18.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc8ec1fecf0 con 0x55aabf2e7950 2024-09-17T06:04:18.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 10 client.0 _ll_register_callbacks cb 0x7fc8dc0062b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T06:04:18.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f1d88640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2d0ca0 0x55aabf441250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:18.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f1d88640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2d0ca0 0x55aabf441250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52668/0 (socket says 172.21.15.122:52668) 2024-09-17T06:04:18.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f1d88640 1 -- 172.21.15.122:0/660501410 learned_addr learned my addr 172.21.15.122:0/660501410 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:18.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f2589640 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabeef7460 0x55aabf440d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f2d8a640 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2e7950 0x55aabf46b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f1d88640 1 -- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2e7950 msgr2=0x55aabf46b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2e7950 0x55aabf46b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f1d88640 1 -- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabeef7460 msgr2=0x55aabf440d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabeef7460 0x55aabf440d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f1d88640 1 -- 172.21.15.122:0/660501410 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aabf200ab0 con 0x55aabf2d0ca0 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f2589640 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabeef7460 0x55aabf440d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f1d88640 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2d0ca0 0x55aabf441250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800ebb0 tx=0x7fc8e8085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ff275d0ae6b5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8cd7fa640 1 -- 172.21.15.122:0/660501410 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8087040 con 0x55aabf2d0ca0 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8cd7fa640 1 -- 172.21.15.122:0/660501410 <== mon.0 v2:172.21.15.122:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc8e80871e0 con 0x55aabf2d0ca0 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 1 -- 172.21.15.122:0/660501410 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aabf3f54d0 con 0x55aabf2d0ca0 2024-09-17T06:04:18.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8cd7fa640 1 -- 172.21.15.122:0/660501410 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fc8e806b690 con 0x55aabf2d0ca0 2024-09-17T06:04:18.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 10 client.4530 fetch_fsmap learned FSMap version 6 2024-09-17T06:04:18.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 1 -- 172.21.15.122:0/660501410 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55aabf1df070 con 0x55aabf2d0ca0 2024-09-17T06:04:18.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8cd7fa640 1 -- 172.21.15.122:0/660501410 <== mon.0 v2:172.21.15.122:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55aabf3f54d0 con 0x55aabf2d0ca0 2024-09-17T06:04:18.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8cd7fa640 1 -- 172.21.15.122:0/660501410 <== mon.0 v2:172.21.15.122:3300/0 5 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7fc8e8061ed0 con 0x55aabf2d0ca0 2024-09-17T06:04:18.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 10 client.4530 fetch_fsmap finished waiting for FSMap version 6 2024-09-17T06:04:18.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 10 client.4530 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T06:04:18.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 20 client.4530 populate_metadata read hostname 'smithi122' 2024-09-17T06:04:18.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55aabeeca830 0x55aabf46c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:18.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 4 client.4530 mds_command: new command op to 4450 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T06:04:18.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8fbab8000 1 -- 172.21.15.122:0/660501410 --> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] -- command(tid 0: {"prefix": "status"}) -- 0x55aabf44b600 con 0x55aabeeca830 2024-09-17T06:04:18.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.972+0000 7fc8f2589640 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55aabeeca830 0x55aabf46c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:18.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8cd7fa640 10 client.4530 ms_handle_connect on v2:172.21.15.173:6838/1694851531 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f2589640 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55aabeeca830 0x55aabf46c160 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb95a6782d754a79 server_cookie=8b750fc2b6e97050 in_seq=0 out_seq=0 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8cd7fa640 1 -- 172.21.15.122:0/660501410 <== mds.0 v2:172.21.15.173:6838/1694851531 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55aabf44b600 con 0x55aabeeca830 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8cd7fa640 10 client.4530 handle_command_reply: tid=0 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8fbab8000 1 client.4530 shutdown 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8fbab8000 1 -- 172.21.15.122:0/660501410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2d0ca0 msgr2=0x55aabf441250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2d0ca0 0x55aabf441250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800ebb0 tx=0x7fc8e8085040 comp rx=0 tx=0).stop 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8fbab8000 1 -- 172.21.15.122:0/660501410 shutdown_connections 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55aabeeca830 0x55aabf46c160 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55aabf2e7950 0x55aabf46b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55aabf2d0ca0 0x55aabf441250 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8fbab8000 1 --2- 172.21.15.122:0/660501410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aabeef7460 0x55aabf440d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8cd7fa640 0 client.4530 ms_handle_reset on v2:172.21.15.173:6838/1694851531 2024-09-17T06:04:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8fbab8000 1 -- 172.21.15.122:0/660501410 >> 172.21.15.122:0/660501410 conn(0x55aabf3bdd90 msgr2=0x55aabf3eccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:18.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8fbab8000 1 -- 172.21.15.122:0/660501410 shutdown_connections 2024-09-17T06:04:18.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8fbab8000 1 -- 172.21.15.122:0/660501410 wait complete. 2024-09-17T06:04:18.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8fbab8000 20 client.4530 trim_cache size 0 max 16384 2024-09-17T06:04:18.980 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:04:18.980 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_fsid": "5aff0fc3-254a-48aa-be08-0081a34bd09c", 2024-09-17T06:04:18.980 INFO:teuthology.orchestra.run.smithi122.stdout: "whoami": 0, 2024-09-17T06:04:18.980 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4450, 2024-09-17T06:04:18.980 INFO:teuthology.orchestra.run.smithi122.stdout: "want_state": "up:active", 2024-09-17T06:04:18.980 INFO:teuthology.orchestra.run.smithi122.stdout: "state": "up:active", 2024-09-17T06:04:18.980 INFO:teuthology.orchestra.run.smithi122.stdout: "fs_name": "cephfs", 2024-09-17T06:04:18.981 INFO:teuthology.orchestra.run.smithi122.stdout: "rank_uptime": 10.163984725000001, 2024-09-17T06:04:18.981 INFO:teuthology.orchestra.run.smithi122.stdout: "mdsmap_epoch": 5, 2024-09-17T06:04:18.981 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_epoch": 26, 2024-09-17T06:04:18.981 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_epoch_barrier": 26, 2024-09-17T06:04:18.981 INFO:teuthology.orchestra.run.smithi122.stdout: "uptime": 16.133913136 2024-09-17T06:04:18.981 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:04:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc8d0073230 msgr2=0x7fc8d0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f47ed640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc8d0073230 0x7fc8d0075740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc000c10 tx=0x7fc8dc006b80 comp rx=0 tx=0).stop 2024-09-17T06:04:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1806997030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8ec151490 msgr2=0x7fc8ec0cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f47ed640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8ec151490 0x7fc8ec0cbf20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8001610 tx=0x7fc8e800e6b0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1806997030 shutdown_connections 2024-09-17T06:04:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f47ed640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8ec0cc460 0x7fc8ec149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f47ed640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8ec151490 0x7fc8ec0cbf20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f47ed640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc8d0073230 0x7fc8d0075740 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f47ed640 1 --2- 172.21.15.122:0/1806997030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8d8005360 0x7fc8ec1f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1806997030 >> 172.21.15.122:0/1806997030 conn(0x7fc8ec08d450 msgr2=0x7fc8ec14bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:18.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1806997030 shutdown_connections 2024-09-17T06:04:18.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:18.976+0000 7fc8f47ed640 1 -- 172.21.15.122:0/1806997030 wait complete. 2024-09-17T06:04:19.001 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T06:04:19.001 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-17T06:04:19.001 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T06:04:19.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.156+0000 7fc17725b640 1 -- 172.21.15.122:0/3973518603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc158003a40 msgr2=0x7fc158003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:19.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.156+0000 7fc17725b640 1 --2- 172.21.15.122:0/3973518603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc158003a40 0x7fc158003eb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0016f0 tx=0x7fc16c01c7b0 comp rx=0 tx=0).stop 2024-09-17T06:04:19.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.156+0000 7fc1757f8640 1 -- 172.21.15.122:0/3973518603 reap_dead start 2024-09-17T06:04:19.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.156+0000 7fc17725b640 1 -- 172.21.15.122:0/3973518603 shutdown_connections 2024-09-17T06:04:19.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.156+0000 7fc17725b640 1 -- 172.21.15.122:0/3973518603 >> 172.21.15.122:0/3973518603 conn(0x7fc1700746d0 msgr2=0x7fc170074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:19.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.156+0000 7fc17725b640 1 -- 172.21.15.122:0/3973518603 shutdown_connections 2024-09-17T06:04:19.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.156+0000 7fc17725b640 1 -- 172.21.15.122:0/3973518603 wait complete. 2024-09-17T06:04:19.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc17725b640 1 Processor -- start 2024-09-17T06:04:19.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc17725b640 1 -- start start 2024-09-17T06:04:19.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc17725b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc158003a40 0x7fc170147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:19.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc17725b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1701e4ba0 0x7fc1701f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:19.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc17725b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc170149ec0 0x7fc1701f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:19.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc17725b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc17015d470 con 0x7fc1701e4ba0 2024-09-17T06:04:19.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc17725b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc17015c6a0 con 0x7fc158003a40 2024-09-17T06:04:19.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc17725b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc170153510 con 0x7fc170149ec0 2024-09-17T06:04:19.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc167fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1701e4ba0 0x7fc1701f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:19.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc167fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1701e4ba0 0x7fc1701f2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52682/0 (socket says 172.21.15.122:52682) 2024-09-17T06:04:19.162 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc167fff640 1 -- 172.21.15.122:0/2055919 learned_addr learned my addr 172.21.15.122:0/2055919 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc1757f8640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc170149ec0 0x7fc1701f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc174ff7640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc158003a40 0x7fc170147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc167fff640 1 -- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc170149ec0 msgr2=0x7fc1701f34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc167fff640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc170149ec0 0x7fc1701f34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc167fff640 1 -- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc158003a40 msgr2=0x7fc170147220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc167fff640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc158003a40 0x7fc170147220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc167fff640 1 -- 172.21.15.122:0/2055919 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1701e3fe0 con 0x7fc1701e4ba0 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc167fff640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1701e4ba0 0x7fc1701f2f90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc1600109e0 tx=0x7fc160010ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc1657fa640 1 -- 172.21.15.122:0/2055919 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16000ecb0 con 0x7fc1701e4ba0 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc1657fa640 1 -- 172.21.15.122:0/2055919 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc16000ee50 con 0x7fc1701e4ba0 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc17725b640 1 -- 172.21.15.122:0/2055919 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1701e25a0 con 0x7fc1701e4ba0 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc1657fa640 1 -- 172.21.15.122:0/2055919 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160005260 con 0x7fc1701e4ba0 2024-09-17T06:04:19.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc17725b640 1 -- 172.21.15.122:0/2055919 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1701e30b0 con 0x7fc1701e4ba0 2024-09-17T06:04:19.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.160+0000 7fc17725b640 1 -- 172.21.15.122:0/2055919 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1700723b0 con 0x7fc1701e4ba0 2024-09-17T06:04:19.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.164+0000 7fc1657fa640 1 -- 172.21.15.122:0/2055919 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc160005400 con 0x7fc1701e4ba0 2024-09-17T06:04:19.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.164+0000 7fc1657fa640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc15c073230 0x7fc15c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:19.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.164+0000 7fc1657fa640 1 -- 172.21.15.122:0/2055919 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc160095570 con 0x7fc1701e4ba0 2024-09-17T06:04:19.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.164+0000 7fc174ff7640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc15c073230 0x7fc15c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:19.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.164+0000 7fc174ff7640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc15c073230 0x7fc15c075740 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0016c0 tx=0x7fc16c0195a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:19.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.168+0000 7fc1657fa640 1 -- 172.21.15.122:0/2055919 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc160060450 con 0x7fc1701e4ba0 2024-09-17T06:04:19.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 -- 172.21.15.122:0/2055919 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc170150420 con 0x7fc1701e4ba0 2024-09-17T06:04:19.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc1657fa640 1 -- 172.21.15.122:0/2055919 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fc16005fd50 con 0x7fc1701e4ba0 2024-09-17T06:04:19.372 INFO:teuthology.orchestra.run.smithi122.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T06:04:19.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 -- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc15c073230 msgr2=0x7fc15c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:19.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc15c073230 0x7fc15c075740 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0016c0 tx=0x7fc16c0195a0 comp rx=0 tx=0).stop 2024-09-17T06:04:19.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 -- 172.21.15.122:0/2055919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1701e4ba0 msgr2=0x7fc1701f2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:19.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1701e4ba0 0x7fc1701f2f90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc1600109e0 tx=0x7fc160010ea0 comp rx=0 tx=0).stop 2024-09-17T06:04:19.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 -- 172.21.15.122:0/2055919 shutdown_connections 2024-09-17T06:04:19.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc170149ec0 0x7fc1701f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:19.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1701e4ba0 0x7fc1701f2f90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:19.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc15c073230 0x7fc15c075740 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:19.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 --2- 172.21.15.122:0/2055919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc158003a40 0x7fc170147220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:19.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 -- 172.21.15.122:0/2055919 >> 172.21.15.122:0/2055919 conn(0x7fc1700746d0 msgr2=0x7fc170159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:19.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 -- 172.21.15.122:0/2055919 shutdown_connections 2024-09-17T06:04:19.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19.372+0000 7fc17725b640 1 -- 172.21.15.122:0/2055919 wait complete. 2024-09-17T06:04:19.392 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T06:04:19.392 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T06:04:19.392 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2024-09-17T06:04:19.392 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-17T06:04:19.393 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-17T06:04:19.393 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T06:04:19.393 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T06:04:19.393 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T06:04:19.393 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-17T06:04:19.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:19.393 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2024-09-17T06:04:19.398 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T06:04:19.398 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f0 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f1 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2024-09-17T06:04:19.399 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T06:04:19.400 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42491sec preferred_lft 42491sec 2024-09-17T06:04:19.400 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::ec4:7aff:fe8f:d515/64 scope link 2024-09-17T06:04:19.400 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-09-17T06:04:19.400 INFO:teuthology.orchestra.run.smithi122.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T06:04:19.400 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 02:42:d7:61:66:b1 brd ff:ff:ff:ff:ff:ff 2024-09-17T06:04:19.400 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T06:04:19.400 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-09-17T06:04:19.401 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T06:04:19.401 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T06:04:19.401 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-17T06:04:19.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add name ceph-brx type bridge 2024-09-17T06:04:19.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip addr flush dev ceph-brx 2024-09-17T06:04:19.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set ceph-brx up 2024-09-17T06:04:19.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T06:04:19.401 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-17T06:04:19.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T06:04:19.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:19.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:19.524 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T06:04:19.576 INFO:teuthology.orchestra.run.smithi122.stdout:1 2024-09-17T06:04:19.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:19.577 DEBUG:teuthology.orchestra.run.smithi122:> route 2024-09-17T06:04:19.639 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2024-09-17T06:04:19.639 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T06:04:19.639 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T06:04:19.639 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T06:04:19.639 INFO:teuthology.orchestra.run.smithi122.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T06:04:19.639 INFO:teuthology.orchestra.run.smithi122.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T06:04:19.639 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T06:04:19.639 INFO:teuthology.orchestra.run.smithi122.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T06:04:19.639 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T06:04:19.639 INFO:teuthology.orchestra.run.smithi122.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T06:04:19.640 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T06:04:19.640 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T06:04:19.640 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-17T06:04:19.640 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T06:04:19.640 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T06:04:19.640 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T06:04:19.640 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-17T06:04:19.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T06:04:19.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:19.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:19.762 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-09-17T06:04:19.772 INFO:tasks.ceph.mds.d.smithi173.stderr:2024-09-17T06:04:19.772+0000 7f414901f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T06:04:19.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:19.813 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list-id 2024-09-17T06:04:19.860 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T06:04:19.860 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-17T06:04:19.860 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T06:04:19.860 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-17T06:04:19.860 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-17T06:04:19.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T06:04:19.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:19.977 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-17T06:04:19.977 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T06:04:19.978 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-17T06:04:19.978 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-17T06:04:19.978 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T06:04:19.978 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-17T06:04:19.978 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-17T06:04:19.978 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-17T06:04:19.978 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-17T06:04:20.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T06:04:20.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:20.082 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T06:04:20.082 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-17T06:04:20.083 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2024-09-17T06:04:20.083 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T06:04:20.083 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-17T06:04:20.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T06:04:20.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:20.184 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-17T06:04:20.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T06:04:20.185 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-17T06:04:20.233 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-17T06:04:20.234 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T06:04:20.234 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-17T06:04:20.282 DEBUG:teuthology.orchestra.run.smithi122:> sudo modprobe fuse 2024-09-17T06:04:20.334 DEBUG:teuthology.orchestra.run.smithi122:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T06:04:20.380 INFO:teuthology.orchestra.run.smithi122.stdout:/sys 2024-09-17T06:04:20.380 INFO:teuthology.orchestra.run.smithi122.stdout:/proc 2024-09-17T06:04:20.380 INFO:teuthology.orchestra.run.smithi122.stdout:/dev 2024-09-17T06:04:20.381 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/pts 2024-09-17T06:04:20.381 INFO:teuthology.orchestra.run.smithi122.stdout:/run 2024-09-17T06:04:20.381 INFO:teuthology.orchestra.run.smithi122.stdout:/ 2024-09-17T06:04:20.381 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/security 2024-09-17T06:04:20.381 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/shm 2024-09-17T06:04:20.381 INFO:teuthology.orchestra.run.smithi122.stdout:/run/lock 2024-09-17T06:04:20.381 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/cgroup 2024-09-17T06:04:20.381 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/pstore 2024-09-17T06:04:20.381 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/bpf 2024-09-17T06:04:20.381 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T06:04:20.381 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/hugepages 2024-09-17T06:04:20.381 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/mqueue 2024-09-17T06:04:20.382 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/debug 2024-09-17T06:04:20.382 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/tracing 2024-09-17T06:04:20.382 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/fs/nfsd 2024-09-17T06:04:20.382 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/fuse/connections 2024-09-17T06:04:20.382 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/config 2024-09-17T06:04:20.382 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-sysusers.service 2024-09-17T06:04:20.382 INFO:teuthology.orchestra.run.smithi122.stdout:/run/rpc_pipefs 2024-09-17T06:04:20.382 INFO:teuthology.orchestra.run.smithi122.stdout:/run/user/1000 2024-09-17T06:04:20.382 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph 2024-09-17T06:04:20.382 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T06:04:20.382 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T06:04:20.382 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T06:04:20.383 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T06:04:20.383 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns 2024-09-17T06:04:20.383 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T06:04:20.383 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T06:04:20.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:20.384 DEBUG:teuthology.orchestra.run.smithi122:> ls /sys/fs/fuse/connections 2024-09-17T06:04:20.432 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T06:04:20.432 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-17T06:04:20.477 DEBUG:teuthology.orchestra.run.smithi122:> sudo modprobe fuse 2024-09-17T06:04:20.491 DEBUG:teuthology.orchestra.run.smithi122:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T06:04:20.540 INFO:teuthology.orchestra.run.smithi122.stdout:/sys 2024-09-17T06:04:20.540 INFO:teuthology.orchestra.run.smithi122.stdout:/proc 2024-09-17T06:04:20.540 INFO:teuthology.orchestra.run.smithi122.stdout:/dev 2024-09-17T06:04:20.540 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/pts 2024-09-17T06:04:20.540 INFO:teuthology.orchestra.run.smithi122.stdout:/run 2024-09-17T06:04:20.540 INFO:teuthology.orchestra.run.smithi122.stdout:/ 2024-09-17T06:04:20.540 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/security 2024-09-17T06:04:20.540 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/shm 2024-09-17T06:04:20.540 INFO:teuthology.orchestra.run.smithi122.stdout:/run/lock 2024-09-17T06:04:20.540 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/cgroup 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/pstore 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/bpf 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/hugepages 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/mqueue 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/debug 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/tracing 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/fs/nfsd 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/fuse/connections 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/config 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-sysusers.service 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/run/rpc_pipefs 2024-09-17T06:04:20.541 INFO:teuthology.orchestra.run.smithi122.stdout:/run/user/1000 2024-09-17T06:04:20.542 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph 2024-09-17T06:04:20.542 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T06:04:20.542 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T06:04:20.542 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T06:04:20.542 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T06:04:20.542 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns 2024-09-17T06:04:20.542 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T06:04:20.542 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T06:04:20.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:20.543 DEBUG:teuthology.orchestra.run.smithi122:> ls /sys/fs/fuse/connections 2024-09-17T06:04:20.591 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi122.stderr:2024-09-17T06:04:20.588+0000 7f8e6e2ad580 -1 init, newargv = 0x5632ac970230 newargc=15 2024-09-17T06:04:20.591 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi122.stderr:ceph-fuse[35632]: starting ceph client 2024-09-17T06:04:20.601 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi122.stderr:ceph-fuse[35632]: starting fuse 2024-09-17T06:04:21.691 DEBUG:teuthology.orchestra.run.smithi122:> sudo modprobe fuse 2024-09-17T06:04:21.708 DEBUG:teuthology.orchestra.run.smithi122:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T06:04:21.758 INFO:teuthology.orchestra.run.smithi122.stdout:/sys 2024-09-17T06:04:21.758 INFO:teuthology.orchestra.run.smithi122.stdout:/proc 2024-09-17T06:04:21.758 INFO:teuthology.orchestra.run.smithi122.stdout:/dev 2024-09-17T06:04:21.758 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/pts 2024-09-17T06:04:21.758 INFO:teuthology.orchestra.run.smithi122.stdout:/run 2024-09-17T06:04:21.758 INFO:teuthology.orchestra.run.smithi122.stdout:/ 2024-09-17T06:04:21.758 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/security 2024-09-17T06:04:21.758 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/shm 2024-09-17T06:04:21.758 INFO:teuthology.orchestra.run.smithi122.stdout:/run/lock 2024-09-17T06:04:21.758 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/cgroup 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/pstore 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/bpf 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/hugepages 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/mqueue 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/debug 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/tracing 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/fs/nfsd 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/fuse/connections 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/config 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-sysusers.service 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/run/rpc_pipefs 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/run/user/1000 2024-09-17T06:04:21.759 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph 2024-09-17T06:04:21.760 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T06:04:21.760 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T06:04:21.760 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T06:04:21.760 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T06:04:21.760 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns 2024-09-17T06:04:21.760 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T06:04:21.760 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T06:04:21.760 INFO:teuthology.orchestra.run.smithi122.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-17T06:04:21.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:21.761 DEBUG:teuthology.orchestra.run.smithi122:> ls /sys/fs/fuse/connections 2024-09-17T06:04:21.807 INFO:teuthology.orchestra.run.smithi122.stdout:45 2024-09-17T06:04:21.808 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-17T06:04:21.808 DEBUG:teuthology.orchestra.run.smithi122:> sudo stdin-killer -- python3 -c ' 2024-09-17T06:04:21.808 DEBUG:teuthology.orchestra.run.smithi122:> import glob 2024-09-17T06:04:21.808 DEBUG:teuthology.orchestra.run.smithi122:> import re 2024-09-17T06:04:21.808 DEBUG:teuthology.orchestra.run.smithi122:> import os 2024-09-17T06:04:21.808 DEBUG:teuthology.orchestra.run.smithi122:> import subprocess 2024-09-17T06:04:21.808 DEBUG:teuthology.orchestra.run.smithi122:> 2024-09-17T06:04:21.808 DEBUG:teuthology.orchestra.run.smithi122:> def _find_admin_socket(client_name): 2024-09-17T06:04:21.808 DEBUG:teuthology.orchestra.run.smithi122:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-17T06:04:21.808 DEBUG:teuthology.orchestra.run.smithi122:> files = glob.glob(asok_path) 2024-09-17T06:04:21.808 DEBUG:teuthology.orchestra.run.smithi122:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-17T06:04:21.808 DEBUG:teuthology.orchestra.run.smithi122:> 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> # Given a non-glob path, it better be there 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> if "*" not in asok_path: 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> assert(len(files) == 1) 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> return files[0] 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> for f in files: 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> contents = proc_f.read() 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> if mountpoint in contents: 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> return f 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> 2024-09-17T06:04:21.809 DEBUG:teuthology.orchestra.run.smithi122:> print(_find_admin_socket("client.admin")) 2024-09-17T06:04:21.810 DEBUG:teuthology.orchestra.run.smithi122:> ' 2024-09-17T06:04:21.931 INFO:teuthology.orchestra.run.smithi122.stdout:/var/run/ceph/ceph-client.admin.35632.asok 2024-09-17T06:04:21.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:21.942 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.35632.asok 2024-09-17T06:04:21.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:21.942 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.35632.asok status 2024-09-17T06:04:22.117 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:04:22.117 INFO:teuthology.orchestra.run.smithi122.stdout: "metadata": { 2024-09-17T06:04:22.117 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_sha1": "ce1b342bf8c6349a8c90cd607f83bff2443f21cf", 2024-09-17T06:04:22.118 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_version": "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)", 2024-09-17T06:04:22.118 INFO:teuthology.orchestra.run.smithi122.stdout: "entity_id": "admin", 2024-09-17T06:04:22.118 INFO:teuthology.orchestra.run.smithi122.stdout: "hostname": "smithi122", 2024-09-17T06:04:22.118 INFO:teuthology.orchestra.run.smithi122.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-17T06:04:22.118 INFO:teuthology.orchestra.run.smithi122.stdout: "pid": "35632", 2024-09-17T06:04:22.118 INFO:teuthology.orchestra.run.smithi122.stdout: "root": "/" 2024-09-17T06:04:22.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:22.118 INFO:teuthology.orchestra.run.smithi122.stdout: "dentry_count": 0, 2024-09-17T06:04:22.118 INFO:teuthology.orchestra.run.smithi122.stdout: "dentry_pinned_count": 0, 2024-09-17T06:04:22.118 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4542, 2024-09-17T06:04:22.118 INFO:teuthology.orchestra.run.smithi122.stdout: "inst": { 2024-09-17T06:04:22.118 INFO:teuthology.orchestra.run.smithi122.stdout: "name": { 2024-09-17T06:04:22.119 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "client", 2024-09-17T06:04:22.119 INFO:teuthology.orchestra.run.smithi122.stdout: "num": 4542 2024-09-17T06:04:22.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:22.119 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": { 2024-09-17T06:04:22.119 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:22.119 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "192.168.0.1:0", 2024-09-17T06:04:22.119 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2184795174 2024-09-17T06:04:22.119 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:22.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:22.119 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": { 2024-09-17T06:04:22.119 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:22.119 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "192.168.0.1:0", 2024-09-17T06:04:22.120 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2184795174 2024-09-17T06:04:22.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:22.120 INFO:teuthology.orchestra.run.smithi122.stdout: "inst_str": "client.4542 192.168.0.1:0/2184795174", 2024-09-17T06:04:22.120 INFO:teuthology.orchestra.run.smithi122.stdout: "addr_str": "192.168.0.1:0/2184795174", 2024-09-17T06:04:22.120 INFO:teuthology.orchestra.run.smithi122.stdout: "inode_count": 1, 2024-09-17T06:04:22.120 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_epoch": 5, 2024-09-17T06:04:22.120 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_epoch": 26, 2024-09-17T06:04:22.120 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_epoch_barrier": 0, 2024-09-17T06:04:22.120 INFO:teuthology.orchestra.run.smithi122.stdout: "blocklisted": false, 2024-09-17T06:04:22.120 INFO:teuthology.orchestra.run.smithi122.stdout: "fs_name": "cephfs" 2024-09-17T06:04:22.120 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:04:22.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:22.133 DEBUG:teuthology.orchestra.run.smithi122:> stat --file-system '--printf=%T 2024-09-17T06:04:22.133 DEBUG:teuthology.orchestra.run.smithi122:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-17T06:04:22.139 INFO:teuthology.orchestra.run.smithi122.stdout:fuseblk 2024-09-17T06:04:22.140 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-17T06:04:22.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:22.140 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-17T06:04:22.196 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-17T06:04:22.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T06:04:22.326 INFO:teuthology.orchestra.run.smithi122.stdout:# file: . 2024-09-17T06:04:22.326 INFO:teuthology.orchestra.run.smithi122.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-17T06:04:22.326 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:22.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:22.334 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:04:22.334 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T06:04:22.339 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T06:04:22.542 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.540+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1126939318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e84003a10 msgr2=0x7f2e84003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:22.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.540+0000 7f2ea31ff640 1 --2- 172.21.15.122:0/1126939318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e84003a10 0x7f2e84003e80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c06e790 tx=0x7f2e9401cc60 comp rx=0 tx=0).stop 2024-09-17T06:04:22.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.540+0000 7f2ea179c640 1 -- 172.21.15.122:0/1126939318 reap_dead start 2024-09-17T06:04:22.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.540+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1126939318 shutdown_connections 2024-09-17T06:04:22.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.540+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1126939318 >> 172.21.15.122:0/1126939318 conn(0x7f2e9c073aa0 msgr2=0x7f2e9c0cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:22.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.540+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1126939318 shutdown_connections 2024-09-17T06:04:22.543 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.540+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1126939318 wait complete. 2024-09-17T06:04:22.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea31ff640 1 Processor -- start 2024-09-17T06:04:22.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea31ff640 1 -- start start 2024-09-17T06:04:22.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea31ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e84003a10 0x7f2e9c1588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:22.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea31ff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e9c1eff00 0x7f2e9c148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea31ff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c149640 0x7f2e9c14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea31ff640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9c159750 con 0x7f2e84003a10 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea31ff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9c159da0 con 0x7f2e9c149640 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea31ff640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f2e9c159a30 con 0x7f2e9c1eff00 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea0f9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e84003a10 0x7f2e9c1588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea0f9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e84003a10 0x7f2e9c1588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52700/0 (socket says 172.21.15.122:52700) 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea0f9b640 1 -- 172.21.15.122:0/1918060457 learned_addr learned my addr 172.21.15.122:0/1918060457 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea0f9b640 1 -- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e9c1eff00 msgr2=0x7f2e9c148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea0f9b640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e9c1eff00 0x7f2e9c148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea0f9b640 1 -- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c149640 msgr2=0x7f2e9c14bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea179c640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c149640 0x7f2e9c14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea0f9b640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c149640 0x7f2e9c14bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea0f9b640 1 -- 172.21.15.122:0/1918060457 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9c06f3e0 con 0x7f2e84003a10 2024-09-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea0f9b640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e84003a10 0x7f2e9c1588c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2e94001ec0 tx=0x7f2e940056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:22.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2e997fa640 1 -- 172.21.15.122:0/1918060457 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e940ab040 con 0x7f2e84003a10 2024-09-17T06:04:22.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2e997fa640 1 -- 172.21.15.122:0/1918060457 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e940be070 con 0x7f2e84003a10 2024-09-17T06:04:22.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2e997fa640 1 -- 172.21.15.122:0/1918060457 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94004a20 con 0x7f2e84003a10 2024-09-17T06:04:22.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1918060457 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9c158e00 con 0x7f2e84003a10 2024-09-17T06:04:22.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.544+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1918060457 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e9c157820 con 0x7f2e84003a10 2024-09-17T06:04:22.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.548+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1918060457 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e9c071f80 con 0x7f2e84003a10 2024-09-17T06:04:22.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.548+0000 7f2e997fa640 1 -- 172.21.15.122:0/1918060457 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2e940b6070 con 0x7f2e84003a10 2024-09-17T06:04:22.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.548+0000 7f2e997fa640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2e88073230 0x7f2e88075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:22.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.548+0000 7f2e997fa640 1 -- 172.21.15.122:0/1918060457 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2e9412f3b0 con 0x7f2e84003a10 2024-09-17T06:04:22.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.548+0000 7f2e9bfff640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2e88073230 0x7f2e88075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:22.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.548+0000 7f2e9bfff640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2e88073230 0x7f2e88075740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2e90001340 tx=0x7f2e90003980 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:22.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.552+0000 7f2e997fa640 1 -- 172.21.15.122:0/1918060457 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2e940a5e20 con 0x7f2e84003a10 2024-09-17T06:04:22.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.732+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1918060457 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2e9c149b90 con 0x7f2e84003a10 2024-09-17T06:04:22.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2e997fa640 1 -- 172.21.15.122:0/1918060457 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f2e94016970 con 0x7f2e84003a10 2024-09-17T06:04:22.735 INFO:teuthology.orchestra.run.smithi122.stderr:listed 0 entries 2024-09-17T06:04:22.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2e88073230 msgr2=0x7f2e88075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:22.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2ea31ff640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2e88073230 0x7f2e88075740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2e90001340 tx=0x7f2e90003980 comp rx=0 tx=0).stop 2024-09-17T06:04:22.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1918060457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e84003a10 msgr2=0x7f2e9c1588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:22.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2ea31ff640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e84003a10 0x7f2e9c1588c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2e94001ec0 tx=0x7f2e940056e0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1918060457 shutdown_connections 2024-09-17T06:04:22.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2ea31ff640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2e88073230 0x7f2e88075740 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2ea31ff640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e9c149640 0x7f2e9c14bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2ea31ff640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e9c1eff00 0x7f2e9c148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2ea31ff640 1 --2- 172.21.15.122:0/1918060457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e84003a10 0x7f2e9c1588c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1918060457 >> 172.21.15.122:0/1918060457 conn(0x7f2e9c073aa0 msgr2=0x7f2e9c06d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:22.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1918060457 shutdown_connections 2024-09-17T06:04:22.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.736+0000 7f2ea31ff640 1 -- 172.21.15.122:0/1918060457 wait complete. 2024-09-17T06:04:22.757 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:04:22.757 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T06:04:22.763 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T06:04:22.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.951+0000 7f6aee29f640 1 -- 172.21.15.122:0/1413552965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ae806f830 msgr2=0x7f6ae815c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:22.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.951+0000 7f6aee29f640 1 --2- 172.21.15.122:0/1413552965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ae806f830 0x7f6ae815c6e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80b39b0 tx=0x7f6ad001c8c0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.951+0000 7f6aee29f640 1 -- 172.21.15.122:0/1413552965 shutdown_connections 2024-09-17T06:04:22.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.951+0000 7f6aee29f640 1 --2- 172.21.15.122:0/1413552965 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ae815cc20 0x7f6ae815d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.951+0000 7f6aee29f640 1 --2- 172.21.15.122:0/1413552965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ae806f830 0x7f6ae815c6e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.951+0000 7f6aee29f640 1 --2- 172.21.15.122:0/1413552965 >> v2:172.21.15.173:3300/0 conn(0x7f6ae814f9d0 0x7f6ae806f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.951+0000 7f6aee29f640 1 -- 172.21.15.122:0/1413552965 >> 172.21.15.122:0/1413552965 conn(0x7f6ae8073750 msgr2=0x7f6ae80cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:22.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.951+0000 7f6aee29f640 1 -- 172.21.15.122:0/1413552965 shutdown_connections 2024-09-17T06:04:22.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.951+0000 7f6aee29f640 1 -- 172.21.15.122:0/1413552965 wait complete. 2024-09-17T06:04:22.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.951+0000 7f6aee29f640 1 Processor -- start 2024-09-17T06:04:22.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.951+0000 7f6aee29f640 1 -- start start 2024-09-17T06:04:22.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6aee29f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ae806f830 0x7f6ae80c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6aee29f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ae814f9d0 0x7f6ae8149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6aee29f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ae815cc20 0x7f6ae814a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6aee29f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae814fde0 con 0x7f6ae806f830 2024-09-17T06:04:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6aee29f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae80b3be0 con 0x7f6ae814f9d0 2024-09-17T06:04:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6aee29f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae814ff60 con 0x7f6ae815cc20 2024-09-17T06:04:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ae806f830 0x7f6ae80c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ae806f830 0x7f6ae80c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52726/0 (socket says 172.21.15.122:52726) 2024-09-17T06:04:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae7fff640 1 -- 172.21.15.122:0/4085002032 learned_addr learned my addr 172.21.15.122:0/4085002032 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae77fe640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ae814f9d0 0x7f6ae8149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae7fff640 1 -- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ae815cc20 msgr2=0x7f6ae814a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae7fff640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ae815cc20 0x7f6ae814a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae7fff640 1 -- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ae814f9d0 msgr2=0x7f6ae8149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae7fff640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ae814f9d0 0x7f6ae8149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae7fff640 1 -- 172.21.15.122:0/4085002032 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae8156e00 con 0x7f6ae806f830 2024-09-17T06:04:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae77fe640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ae814f9d0 0x7f6ae8149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae7fff640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ae806f830 0x7f6ae80c7920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000cce0 tx=0x7f6ae000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae4ff9640 1 -- 172.21.15.122:0/4085002032 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000f450 con 0x7f6ae806f830 2024-09-17T06:04:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae4ff9640 1 -- 172.21.15.122:0/4085002032 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ae000f6e0 con 0x7f6ae806f830 2024-09-17T06:04:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6aee29f640 1 -- 172.21.15.122:0/4085002032 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae81584c0 con 0x7f6ae806f830 2024-09-17T06:04:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae4ff9640 1 -- 172.21.15.122:0/4085002032 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000fb10 con 0x7f6ae806f830 2024-09-17T06:04:22.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6aee29f640 1 -- 172.21.15.122:0/4085002032 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae81f5f60 con 0x7f6ae806f830 2024-09-17T06:04:22.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6aee29f640 1 -- 172.21.15.122:0/4085002032 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae806d720 con 0x7f6ae806f830 2024-09-17T06:04:22.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.955+0000 7f6ae4ff9640 1 -- 172.21.15.122:0/4085002032 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6ae000fcb0 con 0x7f6ae806f830 2024-09-17T06:04:22.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.959+0000 7f6ae4ff9640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6ac8073200 0x7f6ac8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:22.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.959+0000 7f6ae4ff9640 1 -- 172.21.15.122:0/4085002032 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6ae00950d0 con 0x7f6ae806f830 2024-09-17T06:04:22.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.959+0000 7f6ae77fe640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6ac8073200 0x7f6ac8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:22.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.959+0000 7f6ae77fe640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6ac8073200 0x7f6ac8075710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00ae000 tx=0x7f6ad0019660 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:22.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:22.963+0000 7f6ae4ff9640 1 -- 172.21.15.122:0/4085002032 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6ae0014030 con 0x7f6ae806f830 2024-09-17T06:04:23.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.147+0000 7f6aee29f640 1 -- 172.21.15.122:0/4085002032 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6ae80c9be0 con 0x7f6ae806f830 2024-09-17T06:04:23.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.147+0000 7f6ae4ff9640 1 -- 172.21.15.122:0/4085002032 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f6ae005fe40 con 0x7f6ae806f830 2024-09-17T06:04:23.148 INFO:teuthology.orchestra.run.smithi122.stderr:listed 0 entries 2024-09-17T06:04:23.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.147+0000 7f6aee29f640 1 -- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6ac8073200 msgr2=0x7f6ac8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:23.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.147+0000 7f6aee29f640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6ac8073200 0x7f6ac8075710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00ae000 tx=0x7f6ad0019660 comp rx=0 tx=0).stop 2024-09-17T06:04:23.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.147+0000 7f6aee29f640 1 -- 172.21.15.122:0/4085002032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ae806f830 msgr2=0x7f6ae80c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:23.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.147+0000 7f6aee29f640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ae806f830 0x7f6ae80c7920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000cce0 tx=0x7f6ae000a620 comp rx=0 tx=0).stop 2024-09-17T06:04:23.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.147+0000 7f6aee29f640 1 -- 172.21.15.122:0/4085002032 shutdown_connections 2024-09-17T06:04:23.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.147+0000 7f6aee29f640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ae815cc20 0x7f6ae814a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:23.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.147+0000 7f6aee29f640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6ac8073200 0x7f6ac8075710 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:23.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.147+0000 7f6aee29f640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ae814f9d0 0x7f6ae8149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:23.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.147+0000 7f6aee29f640 1 --2- 172.21.15.122:0/4085002032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ae806f830 0x7f6ae80c7920 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:23.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.151+0000 7f6aee29f640 1 -- 172.21.15.122:0/4085002032 >> 172.21.15.122:0/4085002032 conn(0x7f6ae8073750 msgr2=0x7f6ae814eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:23.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.151+0000 7f6aee29f640 1 -- 172.21.15.122:0/4085002032 shutdown_connections 2024-09-17T06:04:23.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:23.151+0000 7f6aee29f640 1 -- 172.21.15.122:0/4085002032 wait complete. 2024-09-17T06:04:23.170 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi122.front.sepia.ceph.com... 2024-09-17T06:04:23.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:23.170 DEBUG:teuthology.orchestra.run.smithi122:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-17T06:04:23.187 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi122.stderr:ceph-fuse[35632]: fuse finished with error 0 and tester_r 0 2024-09-17T06:04:23.189 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:04:29.290 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T06:04:29.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:29.291 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-17T06:04:29.308 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:04:29.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.511+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/1972638380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2a00c9a80 msgr2=0x7fc2a00c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:29.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.511+0000 7fc2a6f7e640 1 --2- 172.21.15.122:0/1972638380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2a00c9a80 0x7fc2a00c9e90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc288009840 tx=0x7fc28801c820 comp rx=0 tx=0).stop 2024-09-17T06:04:29.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.511+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/1972638380 shutdown_connections 2024-09-17T06:04:29.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.511+0000 7fc2a6f7e640 1 --2- 172.21.15.122:0/1972638380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2a00c9a80 0x7fc2a00c9e90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:29.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.511+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/1972638380 >> 172.21.15.122:0/1972638380 conn(0x7fc2a0070c10 msgr2=0x7fc2a0072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:29.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.511+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/1972638380 shutdown_connections 2024-09-17T06:04:29.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.511+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/1972638380 wait complete. 2024-09-17T06:04:29.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a6f7e640 1 Processor -- start 2024-09-17T06:04:29.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a6f7e640 1 -- start start 2024-09-17T06:04:29.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a6f7e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2a00c9a80 0x7fc2a0157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:29.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a6f7e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2a0155480 0x7fc2a0150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:29.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a6f7e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2a0163cd0 0x7fc2a0149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:29.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a6f7e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a015b590 con 0x7fc2a0155480 2024-09-17T06:04:29.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a6f7e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a00b25f0 con 0x7fc2a00c9a80 2024-09-17T06:04:29.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a6f7e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc2a015c130 con 0x7fc2a0163cd0 2024-09-17T06:04:29.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc29ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2a0155480 0x7fc2a0150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:29.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc29ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2a0155480 0x7fc2a0150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35784/0 (socket says 172.21.15.122:35784) 2024-09-17T06:04:29.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc29ffff640 1 -- 172.21.15.122:0/821476588 learned_addr learned my addr 172.21.15.122:0/821476588 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:29.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a4d1a640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2a00c9a80 0x7fc2a0157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:29.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a551b640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2a0163cd0 0x7fc2a0149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:29.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc29ffff640 1 -- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2a0163cd0 msgr2=0x7fc2a0149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:29.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc29ffff640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2a0163cd0 0x7fc2a0149910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:29.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc29ffff640 1 -- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2a00c9a80 msgr2=0x7fc2a0157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:29.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc29ffff640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2a00c9a80 0x7fc2a0157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:29.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc29ffff640 1 -- 172.21.15.122:0/821476588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a00cb090 con 0x7fc2a0155480 2024-09-17T06:04:29.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a4d1a640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2a00c9a80 0x7fc2a0157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:29.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a551b640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2a0163cd0 0x7fc2a0149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:29.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc29ffff640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2a0155480 0x7fc2a0150db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc2880b0040 tx=0x7fc2880a65a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:29.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc29d7fa640 1 -- 172.21.15.122:0/821476588 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288004040 con 0x7fc2a0155480 2024-09-17T06:04:29.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc29d7fa640 1 -- 172.21.15.122:0/821476588 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2880042d0 con 0x7fc2a0155480 2024-09-17T06:04:29.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/821476588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a00cb370 con 0x7fc2a0155480 2024-09-17T06:04:29.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.515+0000 7fc29d7fa640 1 -- 172.21.15.122:0/821476588 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288005050 con 0x7fc2a0155480 2024-09-17T06:04:29.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.519+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/821476588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a0157330 con 0x7fc2a0155480 2024-09-17T06:04:29.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.519+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/821476588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a006f140 con 0x7fc2a0155480 2024-09-17T06:04:29.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.519+0000 7fc29d7fa640 1 -- 172.21.15.122:0/821476588 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc2880c0030 con 0x7fc2a0155480 2024-09-17T06:04:29.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.519+0000 7fc29d7fa640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc280073200 0x7fc280075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:29.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.519+0000 7fc29d7fa640 1 -- 172.21.15.122:0/821476588 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc28812ea40 con 0x7fc2a0155480 2024-09-17T06:04:29.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.519+0000 7fc2a4d1a640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc280073200 0x7fc280075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:29.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.519+0000 7fc2a4d1a640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc280073200 0x7fc280075710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc298007fd0 tx=0x7fc298009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:29.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.523+0000 7fc29d7fa640 1 -- 172.21.15.122:0/821476588 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc2880c7060 con 0x7fc2a0155480 2024-09-17T06:04:29.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.695+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/821476588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2a0155890 con 0x7fc2a0155480 2024-09-17T06:04:29.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc29d7fa640 1 -- 172.21.15.122:0/821476588 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7fc288016410 con 0x7fc2a0155480 2024-09-17T06:04:29.701 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:29.701 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":26,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:04:13.331438+0000","last_up_change":"2024-09-17T06:03:56.580331+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6811","nonce":920798795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6813","nonce":920798795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6817","nonce":920798795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6815","nonce":920798795}]},"public_addr":"172.21.15.173:6811/920798795","cluster_addr":"172.21.15.173:6813/920798795","heartbeat_back_addr":"172.21.15.173:6817/920798795","heartbeat_front_addr":"172.21.15.173:6815/920798795","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:04:29.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc280073200 msgr2=0x7fc280075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:29.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc2a6f7e640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc280073200 0x7fc280075710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc298007fd0 tx=0x7fc298009040 comp rx=0 tx=0).stop 2024-09-17T06:04:29.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/821476588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2a0155480 msgr2=0x7fc2a0150db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:29.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc2a6f7e640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2a0155480 0x7fc2a0150db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc2880b0040 tx=0x7fc2880a65a0 comp rx=0 tx=0).stop 2024-09-17T06:04:29.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/821476588 shutdown_connections 2024-09-17T06:04:29.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc2a6f7e640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc2a0163cd0 0x7fc2a0149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:29.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc2a6f7e640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2a0155480 0x7fc2a0150db0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:29.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc2a6f7e640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc280073200 0x7fc280075710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:29.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc2a6f7e640 1 --2- 172.21.15.122:0/821476588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2a00c9a80 0x7fc2a0157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:29.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/821476588 >> 172.21.15.122:0/821476588 conn(0x7fc2a0070c10 msgr2=0x7fc2a01519e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:29.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/821476588 shutdown_connections 2024-09-17T06:04:29.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.699+0000 7fc2a6f7e640 1 -- 172.21.15.122:0/821476588 wait complete. 2024-09-17T06:04:29.723 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:04:29.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.871+0000 7ff8f8362640 1 -- 172.21.15.122:0/604167720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f015ab10 msgr2=0x7ff8f015af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:29.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.871+0000 7ff8f8362640 1 --2- 172.21.15.122:0/604167720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f015ab10 0x7ff8f015af20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff8f006a130 tx=0x7ff8e801f370 comp rx=0 tx=0).stop 2024-09-17T06:04:29.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.871+0000 7ff8f8362640 1 -- 172.21.15.122:0/604167720 shutdown_connections 2024-09-17T06:04:29.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.871+0000 7ff8f8362640 1 --2- 172.21.15.122:0/604167720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f015ab10 0x7ff8f015af20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:29.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.871+0000 7ff8f8362640 1 --2- 172.21.15.122:0/604167720 >> v2:172.21.15.173:3300/0 conn(0x7ff8f00c6780 0x7ff8f0159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:29.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.871+0000 7ff8f8362640 1 -- 172.21.15.122:0/604167720 >> 172.21.15.122:0/604167720 conn(0x7ff8f00746d0 msgr2=0x7ff8f0074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:29.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.871+0000 7ff8f8362640 1 -- 172.21.15.122:0/604167720 shutdown_connections 2024-09-17T06:04:29.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.871+0000 7ff8f8362640 1 -- 172.21.15.122:0/604167720 wait complete. 2024-09-17T06:04:29.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f8362640 1 Processor -- start 2024-09-17T06:04:29.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f8362640 1 -- start start 2024-09-17T06:04:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f8362640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f00c6780 0x7ff8f014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f8362640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8f0152f90 0x7ff8f00cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f8362640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8f015ab10 0x7ff8f01e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f8362640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f015b460 con 0x7ff8f00c6780 2024-09-17T06:04:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f8362640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f015d280 con 0x7ff8f0152f90 2024-09-17T06:04:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f8362640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f015c6c0 con 0x7ff8f015ab10 2024-09-17T06:04:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f60fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f00c6780 0x7ff8f014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f60fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f00c6780 0x7ff8f014d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35806/0 (socket says 172.21.15.122:35806) 2024-09-17T06:04:29.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f60fe640 1 -- 172.21.15.122:0/1997139874 learned_addr learned my addr 172.21.15.122:0/1997139874 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f58fd640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8f0152f90 0x7ff8f00cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f68ff640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8f015ab10 0x7ff8f01e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f60fe640 1 -- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8f015ab10 msgr2=0x7ff8f01e47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f60fe640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8f015ab10 0x7ff8f01e47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f60fe640 1 -- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8f0152f90 msgr2=0x7ff8f00cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f60fe640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8f0152f90 0x7ff8f00cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f60fe640 1 -- 172.21.15.122:0/1997139874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f00cb150 con 0x7ff8f00c6780 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f58fd640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8f0152f90 0x7ff8f00cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f60fe640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f00c6780 0x7ff8f014d7e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00d780 tx=0x7ff8ec00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8e6ffd640 1 -- 172.21.15.122:0/1997139874 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec017070 con 0x7ff8f00c6780 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8e6ffd640 1 -- 172.21.15.122:0/1997139874 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8ec00de90 con 0x7ff8f00c6780 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f8362640 1 -- 172.21.15.122:0/1997139874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f00ca730 con 0x7ff8f00c6780 2024-09-17T06:04:29.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8e6ffd640 1 -- 172.21.15.122:0/1997139874 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec004020 con 0x7ff8f00c6780 2024-09-17T06:04:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.875+0000 7ff8f8362640 1 -- 172.21.15.122:0/1997139874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f00cd1d0 con 0x7ff8f00c6780 2024-09-17T06:04:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.879+0000 7ff8f8362640 1 -- 172.21.15.122:0/1997139874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f01533a0 con 0x7ff8f00c6780 2024-09-17T06:04:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.879+0000 7ff8e6ffd640 1 -- 172.21.15.122:0/1997139874 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff8ec0041c0 con 0x7ff8f00c6780 2024-09-17T06:04:29.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.879+0000 7ff8e6ffd640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff8d4073200 0x7ff8d4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:29.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.879+0000 7ff8e6ffd640 1 -- 172.21.15.122:0/1997139874 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff8ec094980 con 0x7ff8f00c6780 2024-09-17T06:04:29.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.879+0000 7ff8f58fd640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff8d4073200 0x7ff8d4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:29.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.879+0000 7ff8f58fd640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff8d4073200 0x7ff8d4075710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00c2e10 tx=0x7ff8e0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:29.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:29.883+0000 7ff8e6ffd640 1 -- 172.21.15.122:0/1997139874 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff8ec020020 con 0x7ff8f00c6780 2024-09-17T06:04:30.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.051+0000 7ff8f8362640 1 -- 172.21.15.122:0/1997139874 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8f00c3630 con 0x7ff8f00c6780 2024-09-17T06:04:30.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8e6ffd640 1 -- 172.21.15.122:0/1997139874 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7ff8ec05f660 con 0x7ff8f00c6780 2024-09-17T06:04:30.056 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:30.056 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":26,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:04:13.331438+0000","last_up_change":"2024-09-17T06:03:56.580331+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6811","nonce":920798795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6813","nonce":920798795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6817","nonce":920798795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6815","nonce":920798795}]},"public_addr":"172.21.15.173:6811/920798795","cluster_addr":"172.21.15.173:6813/920798795","heartbeat_back_addr":"172.21.15.173:6817/920798795","heartbeat_front_addr":"172.21.15.173:6815/920798795","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:04:30.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8f8362640 1 -- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff8d4073200 msgr2=0x7ff8d4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:30.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8f8362640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff8d4073200 0x7ff8d4075710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00c2e10 tx=0x7ff8e0009040 comp rx=0 tx=0).stop 2024-09-17T06:04:30.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8f8362640 1 -- 172.21.15.122:0/1997139874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f00c6780 msgr2=0x7ff8f014d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:30.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8f8362640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f00c6780 0x7ff8f014d7e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00d780 tx=0x7ff8ec00dc40 comp rx=0 tx=0).stop 2024-09-17T06:04:30.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8f8362640 1 -- 172.21.15.122:0/1997139874 shutdown_connections 2024-09-17T06:04:30.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8f8362640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff8f015ab10 0x7ff8f01e47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8f8362640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff8d4073200 0x7ff8d4075710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8f8362640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8f0152f90 0x7ff8f00cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8f8362640 1 --2- 172.21.15.122:0/1997139874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f00c6780 0x7ff8f014d7e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8f8362640 1 -- 172.21.15.122:0/1997139874 >> 172.21.15.122:0/1997139874 conn(0x7ff8f00746d0 msgr2=0x7ff8f01539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:30.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8f8362640 1 -- 172.21.15.122:0/1997139874 shutdown_connections 2024-09-17T06:04:30.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.055+0000 7ff8f8362640 1 -- 172.21.15.122:0/1997139874 wait complete. 2024-09-17T06:04:30.077 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T06:04:30.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.219+0000 7f981f3e8640 1 -- 172.21.15.122:0/1383339633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9804003a60 msgr2=0x7f9804003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:30.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.219+0000 7f981f3e8640 1 --2- 172.21.15.122:0/1383339633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9804003a60 0x7f9804003ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f981400bb10 tx=0x7f981401cda0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.219+0000 7f981f3e8640 1 -- 172.21.15.122:0/1383339633 shutdown_connections 2024-09-17T06:04:30.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.219+0000 7f981f3e8640 1 --2- 172.21.15.122:0/1383339633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9804003a60 0x7f9804003ed0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.219+0000 7f981f3e8640 1 -- 172.21.15.122:0/1383339633 >> 172.21.15.122:0/1383339633 conn(0x7f981808ccd0 msgr2=0x7f981808d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:30.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.219+0000 7f981f3e8640 1 -- 172.21.15.122:0/1383339633 shutdown_connections 2024-09-17T06:04:30.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.219+0000 7f981f3e8640 1 -- 172.21.15.122:0/1383339633 wait complete. 2024-09-17T06:04:30.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.219+0000 7f981f3e8640 1 Processor -- start 2024-09-17T06:04:30.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.219+0000 7f981f3e8640 1 -- start start 2024-09-17T06:04:30.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981f3e8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9804003a60 0x7f98180d0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:30.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981f3e8640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9818144fc0 0x7f98181f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:30.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981f3e8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9818154440 0x7f98181e50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:30.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981f3e8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98180b4910 con 0x7f9818154440 2024-09-17T06:04:30.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981f3e8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f98180c5ea0 con 0x7f9804003a60 2024-09-17T06:04:30.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981f3e8640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f98180c5a60 con 0x7f9818144fc0 2024-09-17T06:04:30.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981d985640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9818154440 0x7f98181e50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:30.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981d985640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9818154440 0x7f98181e50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35820/0 (socket says 172.21.15.122:35820) 2024-09-17T06:04:30.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981d985640 1 -- 172.21.15.122:0/3263422475 learned_addr learned my addr 172.21.15.122:0/3263422475 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:30.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981d184640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9804003a60 0x7f98180d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:30.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981c983640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9818144fc0 0x7f98181f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:30.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981d985640 1 -- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9818144fc0 msgr2=0x7f98181f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:30.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981d985640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9818144fc0 0x7f98181f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981d985640 1 -- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9804003a60 msgr2=0x7f98180d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:30.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981d985640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9804003a60 0x7f98180d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981d985640 1 -- 172.21.15.122:0/3263422475 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98181f5330 con 0x7f9818154440 2024-09-17T06:04:30.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981d985640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9818154440 0x7f98181e50c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f98040057f0 tx=0x7f981000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:30.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f980dffb640 1 -- 172.21.15.122:0/3263422475 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810017070 con 0x7f9818154440 2024-09-17T06:04:30.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f980dffb640 1 -- 172.21.15.122:0/3263422475 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9810006e50 con 0x7f9818154440 2024-09-17T06:04:30.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f980dffb640 1 -- 172.21.15.122:0/3263422475 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810003be0 con 0x7f9818154440 2024-09-17T06:04:30.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981f3e8640 1 -- 172.21.15.122:0/3263422475 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9818149550 con 0x7f9818154440 2024-09-17T06:04:30.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981f3e8640 1 -- 172.21.15.122:0/3263422475 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98181f20a0 con 0x7f9818154440 2024-09-17T06:04:30.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.223+0000 7f981f3e8640 1 -- 172.21.15.122:0/3263422475 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981815b270 con 0x7f9818154440 2024-09-17T06:04:30.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.227+0000 7f980dffb640 1 -- 172.21.15.122:0/3263422475 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9810005080 con 0x7f9818154440 2024-09-17T06:04:30.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.227+0000 7f980dffb640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f97fc073200 0x7f97fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:30.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.227+0000 7f980dffb640 1 -- 172.21.15.122:0/3263422475 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f98100938f0 con 0x7f9818154440 2024-09-17T06:04:30.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.227+0000 7f981d184640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f97fc073200 0x7f97fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:30.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.227+0000 7f981d184640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f97fc073200 0x7f97fc075710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98140b0000 tx=0x7f9814019b40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:30.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.231+0000 7f980dffb640 1 -- 172.21.15.122:0/3263422475 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f981005e5d0 con 0x7f9818154440 2024-09-17T06:04:30.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.435+0000 7f981f3e8640 1 -- 172.21.15.122:0/3263422475 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9818150d30 con 0x7f9818154440 2024-09-17T06:04:30.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.619+0000 7f980dffb640 1 -- 172.21.15.122:0/3263422475 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f981005ded0 con 0x7f9818154440 2024-09-17T06:04:30.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.623+0000 7f981f3e8640 1 -- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f97fc073200 msgr2=0x7f97fc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:30.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.623+0000 7f981f3e8640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f97fc073200 0x7f97fc075710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98140b0000 tx=0x7f9814019b40 comp rx=0 tx=0).stop 2024-09-17T06:04:30.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.623+0000 7f981f3e8640 1 -- 172.21.15.122:0/3263422475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9818154440 msgr2=0x7f98181e50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:30.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.623+0000 7f981f3e8640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9818154440 0x7f98181e50c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f98040057f0 tx=0x7f981000cb90 comp rx=0 tx=0).stop 2024-09-17T06:04:30.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.623+0000 7f981f3e8640 1 -- 172.21.15.122:0/3263422475 shutdown_connections 2024-09-17T06:04:30.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.623+0000 7f981f3e8640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9818154440 0x7f98181e50c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.623+0000 7f981f3e8640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9818144fc0 0x7f98181f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.623+0000 7f981f3e8640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f97fc073200 0x7f97fc075710 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.623+0000 7f981f3e8640 1 --2- 172.21.15.122:0/3263422475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9804003a60 0x7f98180d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.623+0000 7f981f3e8640 1 -- 172.21.15.122:0/3263422475 >> 172.21.15.122:0/3263422475 conn(0x7f981808ccd0 msgr2=0x7f9818158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:30.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.623+0000 7f981f3e8640 1 -- 172.21.15.122:0/3263422475 shutdown_connections 2024-09-17T06:04:30.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.623+0000 7f981f3e8640 1 -- 172.21.15.122:0/3263422475 wait complete. 2024-09-17T06:04:30.648 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300} 2024-09-17T06:04:30.648 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T06:04:30.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.803+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3908439166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc70004d50 msgr2=0x7fcc70005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:30.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.803+0000 7fcc8b5ff640 1 --2- 172.21.15.122:0/3908439166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc70004d50 0x7fcc70005200 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc84158900 tx=0x7fcc7c01caf0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.803+0000 7fcc89b9c640 1 -- 172.21.15.122:0/3908439166 reap_dead start 2024-09-17T06:04:30.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.803+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3908439166 shutdown_connections 2024-09-17T06:04:30.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.803+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3908439166 >> 172.21.15.122:0/3908439166 conn(0x7fcc840746d0 msgr2=0x7fcc84074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:30.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.803+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3908439166 shutdown_connections 2024-09-17T06:04:30.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.803+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3908439166 wait complete. 2024-09-17T06:04:30.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc8b5ff640 1 Processor -- start 2024-09-17T06:04:30.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc8b5ff640 1 -- start start 2024-09-17T06:04:30.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc8b5ff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc70004d50 0x7fcc84150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:30.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc8b5ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc8414bc20 0x7fcc841544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:30.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc8b5ff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc84151190 0x7fcc8414b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:30.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc8b5ff640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcc84157ea0 con 0x7fcc8414bc20 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc8b5ff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcc840c99e0 con 0x7fcc84151190 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc8b5ff640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fcc840c7df0 con 0x7fcc70004d50 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc88b9a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc8414bc20 0x7fcc841544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc88b9a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc8414bc20 0x7fcc841544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35838/0 (socket says 172.21.15.122:35838) 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc88b9a640 1 -- 172.21.15.122:0/3756085781 learned_addr learned my addr 172.21.15.122:0/3756085781 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc8939b640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc70004d50 0x7fcc84150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc89b9c640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc84151190 0x7fcc8414b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc88b9a640 1 -- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc70004d50 msgr2=0x7fcc84150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc88b9a640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc70004d50 0x7fcc84150830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc88b9a640 1 -- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc84151190 msgr2=0x7fcc8414b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc88b9a640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc84151190 0x7fcc8414b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc88b9a640 1 -- 172.21.15.122:0/3756085781 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8414c120 con 0x7fcc8414bc20 2024-09-17T06:04:30.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc88b9a640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc8414bc20 0x7fcc841544b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400e9e0 tx=0x7fcc7400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:30.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc79ffb640 1 -- 172.21.15.122:0/3756085781 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7401c070 con 0x7fcc8414bc20 2024-09-17T06:04:30.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc79ffb640 1 -- 172.21.15.122:0/3756085781 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc7400cb90 con 0x7fcc8414bc20 2024-09-17T06:04:30.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc79ffb640 1 -- 172.21.15.122:0/3756085781 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74017410 con 0x7fcc8414bc20 2024-09-17T06:04:30.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3756085781 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc84153530 con 0x7fcc8414bc20 2024-09-17T06:04:30.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.807+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3756085781 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc84153af0 con 0x7fcc8414bc20 2024-09-17T06:04:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.811+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3756085781 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc840c75b0 con 0x7fcc8414bc20 2024-09-17T06:04:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.811+0000 7fcc79ffb640 1 -- 172.21.15.122:0/3756085781 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcc7401f070 con 0x7fcc8414bc20 2024-09-17T06:04:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.811+0000 7fcc79ffb640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcc68073200 0x7fcc68075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.811+0000 7fcc79ffb640 1 -- 172.21.15.122:0/3756085781 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcc74094700 con 0x7fcc8414bc20 2024-09-17T06:04:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.811+0000 7fcc8939b640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcc68073200 0x7fcc68075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:30.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.811+0000 7fcc8939b640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcc68073200 0x7fcc68075710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcc80001ec0 tx=0x7fcc80000ee0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:30.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:30.815+0000 7fcc79ffb640 1 -- 172.21.15.122:0/3756085781 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fcc7405eda0 con 0x7fcc8414bc20 2024-09-17T06:04:31.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.023+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3756085781 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcc841e2390 con 0x7fcc8414bc20 2024-09-17T06:04:31.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.631+0000 7fcc79ffb640 1 -- 172.21.15.122:0/3756085781 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fcc740637d0 con 0x7fcc8414bc20 2024-09-17T06:04:31.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.635+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcc68073200 msgr2=0x7fcc68075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:31.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.635+0000 7fcc8b5ff640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcc68073200 0x7fcc68075710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcc80001ec0 tx=0x7fcc80000ee0 comp rx=0 tx=0).stop 2024-09-17T06:04:31.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.635+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3756085781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc8414bc20 msgr2=0x7fcc841544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:31.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.635+0000 7fcc8b5ff640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc8414bc20 0x7fcc841544b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400e9e0 tx=0x7fcc7400eea0 comp rx=0 tx=0).stop 2024-09-17T06:04:31.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.635+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3756085781 shutdown_connections 2024-09-17T06:04:31.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.635+0000 7fcc8b5ff640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcc68073200 0x7fcc68075710 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:31.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.635+0000 7fcc8b5ff640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc84151190 0x7fcc8414b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:31.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.635+0000 7fcc8b5ff640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc8414bc20 0x7fcc841544b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:31.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.635+0000 7fcc8b5ff640 1 --2- 172.21.15.122:0/3756085781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcc70004d50 0x7fcc84150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:31.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.635+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3756085781 >> 172.21.15.122:0/3756085781 conn(0x7fcc840746d0 msgr2=0x7fcc8414d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:31.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.635+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3756085781 shutdown_connections 2024-09-17T06:04:31.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.635+0000 7fcc8b5ff640 1 -- 172.21.15.122:0/3756085781 wait complete. 2024-09-17T06:04:31.661 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-17T06:04:31.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.819+0000 7f7949a0e640 1 -- 172.21.15.122:0/2217918249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79440cbb40 msgr2=0x7f794415b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:31.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.819+0000 7f7949a0e640 1 --2- 172.21.15.122:0/2217918249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79440cbb40 0x7f794415b470 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f794408da00 tx=0x7f793401ccf0 comp rx=0 tx=0).stop 2024-09-17T06:04:31.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.819+0000 7f7949a0e640 1 -- 172.21.15.122:0/2217918249 shutdown_connections 2024-09-17T06:04:31.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.819+0000 7f7949a0e640 1 --2- 172.21.15.122:0/2217918249 >> v2:172.21.15.173:3300/0 conn(0x7f794406dab0 0x7f79440cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:31.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.819+0000 7f7949a0e640 1 --2- 172.21.15.122:0/2217918249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79440cbb40 0x7f794415b470 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:31.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.819+0000 7f7949a0e640 1 --2- 172.21.15.122:0/2217918249 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79440ccdb0 0x7f79440cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:31.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.819+0000 7f7949a0e640 1 -- 172.21.15.122:0/2217918249 >> 172.21.15.122:0/2217918249 conn(0x7f794408d450 msgr2=0x7f794406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:31.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.819+0000 7f7949a0e640 1 -- 172.21.15.122:0/2217918249 shutdown_connections 2024-09-17T06:04:31.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.819+0000 7f7949a0e640 1 -- 172.21.15.122:0/2217918249 wait complete. 2024-09-17T06:04:31.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f7949a0e640 1 Processor -- start 2024-09-17T06:04:31.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f7949a0e640 1 -- start start 2024-09-17T06:04:31.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f7949a0e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f794406dab0 0x7f794414cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:31.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f7949a0e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79440cbb40 0x7f79441574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:31.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f7949a0e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79440ccdb0 0x7f794415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:31.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f7949a0e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f794406ff20 con 0x7f79440ccdb0 2024-09-17T06:04:31.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f7949a0e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7944155970 con 0x7f794406dab0 2024-09-17T06:04:31.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f7949a0e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f79440700a0 con 0x7f79440cbb40 2024-09-17T06:04:31.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f79437fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79440ccdb0 0x7f794415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:31.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f79437fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79440ccdb0 0x7f794415dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35860/0 (socket says 172.21.15.122:35860) 2024-09-17T06:04:31.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f79437fe640 1 -- 172.21.15.122:0/345069385 learned_addr learned my addr 172.21.15.122:0/345069385 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:31.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f79427fc640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79440cbb40 0x7f79441574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:31.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f79437fe640 1 -- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79440cbb40 msgr2=0x7f79441574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:31.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f7942ffd640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f794406dab0 0x7f794414cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:31.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f79437fe640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79440cbb40 0x7f79441574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:31.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f79437fe640 1 -- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f794406dab0 msgr2=0x7f794414cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:31.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f79437fe640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f794406dab0 0x7f794414cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:31.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f79437fe640 1 -- 172.21.15.122:0/345069385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7944153230 con 0x7f79440ccdb0 2024-09-17T06:04:31.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f79437fe640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79440ccdb0 0x7f794415dbb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7934009bd0 tx=0x7f7934005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:31.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f793bfff640 1 -- 172.21.15.122:0/345069385 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79340bb070 con 0x7f79440ccdb0 2024-09-17T06:04:31.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f793bfff640 1 -- 172.21.15.122:0/345069385 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7934004d40 con 0x7f79440ccdb0 2024-09-17T06:04:31.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f793bfff640 1 -- 172.21.15.122:0/345069385 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79340b2040 con 0x7f79440ccdb0 2024-09-17T06:04:31.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f7949a0e640 1 -- 172.21.15.122:0/345069385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f794414d520 con 0x7f79440ccdb0 2024-09-17T06:04:31.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f7949a0e640 1 -- 172.21.15.122:0/345069385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79441f5290 con 0x7f79440ccdb0 2024-09-17T06:04:31.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.823+0000 7f7949a0e640 1 -- 172.21.15.122:0/345069385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7944153520 con 0x7f79440ccdb0 2024-09-17T06:04:31.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.827+0000 7f793bfff640 1 -- 172.21.15.122:0/345069385 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7934004240 con 0x7f79440ccdb0 2024-09-17T06:04:31.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.827+0000 7f793bfff640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7924073200 0x7f7924075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:31.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.827+0000 7f793bfff640 1 -- 172.21.15.122:0/345069385 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f793412e400 con 0x7f79440ccdb0 2024-09-17T06:04:31.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.827+0000 7f7942ffd640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7924073200 0x7f7924075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:31.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.827+0000 7f7942ffd640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7924073200 0x7f7924075710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f793c0058d0 tx=0x7f793c005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:31.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:31.831+0000 7f793bfff640 1 -- 172.21.15.122:0/345069385 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f79340f1db0 con 0x7f79440ccdb0 2024-09-17T06:04:32.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.023+0000 7f7949a0e640 1 -- 172.21.15.122:0/345069385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f794414d800 con 0x7f79440ccdb0 2024-09-17T06:04:32.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.631+0000 7f793bfff640 1 -- 172.21.15.122:0/345069385 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7f7934016970 con 0x7f79440ccdb0 2024-09-17T06:04:32.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.635+0000 7f7949a0e640 1 -- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7924073200 msgr2=0x7f7924075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:32.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.635+0000 7f7949a0e640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7924073200 0x7f7924075710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f793c0058d0 tx=0x7f793c005860 comp rx=0 tx=0).stop 2024-09-17T06:04:32.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.635+0000 7f7949a0e640 1 -- 172.21.15.122:0/345069385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79440ccdb0 msgr2=0x7f794415dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:32.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.635+0000 7f7949a0e640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79440ccdb0 0x7f794415dbb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7934009bd0 tx=0x7f7934005b00 comp rx=0 tx=0).stop 2024-09-17T06:04:32.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.635+0000 7f7949a0e640 1 -- 172.21.15.122:0/345069385 shutdown_connections 2024-09-17T06:04:32.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.635+0000 7f7949a0e640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79440ccdb0 0x7f794415dbb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:32.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.635+0000 7f7949a0e640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79440cbb40 0x7f79441574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:32.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.635+0000 7f7949a0e640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7924073200 0x7f7924075710 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:32.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.635+0000 7f7949a0e640 1 --2- 172.21.15.122:0/345069385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f794406dab0 0x7f794414cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:32.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.635+0000 7f7949a0e640 1 -- 172.21.15.122:0/345069385 >> 172.21.15.122:0/345069385 conn(0x7f794408d450 msgr2=0x7f79440c5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:32.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.635+0000 7f7949a0e640 1 -- 172.21.15.122:0/345069385 shutdown_connections 2024-09-17T06:04:32.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.635+0000 7f7949a0e640 1 -- 172.21.15.122:0/345069385 wait complete. 2024-09-17T06:04:32.664 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T06:04:32.665 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T06:04:32.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.823+0000 7f951e679640 1 -- 172.21.15.122:0/2161999113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95180c6780 msgr2=0x7f9518159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:32.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.823+0000 7f951e679640 1 --2- 172.21.15.122:0/2161999113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95180c6780 0x7f9518159b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9508009900 tx=0x7f950801f0f0 comp rx=0 tx=0).stop 2024-09-17T06:04:32.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.823+0000 7f951e679640 1 -- 172.21.15.122:0/2161999113 shutdown_connections 2024-09-17T06:04:32.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.823+0000 7f951e679640 1 --2- 172.21.15.122:0/2161999113 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9518153310 0x7f951815aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:32.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.823+0000 7f951e679640 1 --2- 172.21.15.122:0/2161999113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95180c6780 0x7f9518159b30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:32.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.823+0000 7f951e679640 1 -- 172.21.15.122:0/2161999113 >> 172.21.15.122:0/2161999113 conn(0x7f95180746d0 msgr2=0x7f9518074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:32.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.823+0000 7f951e679640 1 -- 172.21.15.122:0/2161999113 shutdown_connections 2024-09-17T06:04:32.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.823+0000 7f951e679640 1 -- 172.21.15.122:0/2161999113 wait complete. 2024-09-17T06:04:32.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f951e679640 1 Processor -- start 2024-09-17T06:04:32.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f951e679640 1 -- start start 2024-09-17T06:04:32.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f951e679640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95180c6780 0x7f9518146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:32.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f951e679640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9518152f00 0x7f95181e2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:32.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f951e679640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9518153310 0x7f951815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:32.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f951e679640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f951815d470 con 0x7f95180c6780 2024-09-17T06:04:32.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f951e679640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f951815cf30 con 0x7f9518152f00 2024-09-17T06:04:32.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f951e679640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f95180b8cf0 con 0x7f9518153310 2024-09-17T06:04:32.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f9517fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95180c6780 0x7f9518146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:32.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f9517fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95180c6780 0x7f9518146d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35872/0 (socket says 172.21.15.122:35872) 2024-09-17T06:04:32.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f9517fff640 1 -- 172.21.15.122:0/1734496413 learned_addr learned my addr 172.21.15.122:0/1734496413 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:32.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f9517fff640 1 -- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9518153310 msgr2=0x7f951815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:32.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f9517fff640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9518153310 0x7f951815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:32.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f95177fe640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9518152f00 0x7f95181e2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:32.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f9517fff640 1 -- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9518152f00 msgr2=0x7f95181e2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:32.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f9517fff640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9518152f00 0x7f95181e2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:32.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.827+0000 7f9517fff640 1 -- 172.21.15.122:0/1734496413 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95181f0630 con 0x7f95180c6780 2024-09-17T06:04:32.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.831+0000 7f9517fff640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95180c6780 0x7f9518146d70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f950801d7a0 tx=0x7f9508003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:32.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.831+0000 7f9514ff9640 1 -- 172.21.15.122:0/1734496413 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080b5040 con 0x7f95180c6780 2024-09-17T06:04:32.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.831+0000 7f9514ff9640 1 -- 172.21.15.122:0/1734496413 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9508003b60 con 0x7f95180c6780 2024-09-17T06:04:32.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.831+0000 7f951e679640 1 -- 172.21.15.122:0/1734496413 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95181f3040 con 0x7f95180c6780 2024-09-17T06:04:32.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.831+0000 7f9514ff9640 1 -- 172.21.15.122:0/1734496413 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080b05f0 con 0x7f95180c6780 2024-09-17T06:04:32.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.831+0000 7f951e679640 1 -- 172.21.15.122:0/1734496413 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95181f3600 con 0x7f95180c6780 2024-09-17T06:04:32.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.831+0000 7f951e679640 1 -- 172.21.15.122:0/1734496413 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9518159b30 con 0x7f95180c6780 2024-09-17T06:04:32.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.831+0000 7f9514ff9640 1 -- 172.21.15.122:0/1734496413 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f95080c2060 con 0x7f95180c6780 2024-09-17T06:04:32.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.831+0000 7f9514ff9640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9504073230 0x7f9504075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:32.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.831+0000 7f9514ff9640 1 -- 172.21.15.122:0/1734496413 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f95081319d0 con 0x7f95180c6780 2024-09-17T06:04:32.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.831+0000 7f95177fe640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9504073230 0x7f9504075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:32.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.831+0000 7f95177fe640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9504073230 0x7f9504075740 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9518158620 tx=0x7f950c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:32.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:32.839+0000 7f9514ff9640 1 -- 172.21.15.122:0/1734496413 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9508018c50 con 0x7f95180c6780 2024-09-17T06:04:33.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.047+0000 7f951e679640 1 -- 172.21.15.122:0/1734496413 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9518147930 con 0x7f95180c6780 2024-09-17T06:04:33.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f9514ff9640 1 -- 172.21.15.122:0/1734496413 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7f95080fc780 con 0x7f95180c6780 2024-09-17T06:04:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:33.053 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":9,"btime":"2024-09-17T06:04:32:633995+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1941177833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1941177833},{"type":"v1","addr":"172.21.15.173:6835","nonce":1941177833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3902874091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3902874091},{"type":"v1","addr":"172.21.15.122:6833","nonce":3902874091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2868113442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2868113442},{"type":"v1","addr":"172.21.15.122:6836","nonce":2868113442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1552928786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1552928786},{"type":"v1","addr":"172.21.15.122:6837","nonce":1552928786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4447,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2188047562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2188047562},{"type":"v1","addr":"172.21.15.173:6837","nonce":2188047562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T06:04:08.229792+0000","modified":"2024-09-17T06:04:32.027039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4450":{"gid":4450,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6839/1694851531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":1694851531},{"type":"v1","addr":"172.21.15.173:6839","nonce":1694851531}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4450,"qdb_cluster":[4450]},"id":1}]} 2024-09-17T06:04:33.053 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 9 2024-09-17T06:04:33.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f951e679640 1 -- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9504073230 msgr2=0x7f9504075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:33.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f951e679640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9504073230 0x7f9504075740 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9518158620 tx=0x7f950c009040 comp rx=0 tx=0).stop 2024-09-17T06:04:33.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f951e679640 1 -- 172.21.15.122:0/1734496413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95180c6780 msgr2=0x7f9518146d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:33.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f951e679640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95180c6780 0x7f9518146d70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f950801d7a0 tx=0x7f9508003680 comp rx=0 tx=0).stop 2024-09-17T06:04:33.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f951e679640 1 -- 172.21.15.122:0/1734496413 shutdown_connections 2024-09-17T06:04:33.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f951e679640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9518153310 0x7f951815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f951e679640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9504073230 0x7f9504075740 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f951e679640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9518152f00 0x7f95181e2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f951e679640 1 --2- 172.21.15.122:0/1734496413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95180c6780 0x7f9518146d70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f951e679640 1 -- 172.21.15.122:0/1734496413 >> 172.21.15.122:0/1734496413 conn(0x7f95180746d0 msgr2=0x7f951814c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:33.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f951e679640 1 -- 172.21.15.122:0/1734496413 shutdown_connections 2024-09-17T06:04:33.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.051+0000 7f951e679640 1 -- 172.21.15.122:0/1734496413 wait complete. 2024-09-17T06:04:33.075 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:04:33.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.223+0000 7fb4448e6640 1 -- 172.21.15.122:0/2723487405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb428004090 msgr2=0x7fb428004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:33.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.223+0000 7fb4448e6640 1 --2- 172.21.15.122:0/2723487405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb428004090 0x7fb428004810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb440070e90 tx=0x7fb43401ce40 comp rx=0 tx=0).stop 2024-09-17T06:04:33.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.223+0000 7fb43ed9d640 1 -- 172.21.15.122:0/2723487405 reap_dead start 2024-09-17T06:04:33.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.223+0000 7fb4448e6640 1 -- 172.21.15.122:0/2723487405 shutdown_connections 2024-09-17T06:04:33.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.223+0000 7fb4448e6640 1 -- 172.21.15.122:0/2723487405 >> 172.21.15.122:0/2723487405 conn(0x7fb4400746d0 msgr2=0x7fb440074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:33.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.223+0000 7fb4448e6640 1 -- 172.21.15.122:0/2723487405 shutdown_connections 2024-09-17T06:04:33.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.223+0000 7fb4448e6640 1 -- 172.21.15.122:0/2723487405 wait complete. 2024-09-17T06:04:33.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb4448e6640 1 Processor -- start 2024-09-17T06:04:33.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb4448e6640 1 -- start start 2024-09-17T06:04:33.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb4448e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb428004090 0x7fb4401f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:33.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb4448e6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4400cc810 0x7fb4401470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:33.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb4448e6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4401efa00 0x7fb4400ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:33.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb4448e6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb440158a70 con 0x7fb428004090 2024-09-17T06:04:33.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb4448e6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb440158790 con 0x7fb4400cc810 2024-09-17T06:04:33.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb4448e6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb440158d50 con 0x7fb4401efa00 2024-09-17T06:04:33.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb43e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb428004090 0x7fb4401f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:33.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb43e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb428004090 0x7fb4401f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35886/0 (socket says 172.21.15.122:35886) 2024-09-17T06:04:33.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb43e59c640 1 -- 172.21.15.122:0/3517426409 learned_addr learned my addr 172.21.15.122:0/3517426409 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:33.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb43dd9b640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4400cc810 0x7fb4401470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:33.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb43ed9d640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4401efa00 0x7fb4400ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:33.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb43e59c640 1 -- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4401efa00 msgr2=0x7fb4400ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:33.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb43e59c640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4401efa00 0x7fb4400ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb43e59c640 1 -- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4400cc810 msgr2=0x7fb4401470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:33.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb43e59c640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4400cc810 0x7fb4401470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb43e59c640 1 -- 172.21.15.122:0/3517426409 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4400ca0d0 con 0x7fb428004090 2024-09-17T06:04:33.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb43dd9b640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4400cc810 0x7fb4401470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:33.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb43e59c640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb428004090 0x7fb4401f2ff0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb430001ec0 tx=0x7fb43000ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:33.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb42effd640 1 -- 172.21.15.122:0/3517426409 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430015070 con 0x7fb428004090 2024-09-17T06:04:33.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb42effd640 1 -- 172.21.15.122:0/3517426409 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb43000c9a0 con 0x7fb428004090 2024-09-17T06:04:33.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb4448e6640 1 -- 172.21.15.122:0/3517426409 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb440147630 con 0x7fb428004090 2024-09-17T06:04:33.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb42effd640 1 -- 172.21.15.122:0/3517426409 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43000cdf0 con 0x7fb428004090 2024-09-17T06:04:33.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.227+0000 7fb4448e6640 1 -- 172.21.15.122:0/3517426409 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4400cd2f0 con 0x7fb428004090 2024-09-17T06:04:33.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.231+0000 7fb4448e6640 1 -- 172.21.15.122:0/3517426409 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb440152540 con 0x7fb428004090 2024-09-17T06:04:33.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.231+0000 7fb42effd640 1 -- 172.21.15.122:0/3517426409 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb430018070 con 0x7fb428004090 2024-09-17T06:04:33.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.231+0000 7fb42effd640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb420073230 0x7fb420075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:33.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.231+0000 7fb42effd640 1 -- 172.21.15.122:0/3517426409 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb430094ac0 con 0x7fb428004090 2024-09-17T06:04:33.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.231+0000 7fb43dd9b640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb420073230 0x7fb420075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:33.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.231+0000 7fb43dd9b640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb420073230 0x7fb420075740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb4340af000 tx=0x7fb434019be0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:33.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.235+0000 7fb42effd640 1 -- 172.21.15.122:0/3517426409 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb440147630 con 0x7fb428004090 2024-09-17T06:04:33.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.407+0000 7fb4448e6640 1 -- 172.21.15.122:0/3517426409 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb440147810 con 0x7fb428004090 2024-09-17T06:04:33.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb42effd640 1 -- 172.21.15.122:0/3517426409 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7fb43005f720 con 0x7fb428004090 2024-09-17T06:04:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:33.413 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":26,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:04:13.331438+0000","last_up_change":"2024-09-17T06:03:56.580331+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6811","nonce":920798795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6813","nonce":920798795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6817","nonce":920798795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6815","nonce":920798795}]},"public_addr":"172.21.15.173:6811/920798795","cluster_addr":"172.21.15.173:6813/920798795","heartbeat_back_addr":"172.21.15.173:6817/920798795","heartbeat_front_addr":"172.21.15.173:6815/920798795","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:04:33.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb4448e6640 1 -- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb420073230 msgr2=0x7fb420075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:33.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb4448e6640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb420073230 0x7fb420075740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb4340af000 tx=0x7fb434019be0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb4448e6640 1 -- 172.21.15.122:0/3517426409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb428004090 msgr2=0x7fb4401f2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:33.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb4448e6640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb428004090 0x7fb4401f2ff0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb430001ec0 tx=0x7fb43000ea90 comp rx=0 tx=0).stop 2024-09-17T06:04:33.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb4448e6640 1 -- 172.21.15.122:0/3517426409 shutdown_connections 2024-09-17T06:04:33.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb4448e6640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4401efa00 0x7fb4400ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb4448e6640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb420073230 0x7fb420075740 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb4448e6640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4400cc810 0x7fb4401470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb4448e6640 1 --2- 172.21.15.122:0/3517426409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb428004090 0x7fb4401f2ff0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb4448e6640 1 -- 172.21.15.122:0/3517426409 >> 172.21.15.122:0/3517426409 conn(0x7fb4400746d0 msgr2=0x7fb440147f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:33.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb4448e6640 1 -- 172.21.15.122:0/3517426409 shutdown_connections 2024-09-17T06:04:33.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.411+0000 7fb4448e6640 1 -- 172.21.15.122:0/3517426409 wait complete. 2024-09-17T06:04:33.435 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T06:04:33.435 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:04:33.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.587+0000 7f3288ca5640 1 -- 172.21.15.122:0/1950572365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32840c6fd0 msgr2=0x7f328415d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:33.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.587+0000 7f3288ca5640 1 --2- 172.21.15.122:0/1950572365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32840c6fd0 0x7f328415d2b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f327c009900 tx=0x7f327c01c6c0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.587+0000 7f3288ca5640 1 -- 172.21.15.122:0/1950572365 shutdown_connections 2024-09-17T06:04:33.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.587+0000 7f3288ca5640 1 --2- 172.21.15.122:0/1950572365 >> v2:172.21.15.173:3300/0 conn(0x7f3284153070 0x7f32840ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.587+0000 7f3288ca5640 1 --2- 172.21.15.122:0/1950572365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32840c6fd0 0x7f328415d2b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.587+0000 7f3288ca5640 1 -- 172.21.15.122:0/1950572365 >> 172.21.15.122:0/1950572365 conn(0x7f32840701b0 msgr2=0x7f32840705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:33.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.587+0000 7f3288ca5640 1 -- 172.21.15.122:0/1950572365 shutdown_connections 2024-09-17T06:04:33.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.587+0000 7f3288ca5640 1 -- 172.21.15.122:0/1950572365 wait complete. 2024-09-17T06:04:33.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3288ca5640 1 Processor -- start 2024-09-17T06:04:33.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3288ca5640 1 -- start start 2024-09-17T06:04:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3288ca5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32840c6fd0 0x7f328415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3288ca5640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32840c9b30 0x7f328414fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3288ca5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3284153070 0x7f3284147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3288ca5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f32840c6b40 con 0x7f32840c6fd0 2024-09-17T06:04:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3288ca5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f328415cd90 con 0x7f3284153070 2024-09-17T06:04:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3288ca5640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3284166410 con 0x7f32840c9b30 2024-09-17T06:04:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f328259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32840c6fd0 0x7f328415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f328259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32840c6fd0 0x7f328415a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35894/0 (socket says 172.21.15.122:35894) 2024-09-17T06:04:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f328259c640 1 -- 172.21.15.122:0/2214733602 learned_addr learned my addr 172.21.15.122:0/2214733602 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3282d9d640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3284153070 0x7f3284147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3281d9b640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32840c9b30 0x7f328414fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:33.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f328259c640 1 -- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32840c9b30 msgr2=0x7f328414fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f328259c640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32840c9b30 0x7f328414fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f328259c640 1 -- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3284153070 msgr2=0x7f3284147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f328259c640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3284153070 0x7f3284147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f328259c640 1 -- 172.21.15.122:0/2214733602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328415ace0 con 0x7f32840c6fd0 2024-09-17T06:04:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3282d9d640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3284153070 0x7f3284147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f328259c640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32840c6fd0 0x7f328415a7a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f327c01ad70 tx=0x7f327c0a6c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3272ffd640 1 -- 172.21.15.122:0/2214733602 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c0ac070 con 0x7f32840c6fd0 2024-09-17T06:04:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3272ffd640 1 -- 172.21.15.122:0/2214733602 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f327c004120 con 0x7f32840c6fd0 2024-09-17T06:04:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3288ca5640 1 -- 172.21.15.122:0/2214733602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3284152c90 con 0x7f32840c6fd0 2024-09-17T06:04:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3272ffd640 1 -- 172.21.15.122:0/2214733602 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c005040 con 0x7f32840c6fd0 2024-09-17T06:04:33.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.591+0000 7f3288ca5640 1 -- 172.21.15.122:0/2214733602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f328415c0a0 con 0x7f32840c6fd0 2024-09-17T06:04:33.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.595+0000 7f3288ca5640 1 -- 172.21.15.122:0/2214733602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f328415a3e0 con 0x7f32840c6fd0 2024-09-17T06:04:33.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.595+0000 7f3272ffd640 1 -- 172.21.15.122:0/2214733602 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f327c0af070 con 0x7f32840c6fd0 2024-09-17T06:04:33.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.595+0000 7f3272ffd640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3264073230 0x7f3264075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:33.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.595+0000 7f3272ffd640 1 -- 172.21.15.122:0/2214733602 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f327c12dfd0 con 0x7f32840c6fd0 2024-09-17T06:04:33.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.595+0000 7f3281d9b640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3264073230 0x7f3264075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:33.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.595+0000 7f3281d9b640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3264073230 0x7f3264075740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3284148a30 tx=0x7f32740072f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:33.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.599+0000 7f3272ffd640 1 -- 172.21.15.122:0/2214733602 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f327c0bf070 con 0x7f32840c6fd0 2024-09-17T06:04:33.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.771+0000 7f3288ca5640 1 -- 172.21.15.122:0/2214733602 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f328414dcc0 con 0x7f3264073230 2024-09-17T06:04:33.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.799+0000 7f3272ffd640 1 -- 172.21.15.122:0/2214733602 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f32740079b0 con 0x7f3264073230 2024-09-17T06:04:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:33.809 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:04:33.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.807+0000 7f3288ca5640 1 -- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3264073230 msgr2=0x7f3264075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:33.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.807+0000 7f3288ca5640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3264073230 0x7f3264075740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3284148a30 tx=0x7f32740072f0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.807+0000 7f3288ca5640 1 -- 172.21.15.122:0/2214733602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32840c6fd0 msgr2=0x7f328415a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:33.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.807+0000 7f3288ca5640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32840c6fd0 0x7f328415a7a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f327c01ad70 tx=0x7f327c0a6c20 comp rx=0 tx=0).stop 2024-09-17T06:04:33.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.807+0000 7f3288ca5640 1 -- 172.21.15.122:0/2214733602 shutdown_connections 2024-09-17T06:04:33.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.807+0000 7f3288ca5640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3264073230 0x7f3264075740 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.807+0000 7f3288ca5640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3284153070 0x7f3284147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.807+0000 7f3288ca5640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32840c9b30 0x7f328414fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.807+0000 7f3288ca5640 1 --2- 172.21.15.122:0/2214733602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32840c6fd0 0x7f328415a7a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:33.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.807+0000 7f3288ca5640 1 -- 172.21.15.122:0/2214733602 >> 172.21.15.122:0/2214733602 conn(0x7f32840701b0 msgr2=0x7f32840c4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:33.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.807+0000 7f3288ca5640 1 -- 172.21.15.122:0/2214733602 shutdown_connections 2024-09-17T06:04:33.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:33.807+0000 7f3288ca5640 1 -- 172.21.15.122:0/2214733602 wait complete. 2024-09-17T06:04:33.831 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-17T06:04:33.521070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219568,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755152,"statfs":{"total":773094113280,"available":772869275648,"internally_reserved":0,"allocated":3416064,"data_stored":2037216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005584"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827969+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:04:14.827969+0000","last_peered":"2024-09-17T06:04:14.827969+0000","last_clean":"2024-09-17T06:04:14.827969+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:04:14.827969+0000","last_undegraded":"2024-09-17T06:04:14.827969+0000","last_fullsized":"2024-09-17T06:04:14.827969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914314+0000","last_change":"2024-09-17T06:04:08.851488+0000","last_active":"2024-09-17T06:04:13.914314+0000","last_peered":"2024-09-17T06:04:13.914314+0000","last_clean":"2024-09-17T06:04:13.914314+0000","last_became_active":"2024-09-17T06:04:08.847345+0000","last_became_peered":"2024-09-17T06:04:08.847345+0000","last_unstale":"2024-09-17T06:04:13.914314+0000","last_undegraded":"2024-09-17T06:04:13.914314+0000","last_fullsized":"2024-09-17T06:04:13.914314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912954+0000","last_change":"2024-09-17T06:04:13.045049+0000","last_active":"2024-09-17T06:04:13.912954+0000","last_peered":"2024-09-17T06:04:13.912954+0000","last_clean":"2024-09-17T06:04:13.912954+0000","last_became_active":"2024-09-17T06:04:13.041321+0000","last_became_peered":"2024-09-17T06:04:13.041321+0000","last_unstale":"2024-09-17T06:04:13.912954+0000","last_undegraded":"2024-09-17T06:04:13.912954+0000","last_fullsized":"2024-09-17T06:04:13.912954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.500551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914545+0000","last_change":"2024-09-17T06:04:07.834691+0000","last_active":"2024-09-17T06:04:13.914545+0000","last_peered":"2024-09-17T06:04:13.914545+0000","last_clean":"2024-09-17T06:04:13.914545+0000","last_became_active":"2024-09-17T06:04:07.834110+0000","last_became_peered":"2024-09-17T06:04:07.834110+0000","last_unstale":"2024-09-17T06:04:13.914545+0000","last_undegraded":"2024-09-17T06:04:13.914545+0000","last_fullsized":"2024-09-17T06:04:13.914545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827140+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:04:14.827140+0000","last_peered":"2024-09-17T06:04:14.827140+0000","last_clean":"2024-09-17T06:04:14.827140+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:04:14.827140+0000","last_undegraded":"2024-09-17T06:04:14.827140+0000","last_fullsized":"2024-09-17T06:04:14.827140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915612+0000","last_change":"2024-09-17T06:04:12.954966+0000","last_active":"2024-09-17T06:04:13.915612+0000","last_peered":"2024-09-17T06:04:13.915612+0000","last_clean":"2024-09-17T06:04:13.915612+0000","last_became_active":"2024-09-17T06:04:12.953915+0000","last_became_peered":"2024-09-17T06:04:12.953915+0000","last_unstale":"2024-09-17T06:04:13.915612+0000","last_undegraded":"2024-09-17T06:04:13.915612+0000","last_fullsized":"2024-09-17T06:04:13.915612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:54.009189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826543+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:04:14.826543+0000","last_peered":"2024-09-17T06:04:14.826543+0000","last_clean":"2024-09-17T06:04:14.826543+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:04:14.826543+0000","last_undegraded":"2024-09-17T06:04:14.826543+0000","last_fullsized":"2024-09-17T06:04:14.826543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922620+0000","last_change":"2024-09-17T06:04:08.847869+0000","last_active":"2024-09-17T06:04:13.922620+0000","last_peered":"2024-09-17T06:04:13.922620+0000","last_clean":"2024-09-17T06:04:13.922620+0000","last_became_active":"2024-09-17T06:04:08.847475+0000","last_became_peered":"2024-09-17T06:04:08.847475+0000","last_unstale":"2024-09-17T06:04:13.922620+0000","last_undegraded":"2024-09-17T06:04:13.922620+0000","last_fullsized":"2024-09-17T06:04:13.922620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:54.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.917090+0000","last_change":"2024-09-17T06:04:12.948833+0000","last_active":"2024-09-17T06:04:13.917090+0000","last_peered":"2024-09-17T06:04:13.917090+0000","last_clean":"2024-09-17T06:04:13.917090+0000","last_became_active":"2024-09-17T06:04:12.947705+0000","last_became_peered":"2024-09-17T06:04:12.947705+0000","last_unstale":"2024-09-17T06:04:13.917090+0000","last_undegraded":"2024-09-17T06:04:13.917090+0000","last_fullsized":"2024-09-17T06:04:13.917090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:46.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826033+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:04:14.826033+0000","last_peered":"2024-09-17T06:04:14.826033+0000","last_clean":"2024-09-17T06:04:14.826033+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:04:14.826033+0000","last_undegraded":"2024-09-17T06:04:14.826033+0000","last_fullsized":"2024-09-17T06:04:14.826033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923681+0000","last_change":"2024-09-17T06:04:08.850056+0000","last_active":"2024-09-17T06:04:13.923681+0000","last_peered":"2024-09-17T06:04:13.923681+0000","last_clean":"2024-09-17T06:04:13.923681+0000","last_became_active":"2024-09-17T06:04:08.847436+0000","last_became_peered":"2024-09-17T06:04:08.847436+0000","last_unstale":"2024-09-17T06:04:13.923681+0000","last_undegraded":"2024-09-17T06:04:13.923681+0000","last_fullsized":"2024-09-17T06:04:13.923681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:29.069085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916255+0000","last_change":"2024-09-17T06:04:12.951144+0000","last_active":"2024-09-17T06:04:13.916255+0000","last_peered":"2024-09-17T06:04:13.916255+0000","last_clean":"2024-09-17T06:04:13.916255+0000","last_became_active":"2024-09-17T06:04:12.950127+0000","last_became_peered":"2024-09-17T06:04:12.950127+0000","last_unstale":"2024-09-17T06:04:13.916255+0000","last_undegraded":"2024-09-17T06:04:13.916255+0000","last_fullsized":"2024-09-17T06:04:13.916255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:52.901835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.753568+0000","last_change":"2024-09-17T06:04:08.847906+0000","last_active":"2024-09-17T06:04:14.753568+0000","last_peered":"2024-09-17T06:04:14.753568+0000","last_clean":"2024-09-17T06:04:14.753568+0000","last_became_active":"2024-09-17T06:04:08.847601+0000","last_became_peered":"2024-09-17T06:04:08.847601+0000","last_unstale":"2024-09-17T06:04:14.753568+0000","last_undegraded":"2024-09-17T06:04:14.753568+0000","last_fullsized":"2024-09-17T06:04:14.753568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826490+0000","last_change":"2024-09-17T06:04:07.851351+0000","last_active":"2024-09-17T06:04:14.826490+0000","last_peered":"2024-09-17T06:04:14.826490+0000","last_clean":"2024-09-17T06:04:14.826490+0000","last_became_active":"2024-09-17T06:04:07.850947+0000","last_became_peered":"2024-09-17T06:04:07.850947+0000","last_unstale":"2024-09-17T06:04:14.826490+0000","last_undegraded":"2024-09-17T06:04:14.826490+0000","last_fullsized":"2024-09-17T06:04:14.826490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:43.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919163+0000","last_change":"2024-09-17T06:04:12.936732+0000","last_active":"2024-09-17T06:04:13.919163+0000","last_peered":"2024-09-17T06:04:13.919163+0000","last_clean":"2024-09-17T06:04:13.919163+0000","last_became_active":"2024-09-17T06:04:12.935512+0000","last_became_peered":"2024-09-17T06:04:12.935512+0000","last_unstale":"2024-09-17T06:04:13.919163+0000","last_undegraded":"2024-09-17T06:04:13.919163+0000","last_fullsized":"2024-09-17T06:04:13.919163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915113+0000","last_change":"2024-09-17T06:04:08.847093+0000","last_active":"2024-09-17T06:04:13.915113+0000","last_peered":"2024-09-17T06:04:13.915113+0000","last_clean":"2024-09-17T06:04:13.915113+0000","last_became_active":"2024-09-17T06:04:08.846716+0000","last_became_peered":"2024-09-17T06:04:08.846716+0000","last_unstale":"2024-09-17T06:04:13.915113+0000","last_undegraded":"2024-09-17T06:04:13.915113+0000","last_fullsized":"2024-09-17T06:04:13.915113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557626+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:04:14.557626+0000","last_peered":"2024-09-17T06:04:14.557626+0000","last_clean":"2024-09-17T06:04:14.557626+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:04:14.557626+0000","last_undegraded":"2024-09-17T06:04:14.557626+0000","last_fullsized":"2024-09-17T06:04:14.557626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918420+0000","last_change":"2024-09-17T06:04:12.951796+0000","last_active":"2024-09-17T06:04:13.918420+0000","last_peered":"2024-09-17T06:04:13.918420+0000","last_clean":"2024-09-17T06:04:13.918420+0000","last_became_active":"2024-09-17T06:04:12.948211+0000","last_became_peered":"2024-09-17T06:04:12.948211+0000","last_unstale":"2024-09-17T06:04:13.918420+0000","last_undegraded":"2024-09-17T06:04:13.918420+0000","last_fullsized":"2024-09-17T06:04:13.918420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:43.869350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913781+0000","last_change":"2024-09-17T06:04:08.850212+0000","last_active":"2024-09-17T06:04:13.913781+0000","last_peered":"2024-09-17T06:04:13.913781+0000","last_clean":"2024-09-17T06:04:13.913781+0000","last_became_active":"2024-09-17T06:04:08.835906+0000","last_became_peered":"2024-09-17T06:04:08.835906+0000","last_unstale":"2024-09-17T06:04:13.913781+0000","last_undegraded":"2024-09-17T06:04:13.913781+0000","last_fullsized":"2024-09-17T06:04:13.913781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556835+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:04:14.556835+0000","last_peered":"2024-09-17T06:04:14.556835+0000","last_clean":"2024-09-17T06:04:14.556835+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:04:14.556835+0000","last_undegraded":"2024-09-17T06:04:14.556835+0000","last_fullsized":"2024-09-17T06:04:14.556835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558516+0000","last_change":"2024-09-17T06:04:13.048882+0000","last_active":"2024-09-17T06:04:14.558516+0000","last_peered":"2024-09-17T06:04:14.558516+0000","last_clean":"2024-09-17T06:04:14.558516+0000","last_became_active":"2024-09-17T06:04:13.047684+0000","last_became_peered":"2024-09-17T06:04:13.047684+0000","last_unstale":"2024-09-17T06:04:14.558516+0000","last_undegraded":"2024-09-17T06:04:14.558516+0000","last_fullsized":"2024-09-17T06:04:14.558516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:21.270772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916697+0000","last_change":"2024-09-17T06:04:08.838033+0000","last_active":"2024-09-17T06:04:13.916697+0000","last_peered":"2024-09-17T06:04:13.916697+0000","last_clean":"2024-09-17T06:04:13.916697+0000","last_became_active":"2024-09-17T06:04:08.836402+0000","last_became_peered":"2024-09-17T06:04:08.836402+0000","last_unstale":"2024-09-17T06:04:13.916697+0000","last_undegraded":"2024-09-17T06:04:13.916697+0000","last_fullsized":"2024-09-17T06:04:13.916697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:12.374198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825530+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:04:14.825530+0000","last_peered":"2024-09-17T06:04:14.825530+0000","last_clean":"2024-09-17T06:04:14.825530+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:04:14.825530+0000","last_undegraded":"2024-09-17T06:04:14.825530+0000","last_fullsized":"2024-09-17T06:04:14.825530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919390+0000","last_change":"2024-09-17T06:04:12.949288+0000","last_active":"2024-09-17T06:04:13.919390+0000","last_peered":"2024-09-17T06:04:13.919390+0000","last_clean":"2024-09-17T06:04:13.919390+0000","last_became_active":"2024-09-17T06:04:12.947997+0000","last_became_peered":"2024-09-17T06:04:12.947997+0000","last_unstale":"2024-09-17T06:04:13.919390+0000","last_undegraded":"2024-09-17T06:04:13.919390+0000","last_fullsized":"2024-09-17T06:04:13.919390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827729+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:04:14.827729+0000","last_peered":"2024-09-17T06:04:14.827729+0000","last_clean":"2024-09-17T06:04:14.827729+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:04:14.827729+0000","last_undegraded":"2024-09-17T06:04:14.827729+0000","last_fullsized":"2024-09-17T06:04:14.827729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755401+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:04:14.755401+0000","last_peered":"2024-09-17T06:04:14.755401+0000","last_clean":"2024-09-17T06:04:14.755401+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:04:14.755401+0000","last_undegraded":"2024-09-17T06:04:14.755401+0000","last_fullsized":"2024-09-17T06:04:14.755401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915706+0000","last_change":"2024-09-17T06:04:13.039804+0000","last_active":"2024-09-17T06:04:13.915706+0000","last_peered":"2024-09-17T06:04:13.915706+0000","last_clean":"2024-09-17T06:04:13.915706+0000","last_became_active":"2024-09-17T06:04:13.038212+0000","last_became_peered":"2024-09-17T06:04:13.038212+0000","last_unstale":"2024-09-17T06:04:13.915706+0000","last_undegraded":"2024-09-17T06:04:13.915706+0000","last_fullsized":"2024-09-17T06:04:13.915706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:35.798927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915606+0000","last_change":"2024-09-17T06:04:08.853353+0000","last_active":"2024-09-17T06:04:13.915606+0000","last_peered":"2024-09-17T06:04:13.915606+0000","last_clean":"2024-09-17T06:04:13.915606+0000","last_became_active":"2024-09-17T06:04:08.852015+0000","last_became_peered":"2024-09-17T06:04:08.852015+0000","last_unstale":"2024-09-17T06:04:13.915606+0000","last_undegraded":"2024-09-17T06:04:13.915606+0000","last_fullsized":"2024-09-17T06:04:13.915606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558240+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:04:14.558240+0000","last_peered":"2024-09-17T06:04:14.558240+0000","last_clean":"2024-09-17T06:04:14.558240+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:04:14.558240+0000","last_undegraded":"2024-09-17T06:04:14.558240+0000","last_fullsized":"2024-09-17T06:04:14.558240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912658+0000","last_change":"2024-09-17T06:04:13.034589+0000","last_active":"2024-09-17T06:04:13.912658+0000","last_peered":"2024-09-17T06:04:13.912658+0000","last_clean":"2024-09-17T06:04:13.912658+0000","last_became_active":"2024-09-17T06:04:13.034080+0000","last_became_peered":"2024-09-17T06:04:13.034080+0000","last_unstale":"2024-09-17T06:04:13.912658+0000","last_undegraded":"2024-09-17T06:04:13.912658+0000","last_fullsized":"2024-09-17T06:04:13.912658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:16.669822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557861+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:04:14.557861+0000","last_peered":"2024-09-17T06:04:14.557861+0000","last_clean":"2024-09-17T06:04:14.557861+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:04:14.557861+0000","last_undegraded":"2024-09-17T06:04:14.557861+0000","last_fullsized":"2024-09-17T06:04:14.557861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826908+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:04:14.826908+0000","last_peered":"2024-09-17T06:04:14.826908+0000","last_clean":"2024-09-17T06:04:14.826908+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:04:14.826908+0000","last_undegraded":"2024-09-17T06:04:14.826908+0000","last_fullsized":"2024-09-17T06:04:14.826908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826528+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:04:14.826528+0000","last_peered":"2024-09-17T06:04:14.826528+0000","last_clean":"2024-09-17T06:04:14.826528+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:04:14.826528+0000","last_undegraded":"2024-09-17T06:04:14.826528+0000","last_fullsized":"2024-09-17T06:04:14.826528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923885+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:04:13.923885+0000","last_peered":"2024-09-17T06:04:13.923885+0000","last_clean":"2024-09-17T06:04:13.923885+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:04:13.923885+0000","last_undegraded":"2024-09-17T06:04:13.923885+0000","last_fullsized":"2024-09-17T06:04:13.923885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558155+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:04:14.558155+0000","last_peered":"2024-09-17T06:04:14.558155+0000","last_clean":"2024-09-17T06:04:14.558155+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:04:14.558155+0000","last_undegraded":"2024-09-17T06:04:14.558155+0000","last_fullsized":"2024-09-17T06:04:14.558155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556865+0000","last_change":"2024-09-17T06:04:12.942301+0000","last_active":"2024-09-17T06:04:14.556865+0000","last_peered":"2024-09-17T06:04:14.556865+0000","last_clean":"2024-09-17T06:04:14.556865+0000","last_became_active":"2024-09-17T06:04:12.941640+0000","last_became_peered":"2024-09-17T06:04:12.941640+0000","last_unstale":"2024-09-17T06:04:14.556865+0000","last_undegraded":"2024-09-17T06:04:14.556865+0000","last_fullsized":"2024-09-17T06:04:14.556865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:31.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918736+0000","last_change":"2024-09-17T06:04:08.838642+0000","last_active":"2024-09-17T06:04:13.918736+0000","last_peered":"2024-09-17T06:04:13.918736+0000","last_clean":"2024-09-17T06:04:13.918736+0000","last_became_active":"2024-09-17T06:04:08.835562+0000","last_became_peered":"2024-09-17T06:04:08.835562+0000","last_unstale":"2024-09-17T06:04:13.918736+0000","last_undegraded":"2024-09-17T06:04:13.918736+0000","last_fullsized":"2024-09-17T06:04:13.918736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:16.900376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922711+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:04:13.922711+0000","last_peered":"2024-09-17T06:04:13.922711+0000","last_clean":"2024-09-17T06:04:13.922711+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:04:13.922711+0000","last_undegraded":"2024-09-17T06:04:13.922711+0000","last_fullsized":"2024-09-17T06:04:13.922711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557663+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:04:14.557663+0000","last_peered":"2024-09-17T06:04:14.557663+0000","last_clean":"2024-09-17T06:04:14.557663+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:04:14.557663+0000","last_undegraded":"2024-09-17T06:04:14.557663+0000","last_fullsized":"2024-09-17T06:04:14.557663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556896+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:04:14.556896+0000","last_peered":"2024-09-17T06:04:14.556896+0000","last_clean":"2024-09-17T06:04:14.556896+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:04:14.556896+0000","last_undegraded":"2024-09-17T06:04:14.556896+0000","last_fullsized":"2024-09-17T06:04:14.556896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824198+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:04:14.824198+0000","last_peered":"2024-09-17T06:04:14.824198+0000","last_clean":"2024-09-17T06:04:14.824198+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:04:14.824198+0000","last_undegraded":"2024-09-17T06:04:14.824198+0000","last_fullsized":"2024-09-17T06:04:14.824198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558517+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:04:14.558517+0000","last_peered":"2024-09-17T06:04:14.558517+0000","last_clean":"2024-09-17T06:04:14.558517+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:04:14.558517+0000","last_undegraded":"2024-09-17T06:04:14.558517+0000","last_fullsized":"2024-09-17T06:04:14.558517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826003+0000","last_change":"2024-09-17T06:04:08.840359+0000","last_active":"2024-09-17T06:04:14.826003+0000","last_peered":"2024-09-17T06:04:14.826003+0000","last_clean":"2024-09-17T06:04:14.826003+0000","last_became_active":"2024-09-17T06:04:08.839822+0000","last_became_peered":"2024-09-17T06:04:08.839822+0000","last_unstale":"2024-09-17T06:04:14.826003+0000","last_undegraded":"2024-09-17T06:04:14.826003+0000","last_fullsized":"2024-09-17T06:04:14.826003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825413+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:04:14.825413+0000","last_peered":"2024-09-17T06:04:14.825413+0000","last_clean":"2024-09-17T06:04:14.825413+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:04:14.825413+0000","last_undegraded":"2024-09-17T06:04:14.825413+0000","last_fullsized":"2024-09-17T06:04:14.825413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827476+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:04:14.827476+0000","last_peered":"2024-09-17T06:04:14.827476+0000","last_clean":"2024-09-17T06:04:14.827476+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:04:14.827476+0000","last_undegraded":"2024-09-17T06:04:14.827476+0000","last_fullsized":"2024-09-17T06:04:14.827476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913432+0000","last_change":"2024-09-17T06:04:08.846617+0000","last_active":"2024-09-17T06:04:13.913432+0000","last_peered":"2024-09-17T06:04:13.913432+0000","last_clean":"2024-09-17T06:04:13.913432+0000","last_became_active":"2024-09-17T06:04:08.837049+0000","last_became_peered":"2024-09-17T06:04:08.837049+0000","last_unstale":"2024-09-17T06:04:13.913432+0000","last_undegraded":"2024-09-17T06:04:13.913432+0000","last_fullsized":"2024-09-17T06:04:13.913432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923114+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:04:13.923114+0000","last_peered":"2024-09-17T06:04:13.923114+0000","last_clean":"2024-09-17T06:04:13.923114+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:04:13.923114+0000","last_undegraded":"2024-09-17T06:04:13.923114+0000","last_fullsized":"2024-09-17T06:04:13.923114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825786+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:04:14.825786+0000","last_peered":"2024-09-17T06:04:14.825786+0000","last_clean":"2024-09-17T06:04:14.825786+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:04:14.825786+0000","last_undegraded":"2024-09-17T06:04:14.825786+0000","last_fullsized":"2024-09-17T06:04:14.825786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754281+0000","last_change":"2024-09-17T06:04:13.042118+0000","last_active":"2024-09-17T06:04:14.754281+0000","last_peered":"2024-09-17T06:04:14.754281+0000","last_clean":"2024-09-17T06:04:14.754281+0000","last_became_active":"2024-09-17T06:04:13.040403+0000","last_became_peered":"2024-09-17T06:04:13.040403+0000","last_unstale":"2024-09-17T06:04:14.754281+0000","last_undegraded":"2024-09-17T06:04:14.754281+0000","last_fullsized":"2024-09-17T06:04:14.754281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826117+0000","last_change":"2024-09-17T06:04:08.838758+0000","last_active":"2024-09-17T06:04:14.826117+0000","last_peered":"2024-09-17T06:04:14.826117+0000","last_clean":"2024-09-17T06:04:14.826117+0000","last_became_active":"2024-09-17T06:04:08.838386+0000","last_became_peered":"2024-09-17T06:04:08.838386+0000","last_unstale":"2024-09-17T06:04:14.826117+0000","last_undegraded":"2024-09-17T06:04:14.826117+0000","last_fullsized":"2024-09-17T06:04:14.826117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:03.255963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824908+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:04:14.824908+0000","last_peered":"2024-09-17T06:04:14.824908+0000","last_clean":"2024-09-17T06:04:14.824908+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:04:14.824908+0000","last_undegraded":"2024-09-17T06:04:14.824908+0000","last_fullsized":"2024-09-17T06:04:14.824908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.753747+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:04:14.753747+0000","last_peered":"2024-09-17T06:04:14.753747+0000","last_clean":"2024-09-17T06:04:14.753747+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:04:14.753747+0000","last_undegraded":"2024-09-17T06:04:14.753747+0000","last_fullsized":"2024-09-17T06:04:14.753747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922776+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:04:13.922776+0000","last_peered":"2024-09-17T06:04:13.922776+0000","last_clean":"2024-09-17T06:04:13.922776+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:04:13.922776+0000","last_undegraded":"2024-09-17T06:04:13.922776+0000","last_fullsized":"2024-09-17T06:04:13.922776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558194+0000","last_change":"2024-09-17T06:04:07.833230+0000","last_active":"2024-09-17T06:04:14.558194+0000","last_peered":"2024-09-17T06:04:14.558194+0000","last_clean":"2024-09-17T06:04:14.558194+0000","last_became_active":"2024-09-17T06:04:07.832307+0000","last_became_peered":"2024-09-17T06:04:07.832307+0000","last_unstale":"2024-09-17T06:04:14.558194+0000","last_undegraded":"2024-09-17T06:04:14.558194+0000","last_fullsized":"2024-09-17T06:04:14.558194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:15.843465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826765+0000","last_change":"2024-09-17T06:04:12.934060+0000","last_active":"2024-09-17T06:04:14.826765+0000","last_peered":"2024-09-17T06:04:14.826765+0000","last_clean":"2024-09-17T06:04:14.826765+0000","last_became_active":"2024-09-17T06:04:12.933545+0000","last_became_peered":"2024-09-17T06:04:12.933545+0000","last_unstale":"2024-09-17T06:04:14.826765+0000","last_undegraded":"2024-09-17T06:04:14.826765+0000","last_fullsized":"2024-09-17T06:04:14.826765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:29.393815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827267+0000","last_change":"2024-09-17T06:04:08.851525+0000","last_active":"2024-09-17T06:04:14.827267+0000","last_peered":"2024-09-17T06:04:14.827267+0000","last_clean":"2024-09-17T06:04:14.827267+0000","last_became_active":"2024-09-17T06:04:08.851117+0000","last_became_peered":"2024-09-17T06:04:08.851117+0000","last_unstale":"2024-09-17T06:04:14.827267+0000","last_undegraded":"2024-09-17T06:04:14.827267+0000","last_fullsized":"2024-09-17T06:04:14.827267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:53.071703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825390+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:04:14.825390+0000","last_peered":"2024-09-17T06:04:14.825390+0000","last_clean":"2024-09-17T06:04:14.825390+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:04:14.825390+0000","last_undegraded":"2024-09-17T06:04:14.825390+0000","last_fullsized":"2024-09-17T06:04:14.825390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921808+0000","last_change":"2024-09-17T06:04:13.042590+0000","last_active":"2024-09-17T06:04:13.921808+0000","last_peered":"2024-09-17T06:04:13.921808+0000","last_clean":"2024-09-17T06:04:13.921808+0000","last_became_active":"2024-09-17T06:04:13.041078+0000","last_became_peered":"2024-09-17T06:04:13.041078+0000","last_unstale":"2024-09-17T06:04:13.921808+0000","last_undegraded":"2024-09-17T06:04:13.921808+0000","last_fullsized":"2024-09-17T06:04:13.921808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:59.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826490+0000","last_change":"2024-09-17T06:04:08.848046+0000","last_active":"2024-09-17T06:04:14.826490+0000","last_peered":"2024-09-17T06:04:14.826490+0000","last_clean":"2024-09-17T06:04:14.826490+0000","last_became_active":"2024-09-17T06:04:08.847664+0000","last_became_peered":"2024-09-17T06:04:08.847664+0000","last_unstale":"2024-09-17T06:04:14.826490+0000","last_undegraded":"2024-09-17T06:04:14.826490+0000","last_fullsized":"2024-09-17T06:04:14.826490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:12.579790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919451+0000","last_change":"2024-09-17T06:04:07.841655+0000","last_active":"2024-09-17T06:04:13.919451+0000","last_peered":"2024-09-17T06:04:13.919451+0000","last_clean":"2024-09-17T06:04:13.919451+0000","last_became_active":"2024-09-17T06:04:07.840432+0000","last_became_peered":"2024-09-17T06:04:07.840432+0000","last_unstale":"2024-09-17T06:04:13.919451+0000","last_undegraded":"2024-09-17T06:04:13.919451+0000","last_fullsized":"2024-09-17T06:04:13.919451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:04.523110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915435+0000","last_change":"2024-09-17T06:04:12.955760+0000","last_active":"2024-09-17T06:04:13.915435+0000","last_peered":"2024-09-17T06:04:13.915435+0000","last_clean":"2024-09-17T06:04:13.915435+0000","last_became_active":"2024-09-17T06:04:12.954977+0000","last_became_peered":"2024-09-17T06:04:12.954977+0000","last_unstale":"2024-09-17T06:04:13.915435+0000","last_undegraded":"2024-09-17T06:04:13.915435+0000","last_fullsized":"2024-09-17T06:04:13.915435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:19.737903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825704+0000","last_change":"2024-09-17T06:04:08.849143+0000","last_active":"2024-09-17T06:04:14.825704+0000","last_peered":"2024-09-17T06:04:14.825704+0000","last_clean":"2024-09-17T06:04:14.825704+0000","last_became_active":"2024-09-17T06:04:08.848740+0000","last_became_peered":"2024-09-17T06:04:08.848740+0000","last_unstale":"2024-09-17T06:04:14.825704+0000","last_undegraded":"2024-09-17T06:04:14.825704+0000","last_fullsized":"2024-09-17T06:04:14.825704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.823997+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:04:14.823997+0000","last_peered":"2024-09-17T06:04:14.823997+0000","last_clean":"2024-09-17T06:04:14.823997+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:04:14.823997+0000","last_undegraded":"2024-09-17T06:04:14.823997+0000","last_fullsized":"2024-09-17T06:04:14.823997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827071+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:04:14.827071+0000","last_peered":"2024-09-17T06:04:14.827071+0000","last_clean":"2024-09-17T06:04:14.827071+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:04:14.827071+0000","last_undegraded":"2024-09-17T06:04:14.827071+0000","last_fullsized":"2024-09-17T06:04:14.827071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754000+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:04:14.754000+0000","last_peered":"2024-09-17T06:04:14.754000+0000","last_clean":"2024-09-17T06:04:14.754000+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:04:14.754000+0000","last_undegraded":"2024-09-17T06:04:14.754000+0000","last_fullsized":"2024-09-17T06:04:14.754000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754133+0000","last_change":"2024-09-17T06:04:07.849633+0000","last_active":"2024-09-17T06:04:14.754133+0000","last_peered":"2024-09-17T06:04:14.754133+0000","last_clean":"2024-09-17T06:04:14.754133+0000","last_became_active":"2024-09-17T06:04:07.848323+0000","last_became_peered":"2024-09-17T06:04:07.848323+0000","last_unstale":"2024-09-17T06:04:14.754133+0000","last_undegraded":"2024-09-17T06:04:14.754133+0000","last_fullsized":"2024-09-17T06:04:14.754133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915247+0000","last_change":"2024-09-17T06:04:13.036889+0000","last_active":"2024-09-17T06:04:13.915247+0000","last_peered":"2024-09-17T06:04:13.915247+0000","last_clean":"2024-09-17T06:04:13.915247+0000","last_became_active":"2024-09-17T06:04:13.035428+0000","last_became_peered":"2024-09-17T06:04:13.035428+0000","last_unstale":"2024-09-17T06:04:13.915247+0000","last_undegraded":"2024-09-17T06:04:13.915247+0000","last_fullsized":"2024-09-17T06:04:13.915247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:00.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826148+0000","last_change":"2024-09-17T06:04:08.848113+0000","last_active":"2024-09-17T06:04:14.826148+0000","last_peered":"2024-09-17T06:04:14.826148+0000","last_clean":"2024-09-17T06:04:14.826148+0000","last_became_active":"2024-09-17T06:04:08.847695+0000","last_became_peered":"2024-09-17T06:04:08.847695+0000","last_unstale":"2024-09-17T06:04:14.826148+0000","last_undegraded":"2024-09-17T06:04:14.826148+0000","last_fullsized":"2024-09-17T06:04:14.826148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:21.258775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922496+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:04:13.922496+0000","last_peered":"2024-09-17T06:04:13.922496+0000","last_clean":"2024-09-17T06:04:13.922496+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:04:13.922496+0000","last_undegraded":"2024-09-17T06:04:13.922496+0000","last_fullsized":"2024-09-17T06:04:13.922496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914403+0000","last_change":"2024-09-17T06:04:13.034560+0000","last_active":"2024-09-17T06:04:13.914403+0000","last_peered":"2024-09-17T06:04:13.914403+0000","last_clean":"2024-09-17T06:04:13.914403+0000","last_became_active":"2024-09-17T06:04:13.034023+0000","last_became_peered":"2024-09-17T06:04:13.034023+0000","last_unstale":"2024-09-17T06:04:13.914403+0000","last_undegraded":"2024-09-17T06:04:13.914403+0000","last_fullsized":"2024-09-17T06:04:13.914403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:04.549375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826605+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:04:14.826605+0000","last_peered":"2024-09-17T06:04:14.826605+0000","last_clean":"2024-09-17T06:04:14.826605+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:04:14.826605+0000","last_undegraded":"2024-09-17T06:04:14.826605+0000","last_fullsized":"2024-09-17T06:04:14.826605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827133+0000","last_change":"2024-09-17T06:04:07.837797+0000","last_active":"2024-09-17T06:04:14.827133+0000","last_peered":"2024-09-17T06:04:14.827133+0000","last_clean":"2024-09-17T06:04:14.827133+0000","last_became_active":"2024-09-17T06:04:07.837347+0000","last_became_peered":"2024-09-17T06:04:07.837347+0000","last_unstale":"2024-09-17T06:04:14.827133+0000","last_undegraded":"2024-09-17T06:04:14.827133+0000","last_fullsized":"2024-09-17T06:04:14.827133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.924037+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:04:13.924037+0000","last_peered":"2024-09-17T06:04:13.924037+0000","last_clean":"2024-09-17T06:04:13.924037+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:04:13.924037+0000","last_undegraded":"2024-09-17T06:04:13.924037+0000","last_fullsized":"2024-09-17T06:04:13.924037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826129+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:04:14.826129+0000","last_peered":"2024-09-17T06:04:14.826129+0000","last_clean":"2024-09-17T06:04:14.826129+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:04:14.826129+0000","last_undegraded":"2024-09-17T06:04:14.826129+0000","last_fullsized":"2024-09-17T06:04:14.826129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:22.322334+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:04:22.322334+0000","last_peered":"2024-09-17T06:04:22.322334+0000","last_clean":"2024-09-17T06:04:22.322334+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:04:22.322334+0000","last_undegraded":"2024-09-17T06:04:22.322334+0000","last_fullsized":"2024-09-17T06:04:22.322334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557256+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:04:14.557256+0000","last_peered":"2024-09-17T06:04:14.557256+0000","last_clean":"2024-09-17T06:04:14.557256+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:04:14.557256+0000","last_undegraded":"2024-09-17T06:04:14.557256+0000","last_fullsized":"2024-09-17T06:04:14.557256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919279+0000","last_change":"2024-09-17T06:04:08.842243+0000","last_active":"2024-09-17T06:04:13.919279+0000","last_peered":"2024-09-17T06:04:13.919279+0000","last_clean":"2024-09-17T06:04:13.919279+0000","last_became_active":"2024-09-17T06:04:08.841831+0000","last_became_peered":"2024-09-17T06:04:08.841831+0000","last_unstale":"2024-09-17T06:04:13.919279+0000","last_undegraded":"2024-09-17T06:04:13.919279+0000","last_fullsized":"2024-09-17T06:04:13.919279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:47.589819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557915+0000","last_change":"2024-09-17T06:04:07.852382+0000","last_active":"2024-09-17T06:04:14.557915+0000","last_peered":"2024-09-17T06:04:14.557915+0000","last_clean":"2024-09-17T06:04:14.557915+0000","last_became_active":"2024-09-17T06:04:07.851954+0000","last_became_peered":"2024-09-17T06:04:07.851954+0000","last_unstale":"2024-09-17T06:04:14.557915+0000","last_undegraded":"2024-09-17T06:04:14.557915+0000","last_fullsized":"2024-09-17T06:04:14.557915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918024+0000","last_change":"2024-09-17T06:04:12.942425+0000","last_active":"2024-09-17T06:04:13.918024+0000","last_peered":"2024-09-17T06:04:13.918024+0000","last_clean":"2024-09-17T06:04:13.918024+0000","last_became_active":"2024-09-17T06:04:12.937463+0000","last_became_peered":"2024-09-17T06:04:12.937463+0000","last_unstale":"2024-09-17T06:04:13.918024+0000","last_undegraded":"2024-09-17T06:04:13.918024+0000","last_fullsized":"2024-09-17T06:04:13.918024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:21.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827689+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:04:14.827689+0000","last_peered":"2024-09-17T06:04:14.827689+0000","last_clean":"2024-09-17T06:04:14.827689+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:04:14.827689+0000","last_undegraded":"2024-09-17T06:04:14.827689+0000","last_fullsized":"2024-09-17T06:04:14.827689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922956+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:04:13.922956+0000","last_peered":"2024-09-17T06:04:13.922956+0000","last_clean":"2024-09-17T06:04:13.922956+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:04:13.922956+0000","last_undegraded":"2024-09-17T06:04:13.922956+0000","last_fullsized":"2024-09-17T06:04:13.922956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913193+0000","last_change":"2024-09-17T06:04:12.956822+0000","last_active":"2024-09-17T06:04:13.913193+0000","last_peered":"2024-09-17T06:04:13.913193+0000","last_clean":"2024-09-17T06:04:13.913193+0000","last_became_active":"2024-09-17T06:04:12.956349+0000","last_became_peered":"2024-09-17T06:04:12.956349+0000","last_unstale":"2024-09-17T06:04:13.913193+0000","last_undegraded":"2024-09-17T06:04:13.913193+0000","last_fullsized":"2024-09-17T06:04:13.913193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:56.435215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922611+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:04:13.922611+0000","last_peered":"2024-09-17T06:04:13.922611+0000","last_clean":"2024-09-17T06:04:13.922611+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:04:13.922611+0000","last_undegraded":"2024-09-17T06:04:13.922611+0000","last_fullsized":"2024-09-17T06:04:13.922611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755152+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:04:14.755152+0000","last_peered":"2024-09-17T06:04:14.755152+0000","last_clean":"2024-09-17T06:04:14.755152+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:04:14.755152+0000","last_undegraded":"2024-09-17T06:04:14.755152+0000","last_fullsized":"2024-09-17T06:04:14.755152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913592+0000","last_change":"2024-09-17T06:04:13.043905+0000","last_active":"2024-09-17T06:04:13.913592+0000","last_peered":"2024-09-17T06:04:13.913592+0000","last_clean":"2024-09-17T06:04:13.913592+0000","last_became_active":"2024-09-17T06:04:13.041929+0000","last_became_peered":"2024-09-17T06:04:13.041929+0000","last_unstale":"2024-09-17T06:04:13.913592+0000","last_undegraded":"2024-09-17T06:04:13.913592+0000","last_fullsized":"2024-09-17T06:04:13.913592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:07.693245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827124+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:04:14.827124+0000","last_peered":"2024-09-17T06:04:14.827124+0000","last_clean":"2024-09-17T06:04:14.827124+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:04:14.827124+0000","last_undegraded":"2024-09-17T06:04:14.827124+0000","last_fullsized":"2024-09-17T06:04:14.827124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556560+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:04:14.556560+0000","last_peered":"2024-09-17T06:04:14.556560+0000","last_clean":"2024-09-17T06:04:14.556560+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:04:14.556560+0000","last_undegraded":"2024-09-17T06:04:14.556560+0000","last_fullsized":"2024-09-17T06:04:14.556560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921998+0000","last_change":"2024-09-17T06:04:07.857398+0000","last_active":"2024-09-17T06:04:13.921998+0000","last_peered":"2024-09-17T06:04:13.921998+0000","last_clean":"2024-09-17T06:04:13.921998+0000","last_became_active":"2024-09-17T06:04:07.856866+0000","last_became_peered":"2024-09-17T06:04:07.856866+0000","last_unstale":"2024-09-17T06:04:13.921998+0000","last_undegraded":"2024-09-17T06:04:13.921998+0000","last_fullsized":"2024-09-17T06:04:13.921998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754760+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:04:14.754760+0000","last_peered":"2024-09-17T06:04:14.754760+0000","last_clean":"2024-09-17T06:04:14.754760+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:04:14.754760+0000","last_undegraded":"2024-09-17T06:04:14.754760+0000","last_fullsized":"2024-09-17T06:04:14.754760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913448+0000","last_change":"2024-09-17T06:04:08.850811+0000","last_active":"2024-09-17T06:04:13.913448+0000","last_peered":"2024-09-17T06:04:13.913448+0000","last_clean":"2024-09-17T06:04:13.913448+0000","last_became_active":"2024-09-17T06:04:08.847235+0000","last_became_peered":"2024-09-17T06:04:08.847235+0000","last_unstale":"2024-09-17T06:04:13.913448+0000","last_undegraded":"2024-09-17T06:04:13.913448+0000","last_fullsized":"2024-09-17T06:04:13.913448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:21.794733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913694+0000","last_change":"2024-09-17T06:04:07.840224+0000","last_active":"2024-09-17T06:04:13.913694+0000","last_peered":"2024-09-17T06:04:13.913694+0000","last_clean":"2024-09-17T06:04:13.913694+0000","last_became_active":"2024-09-17T06:04:07.839703+0000","last_became_peered":"2024-09-17T06:04:07.839703+0000","last_unstale":"2024-09-17T06:04:13.913694+0000","last_undegraded":"2024-09-17T06:04:13.913694+0000","last_fullsized":"2024-09-17T06:04:13.913694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:01.141166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755032+0000","last_change":"2024-09-17T06:04:07.844255+0000","last_active":"2024-09-17T06:04:14.755032+0000","last_peered":"2024-09-17T06:04:14.755032+0000","last_clean":"2024-09-17T06:04:14.755032+0000","last_became_active":"2024-09-17T06:04:07.843380+0000","last_became_peered":"2024-09-17T06:04:07.843380+0000","last_unstale":"2024-09-17T06:04:14.755032+0000","last_undegraded":"2024-09-17T06:04:14.755032+0000","last_fullsized":"2024-09-17T06:04:14.755032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:28.720792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827019+0000","last_change":"2024-09-17T06:04:08.837656+0000","last_active":"2024-09-17T06:04:14.827019+0000","last_peered":"2024-09-17T06:04:14.827019+0000","last_clean":"2024-09-17T06:04:14.827019+0000","last_became_active":"2024-09-17T06:04:08.837157+0000","last_became_peered":"2024-09-17T06:04:08.837157+0000","last_unstale":"2024-09-17T06:04:14.827019+0000","last_undegraded":"2024-09-17T06:04:14.827019+0000","last_fullsized":"2024-09-17T06:04:14.827019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824605+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:04:14.824605+0000","last_peered":"2024-09-17T06:04:14.824605+0000","last_clean":"2024-09-17T06:04:14.824605+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:04:14.824605+0000","last_undegraded":"2024-09-17T06:04:14.824605+0000","last_fullsized":"2024-09-17T06:04:14.824605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915126+0000","last_change":"2024-09-17T06:04:07.848422+0000","last_active":"2024-09-17T06:04:13.915126+0000","last_peered":"2024-09-17T06:04:13.915126+0000","last_clean":"2024-09-17T06:04:13.915126+0000","last_became_active":"2024-09-17T06:04:07.847917+0000","last_became_peered":"2024-09-17T06:04:07.847917+0000","last_unstale":"2024-09-17T06:04:13.915126+0000","last_undegraded":"2024-09-17T06:04:13.915126+0000","last_fullsized":"2024-09-17T06:04:13.915126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:04.960985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916415+0000","last_change":"2024-09-17T06:04:08.831009+0000","last_active":"2024-09-17T06:04:13.916415+0000","last_peered":"2024-09-17T06:04:13.916415+0000","last_clean":"2024-09-17T06:04:13.916415+0000","last_became_active":"2024-09-17T06:04:08.830578+0000","last_became_peered":"2024-09-17T06:04:08.830578+0000","last_unstale":"2024-09-17T06:04:13.916415+0000","last_undegraded":"2024-09-17T06:04:13.916415+0000","last_fullsized":"2024-09-17T06:04:13.916415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:21.761554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914674+0000","last_change":"2024-09-17T06:04:12.953383+0000","last_active":"2024-09-17T06:04:13.914674+0000","last_peered":"2024-09-17T06:04:13.914674+0000","last_clean":"2024-09-17T06:04:13.914674+0000","last_became_active":"2024-09-17T06:04:12.952849+0000","last_became_peered":"2024-09-17T06:04:12.952849+0000","last_unstale":"2024-09-17T06:04:13.914674+0000","last_undegraded":"2024-09-17T06:04:13.914674+0000","last_fullsized":"2024-09-17T06:04:13.914674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:01.588798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754494+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:04:14.754494+0000","last_peered":"2024-09-17T06:04:14.754494+0000","last_clean":"2024-09-17T06:04:14.754494+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:04:14.754494+0000","last_undegraded":"2024-09-17T06:04:14.754494+0000","last_fullsized":"2024-09-17T06:04:14.754494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824042+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:04:14.824042+0000","last_peered":"2024-09-17T06:04:14.824042+0000","last_clean":"2024-09-17T06:04:14.824042+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:04:14.824042+0000","last_undegraded":"2024-09-17T06:04:14.824042+0000","last_fullsized":"2024-09-17T06:04:14.824042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922377+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:04:13.922377+0000","last_peered":"2024-09-17T06:04:13.922377+0000","last_clean":"2024-09-17T06:04:13.922377+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:04:13.922377+0000","last_undegraded":"2024-09-17T06:04:13.922377+0000","last_fullsized":"2024-09-17T06:04:13.922377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826836+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:04:14.826836+0000","last_peered":"2024-09-17T06:04:14.826836+0000","last_clean":"2024-09-17T06:04:14.826836+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:04:14.826836+0000","last_undegraded":"2024-09-17T06:04:14.826836+0000","last_fullsized":"2024-09-17T06:04:14.826836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914912+0000","last_change":"2024-09-17T06:04:08.853837+0000","last_active":"2024-09-17T06:04:13.914912+0000","last_peered":"2024-09-17T06:04:13.914912+0000","last_clean":"2024-09-17T06:04:13.914912+0000","last_became_active":"2024-09-17T06:04:08.847311+0000","last_became_peered":"2024-09-17T06:04:08.847311+0000","last_unstale":"2024-09-17T06:04:13.914912+0000","last_undegraded":"2024-09-17T06:04:13.914912+0000","last_fullsized":"2024-09-17T06:04:13.914912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:39.705332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557384+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:04:14.557384+0000","last_peered":"2024-09-17T06:04:14.557384+0000","last_clean":"2024-09-17T06:04:14.557384+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:04:14.557384+0000","last_undegraded":"2024-09-17T06:04:14.557384+0000","last_fullsized":"2024-09-17T06:04:14.557384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755114+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:04:14.755114+0000","last_peered":"2024-09-17T06:04:14.755114+0000","last_clean":"2024-09-17T06:04:14.755114+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:04:14.755114+0000","last_undegraded":"2024-09-17T06:04:14.755114+0000","last_fullsized":"2024-09-17T06:04:14.755114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915505+0000","last_change":"2024-09-17T06:04:08.847264+0000","last_active":"2024-09-17T06:04:13.915505+0000","last_peered":"2024-09-17T06:04:13.915505+0000","last_clean":"2024-09-17T06:04:13.915505+0000","last_became_active":"2024-09-17T06:04:08.846741+0000","last_became_peered":"2024-09-17T06:04:08.846741+0000","last_unstale":"2024-09-17T06:04:13.915505+0000","last_undegraded":"2024-09-17T06:04:13.915505+0000","last_fullsized":"2024-09-17T06:04:13.915505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921907+0000","last_change":"2024-09-17T06:04:08.856656+0000","last_active":"2024-09-17T06:04:13.921907+0000","last_peered":"2024-09-17T06:04:13.921907+0000","last_clean":"2024-09-17T06:04:13.921907+0000","last_became_active":"2024-09-17T06:04:08.855496+0000","last_became_peered":"2024-09-17T06:04:08.855496+0000","last_unstale":"2024-09-17T06:04:13.921907+0000","last_undegraded":"2024-09-17T06:04:13.921907+0000","last_fullsized":"2024-09-17T06:04:13.921907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913105+0000","last_change":"2024-09-17T06:04:08.851245+0000","last_active":"2024-09-17T06:04:13.913105+0000","last_peered":"2024-09-17T06:04:13.913105+0000","last_clean":"2024-09-17T06:04:13.913105+0000","last_became_active":"2024-09-17T06:04:08.847488+0000","last_became_peered":"2024-09-17T06:04:08.847488+0000","last_unstale":"2024-09-17T06:04:13.913105+0000","last_undegraded":"2024-09-17T06:04:13.913105+0000","last_fullsized":"2024-09-17T06:04:13.913105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922140+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:04:13.922140+0000","last_peered":"2024-09-17T06:04:13.922140+0000","last_clean":"2024-09-17T06:04:13.922140+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:04:13.922140+0000","last_undegraded":"2024-09-17T06:04:13.922140+0000","last_fullsized":"2024-09-17T06:04:13.922140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826398+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:04:14.826398+0000","last_peered":"2024-09-17T06:04:14.826398+0000","last_clean":"2024-09-17T06:04:14.826398+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:04:14.826398+0000","last_undegraded":"2024-09-17T06:04:14.826398+0000","last_fullsized":"2024-09-17T06:04:14.826398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754421+0000","last_change":"2024-09-17T06:04:08.847877+0000","last_active":"2024-09-17T06:04:14.754421+0000","last_peered":"2024-09-17T06:04:14.754421+0000","last_clean":"2024-09-17T06:04:14.754421+0000","last_became_active":"2024-09-17T06:04:08.847538+0000","last_became_peered":"2024-09-17T06:04:08.847538+0000","last_unstale":"2024-09-17T06:04:14.754421+0000","last_undegraded":"2024-09-17T06:04:14.754421+0000","last_fullsized":"2024-09-17T06:04:14.754421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826750+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:04:14.826750+0000","last_peered":"2024-09-17T06:04:14.826750+0000","last_clean":"2024-09-17T06:04:14.826750+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:04:14.826750+0000","last_undegraded":"2024-09-17T06:04:14.826750+0000","last_fullsized":"2024-09-17T06:04:14.826750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825216+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:04:14.825216+0000","last_peered":"2024-09-17T06:04:14.825216+0000","last_clean":"2024-09-17T06:04:14.825216+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:04:14.825216+0000","last_undegraded":"2024-09-17T06:04:14.825216+0000","last_fullsized":"2024-09-17T06:04:14.825216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923600+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:04:13.923600+0000","last_peered":"2024-09-17T06:04:13.923600+0000","last_clean":"2024-09-17T06:04:13.923600+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:04:13.923600+0000","last_undegraded":"2024-09-17T06:04:13.923600+0000","last_fullsized":"2024-09-17T06:04:13.923600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921566+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:04:13.921566+0000","last_peered":"2024-09-17T06:04:13.921566+0000","last_clean":"2024-09-17T06:04:13.921566+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:04:13.921566+0000","last_undegraded":"2024-09-17T06:04:13.921566+0000","last_fullsized":"2024-09-17T06:04:13.921566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556805+0000","last_change":"2024-09-17T06:04:08.824718+0000","last_active":"2024-09-17T06:04:14.556805+0000","last_peered":"2024-09-17T06:04:14.556805+0000","last_clean":"2024-09-17T06:04:14.556805+0000","last_became_active":"2024-09-17T06:04:08.823771+0000","last_became_peered":"2024-09-17T06:04:08.823771+0000","last_unstale":"2024-09-17T06:04:14.556805+0000","last_undegraded":"2024-09-17T06:04:14.556805+0000","last_fullsized":"2024-09-17T06:04:14.556805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:53.735092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826605+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:04:14.826605+0000","last_peered":"2024-09-17T06:04:14.826605+0000","last_clean":"2024-09-17T06:04:14.826605+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:04:14.826605+0000","last_undegraded":"2024-09-17T06:04:14.826605+0000","last_fullsized":"2024-09-17T06:04:14.826605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914823+0000","last_change":"2024-09-17T06:04:08.850255+0000","last_active":"2024-09-17T06:04:13.914823+0000","last_peered":"2024-09-17T06:04:13.914823+0000","last_clean":"2024-09-17T06:04:13.914823+0000","last_became_active":"2024-09-17T06:04:08.847637+0000","last_became_peered":"2024-09-17T06:04:08.847637+0000","last_unstale":"2024-09-17T06:04:13.914823+0000","last_undegraded":"2024-09-17T06:04:13.914823+0000","last_fullsized":"2024-09-17T06:04:13.914823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919159+0000","last_change":"2024-09-17T06:04:08.845829+0000","last_active":"2024-09-17T06:04:13.919159+0000","last_peered":"2024-09-17T06:04:13.919159+0000","last_clean":"2024-09-17T06:04:13.919159+0000","last_became_active":"2024-09-17T06:04:08.845441+0000","last_became_peered":"2024-09-17T06:04:08.845441+0000","last_unstale":"2024-09-17T06:04:13.919159+0000","last_undegraded":"2024-09-17T06:04:13.919159+0000","last_fullsized":"2024-09-17T06:04:13.919159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:38.878124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754889+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:04:14.754889+0000","last_peered":"2024-09-17T06:04:14.754889+0000","last_clean":"2024-09-17T06:04:14.754889+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:04:14.754889+0000","last_undegraded":"2024-09-17T06:04:14.754889+0000","last_fullsized":"2024-09-17T06:04:14.754889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755103+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:04:14.755103+0000","last_peered":"2024-09-17T06:04:14.755103+0000","last_clean":"2024-09-17T06:04:14.755103+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:04:14.755103+0000","last_undegraded":"2024-09-17T06:04:14.755103+0000","last_fullsized":"2024-09-17T06:04:14.755103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827068+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:04:14.827068+0000","last_peered":"2024-09-17T06:04:14.827068+0000","last_clean":"2024-09-17T06:04:14.827068+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:04:14.827068+0000","last_undegraded":"2024-09-17T06:04:14.827068+0000","last_fullsized":"2024-09-17T06:04:14.827068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912650+0000","last_change":"2024-09-17T06:04:08.853473+0000","last_active":"2024-09-17T06:04:13.912650+0000","last_peered":"2024-09-17T06:04:13.912650+0000","last_clean":"2024-09-17T06:04:13.912650+0000","last_became_active":"2024-09-17T06:04:08.851946+0000","last_became_peered":"2024-09-17T06:04:08.851946+0000","last_unstale":"2024-09-17T06:04:13.912650+0000","last_undegraded":"2024-09-17T06:04:13.912650+0000","last_fullsized":"2024-09-17T06:04:13.912650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825436+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:04:14.825436+0000","last_peered":"2024-09-17T06:04:14.825436+0000","last_clean":"2024-09-17T06:04:14.825436+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:04:14.825436+0000","last_undegraded":"2024-09-17T06:04:14.825436+0000","last_fullsized":"2024-09-17T06:04:14.825436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921983+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:04:13.921983+0000","last_peered":"2024-09-17T06:04:13.921983+0000","last_clean":"2024-09-17T06:04:13.921983+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:04:13.921983+0000","last_undegraded":"2024-09-17T06:04:13.921983+0000","last_fullsized":"2024-09-17T06:04:13.921983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825723+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:04:14.825723+0000","last_peered":"2024-09-17T06:04:14.825723+0000","last_clean":"2024-09-17T06:04:14.825723+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:04:14.825723+0000","last_undegraded":"2024-09-17T06:04:14.825723+0000","last_fullsized":"2024-09-17T06:04:14.825723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922399+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:04:13.922399+0000","last_peered":"2024-09-17T06:04:13.922399+0000","last_clean":"2024-09-17T06:04:13.922399+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:04:13.922399+0000","last_undegraded":"2024-09-17T06:04:13.922399+0000","last_fullsized":"2024-09-17T06:04:13.922399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825947+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:04:14.825947+0000","last_peered":"2024-09-17T06:04:14.825947+0000","last_clean":"2024-09-17T06:04:14.825947+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:04:14.825947+0000","last_undegraded":"2024-09-17T06:04:14.825947+0000","last_fullsized":"2024-09-17T06:04:14.825947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558186+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:04:14.558186+0000","last_peered":"2024-09-17T06:04:14.558186+0000","last_clean":"2024-09-17T06:04:14.558186+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:04:14.558186+0000","last_undegraded":"2024-09-17T06:04:14.558186+0000","last_fullsized":"2024-09-17T06:04:14.558186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826777+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:04:14.826777+0000","last_peered":"2024-09-17T06:04:14.826777+0000","last_clean":"2024-09-17T06:04:14.826777+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:04:14.826777+0000","last_undegraded":"2024-09-17T06:04:14.826777+0000","last_fullsized":"2024-09-17T06:04:14.826777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":876544,"data_stored":696906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":106060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":105990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:04:33.836 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:04:34.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.027+0000 7f359fb49640 1 -- 172.21.15.122:0/3023069643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359806fe60 msgr2=0x7f359806d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.027+0000 7f359fb49640 1 --2- 172.21.15.122:0/3023069643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359806fe60 0x7f359806d760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3590009c80 tx=0x7f359001f5a0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.027+0000 7f359fb49640 1 -- 172.21.15.122:0/3023069643 shutdown_connections 2024-09-17T06:04:34.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.027+0000 7f359fb49640 1 --2- 172.21.15.122:0/3023069643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359806fe60 0x7f359806d760 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.027+0000 7f359fb49640 1 --2- 172.21.15.122:0/3023069643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3598159240 0x7f3598142640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.027+0000 7f359fb49640 1 -- 172.21.15.122:0/3023069643 >> 172.21.15.122:0/3023069643 conn(0x7f35980ca380 msgr2=0x7f35980ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:34.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.027+0000 7f359fb49640 1 -- 172.21.15.122:0/3023069643 shutdown_connections 2024-09-17T06:04:34.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.027+0000 7f359fb49640 1 -- 172.21.15.122:0/3023069643 wait complete. 2024-09-17T06:04:34.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359fb49640 1 Processor -- start 2024-09-17T06:04:34.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359fb49640 1 -- start start 2024-09-17T06:04:34.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359fb49640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598159240 0x7f35981f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:34.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359fb49640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359815d240 0x7f3598156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:34.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359fb49640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f359815b9f0 0x7f359815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:34.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359fb49640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f359806de20 con 0x7f359815d240 2024-09-17T06:04:34.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359fb49640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f359806dca0 con 0x7f3598159240 2024-09-17T06:04:34.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359fb49640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f359806dfa0 con 0x7f359815b9f0 2024-09-17T06:04:34.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359d0e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359815d240 0x7f3598156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:34.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359d0e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359815d240 0x7f3598156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35914/0 (socket says 172.21.15.122:35914) 2024-09-17T06:04:34.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359d0e4640 1 -- 172.21.15.122:0/2851432700 learned_addr learned my addr 172.21.15.122:0/2851432700 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:34.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359d8e5640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598159240 0x7f35981f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:34.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359d0e4640 1 -- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f359815b9f0 msgr2=0x7f359815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359e0e6640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f359815b9f0 0x7f359815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:34.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359d0e4640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f359815b9f0 0x7f359815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359d0e4640 1 -- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598159240 msgr2=0x7f35981f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359d0e4640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598159240 0x7f35981f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359d0e4640 1 -- 172.21.15.122:0/2851432700 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35981f5f80 con 0x7f359815d240 2024-09-17T06:04:34.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359d8e5640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598159240 0x7f35981f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:34.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359d0e4640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359815d240 0x7f3598156520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f358c00b440 tx=0x7f358c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:34.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f35967fc640 1 -- 172.21.15.122:0/2851432700 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c015020 con 0x7f359815d240 2024-09-17T06:04:34.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f35967fc640 1 -- 172.21.15.122:0/2851432700 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f358c011980 con 0x7f359815d240 2024-09-17T06:04:34.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f35967fc640 1 -- 172.21.15.122:0/2851432700 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c011dd0 con 0x7f359815d240 2024-09-17T06:04:34.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359fb49640 1 -- 172.21.15.122:0/2851432700 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3598156a60 con 0x7f359815d240 2024-09-17T06:04:34.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.031+0000 7f359fb49640 1 -- 172.21.15.122:0/2851432700 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35981f5240 con 0x7f359815d240 2024-09-17T06:04:34.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.035+0000 7f359fb49640 1 -- 172.21.15.122:0/2851432700 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35980c47a0 con 0x7f359815d240 2024-09-17T06:04:34.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.035+0000 7f35967fc640 1 -- 172.21.15.122:0/2851432700 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f358c018020 con 0x7f359815d240 2024-09-17T06:04:34.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.035+0000 7f35967fc640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3584073230 0x7f3584075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:34.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.035+0000 7f35967fc640 1 -- 172.21.15.122:0/2851432700 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f358c0946b0 con 0x7f359815d240 2024-09-17T06:04:34.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.035+0000 7f359d8e5640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3584073230 0x7f3584075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:34.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.035+0000 7f359d8e5640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3584073230 0x7f3584075740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3588005fd0 tx=0x7f3588005dc0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:34.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.039+0000 7f35967fc640 1 -- 172.21.15.122:0/2851432700 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f358c01f030 con 0x7f359815d240 2024-09-17T06:04:34.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.203+0000 7f359fb49640 1 -- 172.21.15.122:0/2851432700 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f359806e460 con 0x7f3584073230 2024-09-17T06:04:34.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.219+0000 7f35967fc640 1 -- 172.21.15.122:0/2851432700 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f359806e460 con 0x7f3584073230 2024-09-17T06:04:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:34.229 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:04:34.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.227+0000 7f359fb49640 1 -- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3584073230 msgr2=0x7f3584075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.227+0000 7f359fb49640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3584073230 0x7f3584075740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3588005fd0 tx=0x7f3588005dc0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.227+0000 7f359fb49640 1 -- 172.21.15.122:0/2851432700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359815d240 msgr2=0x7f3598156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.227+0000 7f359fb49640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359815d240 0x7f3598156520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f358c00b440 tx=0x7f358c00b900 comp rx=0 tx=0).stop 2024-09-17T06:04:34.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.227+0000 7f359fb49640 1 -- 172.21.15.122:0/2851432700 shutdown_connections 2024-09-17T06:04:34.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.227+0000 7f359fb49640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f359815b9f0 0x7f359815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.227+0000 7f359fb49640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359815d240 0x7f3598156520 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.227+0000 7f359fb49640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3584073230 0x7f3584075740 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.227+0000 7f359fb49640 1 --2- 172.21.15.122:0/2851432700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598159240 0x7f35981f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.227+0000 7f359fb49640 1 -- 172.21.15.122:0/2851432700 >> 172.21.15.122:0/2851432700 conn(0x7f35980ca380 msgr2=0x7f359813e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:34.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.227+0000 7f359fb49640 1 -- 172.21.15.122:0/2851432700 shutdown_connections 2024-09-17T06:04:34.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.227+0000 7f359fb49640 1 -- 172.21.15.122:0/2851432700 wait complete. 2024-09-17T06:04:34.248 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-17T06:04:33.521070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219568,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755152,"statfs":{"total":773094113280,"available":772869275648,"internally_reserved":0,"allocated":3416064,"data_stored":2037216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005584"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827969+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:04:14.827969+0000","last_peered":"2024-09-17T06:04:14.827969+0000","last_clean":"2024-09-17T06:04:14.827969+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:04:14.827969+0000","last_undegraded":"2024-09-17T06:04:14.827969+0000","last_fullsized":"2024-09-17T06:04:14.827969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914314+0000","last_change":"2024-09-17T06:04:08.851488+0000","last_active":"2024-09-17T06:04:13.914314+0000","last_peered":"2024-09-17T06:04:13.914314+0000","last_clean":"2024-09-17T06:04:13.914314+0000","last_became_active":"2024-09-17T06:04:08.847345+0000","last_became_peered":"2024-09-17T06:04:08.847345+0000","last_unstale":"2024-09-17T06:04:13.914314+0000","last_undegraded":"2024-09-17T06:04:13.914314+0000","last_fullsized":"2024-09-17T06:04:13.914314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912954+0000","last_change":"2024-09-17T06:04:13.045049+0000","last_active":"2024-09-17T06:04:13.912954+0000","last_peered":"2024-09-17T06:04:13.912954+0000","last_clean":"2024-09-17T06:04:13.912954+0000","last_became_active":"2024-09-17T06:04:13.041321+0000","last_became_peered":"2024-09-17T06:04:13.041321+0000","last_unstale":"2024-09-17T06:04:13.912954+0000","last_undegraded":"2024-09-17T06:04:13.912954+0000","last_fullsized":"2024-09-17T06:04:13.912954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.500551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914545+0000","last_change":"2024-09-17T06:04:07.834691+0000","last_active":"2024-09-17T06:04:13.914545+0000","last_peered":"2024-09-17T06:04:13.914545+0000","last_clean":"2024-09-17T06:04:13.914545+0000","last_became_active":"2024-09-17T06:04:07.834110+0000","last_became_peered":"2024-09-17T06:04:07.834110+0000","last_unstale":"2024-09-17T06:04:13.914545+0000","last_undegraded":"2024-09-17T06:04:13.914545+0000","last_fullsized":"2024-09-17T06:04:13.914545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827140+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:04:14.827140+0000","last_peered":"2024-09-17T06:04:14.827140+0000","last_clean":"2024-09-17T06:04:14.827140+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:04:14.827140+0000","last_undegraded":"2024-09-17T06:04:14.827140+0000","last_fullsized":"2024-09-17T06:04:14.827140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915612+0000","last_change":"2024-09-17T06:04:12.954966+0000","last_active":"2024-09-17T06:04:13.915612+0000","last_peered":"2024-09-17T06:04:13.915612+0000","last_clean":"2024-09-17T06:04:13.915612+0000","last_became_active":"2024-09-17T06:04:12.953915+0000","last_became_peered":"2024-09-17T06:04:12.953915+0000","last_unstale":"2024-09-17T06:04:13.915612+0000","last_undegraded":"2024-09-17T06:04:13.915612+0000","last_fullsized":"2024-09-17T06:04:13.915612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:54.009189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826543+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:04:14.826543+0000","last_peered":"2024-09-17T06:04:14.826543+0000","last_clean":"2024-09-17T06:04:14.826543+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:04:14.826543+0000","last_undegraded":"2024-09-17T06:04:14.826543+0000","last_fullsized":"2024-09-17T06:04:14.826543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922620+0000","last_change":"2024-09-17T06:04:08.847869+0000","last_active":"2024-09-17T06:04:13.922620+0000","last_peered":"2024-09-17T06:04:13.922620+0000","last_clean":"2024-09-17T06:04:13.922620+0000","last_became_active":"2024-09-17T06:04:08.847475+0000","last_became_peered":"2024-09-17T06:04:08.847475+0000","last_unstale":"2024-09-17T06:04:13.922620+0000","last_undegraded":"2024-09-17T06:04:13.922620+0000","last_fullsized":"2024-09-17T06:04:13.922620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:54.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.917090+0000","last_change":"2024-09-17T06:04:12.948833+0000","last_active":"2024-09-17T06:04:13.917090+0000","last_peered":"2024-09-17T06:04:13.917090+0000","last_clean":"2024-09-17T06:04:13.917090+0000","last_became_active":"2024-09-17T06:04:12.947705+0000","last_became_peered":"2024-09-17T06:04:12.947705+0000","last_unstale":"2024-09-17T06:04:13.917090+0000","last_undegraded":"2024-09-17T06:04:13.917090+0000","last_fullsized":"2024-09-17T06:04:13.917090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:46.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826033+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:04:14.826033+0000","last_peered":"2024-09-17T06:04:14.826033+0000","last_clean":"2024-09-17T06:04:14.826033+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:04:14.826033+0000","last_undegraded":"2024-09-17T06:04:14.826033+0000","last_fullsized":"2024-09-17T06:04:14.826033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923681+0000","last_change":"2024-09-17T06:04:08.850056+0000","last_active":"2024-09-17T06:04:13.923681+0000","last_peered":"2024-09-17T06:04:13.923681+0000","last_clean":"2024-09-17T06:04:13.923681+0000","last_became_active":"2024-09-17T06:04:08.847436+0000","last_became_peered":"2024-09-17T06:04:08.847436+0000","last_unstale":"2024-09-17T06:04:13.923681+0000","last_undegraded":"2024-09-17T06:04:13.923681+0000","last_fullsized":"2024-09-17T06:04:13.923681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:29.069085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916255+0000","last_change":"2024-09-17T06:04:12.951144+0000","last_active":"2024-09-17T06:04:13.916255+0000","last_peered":"2024-09-17T06:04:13.916255+0000","last_clean":"2024-09-17T06:04:13.916255+0000","last_became_active":"2024-09-17T06:04:12.950127+0000","last_became_peered":"2024-09-17T06:04:12.950127+0000","last_unstale":"2024-09-17T06:04:13.916255+0000","last_undegraded":"2024-09-17T06:04:13.916255+0000","last_fullsized":"2024-09-17T06:04:13.916255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:52.901835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.753568+0000","last_change":"2024-09-17T06:04:08.847906+0000","last_active":"2024-09-17T06:04:14.753568+0000","last_peered":"2024-09-17T06:04:14.753568+0000","last_clean":"2024-09-17T06:04:14.753568+0000","last_became_active":"2024-09-17T06:04:08.847601+0000","last_became_peered":"2024-09-17T06:04:08.847601+0000","last_unstale":"2024-09-17T06:04:14.753568+0000","last_undegraded":"2024-09-17T06:04:14.753568+0000","last_fullsized":"2024-09-17T06:04:14.753568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826490+0000","last_change":"2024-09-17T06:04:07.851351+0000","last_active":"2024-09-17T06:04:14.826490+0000","last_peered":"2024-09-17T06:04:14.826490+0000","last_clean":"2024-09-17T06:04:14.826490+0000","last_became_active":"2024-09-17T06:04:07.850947+0000","last_became_peered":"2024-09-17T06:04:07.850947+0000","last_unstale":"2024-09-17T06:04:14.826490+0000","last_undegraded":"2024-09-17T06:04:14.826490+0000","last_fullsized":"2024-09-17T06:04:14.826490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:43.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919163+0000","last_change":"2024-09-17T06:04:12.936732+0000","last_active":"2024-09-17T06:04:13.919163+0000","last_peered":"2024-09-17T06:04:13.919163+0000","last_clean":"2024-09-17T06:04:13.919163+0000","last_became_active":"2024-09-17T06:04:12.935512+0000","last_became_peered":"2024-09-17T06:04:12.935512+0000","last_unstale":"2024-09-17T06:04:13.919163+0000","last_undegraded":"2024-09-17T06:04:13.919163+0000","last_fullsized":"2024-09-17T06:04:13.919163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915113+0000","last_change":"2024-09-17T06:04:08.847093+0000","last_active":"2024-09-17T06:04:13.915113+0000","last_peered":"2024-09-17T06:04:13.915113+0000","last_clean":"2024-09-17T06:04:13.915113+0000","last_became_active":"2024-09-17T06:04:08.846716+0000","last_became_peered":"2024-09-17T06:04:08.846716+0000","last_unstale":"2024-09-17T06:04:13.915113+0000","last_undegraded":"2024-09-17T06:04:13.915113+0000","last_fullsized":"2024-09-17T06:04:13.915113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557626+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:04:14.557626+0000","last_peered":"2024-09-17T06:04:14.557626+0000","last_clean":"2024-09-17T06:04:14.557626+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:04:14.557626+0000","last_undegraded":"2024-09-17T06:04:14.557626+0000","last_fullsized":"2024-09-17T06:04:14.557626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918420+0000","last_change":"2024-09-17T06:04:12.951796+0000","last_active":"2024-09-17T06:04:13.918420+0000","last_peered":"2024-09-17T06:04:13.918420+0000","last_clean":"2024-09-17T06:04:13.918420+0000","last_became_active":"2024-09-17T06:04:12.948211+0000","last_became_peered":"2024-09-17T06:04:12.948211+0000","last_unstale":"2024-09-17T06:04:13.918420+0000","last_undegraded":"2024-09-17T06:04:13.918420+0000","last_fullsized":"2024-09-17T06:04:13.918420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:43.869350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913781+0000","last_change":"2024-09-17T06:04:08.850212+0000","last_active":"2024-09-17T06:04:13.913781+0000","last_peered":"2024-09-17T06:04:13.913781+0000","last_clean":"2024-09-17T06:04:13.913781+0000","last_became_active":"2024-09-17T06:04:08.835906+0000","last_became_peered":"2024-09-17T06:04:08.835906+0000","last_unstale":"2024-09-17T06:04:13.913781+0000","last_undegraded":"2024-09-17T06:04:13.913781+0000","last_fullsized":"2024-09-17T06:04:13.913781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556835+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:04:14.556835+0000","last_peered":"2024-09-17T06:04:14.556835+0000","last_clean":"2024-09-17T06:04:14.556835+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:04:14.556835+0000","last_undegraded":"2024-09-17T06:04:14.556835+0000","last_fullsized":"2024-09-17T06:04:14.556835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558516+0000","last_change":"2024-09-17T06:04:13.048882+0000","last_active":"2024-09-17T06:04:14.558516+0000","last_peered":"2024-09-17T06:04:14.558516+0000","last_clean":"2024-09-17T06:04:14.558516+0000","last_became_active":"2024-09-17T06:04:13.047684+0000","last_became_peered":"2024-09-17T06:04:13.047684+0000","last_unstale":"2024-09-17T06:04:14.558516+0000","last_undegraded":"2024-09-17T06:04:14.558516+0000","last_fullsized":"2024-09-17T06:04:14.558516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:21.270772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916697+0000","last_change":"2024-09-17T06:04:08.838033+0000","last_active":"2024-09-17T06:04:13.916697+0000","last_peered":"2024-09-17T06:04:13.916697+0000","last_clean":"2024-09-17T06:04:13.916697+0000","last_became_active":"2024-09-17T06:04:08.836402+0000","last_became_peered":"2024-09-17T06:04:08.836402+0000","last_unstale":"2024-09-17T06:04:13.916697+0000","last_undegraded":"2024-09-17T06:04:13.916697+0000","last_fullsized":"2024-09-17T06:04:13.916697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:12.374198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825530+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:04:14.825530+0000","last_peered":"2024-09-17T06:04:14.825530+0000","last_clean":"2024-09-17T06:04:14.825530+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:04:14.825530+0000","last_undegraded":"2024-09-17T06:04:14.825530+0000","last_fullsized":"2024-09-17T06:04:14.825530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919390+0000","last_change":"2024-09-17T06:04:12.949288+0000","last_active":"2024-09-17T06:04:13.919390+0000","last_peered":"2024-09-17T06:04:13.919390+0000","last_clean":"2024-09-17T06:04:13.919390+0000","last_became_active":"2024-09-17T06:04:12.947997+0000","last_became_peered":"2024-09-17T06:04:12.947997+0000","last_unstale":"2024-09-17T06:04:13.919390+0000","last_undegraded":"2024-09-17T06:04:13.919390+0000","last_fullsized":"2024-09-17T06:04:13.919390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827729+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:04:14.827729+0000","last_peered":"2024-09-17T06:04:14.827729+0000","last_clean":"2024-09-17T06:04:14.827729+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:04:14.827729+0000","last_undegraded":"2024-09-17T06:04:14.827729+0000","last_fullsized":"2024-09-17T06:04:14.827729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755401+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:04:14.755401+0000","last_peered":"2024-09-17T06:04:14.755401+0000","last_clean":"2024-09-17T06:04:14.755401+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:04:14.755401+0000","last_undegraded":"2024-09-17T06:04:14.755401+0000","last_fullsized":"2024-09-17T06:04:14.755401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915706+0000","last_change":"2024-09-17T06:04:13.039804+0000","last_active":"2024-09-17T06:04:13.915706+0000","last_peered":"2024-09-17T06:04:13.915706+0000","last_clean":"2024-09-17T06:04:13.915706+0000","last_became_active":"2024-09-17T06:04:13.038212+0000","last_became_peered":"2024-09-17T06:04:13.038212+0000","last_unstale":"2024-09-17T06:04:13.915706+0000","last_undegraded":"2024-09-17T06:04:13.915706+0000","last_fullsized":"2024-09-17T06:04:13.915706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:35.798927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915606+0000","last_change":"2024-09-17T06:04:08.853353+0000","last_active":"2024-09-17T06:04:13.915606+0000","last_peered":"2024-09-17T06:04:13.915606+0000","last_clean":"2024-09-17T06:04:13.915606+0000","last_became_active":"2024-09-17T06:04:08.852015+0000","last_became_peered":"2024-09-17T06:04:08.852015+0000","last_unstale":"2024-09-17T06:04:13.915606+0000","last_undegraded":"2024-09-17T06:04:13.915606+0000","last_fullsized":"2024-09-17T06:04:13.915606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558240+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:04:14.558240+0000","last_peered":"2024-09-17T06:04:14.558240+0000","last_clean":"2024-09-17T06:04:14.558240+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:04:14.558240+0000","last_undegraded":"2024-09-17T06:04:14.558240+0000","last_fullsized":"2024-09-17T06:04:14.558240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912658+0000","last_change":"2024-09-17T06:04:13.034589+0000","last_active":"2024-09-17T06:04:13.912658+0000","last_peered":"2024-09-17T06:04:13.912658+0000","last_clean":"2024-09-17T06:04:13.912658+0000","last_became_active":"2024-09-17T06:04:13.034080+0000","last_became_peered":"2024-09-17T06:04:13.034080+0000","last_unstale":"2024-09-17T06:04:13.912658+0000","last_undegraded":"2024-09-17T06:04:13.912658+0000","last_fullsized":"2024-09-17T06:04:13.912658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:16.669822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557861+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:04:14.557861+0000","last_peered":"2024-09-17T06:04:14.557861+0000","last_clean":"2024-09-17T06:04:14.557861+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:04:14.557861+0000","last_undegraded":"2024-09-17T06:04:14.557861+0000","last_fullsized":"2024-09-17T06:04:14.557861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826908+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:04:14.826908+0000","last_peered":"2024-09-17T06:04:14.826908+0000","last_clean":"2024-09-17T06:04:14.826908+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:04:14.826908+0000","last_undegraded":"2024-09-17T06:04:14.826908+0000","last_fullsized":"2024-09-17T06:04:14.826908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826528+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:04:14.826528+0000","last_peered":"2024-09-17T06:04:14.826528+0000","last_clean":"2024-09-17T06:04:14.826528+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:04:14.826528+0000","last_undegraded":"2024-09-17T06:04:14.826528+0000","last_fullsized":"2024-09-17T06:04:14.826528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923885+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:04:13.923885+0000","last_peered":"2024-09-17T06:04:13.923885+0000","last_clean":"2024-09-17T06:04:13.923885+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:04:13.923885+0000","last_undegraded":"2024-09-17T06:04:13.923885+0000","last_fullsized":"2024-09-17T06:04:13.923885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558155+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:04:14.558155+0000","last_peered":"2024-09-17T06:04:14.558155+0000","last_clean":"2024-09-17T06:04:14.558155+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:04:14.558155+0000","last_undegraded":"2024-09-17T06:04:14.558155+0000","last_fullsized":"2024-09-17T06:04:14.558155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556865+0000","last_change":"2024-09-17T06:04:12.942301+0000","last_active":"2024-09-17T06:04:14.556865+0000","last_peered":"2024-09-17T06:04:14.556865+0000","last_clean":"2024-09-17T06:04:14.556865+0000","last_became_active":"2024-09-17T06:04:12.941640+0000","last_became_peered":"2024-09-17T06:04:12.941640+0000","last_unstale":"2024-09-17T06:04:14.556865+0000","last_undegraded":"2024-09-17T06:04:14.556865+0000","last_fullsized":"2024-09-17T06:04:14.556865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:31.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918736+0000","last_change":"2024-09-17T06:04:08.838642+0000","last_active":"2024-09-17T06:04:13.918736+0000","last_peered":"2024-09-17T06:04:13.918736+0000","last_clean":"2024-09-17T06:04:13.918736+0000","last_became_active":"2024-09-17T06:04:08.835562+0000","last_became_peered":"2024-09-17T06:04:08.835562+0000","last_unstale":"2024-09-17T06:04:13.918736+0000","last_undegraded":"2024-09-17T06:04:13.918736+0000","last_fullsized":"2024-09-17T06:04:13.918736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:16.900376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922711+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:04:13.922711+0000","last_peered":"2024-09-17T06:04:13.922711+0000","last_clean":"2024-09-17T06:04:13.922711+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:04:13.922711+0000","last_undegraded":"2024-09-17T06:04:13.922711+0000","last_fullsized":"2024-09-17T06:04:13.922711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557663+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:04:14.557663+0000","last_peered":"2024-09-17T06:04:14.557663+0000","last_clean":"2024-09-17T06:04:14.557663+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:04:14.557663+0000","last_undegraded":"2024-09-17T06:04:14.557663+0000","last_fullsized":"2024-09-17T06:04:14.557663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556896+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:04:14.556896+0000","last_peered":"2024-09-17T06:04:14.556896+0000","last_clean":"2024-09-17T06:04:14.556896+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:04:14.556896+0000","last_undegraded":"2024-09-17T06:04:14.556896+0000","last_fullsized":"2024-09-17T06:04:14.556896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824198+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:04:14.824198+0000","last_peered":"2024-09-17T06:04:14.824198+0000","last_clean":"2024-09-17T06:04:14.824198+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:04:14.824198+0000","last_undegraded":"2024-09-17T06:04:14.824198+0000","last_fullsized":"2024-09-17T06:04:14.824198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558517+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:04:14.558517+0000","last_peered":"2024-09-17T06:04:14.558517+0000","last_clean":"2024-09-17T06:04:14.558517+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:04:14.558517+0000","last_undegraded":"2024-09-17T06:04:14.558517+0000","last_fullsized":"2024-09-17T06:04:14.558517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826003+0000","last_change":"2024-09-17T06:04:08.840359+0000","last_active":"2024-09-17T06:04:14.826003+0000","last_peered":"2024-09-17T06:04:14.826003+0000","last_clean":"2024-09-17T06:04:14.826003+0000","last_became_active":"2024-09-17T06:04:08.839822+0000","last_became_peered":"2024-09-17T06:04:08.839822+0000","last_unstale":"2024-09-17T06:04:14.826003+0000","last_undegraded":"2024-09-17T06:04:14.826003+0000","last_fullsized":"2024-09-17T06:04:14.826003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825413+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:04:14.825413+0000","last_peered":"2024-09-17T06:04:14.825413+0000","last_clean":"2024-09-17T06:04:14.825413+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:04:14.825413+0000","last_undegraded":"2024-09-17T06:04:14.825413+0000","last_fullsized":"2024-09-17T06:04:14.825413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827476+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:04:14.827476+0000","last_peered":"2024-09-17T06:04:14.827476+0000","last_clean":"2024-09-17T06:04:14.827476+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:04:14.827476+0000","last_undegraded":"2024-09-17T06:04:14.827476+0000","last_fullsized":"2024-09-17T06:04:14.827476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913432+0000","last_change":"2024-09-17T06:04:08.846617+0000","last_active":"2024-09-17T06:04:13.913432+0000","last_peered":"2024-09-17T06:04:13.913432+0000","last_clean":"2024-09-17T06:04:13.913432+0000","last_became_active":"2024-09-17T06:04:08.837049+0000","last_became_peered":"2024-09-17T06:04:08.837049+0000","last_unstale":"2024-09-17T06:04:13.913432+0000","last_undegraded":"2024-09-17T06:04:13.913432+0000","last_fullsized":"2024-09-17T06:04:13.913432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923114+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:04:13.923114+0000","last_peered":"2024-09-17T06:04:13.923114+0000","last_clean":"2024-09-17T06:04:13.923114+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:04:13.923114+0000","last_undegraded":"2024-09-17T06:04:13.923114+0000","last_fullsized":"2024-09-17T06:04:13.923114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825786+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:04:14.825786+0000","last_peered":"2024-09-17T06:04:14.825786+0000","last_clean":"2024-09-17T06:04:14.825786+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:04:14.825786+0000","last_undegraded":"2024-09-17T06:04:14.825786+0000","last_fullsized":"2024-09-17T06:04:14.825786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754281+0000","last_change":"2024-09-17T06:04:13.042118+0000","last_active":"2024-09-17T06:04:14.754281+0000","last_peered":"2024-09-17T06:04:14.754281+0000","last_clean":"2024-09-17T06:04:14.754281+0000","last_became_active":"2024-09-17T06:04:13.040403+0000","last_became_peered":"2024-09-17T06:04:13.040403+0000","last_unstale":"2024-09-17T06:04:14.754281+0000","last_undegraded":"2024-09-17T06:04:14.754281+0000","last_fullsized":"2024-09-17T06:04:14.754281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826117+0000","last_change":"2024-09-17T06:04:08.838758+0000","last_active":"2024-09-17T06:04:14.826117+0000","last_peered":"2024-09-17T06:04:14.826117+0000","last_clean":"2024-09-17T06:04:14.826117+0000","last_became_active":"2024-09-17T06:04:08.838386+0000","last_became_peered":"2024-09-17T06:04:08.838386+0000","last_unstale":"2024-09-17T06:04:14.826117+0000","last_undegraded":"2024-09-17T06:04:14.826117+0000","last_fullsized":"2024-09-17T06:04:14.826117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:03.255963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824908+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:04:14.824908+0000","last_peered":"2024-09-17T06:04:14.824908+0000","last_clean":"2024-09-17T06:04:14.824908+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:04:14.824908+0000","last_undegraded":"2024-09-17T06:04:14.824908+0000","last_fullsized":"2024-09-17T06:04:14.824908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.753747+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:04:14.753747+0000","last_peered":"2024-09-17T06:04:14.753747+0000","last_clean":"2024-09-17T06:04:14.753747+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:04:14.753747+0000","last_undegraded":"2024-09-17T06:04:14.753747+0000","last_fullsized":"2024-09-17T06:04:14.753747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922776+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:04:13.922776+0000","last_peered":"2024-09-17T06:04:13.922776+0000","last_clean":"2024-09-17T06:04:13.922776+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:04:13.922776+0000","last_undegraded":"2024-09-17T06:04:13.922776+0000","last_fullsized":"2024-09-17T06:04:13.922776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558194+0000","last_change":"2024-09-17T06:04:07.833230+0000","last_active":"2024-09-17T06:04:14.558194+0000","last_peered":"2024-09-17T06:04:14.558194+0000","last_clean":"2024-09-17T06:04:14.558194+0000","last_became_active":"2024-09-17T06:04:07.832307+0000","last_became_peered":"2024-09-17T06:04:07.832307+0000","last_unstale":"2024-09-17T06:04:14.558194+0000","last_undegraded":"2024-09-17T06:04:14.558194+0000","last_fullsized":"2024-09-17T06:04:14.558194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:15.843465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826765+0000","last_change":"2024-09-17T06:04:12.934060+0000","last_active":"2024-09-17T06:04:14.826765+0000","last_peered":"2024-09-17T06:04:14.826765+0000","last_clean":"2024-09-17T06:04:14.826765+0000","last_became_active":"2024-09-17T06:04:12.933545+0000","last_became_peered":"2024-09-17T06:04:12.933545+0000","last_unstale":"2024-09-17T06:04:14.826765+0000","last_undegraded":"2024-09-17T06:04:14.826765+0000","last_fullsized":"2024-09-17T06:04:14.826765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:29.393815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827267+0000","last_change":"2024-09-17T06:04:08.851525+0000","last_active":"2024-09-17T06:04:14.827267+0000","last_peered":"2024-09-17T06:04:14.827267+0000","last_clean":"2024-09-17T06:04:14.827267+0000","last_became_active":"2024-09-17T06:04:08.851117+0000","last_became_peered":"2024-09-17T06:04:08.851117+0000","last_unstale":"2024-09-17T06:04:14.827267+0000","last_undegraded":"2024-09-17T06:04:14.827267+0000","last_fullsized":"2024-09-17T06:04:14.827267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:53.071703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825390+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:04:14.825390+0000","last_peered":"2024-09-17T06:04:14.825390+0000","last_clean":"2024-09-17T06:04:14.825390+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:04:14.825390+0000","last_undegraded":"2024-09-17T06:04:14.825390+0000","last_fullsized":"2024-09-17T06:04:14.825390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921808+0000","last_change":"2024-09-17T06:04:13.042590+0000","last_active":"2024-09-17T06:04:13.921808+0000","last_peered":"2024-09-17T06:04:13.921808+0000","last_clean":"2024-09-17T06:04:13.921808+0000","last_became_active":"2024-09-17T06:04:13.041078+0000","last_became_peered":"2024-09-17T06:04:13.041078+0000","last_unstale":"2024-09-17T06:04:13.921808+0000","last_undegraded":"2024-09-17T06:04:13.921808+0000","last_fullsized":"2024-09-17T06:04:13.921808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:59.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826490+0000","last_change":"2024-09-17T06:04:08.848046+0000","last_active":"2024-09-17T06:04:14.826490+0000","last_peered":"2024-09-17T06:04:14.826490+0000","last_clean":"2024-09-17T06:04:14.826490+0000","last_became_active":"2024-09-17T06:04:08.847664+0000","last_became_peered":"2024-09-17T06:04:08.847664+0000","last_unstale":"2024-09-17T06:04:14.826490+0000","last_undegraded":"2024-09-17T06:04:14.826490+0000","last_fullsized":"2024-09-17T06:04:14.826490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:12.579790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919451+0000","last_change":"2024-09-17T06:04:07.841655+0000","last_active":"2024-09-17T06:04:13.919451+0000","last_peered":"2024-09-17T06:04:13.919451+0000","last_clean":"2024-09-17T06:04:13.919451+0000","last_became_active":"2024-09-17T06:04:07.840432+0000","last_became_peered":"2024-09-17T06:04:07.840432+0000","last_unstale":"2024-09-17T06:04:13.919451+0000","last_undegraded":"2024-09-17T06:04:13.919451+0000","last_fullsized":"2024-09-17T06:04:13.919451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:04.523110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915435+0000","last_change":"2024-09-17T06:04:12.955760+0000","last_active":"2024-09-17T06:04:13.915435+0000","last_peered":"2024-09-17T06:04:13.915435+0000","last_clean":"2024-09-17T06:04:13.915435+0000","last_became_active":"2024-09-17T06:04:12.954977+0000","last_became_peered":"2024-09-17T06:04:12.954977+0000","last_unstale":"2024-09-17T06:04:13.915435+0000","last_undegraded":"2024-09-17T06:04:13.915435+0000","last_fullsized":"2024-09-17T06:04:13.915435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:19.737903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825704+0000","last_change":"2024-09-17T06:04:08.849143+0000","last_active":"2024-09-17T06:04:14.825704+0000","last_peered":"2024-09-17T06:04:14.825704+0000","last_clean":"2024-09-17T06:04:14.825704+0000","last_became_active":"2024-09-17T06:04:08.848740+0000","last_became_peered":"2024-09-17T06:04:08.848740+0000","last_unstale":"2024-09-17T06:04:14.825704+0000","last_undegraded":"2024-09-17T06:04:14.825704+0000","last_fullsized":"2024-09-17T06:04:14.825704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.823997+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:04:14.823997+0000","last_peered":"2024-09-17T06:04:14.823997+0000","last_clean":"2024-09-17T06:04:14.823997+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:04:14.823997+0000","last_undegraded":"2024-09-17T06:04:14.823997+0000","last_fullsized":"2024-09-17T06:04:14.823997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827071+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:04:14.827071+0000","last_peered":"2024-09-17T06:04:14.827071+0000","last_clean":"2024-09-17T06:04:14.827071+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:04:14.827071+0000","last_undegraded":"2024-09-17T06:04:14.827071+0000","last_fullsized":"2024-09-17T06:04:14.827071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754000+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:04:14.754000+0000","last_peered":"2024-09-17T06:04:14.754000+0000","last_clean":"2024-09-17T06:04:14.754000+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:04:14.754000+0000","last_undegraded":"2024-09-17T06:04:14.754000+0000","last_fullsized":"2024-09-17T06:04:14.754000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754133+0000","last_change":"2024-09-17T06:04:07.849633+0000","last_active":"2024-09-17T06:04:14.754133+0000","last_peered":"2024-09-17T06:04:14.754133+0000","last_clean":"2024-09-17T06:04:14.754133+0000","last_became_active":"2024-09-17T06:04:07.848323+0000","last_became_peered":"2024-09-17T06:04:07.848323+0000","last_unstale":"2024-09-17T06:04:14.754133+0000","last_undegraded":"2024-09-17T06:04:14.754133+0000","last_fullsized":"2024-09-17T06:04:14.754133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915247+0000","last_change":"2024-09-17T06:04:13.036889+0000","last_active":"2024-09-17T06:04:13.915247+0000","last_peered":"2024-09-17T06:04:13.915247+0000","last_clean":"2024-09-17T06:04:13.915247+0000","last_became_active":"2024-09-17T06:04:13.035428+0000","last_became_peered":"2024-09-17T06:04:13.035428+0000","last_unstale":"2024-09-17T06:04:13.915247+0000","last_undegraded":"2024-09-17T06:04:13.915247+0000","last_fullsized":"2024-09-17T06:04:13.915247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:00.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826148+0000","last_change":"2024-09-17T06:04:08.848113+0000","last_active":"2024-09-17T06:04:14.826148+0000","last_peered":"2024-09-17T06:04:14.826148+0000","last_clean":"2024-09-17T06:04:14.826148+0000","last_became_active":"2024-09-17T06:04:08.847695+0000","last_became_peered":"2024-09-17T06:04:08.847695+0000","last_unstale":"2024-09-17T06:04:14.826148+0000","last_undegraded":"2024-09-17T06:04:14.826148+0000","last_fullsized":"2024-09-17T06:04:14.826148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:21.258775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922496+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:04:13.922496+0000","last_peered":"2024-09-17T06:04:13.922496+0000","last_clean":"2024-09-17T06:04:13.922496+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:04:13.922496+0000","last_undegraded":"2024-09-17T06:04:13.922496+0000","last_fullsized":"2024-09-17T06:04:13.922496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914403+0000","last_change":"2024-09-17T06:04:13.034560+0000","last_active":"2024-09-17T06:04:13.914403+0000","last_peered":"2024-09-17T06:04:13.914403+0000","last_clean":"2024-09-17T06:04:13.914403+0000","last_became_active":"2024-09-17T06:04:13.034023+0000","last_became_peered":"2024-09-17T06:04:13.034023+0000","last_unstale":"2024-09-17T06:04:13.914403+0000","last_undegraded":"2024-09-17T06:04:13.914403+0000","last_fullsized":"2024-09-17T06:04:13.914403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:04.549375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826605+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:04:14.826605+0000","last_peered":"2024-09-17T06:04:14.826605+0000","last_clean":"2024-09-17T06:04:14.826605+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:04:14.826605+0000","last_undegraded":"2024-09-17T06:04:14.826605+0000","last_fullsized":"2024-09-17T06:04:14.826605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827133+0000","last_change":"2024-09-17T06:04:07.837797+0000","last_active":"2024-09-17T06:04:14.827133+0000","last_peered":"2024-09-17T06:04:14.827133+0000","last_clean":"2024-09-17T06:04:14.827133+0000","last_became_active":"2024-09-17T06:04:07.837347+0000","last_became_peered":"2024-09-17T06:04:07.837347+0000","last_unstale":"2024-09-17T06:04:14.827133+0000","last_undegraded":"2024-09-17T06:04:14.827133+0000","last_fullsized":"2024-09-17T06:04:14.827133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.924037+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:04:13.924037+0000","last_peered":"2024-09-17T06:04:13.924037+0000","last_clean":"2024-09-17T06:04:13.924037+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:04:13.924037+0000","last_undegraded":"2024-09-17T06:04:13.924037+0000","last_fullsized":"2024-09-17T06:04:13.924037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826129+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:04:14.826129+0000","last_peered":"2024-09-17T06:04:14.826129+0000","last_clean":"2024-09-17T06:04:14.826129+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:04:14.826129+0000","last_undegraded":"2024-09-17T06:04:14.826129+0000","last_fullsized":"2024-09-17T06:04:14.826129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:22.322334+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:04:22.322334+0000","last_peered":"2024-09-17T06:04:22.322334+0000","last_clean":"2024-09-17T06:04:22.322334+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:04:22.322334+0000","last_undegraded":"2024-09-17T06:04:22.322334+0000","last_fullsized":"2024-09-17T06:04:22.322334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557256+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:04:14.557256+0000","last_peered":"2024-09-17T06:04:14.557256+0000","last_clean":"2024-09-17T06:04:14.557256+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:04:14.557256+0000","last_undegraded":"2024-09-17T06:04:14.557256+0000","last_fullsized":"2024-09-17T06:04:14.557256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919279+0000","last_change":"2024-09-17T06:04:08.842243+0000","last_active":"2024-09-17T06:04:13.919279+0000","last_peered":"2024-09-17T06:04:13.919279+0000","last_clean":"2024-09-17T06:04:13.919279+0000","last_became_active":"2024-09-17T06:04:08.841831+0000","last_became_peered":"2024-09-17T06:04:08.841831+0000","last_unstale":"2024-09-17T06:04:13.919279+0000","last_undegraded":"2024-09-17T06:04:13.919279+0000","last_fullsized":"2024-09-17T06:04:13.919279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:47.589819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557915+0000","last_change":"2024-09-17T06:04:07.852382+0000","last_active":"2024-09-17T06:04:14.557915+0000","last_peered":"2024-09-17T06:04:14.557915+0000","last_clean":"2024-09-17T06:04:14.557915+0000","last_became_active":"2024-09-17T06:04:07.851954+0000","last_became_peered":"2024-09-17T06:04:07.851954+0000","last_unstale":"2024-09-17T06:04:14.557915+0000","last_undegraded":"2024-09-17T06:04:14.557915+0000","last_fullsized":"2024-09-17T06:04:14.557915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918024+0000","last_change":"2024-09-17T06:04:12.942425+0000","last_active":"2024-09-17T06:04:13.918024+0000","last_peered":"2024-09-17T06:04:13.918024+0000","last_clean":"2024-09-17T06:04:13.918024+0000","last_became_active":"2024-09-17T06:04:12.937463+0000","last_became_peered":"2024-09-17T06:04:12.937463+0000","last_unstale":"2024-09-17T06:04:13.918024+0000","last_undegraded":"2024-09-17T06:04:13.918024+0000","last_fullsized":"2024-09-17T06:04:13.918024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:21.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827689+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:04:14.827689+0000","last_peered":"2024-09-17T06:04:14.827689+0000","last_clean":"2024-09-17T06:04:14.827689+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:04:14.827689+0000","last_undegraded":"2024-09-17T06:04:14.827689+0000","last_fullsized":"2024-09-17T06:04:14.827689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922956+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:04:13.922956+0000","last_peered":"2024-09-17T06:04:13.922956+0000","last_clean":"2024-09-17T06:04:13.922956+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:04:13.922956+0000","last_undegraded":"2024-09-17T06:04:13.922956+0000","last_fullsized":"2024-09-17T06:04:13.922956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913193+0000","last_change":"2024-09-17T06:04:12.956822+0000","last_active":"2024-09-17T06:04:13.913193+0000","last_peered":"2024-09-17T06:04:13.913193+0000","last_clean":"2024-09-17T06:04:13.913193+0000","last_became_active":"2024-09-17T06:04:12.956349+0000","last_became_peered":"2024-09-17T06:04:12.956349+0000","last_unstale":"2024-09-17T06:04:13.913193+0000","last_undegraded":"2024-09-17T06:04:13.913193+0000","last_fullsized":"2024-09-17T06:04:13.913193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:56.435215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922611+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:04:13.922611+0000","last_peered":"2024-09-17T06:04:13.922611+0000","last_clean":"2024-09-17T06:04:13.922611+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:04:13.922611+0000","last_undegraded":"2024-09-17T06:04:13.922611+0000","last_fullsized":"2024-09-17T06:04:13.922611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755152+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:04:14.755152+0000","last_peered":"2024-09-17T06:04:14.755152+0000","last_clean":"2024-09-17T06:04:14.755152+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:04:14.755152+0000","last_undegraded":"2024-09-17T06:04:14.755152+0000","last_fullsized":"2024-09-17T06:04:14.755152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913592+0000","last_change":"2024-09-17T06:04:13.043905+0000","last_active":"2024-09-17T06:04:13.913592+0000","last_peered":"2024-09-17T06:04:13.913592+0000","last_clean":"2024-09-17T06:04:13.913592+0000","last_became_active":"2024-09-17T06:04:13.041929+0000","last_became_peered":"2024-09-17T06:04:13.041929+0000","last_unstale":"2024-09-17T06:04:13.913592+0000","last_undegraded":"2024-09-17T06:04:13.913592+0000","last_fullsized":"2024-09-17T06:04:13.913592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:07.693245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827124+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:04:14.827124+0000","last_peered":"2024-09-17T06:04:14.827124+0000","last_clean":"2024-09-17T06:04:14.827124+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:04:14.827124+0000","last_undegraded":"2024-09-17T06:04:14.827124+0000","last_fullsized":"2024-09-17T06:04:14.827124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556560+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:04:14.556560+0000","last_peered":"2024-09-17T06:04:14.556560+0000","last_clean":"2024-09-17T06:04:14.556560+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:04:14.556560+0000","last_undegraded":"2024-09-17T06:04:14.556560+0000","last_fullsized":"2024-09-17T06:04:14.556560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921998+0000","last_change":"2024-09-17T06:04:07.857398+0000","last_active":"2024-09-17T06:04:13.921998+0000","last_peered":"2024-09-17T06:04:13.921998+0000","last_clean":"2024-09-17T06:04:13.921998+0000","last_became_active":"2024-09-17T06:04:07.856866+0000","last_became_peered":"2024-09-17T06:04:07.856866+0000","last_unstale":"2024-09-17T06:04:13.921998+0000","last_undegraded":"2024-09-17T06:04:13.921998+0000","last_fullsized":"2024-09-17T06:04:13.921998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754760+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:04:14.754760+0000","last_peered":"2024-09-17T06:04:14.754760+0000","last_clean":"2024-09-17T06:04:14.754760+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:04:14.754760+0000","last_undegraded":"2024-09-17T06:04:14.754760+0000","last_fullsized":"2024-09-17T06:04:14.754760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913448+0000","last_change":"2024-09-17T06:04:08.850811+0000","last_active":"2024-09-17T06:04:13.913448+0000","last_peered":"2024-09-17T06:04:13.913448+0000","last_clean":"2024-09-17T06:04:13.913448+0000","last_became_active":"2024-09-17T06:04:08.847235+0000","last_became_peered":"2024-09-17T06:04:08.847235+0000","last_unstale":"2024-09-17T06:04:13.913448+0000","last_undegraded":"2024-09-17T06:04:13.913448+0000","last_fullsized":"2024-09-17T06:04:13.913448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:21.794733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913694+0000","last_change":"2024-09-17T06:04:07.840224+0000","last_active":"2024-09-17T06:04:13.913694+0000","last_peered":"2024-09-17T06:04:13.913694+0000","last_clean":"2024-09-17T06:04:13.913694+0000","last_became_active":"2024-09-17T06:04:07.839703+0000","last_became_peered":"2024-09-17T06:04:07.839703+0000","last_unstale":"2024-09-17T06:04:13.913694+0000","last_undegraded":"2024-09-17T06:04:13.913694+0000","last_fullsized":"2024-09-17T06:04:13.913694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:01.141166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755032+0000","last_change":"2024-09-17T06:04:07.844255+0000","last_active":"2024-09-17T06:04:14.755032+0000","last_peered":"2024-09-17T06:04:14.755032+0000","last_clean":"2024-09-17T06:04:14.755032+0000","last_became_active":"2024-09-17T06:04:07.843380+0000","last_became_peered":"2024-09-17T06:04:07.843380+0000","last_unstale":"2024-09-17T06:04:14.755032+0000","last_undegraded":"2024-09-17T06:04:14.755032+0000","last_fullsized":"2024-09-17T06:04:14.755032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:28.720792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827019+0000","last_change":"2024-09-17T06:04:08.837656+0000","last_active":"2024-09-17T06:04:14.827019+0000","last_peered":"2024-09-17T06:04:14.827019+0000","last_clean":"2024-09-17T06:04:14.827019+0000","last_became_active":"2024-09-17T06:04:08.837157+0000","last_became_peered":"2024-09-17T06:04:08.837157+0000","last_unstale":"2024-09-17T06:04:14.827019+0000","last_undegraded":"2024-09-17T06:04:14.827019+0000","last_fullsized":"2024-09-17T06:04:14.827019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824605+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:04:14.824605+0000","last_peered":"2024-09-17T06:04:14.824605+0000","last_clean":"2024-09-17T06:04:14.824605+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:04:14.824605+0000","last_undegraded":"2024-09-17T06:04:14.824605+0000","last_fullsized":"2024-09-17T06:04:14.824605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915126+0000","last_change":"2024-09-17T06:04:07.848422+0000","last_active":"2024-09-17T06:04:13.915126+0000","last_peered":"2024-09-17T06:04:13.915126+0000","last_clean":"2024-09-17T06:04:13.915126+0000","last_became_active":"2024-09-17T06:04:07.847917+0000","last_became_peered":"2024-09-17T06:04:07.847917+0000","last_unstale":"2024-09-17T06:04:13.915126+0000","last_undegraded":"2024-09-17T06:04:13.915126+0000","last_fullsized":"2024-09-17T06:04:13.915126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:04.960985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916415+0000","last_change":"2024-09-17T06:04:08.831009+0000","last_active":"2024-09-17T06:04:13.916415+0000","last_peered":"2024-09-17T06:04:13.916415+0000","last_clean":"2024-09-17T06:04:13.916415+0000","last_became_active":"2024-09-17T06:04:08.830578+0000","last_became_peered":"2024-09-17T06:04:08.830578+0000","last_unstale":"2024-09-17T06:04:13.916415+0000","last_undegraded":"2024-09-17T06:04:13.916415+0000","last_fullsized":"2024-09-17T06:04:13.916415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:21.761554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914674+0000","last_change":"2024-09-17T06:04:12.953383+0000","last_active":"2024-09-17T06:04:13.914674+0000","last_peered":"2024-09-17T06:04:13.914674+0000","last_clean":"2024-09-17T06:04:13.914674+0000","last_became_active":"2024-09-17T06:04:12.952849+0000","last_became_peered":"2024-09-17T06:04:12.952849+0000","last_unstale":"2024-09-17T06:04:13.914674+0000","last_undegraded":"2024-09-17T06:04:13.914674+0000","last_fullsized":"2024-09-17T06:04:13.914674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:01.588798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754494+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:04:14.754494+0000","last_peered":"2024-09-17T06:04:14.754494+0000","last_clean":"2024-09-17T06:04:14.754494+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:04:14.754494+0000","last_undegraded":"2024-09-17T06:04:14.754494+0000","last_fullsized":"2024-09-17T06:04:14.754494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824042+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:04:14.824042+0000","last_peered":"2024-09-17T06:04:14.824042+0000","last_clean":"2024-09-17T06:04:14.824042+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:04:14.824042+0000","last_undegraded":"2024-09-17T06:04:14.824042+0000","last_fullsized":"2024-09-17T06:04:14.824042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922377+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:04:13.922377+0000","last_peered":"2024-09-17T06:04:13.922377+0000","last_clean":"2024-09-17T06:04:13.922377+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:04:13.922377+0000","last_undegraded":"2024-09-17T06:04:13.922377+0000","last_fullsized":"2024-09-17T06:04:13.922377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826836+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:04:14.826836+0000","last_peered":"2024-09-17T06:04:14.826836+0000","last_clean":"2024-09-17T06:04:14.826836+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:04:14.826836+0000","last_undegraded":"2024-09-17T06:04:14.826836+0000","last_fullsized":"2024-09-17T06:04:14.826836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914912+0000","last_change":"2024-09-17T06:04:08.853837+0000","last_active":"2024-09-17T06:04:13.914912+0000","last_peered":"2024-09-17T06:04:13.914912+0000","last_clean":"2024-09-17T06:04:13.914912+0000","last_became_active":"2024-09-17T06:04:08.847311+0000","last_became_peered":"2024-09-17T06:04:08.847311+0000","last_unstale":"2024-09-17T06:04:13.914912+0000","last_undegraded":"2024-09-17T06:04:13.914912+0000","last_fullsized":"2024-09-17T06:04:13.914912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:39.705332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557384+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:04:14.557384+0000","last_peered":"2024-09-17T06:04:14.557384+0000","last_clean":"2024-09-17T06:04:14.557384+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:04:14.557384+0000","last_undegraded":"2024-09-17T06:04:14.557384+0000","last_fullsized":"2024-09-17T06:04:14.557384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755114+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:04:14.755114+0000","last_peered":"2024-09-17T06:04:14.755114+0000","last_clean":"2024-09-17T06:04:14.755114+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:04:14.755114+0000","last_undegraded":"2024-09-17T06:04:14.755114+0000","last_fullsized":"2024-09-17T06:04:14.755114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915505+0000","last_change":"2024-09-17T06:04:08.847264+0000","last_active":"2024-09-17T06:04:13.915505+0000","last_peered":"2024-09-17T06:04:13.915505+0000","last_clean":"2024-09-17T06:04:13.915505+0000","last_became_active":"2024-09-17T06:04:08.846741+0000","last_became_peered":"2024-09-17T06:04:08.846741+0000","last_unstale":"2024-09-17T06:04:13.915505+0000","last_undegraded":"2024-09-17T06:04:13.915505+0000","last_fullsized":"2024-09-17T06:04:13.915505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921907+0000","last_change":"2024-09-17T06:04:08.856656+0000","last_active":"2024-09-17T06:04:13.921907+0000","last_peered":"2024-09-17T06:04:13.921907+0000","last_clean":"2024-09-17T06:04:13.921907+0000","last_became_active":"2024-09-17T06:04:08.855496+0000","last_became_peered":"2024-09-17T06:04:08.855496+0000","last_unstale":"2024-09-17T06:04:13.921907+0000","last_undegraded":"2024-09-17T06:04:13.921907+0000","last_fullsized":"2024-09-17T06:04:13.921907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913105+0000","last_change":"2024-09-17T06:04:08.851245+0000","last_active":"2024-09-17T06:04:13.913105+0000","last_peered":"2024-09-17T06:04:13.913105+0000","last_clean":"2024-09-17T06:04:13.913105+0000","last_became_active":"2024-09-17T06:04:08.847488+0000","last_became_peered":"2024-09-17T06:04:08.847488+0000","last_unstale":"2024-09-17T06:04:13.913105+0000","last_undegraded":"2024-09-17T06:04:13.913105+0000","last_fullsized":"2024-09-17T06:04:13.913105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922140+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:04:13.922140+0000","last_peered":"2024-09-17T06:04:13.922140+0000","last_clean":"2024-09-17T06:04:13.922140+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:04:13.922140+0000","last_undegraded":"2024-09-17T06:04:13.922140+0000","last_fullsized":"2024-09-17T06:04:13.922140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826398+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:04:14.826398+0000","last_peered":"2024-09-17T06:04:14.826398+0000","last_clean":"2024-09-17T06:04:14.826398+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:04:14.826398+0000","last_undegraded":"2024-09-17T06:04:14.826398+0000","last_fullsized":"2024-09-17T06:04:14.826398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754421+0000","last_change":"2024-09-17T06:04:08.847877+0000","last_active":"2024-09-17T06:04:14.754421+0000","last_peered":"2024-09-17T06:04:14.754421+0000","last_clean":"2024-09-17T06:04:14.754421+0000","last_became_active":"2024-09-17T06:04:08.847538+0000","last_became_peered":"2024-09-17T06:04:08.847538+0000","last_unstale":"2024-09-17T06:04:14.754421+0000","last_undegraded":"2024-09-17T06:04:14.754421+0000","last_fullsized":"2024-09-17T06:04:14.754421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826750+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:04:14.826750+0000","last_peered":"2024-09-17T06:04:14.826750+0000","last_clean":"2024-09-17T06:04:14.826750+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:04:14.826750+0000","last_undegraded":"2024-09-17T06:04:14.826750+0000","last_fullsized":"2024-09-17T06:04:14.826750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825216+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:04:14.825216+0000","last_peered":"2024-09-17T06:04:14.825216+0000","last_clean":"2024-09-17T06:04:14.825216+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:04:14.825216+0000","last_undegraded":"2024-09-17T06:04:14.825216+0000","last_fullsized":"2024-09-17T06:04:14.825216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923600+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:04:13.923600+0000","last_peered":"2024-09-17T06:04:13.923600+0000","last_clean":"2024-09-17T06:04:13.923600+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:04:13.923600+0000","last_undegraded":"2024-09-17T06:04:13.923600+0000","last_fullsized":"2024-09-17T06:04:13.923600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921566+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:04:13.921566+0000","last_peered":"2024-09-17T06:04:13.921566+0000","last_clean":"2024-09-17T06:04:13.921566+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:04:13.921566+0000","last_undegraded":"2024-09-17T06:04:13.921566+0000","last_fullsized":"2024-09-17T06:04:13.921566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556805+0000","last_change":"2024-09-17T06:04:08.824718+0000","last_active":"2024-09-17T06:04:14.556805+0000","last_peered":"2024-09-17T06:04:14.556805+0000","last_clean":"2024-09-17T06:04:14.556805+0000","last_became_active":"2024-09-17T06:04:08.823771+0000","last_became_peered":"2024-09-17T06:04:08.823771+0000","last_unstale":"2024-09-17T06:04:14.556805+0000","last_undegraded":"2024-09-17T06:04:14.556805+0000","last_fullsized":"2024-09-17T06:04:14.556805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:53.735092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826605+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:04:14.826605+0000","last_peered":"2024-09-17T06:04:14.826605+0000","last_clean":"2024-09-17T06:04:14.826605+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:04:14.826605+0000","last_undegraded":"2024-09-17T06:04:14.826605+0000","last_fullsized":"2024-09-17T06:04:14.826605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914823+0000","last_change":"2024-09-17T06:04:08.850255+0000","last_active":"2024-09-17T06:04:13.914823+0000","last_peered":"2024-09-17T06:04:13.914823+0000","last_clean":"2024-09-17T06:04:13.914823+0000","last_became_active":"2024-09-17T06:04:08.847637+0000","last_became_peered":"2024-09-17T06:04:08.847637+0000","last_unstale":"2024-09-17T06:04:13.914823+0000","last_undegraded":"2024-09-17T06:04:13.914823+0000","last_fullsized":"2024-09-17T06:04:13.914823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919159+0000","last_change":"2024-09-17T06:04:08.845829+0000","last_active":"2024-09-17T06:04:13.919159+0000","last_peered":"2024-09-17T06:04:13.919159+0000","last_clean":"2024-09-17T06:04:13.919159+0000","last_became_active":"2024-09-17T06:04:08.845441+0000","last_became_peered":"2024-09-17T06:04:08.845441+0000","last_unstale":"2024-09-17T06:04:13.919159+0000","last_undegraded":"2024-09-17T06:04:13.919159+0000","last_fullsized":"2024-09-17T06:04:13.919159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:38.878124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754889+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:04:14.754889+0000","last_peered":"2024-09-17T06:04:14.754889+0000","last_clean":"2024-09-17T06:04:14.754889+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:04:14.754889+0000","last_undegraded":"2024-09-17T06:04:14.754889+0000","last_fullsized":"2024-09-17T06:04:14.754889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755103+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:04:14.755103+0000","last_peered":"2024-09-17T06:04:14.755103+0000","last_clean":"2024-09-17T06:04:14.755103+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:04:14.755103+0000","last_undegraded":"2024-09-17T06:04:14.755103+0000","last_fullsized":"2024-09-17T06:04:14.755103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827068+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:04:14.827068+0000","last_peered":"2024-09-17T06:04:14.827068+0000","last_clean":"2024-09-17T06:04:14.827068+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:04:14.827068+0000","last_undegraded":"2024-09-17T06:04:14.827068+0000","last_fullsized":"2024-09-17T06:04:14.827068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912650+0000","last_change":"2024-09-17T06:04:08.853473+0000","last_active":"2024-09-17T06:04:13.912650+0000","last_peered":"2024-09-17T06:04:13.912650+0000","last_clean":"2024-09-17T06:04:13.912650+0000","last_became_active":"2024-09-17T06:04:08.851946+0000","last_became_peered":"2024-09-17T06:04:08.851946+0000","last_unstale":"2024-09-17T06:04:13.912650+0000","last_undegraded":"2024-09-17T06:04:13.912650+0000","last_fullsized":"2024-09-17T06:04:13.912650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825436+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:04:14.825436+0000","last_peered":"2024-09-17T06:04:14.825436+0000","last_clean":"2024-09-17T06:04:14.825436+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:04:14.825436+0000","last_undegraded":"2024-09-17T06:04:14.825436+0000","last_fullsized":"2024-09-17T06:04:14.825436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921983+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:04:13.921983+0000","last_peered":"2024-09-17T06:04:13.921983+0000","last_clean":"2024-09-17T06:04:13.921983+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:04:13.921983+0000","last_undegraded":"2024-09-17T06:04:13.921983+0000","last_fullsized":"2024-09-17T06:04:13.921983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825723+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:04:14.825723+0000","last_peered":"2024-09-17T06:04:14.825723+0000","last_clean":"2024-09-17T06:04:14.825723+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:04:14.825723+0000","last_undegraded":"2024-09-17T06:04:14.825723+0000","last_fullsized":"2024-09-17T06:04:14.825723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922399+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:04:13.922399+0000","last_peered":"2024-09-17T06:04:13.922399+0000","last_clean":"2024-09-17T06:04:13.922399+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:04:13.922399+0000","last_undegraded":"2024-09-17T06:04:13.922399+0000","last_fullsized":"2024-09-17T06:04:13.922399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825947+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:04:14.825947+0000","last_peered":"2024-09-17T06:04:14.825947+0000","last_clean":"2024-09-17T06:04:14.825947+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:04:14.825947+0000","last_undegraded":"2024-09-17T06:04:14.825947+0000","last_fullsized":"2024-09-17T06:04:14.825947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558186+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:04:14.558186+0000","last_peered":"2024-09-17T06:04:14.558186+0000","last_clean":"2024-09-17T06:04:14.558186+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:04:14.558186+0000","last_undegraded":"2024-09-17T06:04:14.558186+0000","last_fullsized":"2024-09-17T06:04:14.558186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826777+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:04:14.826777+0000","last_peered":"2024-09-17T06:04:14.826777+0000","last_clean":"2024-09-17T06:04:14.826777+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:04:14.826777+0000","last_undegraded":"2024-09-17T06:04:14.826777+0000","last_fullsized":"2024-09-17T06:04:14.826777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":876544,"data_stored":696906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":106060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":105990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:04:34.253 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T06:04:34.253 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T06:04:34.254 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T06:04:34.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.443+0000 7fac42815640 1 -- 172.21.15.122:0/3802931975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac3c0c8df0 msgr2=0x7fac3c072330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.443+0000 7fac42815640 1 --2- 172.21.15.122:0/3802931975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac3c0c8df0 0x7fac3c072330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac30009840 tx=0x7fac3001c820 comp rx=0 tx=0).stop 2024-09-17T06:04:34.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.443+0000 7fac42815640 1 -- 172.21.15.122:0/3802931975 shutdown_connections 2024-09-17T06:04:34.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.443+0000 7fac42815640 1 --2- 172.21.15.122:0/3802931975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac3c0c8df0 0x7fac3c072330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.443+0000 7fac42815640 1 -- 172.21.15.122:0/3802931975 >> 172.21.15.122:0/3802931975 conn(0x7fac3c0746d0 msgr2=0x7fac3c074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:34.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.443+0000 7fac42815640 1 -- 172.21.15.122:0/3802931975 shutdown_connections 2024-09-17T06:04:34.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.443+0000 7fac42815640 1 -- 172.21.15.122:0/3802931975 wait complete. 2024-09-17T06:04:34.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac42815640 1 Processor -- start 2024-09-17T06:04:34.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac42815640 1 -- start start 2024-09-17T06:04:34.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac42815640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fac3c0c68d0 0x7fac3c0cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:34.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac42815640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac3c0c8df0 0x7fac3c145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:34.451 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac42815640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac3c15bf20 0x7fac3c15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:34.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac42815640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c152540 con 0x7fac3c0c8df0 2024-09-17T06:04:34.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac42815640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c0c9f70 con 0x7fac3c15bf20 2024-09-17T06:04:34.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac42815640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fac3c1526c0 con 0x7fac3c0c68d0 2024-09-17T06:04:34.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac3b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac3c0c8df0 0x7fac3c145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:34.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac3b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac3c0c8df0 0x7fac3c145250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35934/0 (socket says 172.21.15.122:35934) 2024-09-17T06:04:34.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac3b7fe640 1 -- 172.21.15.122:0/1993752298 learned_addr learned my addr 172.21.15.122:0/1993752298 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:34.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac3b7fe640 1 -- 172.21.15.122:0/1993752298 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fac3c0c68d0 msgr2=0x7fac3c0cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac3b7fe640 1 --2- 172.21.15.122:0/1993752298 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fac3c0c68d0 0x7fac3c0cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac3b7fe640 1 -- 172.21.15.122:0/1993752298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac3c15bf20 msgr2=0x7fac3c15a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac3b7fe640 1 --2- 172.21.15.122:0/1993752298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac3c15bf20 0x7fac3c15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac3b7fe640 1 -- 172.21.15.122:0/1993752298 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3c0cb050 con 0x7fac3c0c8df0 2024-09-17T06:04:34.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac3b7fe640 1 --2- 172.21.15.122:0/1993752298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac3c0c8df0 0x7fac3c145250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00b3e0 tx=0x7fac2c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:34.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac38ff9640 1 -- 172.21.15.122:0/1993752298 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c015020 con 0x7fac3c0c8df0 2024-09-17T06:04:34.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac38ff9640 1 -- 172.21.15.122:0/1993752298 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac2c011920 con 0x7fac3c0c8df0 2024-09-17T06:04:34.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac42815640 1 -- 172.21.15.122:0/1993752298 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3c15b360 con 0x7fac3c0c8df0 2024-09-17T06:04:34.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac38ff9640 1 -- 172.21.15.122:0/1993752298 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c011d70 con 0x7fac3c0c8df0 2024-09-17T06:04:34.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac42815640 1 -- 172.21.15.122:0/1993752298 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3c1f4b20 con 0x7fac3c0c8df0 2024-09-17T06:04:34.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.447+0000 7fac42815640 1 -- 172.21.15.122:0/1993752298 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac3c072330 con 0x7fac3c0c8df0 2024-09-17T06:04:34.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.451+0000 7fac38ff9640 1 -- 172.21.15.122:0/1993752298 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fac2c018020 con 0x7fac3c0c8df0 2024-09-17T06:04:34.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.451+0000 7fac38ff9640 1 --2- 172.21.15.122:0/1993752298 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fac28073200 0x7fac28075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:34.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.451+0000 7fac38ff9640 1 -- 172.21.15.122:0/1993752298 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fac2c094260 con 0x7fac3c0c8df0 2024-09-17T06:04:34.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.451+0000 7fac3bfff640 1 --2- 172.21.15.122:0/1993752298 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fac28073200 0x7fac28075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:34.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.451+0000 7fac3bfff640 1 --2- 172.21.15.122:0/1993752298 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fac28073200 0x7fac28075710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac300af000 tx=0x7fac300195c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:34.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.455+0000 7fac38ff9640 1 -- 172.21.15.122:0/1993752298 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fac2c01f030 con 0x7fac3c0c8df0 2024-09-17T06:04:34.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.627+0000 7fac42815640 1 -- 172.21.15.122:0/1993752298 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fac3c1558a0 con 0x7fac3c0c8df0 2024-09-17T06:04:34.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.627+0000 7fac38ff9640 1 -- 172.21.15.122:0/1993752298 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v36) ==== 86+0+160 (secure 0 0 0) 0x7fac2c05ef40 con 0x7fac3c0c8df0 2024-09-17T06:04:34.629 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:34.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.631+0000 7fac42815640 1 -- 172.21.15.122:0/1993752298 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fac28073200 msgr2=0x7fac28075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.631+0000 7fac42815640 1 --2- 172.21.15.122:0/1993752298 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fac28073200 0x7fac28075710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac300af000 tx=0x7fac300195c0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.631+0000 7fac42815640 1 -- 172.21.15.122:0/1993752298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac3c0c8df0 msgr2=0x7fac3c145250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.631+0000 7fac42815640 1 --2- 172.21.15.122:0/1993752298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac3c0c8df0 0x7fac3c145250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00b3e0 tx=0x7fac2c00b8a0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.631+0000 7fac42815640 1 -- 172.21.15.122:0/1993752298 shutdown_connections 2024-09-17T06:04:34.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.631+0000 7fac42815640 1 --2- 172.21.15.122:0/1993752298 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fac28073200 0x7fac28075710 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.631+0000 7fac42815640 1 --2- 172.21.15.122:0/1993752298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac3c15bf20 0x7fac3c15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.631+0000 7fac42815640 1 --2- 172.21.15.122:0/1993752298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac3c0c8df0 0x7fac3c145250 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.631+0000 7fac42815640 1 --2- 172.21.15.122:0/1993752298 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fac3c0c68d0 0x7fac3c0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.631+0000 7fac42815640 1 -- 172.21.15.122:0/1993752298 >> 172.21.15.122:0/1993752298 conn(0x7fac3c0746d0 msgr2=0x7fac3c14b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:34.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.631+0000 7fac42815640 1 -- 172.21.15.122:0/1993752298 shutdown_connections 2024-09-17T06:04:34.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.631+0000 7fac42815640 1 -- 172.21.15.122:0/1993752298 wait complete. 2024-09-17T06:04:34.651 INFO:teuthology.orchestra.run.smithi122.stdout:[{"version":36,"timestamp":"2024-09-17T06:03:56.353593+0000","name":"","changes":[{"name":"osd.7/osd_mclock_max_capacity_iops_ssd","new_value":"4474.510417"}]}] 2024-09-17T06:04:34.651 INFO:tasks.ceph_manager:config epoch is 36 2024-09-17T06:04:34.651 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T06:04:34.651 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T06:04:34.651 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T06:04:34.759 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:04:34.761 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:04:34.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.795+0000 7f69cd32d640 1 -- 172.21.15.122:0/2368548261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69c80c4e80 msgr2=0x7f69c8071b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.795+0000 7f69cd32d640 1 --2- 172.21.15.122:0/2368548261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69c80c4e80 0x7f69c8071b20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009c80 tx=0x7f69c001f5a0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.795+0000 7f69cd32d640 1 -- 172.21.15.122:0/2368548261 shutdown_connections 2024-09-17T06:04:34.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.795+0000 7f69cd32d640 1 --2- 172.21.15.122:0/2368548261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69c80c4e80 0x7f69c8071b20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.795+0000 7f69cd32d640 1 --2- 172.21.15.122:0/2368548261 >> v2:172.21.15.173:3300/0 conn(0x7f69c8072ad0 0x7f69c815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.795+0000 7f69cd32d640 1 -- 172.21.15.122:0/2368548261 >> 172.21.15.122:0/2368548261 conn(0x7f69c80ceeb0 msgr2=0x7f69c80cb330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:34.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.795+0000 7f69cd32d640 1 -- 172.21.15.122:0/2368548261 shutdown_connections 2024-09-17T06:04:34.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.795+0000 7f69cd32d640 1 -- 172.21.15.122:0/2368548261 wait complete. 2024-09-17T06:04:34.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69cd32d640 1 Processor -- start 2024-09-17T06:04:34.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69cd32d640 1 -- start start 2024-09-17T06:04:34.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69cd32d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69c8072ad0 0x7f69c81efc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:34.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69cd32d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69c80c4e80 0x7f69c8150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:34.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69cd32d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c80ca5b0 0x7f69c81582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:34.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69cd32d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f69c80ca090 con 0x7f69c80ca5b0 2024-09-17T06:04:34.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69cd32d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f69c80c9db0 con 0x7f69c8072ad0 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69cd32d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f69c80c5290 con 0x7f69c80c4e80 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69c77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c80ca5b0 0x7f69c81582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69c77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c80ca5b0 0x7f69c81582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49146/0 (socket says 172.21.15.122:49146) 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69c77fe640 1 -- 172.21.15.122:0/3335709588 learned_addr learned my addr 172.21.15.122:0/3335709588 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69c67fc640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69c80c4e80 0x7f69c8150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69c6ffd640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69c8072ad0 0x7f69c81efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69c77fe640 1 -- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69c80c4e80 msgr2=0x7f69c8150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69c77fe640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69c80c4e80 0x7f69c8150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69c77fe640 1 -- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69c8072ad0 msgr2=0x7f69c81efc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69c77fe640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69c8072ad0 0x7f69c81efc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69c77fe640 1 -- 172.21.15.122:0/3335709588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c81f0150 con 0x7f69c80ca5b0 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69c77fe640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c80ca5b0 0x7f69c81582d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69c001fe40 tx=0x7f69c0009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:34.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69af7fe640 1 -- 172.21.15.122:0/3335709588 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c00af8a0 con 0x7f69c80ca5b0 2024-09-17T06:04:34.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69af7fe640 1 -- 172.21.15.122:0/3335709588 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69c00afb30 con 0x7f69c80ca5b0 2024-09-17T06:04:34.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69af7fe640 1 -- 172.21.15.122:0/3335709588 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c0004040 con 0x7f69c80ca5b0 2024-09-17T06:04:34.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69cd32d640 1 -- 172.21.15.122:0/3335709588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c8159a90 con 0x7f69c80ca5b0 2024-09-17T06:04:34.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69cd32d640 1 -- 172.21.15.122:0/3335709588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c81e36c0 con 0x7f69c80ca5b0 2024-09-17T06:04:34.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.799+0000 7f69cd32d640 1 -- 172.21.15.122:0/3335709588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c81e2bd0 con 0x7f69c80ca5b0 2024-09-17T06:04:34.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.803+0000 7f69af7fe640 1 -- 172.21.15.122:0/3335709588 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f69c00041e0 con 0x7f69c80ca5b0 2024-09-17T06:04:34.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.803+0000 7f69af7fe640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f69b4073200 0x7f69b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:34.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.803+0000 7f69af7fe640 1 -- 172.21.15.122:0/3335709588 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f69c0133240 con 0x7f69c80ca5b0 2024-09-17T06:04:34.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.803+0000 7f69c6ffd640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f69b4073200 0x7f69b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:34.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.803+0000 7f69c6ffd640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f69b4073200 0x7f69b4075710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69b8007fd0 tx=0x7f69b8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:34.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:34.807+0000 7f69af7fe640 1 -- 172.21.15.122:0/3335709588 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f69c00ac050 con 0x7f69c80ca5b0 2024-09-17T06:04:35.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.007+0000 7f69cd32d640 1 -- 172.21.15.122:0/3335709588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f69c8072550 con 0x7f69c80ca5b0 2024-09-17T06:04:35.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.011+0000 7f69af7fe640 1 -- 172.21.15.122:0/3335709588 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186462 (secure 0 0 0) 0x7f69c0019100 con 0x7f69c80ca5b0 2024-09-17T06:04:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:35.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.015+0000 7f69cd32d640 1 -- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f69b4073200 msgr2=0x7f69b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.015+0000 7f69cd32d640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f69b4073200 0x7f69b4075710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69b8007fd0 tx=0x7f69b8009040 comp rx=0 tx=0).stop 2024-09-17T06:04:35.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.015+0000 7f69cd32d640 1 -- 172.21.15.122:0/3335709588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c80ca5b0 msgr2=0x7f69c81582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.015+0000 7f69cd32d640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c80ca5b0 0x7f69c81582d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69c001fe40 tx=0x7f69c0009340 comp rx=0 tx=0).stop 2024-09-17T06:04:35.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.015+0000 7f69cd32d640 1 -- 172.21.15.122:0/3335709588 shutdown_connections 2024-09-17T06:04:35.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.015+0000 7f69cd32d640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c80ca5b0 0x7f69c81582d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.015+0000 7f69cd32d640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69c80c4e80 0x7f69c8150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.015+0000 7f69cd32d640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f69b4073200 0x7f69b4075710 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69b8007fd0 tx=0x7f69b8009040 comp rx=0 tx=0).stop 2024-09-17T06:04:35.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.015+0000 7f69cd32d640 1 --2- 172.21.15.122:0/3335709588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69c8072ad0 0x7f69c81efc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.015+0000 7f69cd32d640 1 -- 172.21.15.122:0/3335709588 >> 172.21.15.122:0/3335709588 conn(0x7f69c80ceeb0 msgr2=0x7f69c8152f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:35.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.015+0000 7f69cd32d640 1 -- 172.21.15.122:0/3335709588 shutdown_connections 2024-09-17T06:04:35.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.015+0000 7f69cd32d640 1 -- 172.21.15.122:0/3335709588 wait complete. 2024-09-17T06:04:35.034 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":5,"flags":0,"active_gid":4120,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1192300952},{"type":"v1","addr":"172.21.15.173:6801","nonce":1192300952}]},"active_addr":"172.21.15.173:6801/1192300952","active_change":"2024-09-17T06:03:47.496982+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":1025415241}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":2135398454}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":3832206495}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":56129192}]}]} 2024-09-17T06:04:35.039 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T06:04:35.039 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T06:04:35.039 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:04:35.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.191+0000 7f91792ed640 1 -- 172.21.15.122:0/1758198961 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917415eac0 msgr2=0x7f91740ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.191+0000 7f91792ed640 1 --2- 172.21.15.122:0/1758198961 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917415eac0 0x7f91740ce940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9168009900 tx=0x7f916801c8e0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.191+0000 7f91792ed640 1 -- 172.21.15.122:0/1758198961 shutdown_connections 2024-09-17T06:04:35.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.191+0000 7f91792ed640 1 --2- 172.21.15.122:0/1758198961 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917415eac0 0x7f91740ce940 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.191+0000 7f91792ed640 1 --2- 172.21.15.122:0/1758198961 >> v2:172.21.15.173:3300/0 conn(0x7f917406fb60 0x7f9174155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.191+0000 7f91792ed640 1 -- 172.21.15.122:0/1758198961 >> 172.21.15.122:0/1758198961 conn(0x7f91740701b0 msgr2=0x7f91740705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:35.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.191+0000 7f91792ed640 1 -- 172.21.15.122:0/1758198961 shutdown_connections 2024-09-17T06:04:35.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.191+0000 7f91792ed640 1 -- 172.21.15.122:0/1758198961 wait complete. 2024-09-17T06:04:35.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91792ed640 1 Processor -- start 2024-09-17T06:04:35.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91792ed640 1 -- start start 2024-09-17T06:04:35.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91792ed640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f917406fb60 0x7f9174157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91792ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917415eac0 0x7f917414b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91792ed640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917415eed0 0x7f91740cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91792ed640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f917415c330 con 0x7f917415eac0 2024-09-17T06:04:35.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91792ed640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f91740cb030 con 0x7f917406fb60 2024-09-17T06:04:35.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91792ed640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f91740ca8b0 con 0x7f917415eed0 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91727fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917415eac0 0x7f917414b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91727fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917415eac0 0x7f917414b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49148/0 (socket says 172.21.15.122:49148) 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91727fc640 1 -- 172.21.15.122:0/143206160 learned_addr learned my addr 172.21.15.122:0/143206160 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f9172ffd640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f917406fb60 0x7f9174157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91737fe640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917415eed0 0x7f91740cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91727fc640 1 -- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917415eed0 msgr2=0x7f91740cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91727fc640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917415eed0 0x7f91740cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91727fc640 1 -- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f917406fb60 msgr2=0x7f9174157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91727fc640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f917406fb60 0x7f9174157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91727fc640 1 -- 172.21.15.122:0/143206160 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91741578b0 con 0x7f917415eac0 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f9172ffd640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f917406fb60 0x7f9174157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91727fc640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917415eac0 0x7f917414b370 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91680b0040 tx=0x7f9168004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f915b7fe640 1 -- 172.21.15.122:0/143206160 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91680b2040 con 0x7f917415eac0 2024-09-17T06:04:35.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f915b7fe640 1 -- 172.21.15.122:0/143206160 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91680a5950 con 0x7f917415eac0 2024-09-17T06:04:35.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91792ed640 1 -- 172.21.15.122:0/143206160 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917414b8b0 con 0x7f917415eac0 2024-09-17T06:04:35.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f915b7fe640 1 -- 172.21.15.122:0/143206160 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91680a5d00 con 0x7f917415eac0 2024-09-17T06:04:35.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.195+0000 7f91792ed640 1 -- 172.21.15.122:0/143206160 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9174156260 con 0x7f917415eac0 2024-09-17T06:04:35.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.199+0000 7f91792ed640 1 -- 172.21.15.122:0/143206160 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91740ca310 con 0x7f917415eac0 2024-09-17T06:04:35.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.199+0000 7f915b7fe640 1 -- 172.21.15.122:0/143206160 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f91680bf060 con 0x7f917415eac0 2024-09-17T06:04:35.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.199+0000 7f915b7fe640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9160073230 0x7f9160075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.199+0000 7f915b7fe640 1 -- 172.21.15.122:0/143206160 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f916812e5f0 con 0x7f917415eac0 2024-09-17T06:04:35.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.199+0000 7f9172ffd640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9160073230 0x7f9160075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.199+0000 7f9172ffd640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9160073230 0x7f9160075740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f916c009ea0 tx=0x7f916c009500 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:35.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.203+0000 7f915b7fe640 1 -- 172.21.15.122:0/143206160 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f91680164d0 con 0x7f917415eac0 2024-09-17T06:04:35.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.371+0000 7f91792ed640 1 -- 172.21.15.122:0/143206160 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91740ca690 con 0x7f917415eac0 2024-09-17T06:04:35.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f915b7fe640 1 -- 172.21.15.122:0/143206160 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7f91680f9440 con 0x7f917415eac0 2024-09-17T06:04:35.376 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:35.376 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":26,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:04:13.331438+0000","last_up_change":"2024-09-17T06:03:56.580331+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6811","nonce":920798795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6813","nonce":920798795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6817","nonce":920798795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6815","nonce":920798795}]},"public_addr":"172.21.15.173:6811/920798795","cluster_addr":"172.21.15.173:6813/920798795","heartbeat_back_addr":"172.21.15.173:6817/920798795","heartbeat_front_addr":"172.21.15.173:6815/920798795","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:04:35.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f91792ed640 1 -- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9160073230 msgr2=0x7f9160075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f91792ed640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9160073230 0x7f9160075740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f916c009ea0 tx=0x7f916c009500 comp rx=0 tx=0).stop 2024-09-17T06:04:35.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f91792ed640 1 -- 172.21.15.122:0/143206160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917415eac0 msgr2=0x7f917414b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f91792ed640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917415eac0 0x7f917414b370 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91680b0040 tx=0x7f9168004620 comp rx=0 tx=0).stop 2024-09-17T06:04:35.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f91792ed640 1 -- 172.21.15.122:0/143206160 shutdown_connections 2024-09-17T06:04:35.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f91792ed640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917415eed0 0x7f91740cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f91792ed640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f917415eac0 0x7f917414b370 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f91792ed640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9160073230 0x7f9160075740 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f91792ed640 1 --2- 172.21.15.122:0/143206160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f917406fb60 0x7f9174157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f91792ed640 1 -- 172.21.15.122:0/143206160 >> 172.21.15.122:0/143206160 conn(0x7f91740701b0 msgr2=0x7f9174159a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:35.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f91792ed640 1 -- 172.21.15.122:0/143206160 shutdown_connections 2024-09-17T06:04:35.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.375+0000 7f91792ed640 1 -- 172.21.15.122:0/143206160 wait complete. 2024-09-17T06:04:35.397 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T06:04:35.397 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:04:35.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.551+0000 7f89e3ac0640 1 -- 172.21.15.122:0/934187034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89c8003a60 msgr2=0x7f89c8003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.551+0000 7f89e3ac0640 1 --2- 172.21.15.122:0/934187034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89c8003a60 0x7f89c8003ed0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009ee0 tx=0x7f89d401d5f0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.551+0000 7f89e3ac0640 1 -- 172.21.15.122:0/934187034 shutdown_connections 2024-09-17T06:04:35.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.551+0000 7f89e3ac0640 1 --2- 172.21.15.122:0/934187034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89c8003a60 0x7f89c8003ed0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.551+0000 7f89e3ac0640 1 -- 172.21.15.122:0/934187034 >> 172.21.15.122:0/934187034 conn(0x7f89dc0746d0 msgr2=0x7f89dc074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:35.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.551+0000 7f89e3ac0640 1 -- 172.21.15.122:0/934187034 shutdown_connections 2024-09-17T06:04:35.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.551+0000 7f89e3ac0640 1 -- 172.21.15.122:0/934187034 wait complete. 2024-09-17T06:04:35.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.551+0000 7f89e3ac0640 1 Processor -- start 2024-09-17T06:04:35.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.551+0000 7f89e3ac0640 1 -- start start 2024-09-17T06:04:35.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e3ac0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89c8003a60 0x7f89dc1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e3ac0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89dc0c4b00 0x7f89dc154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e3ac0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89dc151be0 0x7f89dc145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e3ac0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f89dc15d470 con 0x7f89c8003a60 2024-09-17T06:04:35.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e3ac0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89dc15c6a0 con 0x7f89dc0c4b00 2024-09-17T06:04:35.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e3ac0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f89dc159f40 con 0x7f89dc151be0 2024-09-17T06:04:35.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e185c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89c8003a60 0x7f89dc1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e185c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89c8003a60 0x7f89dc1563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49162/0 (socket says 172.21.15.122:49162) 2024-09-17T06:04:35.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e185c640 1 -- 172.21.15.122:0/2657549574 learned_addr learned my addr 172.21.15.122:0/2657549574 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:35.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e105b640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89dc0c4b00 0x7f89dc154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e205d640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89dc151be0 0x7f89dc145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e185c640 1 -- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89dc151be0 msgr2=0x7f89dc145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e185c640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89dc151be0 0x7f89dc145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e185c640 1 -- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89dc0c4b00 msgr2=0x7f89dc154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e185c640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89dc0c4b00 0x7f89dc154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e185c640 1 -- 172.21.15.122:0/2657549574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89dc154870 con 0x7f89c8003a60 2024-09-17T06:04:35.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e205d640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89dc151be0 0x7f89dc145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:35.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e185c640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89c8003a60 0x7f89dc1563e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009e00 tx=0x7f89d4009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:35.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89d27fc640 1 -- 172.21.15.122:0/2657549574 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d40ad070 con 0x7f89c8003a60 2024-09-17T06:04:35.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89d27fc640 1 -- 172.21.15.122:0/2657549574 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89d4003c70 con 0x7f89c8003a60 2024-09-17T06:04:35.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e3ac0640 1 -- 172.21.15.122:0/2657549574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89dc152940 con 0x7f89c8003a60 2024-09-17T06:04:35.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89d27fc640 1 -- 172.21.15.122:0/2657549574 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d40a7ae0 con 0x7f89c8003a60 2024-09-17T06:04:35.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e3ac0640 1 -- 172.21.15.122:0/2657549574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89dc0c5220 con 0x7f89c8003a60 2024-09-17T06:04:35.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89e3ac0640 1 -- 172.21.15.122:0/2657549574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89dc0b8eb0 con 0x7f89c8003a60 2024-09-17T06:04:35.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.555+0000 7f89d27fc640 1 -- 172.21.15.122:0/2657549574 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f89d40bc060 con 0x7f89c8003a60 2024-09-17T06:04:35.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.559+0000 7f89d27fc640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f89c0073230 0x7f89c0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.559+0000 7f89d27fc640 1 -- 172.21.15.122:0/2657549574 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f89d412e9e0 con 0x7f89c8003a60 2024-09-17T06:04:35.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.559+0000 7f89e105b640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f89c0073230 0x7f89c0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.559+0000 7f89e105b640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f89c0073230 0x7f89c0075740 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0018b0 tx=0x7f89cc001840 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:35.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.559+0000 7f89d27fc640 1 -- 172.21.15.122:0/2657549574 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f89d4017300 con 0x7f89c8003a60 2024-09-17T06:04:35.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.719+0000 7f89e3ac0640 1 -- 172.21.15.122:0/2657549574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89dc0c3650 con 0x7f89c8003a60 2024-09-17T06:04:35.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.723+0000 7f89d27fc640 1 -- 172.21.15.122:0/2657549574 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7f89d40f9830 con 0x7f89c8003a60 2024-09-17T06:04:35.725 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:35.725 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":26,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:04:13.331438+0000","last_up_change":"2024-09-17T06:03:56.580331+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6811","nonce":920798795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6813","nonce":920798795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6817","nonce":920798795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6815","nonce":920798795}]},"public_addr":"172.21.15.173:6811/920798795","cluster_addr":"172.21.15.173:6813/920798795","heartbeat_back_addr":"172.21.15.173:6817/920798795","heartbeat_front_addr":"172.21.15.173:6815/920798795","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:04:35.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.727+0000 7f89e3ac0640 1 -- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f89c0073230 msgr2=0x7f89c0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.727+0000 7f89e3ac0640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f89c0073230 0x7f89c0075740 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0018b0 tx=0x7f89cc001840 comp rx=0 tx=0).stop 2024-09-17T06:04:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.727+0000 7f89e3ac0640 1 -- 172.21.15.122:0/2657549574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89c8003a60 msgr2=0x7f89dc1563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.727+0000 7f89e3ac0640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89c8003a60 0x7f89dc1563e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009e00 tx=0x7f89d4009200 comp rx=0 tx=0).stop 2024-09-17T06:04:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.727+0000 7f89e3ac0640 1 -- 172.21.15.122:0/2657549574 shutdown_connections 2024-09-17T06:04:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.727+0000 7f89e3ac0640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89dc151be0 0x7f89dc145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.727+0000 7f89e3ac0640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f89c0073230 0x7f89c0075740 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.727+0000 7f89e3ac0640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89dc0c4b00 0x7f89dc154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.727+0000 7f89e3ac0640 1 --2- 172.21.15.122:0/2657549574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89c8003a60 0x7f89dc1563e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.727+0000 7f89e3ac0640 1 -- 172.21.15.122:0/2657549574 >> 172.21.15.122:0/2657549574 conn(0x7f89dc0746d0 msgr2=0x7f89dc068fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.727+0000 7f89e3ac0640 1 -- 172.21.15.122:0/2657549574 shutdown_connections 2024-09-17T06:04:35.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.727+0000 7f89e3ac0640 1 -- 172.21.15.122:0/2657549574 wait complete. 2024-09-17T06:04:35.746 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T06:04:35.746 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T06:04:35.747 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T06:04:35.747 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T06:04:35.748 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T06:04:35.748 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T06:04:35.749 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T06:04:35.749 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T06:04:35.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.975+0000 7f05a8cbe640 1 -- 172.21.15.122:0/3188075536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0590005280 msgr2=0x7f059000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.975+0000 7f05a8cbe640 1 --2- 172.21.15.122:0/3188075536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0590005280 0x7f059000b9d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f059c001dc0 tx=0x7f059c01cb30 comp rx=0 tx=0).stop 2024-09-17T06:04:35.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.975+0000 7f05a8cbe640 1 -- 172.21.15.122:0/3188075536 shutdown_connections 2024-09-17T06:04:35.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.975+0000 7f05a8cbe640 1 --2- 172.21.15.122:0/3188075536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0590005280 0x7f059000b9d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.975+0000 7f05a8cbe640 1 -- 172.21.15.122:0/3188075536 >> 172.21.15.122:0/3188075536 conn(0x7f05a40746d0 msgr2=0x7f05a4074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:35.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.975+0000 7f05a8cbe640 1 -- 172.21.15.122:0/3188075536 shutdown_connections 2024-09-17T06:04:35.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.975+0000 7f05a8cbe640 1 -- 172.21.15.122:0/3188075536 wait complete. 2024-09-17T06:04:35.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0eeb7b7640 1 -- 172.21.15.122:0/1331836644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee40c6780 msgr2=0x7f0ee415a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0eeb7b7640 1 --2- 172.21.15.122:0/1331836644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee40c6780 0x7f0ee415a730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009bc0 tx=0x7f0edc01cba0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0ca6908640 1 -- 172.21.15.122:0/487863772 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ca00b27c0 msgr2=0x7f0ca00c1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0ca6908640 1 --2- 172.21.15.122:0/487863772 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ca00b27c0 0x7f0ca00c1ec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800acd0 tx=0x7f0c9801f510 comp rx=0 tx=0).stop 2024-09-17T06:04:35.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0ca6908640 1 -- 172.21.15.122:0/487863772 shutdown_connections 2024-09-17T06:04:35.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0ca6908640 1 --2- 172.21.15.122:0/487863772 >> v2:172.21.15.122:3300/0 conn(0x7f0ca00c7a70 0x7f0ca01512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0ca6908640 1 --2- 172.21.15.122:0/487863772 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ca00b27c0 0x7f0ca00c1ec0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800acd0 tx=0x7f0c9801f510 comp rx=0 tx=0).stop 2024-09-17T06:04:35.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0ca6908640 1 -- 172.21.15.122:0/487863772 >> 172.21.15.122:0/487863772 conn(0x7f0ca00722e0 msgr2=0x7f0ca00726f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:35.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f05a8cbe640 1 Processor -- start 2024-09-17T06:04:35.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0ca6908640 1 -- 172.21.15.122:0/487863772 shutdown_connections 2024-09-17T06:04:35.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0eeb7b7640 1 -- 172.21.15.122:0/1331836644 shutdown_connections 2024-09-17T06:04:35.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0eeb7b7640 1 --2- 172.21.15.122:0/1331836644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee40c6780 0x7f0ee415a730 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0eeb7b7640 1 -- 172.21.15.122:0/1331836644 >> 172.21.15.122:0/1331836644 conn(0x7f0ee40746d0 msgr2=0x7f0ee4074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:35.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f05a8cbe640 1 -- start start 2024-09-17T06:04:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7fa7a71cb640 1 -- 172.21.15.122:0/3640689246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa790005160 msgr2=0x7fa79000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7fa7a71cb640 1 --2- 172.21.15.122:0/3640689246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa790005160 0x7fa79000b9d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0071ae0 tx=0x7fa79801d470 comp rx=0 tx=0).stop 2024-09-17T06:04:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7fa7a5768640 1 -- 172.21.15.122:0/3640689246 reap_dead start 2024-09-17T06:04:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7fa7a71cb640 1 -- 172.21.15.122:0/3640689246 shutdown_connections 2024-09-17T06:04:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7fa7a71cb640 1 -- 172.21.15.122:0/3640689246 >> 172.21.15.122:0/3640689246 conn(0x7fa7a0070e40 msgr2=0x7fa7a0071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7fa7a71cb640 1 -- 172.21.15.122:0/3640689246 shutdown_connections 2024-09-17T06:04:35.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7fa7a71cb640 1 -- 172.21.15.122:0/3640689246 wait complete. 2024-09-17T06:04:35.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0ca6908640 1 -- 172.21.15.122:0/487863772 wait complete. 2024-09-17T06:04:35.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0ca6908640 1 Processor -- start 2024-09-17T06:04:35.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.979+0000 7f0ca6908640 1 -- start start 2024-09-17T06:04:35.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fc0d43ce640 1 -- 172.21.15.122:0/991821760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0b8004810 msgr2=0x7fc0b8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fc0d43ce640 1 --2- 172.21.15.122:0/991821760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0b8004810 0x7fc0b8004c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00c310 tx=0x7fc0bc01cfd0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a8cbe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0590005280 0x7f05a40cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a8cbe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a4162f20 0x7f05a414eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a8cbe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a415a8e0 0x7f05a4147da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a8cbe640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05a4152540 con 0x7f0590005280 2024-09-17T06:04:35.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a8cbe640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f05a4072a90 con 0x7f05a4162f20 2024-09-17T06:04:35.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a8cbe640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f05a41526c0 con 0x7f05a415a8e0 2024-09-17T06:04:35.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a1d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a4162f20 0x7f05a414eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a1d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a4162f20 0x7f05a414eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:49400/0 (socket says 172.21.15.122:49400) 2024-09-17T06:04:35.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a2d9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a415a8e0 0x7f05a4147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a1d9b640 1 -- 172.21.15.122:0/632578430 learned_addr learned my addr 172.21.15.122:0/632578430 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:35.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a259c640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0590005280 0x7f05a40cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f4ad4a5b640 1 -- 172.21.15.122:0/4098826741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ab8004810 msgr2=0x7f4ab8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f4ad4a5b640 1 --2- 172.21.15.122:0/4098826741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ab8004810 0x7f4ab8004c20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4006f90 tx=0x7f4ac401f660 comp rx=0 tx=0).stop 2024-09-17T06:04:35.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f4acf59e640 1 -- 172.21.15.122:0/4098826741 reap_dead start 2024-09-17T06:04:35.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fa7a71cb640 1 Processor -- start 2024-09-17T06:04:35.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0eeb7b7640 1 -- 172.21.15.122:0/1331836644 shutdown_connections 2024-09-17T06:04:35.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a1d9b640 1 -- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a415a8e0 msgr2=0x7f05a4147da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a1d9b640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05a415a8e0 0x7f05a4147da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a1d9b640 1 -- 172.21.15.122:0/632578430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0590005280 msgr2=0x7f05a40cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a1d9b640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0590005280 0x7f05a40cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a1d9b640 1 -- 172.21.15.122:0/632578430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a41517c0 con 0x7f05a4162f20 2024-09-17T06:04:35.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0eeb7b7640 1 -- 172.21.15.122:0/1331836644 wait complete. 2024-09-17T06:04:35.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca6908640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ca00c7a70 0x7f0ca014c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fc0d296b640 1 -- 172.21.15.122:0/991821760 reap_dead start 2024-09-17T06:04:35.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca6908640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca00c7e80 0x7f0ca01499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca6908640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ca014d680 0x7f0ca0156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0c9ffff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ca00c7a70 0x7f0ca014c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0c9f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca00c7e80 0x7f0ca01499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0c9ffff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ca00c7a70 0x7f0ca014c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:50834/0 (socket says 172.21.15.122:50834) 2024-09-17T06:04:35.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0c9ffff640 1 -- 172.21.15.122:0/1731891964 learned_addr learned my addr 172.21.15.122:0/1731891964 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:35.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca4ea5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ca014d680 0x7f0ca0156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca6908640 1 -- 172.21.15.122:0/1731891964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca0071ba0 con 0x7f0ca014d680 2024-09-17T06:04:35.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca6908640 1 -- 172.21.15.122:0/1731891964 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca00c9480 con 0x7f0ca00c7e80 2024-09-17T06:04:35.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca6908640 1 -- 172.21.15.122:0/1731891964 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca0157ca0 con 0x7f0ca00c7a70 2024-09-17T06:04:35.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca4ea5640 1 -- 172.21.15.122:0/1731891964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ca00c7a70 msgr2=0x7f0ca014c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca4ea5640 1 --2- 172.21.15.122:0/1731891964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ca00c7a70 0x7f0ca014c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca4ea5640 1 -- 172.21.15.122:0/1731891964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca00c7e80 msgr2=0x7f0ca01499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca4ea5640 1 --2- 172.21.15.122:0/1731891964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca00c7e80 0x7f0ca01499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca4ea5640 1 -- 172.21.15.122:0/1731891964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca00cb400 con 0x7f0ca014d680 2024-09-17T06:04:35.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca4ea5640 1 --2- 172.21.15.122:0/1731891964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ca014d680 0x7f0ca0156430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000c460 tx=0x7f0c9000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:35.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0c9cff9640 1 -- 172.21.15.122:0/1731891964 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90016020 con 0x7f0ca014d680 2024-09-17T06:04:35.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0c9cff9640 1 -- 172.21.15.122:0/1731891964 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c90012920 con 0x7f0ca014d680 2024-09-17T06:04:35.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0c9cff9640 1 -- 172.21.15.122:0/1731891964 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90012d50 con 0x7f0ca014d680 2024-09-17T06:04:35.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a1d9b640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a4162f20 0x7f05a414eb80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0594001b90 tx=0x7f05940039d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:35.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca6908640 1 -- 172.21.15.122:0/1731891964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca015b6c0 con 0x7f0ca014d680 2024-09-17T06:04:35.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fa7a71cb640 1 -- start start 2024-09-17T06:04:35.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fa7a71cb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790005160 0x7fa7a01eff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0ca6908640 1 -- 172.21.15.122:0/1731891964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca014cb80 con 0x7f0ca014d680 2024-09-17T06:04:35.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fa7a71cb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7a0147540 0x7fa7a0152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f059affd640 1 -- 172.21.15.122:0/632578430 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594015070 con 0x7f05a4162f20 2024-09-17T06:04:35.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f059affd640 1 -- 172.21.15.122:0/632578430 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0594011840 con 0x7f05a4162f20 2024-09-17T06:04:35.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a8cbe640 1 -- 172.21.15.122:0/632578430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a40ca750 con 0x7f05a4162f20 2024-09-17T06:04:35.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f059affd640 1 -- 172.21.15.122:0/632578430 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594011c90 con 0x7f05a4162f20 2024-09-17T06:04:35.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f05a8cbe640 1 -- 172.21.15.122:0/632578430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a41618a0 con 0x7f05a4162f20 2024-09-17T06:04:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7f0eeb7b7640 1 Processor -- start 2024-09-17T06:04:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fe4146b8640 1 -- 172.21.15.122:0/3226184445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe404044cc0 msgr2=0x7fe404034d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fe4146b8640 1 --2- 172.21.15.122:0/3226184445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe404044cc0 0x7fe404034d60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe40c051dc0 tx=0x7fe40c09bfe0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fe4146b8640 1 -- 172.21.15.122:0/3226184445 shutdown_connections 2024-09-17T06:04:35.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fe4146b8640 1 --2- 172.21.15.122:0/3226184445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe404032e50 0x7fe404046020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fe4146b8640 1 --2- 172.21.15.122:0/3226184445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe404044cc0 0x7fe404034d60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:35.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fe4146b8640 1 -- 172.21.15.122:0/3226184445 >> 172.21.15.122:0/3226184445 conn(0x7fe40404fe40 msgr2=0x7fe404050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:35.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fe4146b8640 1 -- 172.21.15.122:0/3226184445 shutdown_connections 2024-09-17T06:04:35.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.983+0000 7fe4146b8640 1 -- 172.21.15.122:0/3226184445 wait complete. 2024-09-17T06:04:35.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fc0d43ce640 1 -- 172.21.15.122:0/991821760 shutdown_connections 2024-09-17T06:04:35.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fc0d43ce640 1 -- 172.21.15.122:0/991821760 >> 172.21.15.122:0/991821760 conn(0x7fc0cc074ed0 msgr2=0x7fc0cc0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:35.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0eeb7b7640 1 -- start start 2024-09-17T06:04:35.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0c867fc640 1 -- 172.21.15.122:0/1731891964 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0c78001040 con 0x7f0ca014d680 2024-09-17T06:04:35.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f05a8cbe640 1 -- 172.21.15.122:0/632578430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f05a40c8df0 con 0x7f05a4162f20 2024-09-17T06:04:35.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a4f67640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790005160 0x7fa7a01eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a4f67640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790005160 0x7fa7a01eff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:49430/0 (socket says 172.21.15.122:49430) 2024-09-17T06:04:35.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a4f67640 1 -- 172.21.15.122:0/337902430 learned_addr learned my addr 172.21.15.122:0/337902430 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:35.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe4146b8640 1 Processor -- start 2024-09-17T06:04:35.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa79ffff640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7a0147540 0x7fa7a0152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe4146b8640 1 -- start start 2024-09-17T06:04:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a71cb640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7a01529d0 0x7fa7a00cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a00cb860 con 0x7fa7a0147540 2024-09-17T06:04:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a0159c40 con 0x7fa790005160 2024-09-17T06:04:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a015a160 con 0x7fa7a01529d0 2024-09-17T06:04:35.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a5768640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7a01529d0 0x7fa7a00cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:35.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe4146b8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4040064a0 0x7fe4040d70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe4146b8640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe404032e50 0x7fe4040d8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe4146b8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe404044cc0 0x7fe4040c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:35.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe412454640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4040064a0 0x7fe4040d70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a4f67640 1 -- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7a01529d0 msgr2=0x7fa7a00cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a4f67640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7a01529d0 0x7fa7a00cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a4f67640 1 -- 172.21.15.122:0/337902430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7a0147540 msgr2=0x7fa7a0152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a4f67640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7a0147540 0x7fa7a0152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a4f67640 1 -- 172.21.15.122:0/337902430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a01ef480 con 0x7fa790005160 2024-09-17T06:04:36.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f059affd640 1 -- 172.21.15.122:0/632578430 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0594018070 con 0x7f05a4162f20 2024-09-17T06:04:36.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0c9cff9640 1 -- 172.21.15.122:0/1731891964 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0c90019020 con 0x7f0ca014d680 2024-09-17T06:04:36.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0c9cff9640 1 --2- 172.21.15.122:0/1731891964 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0c8c073230 0x7f0c8c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0c9cff9640 1 -- 172.21.15.122:0/1731891964 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0c90094b20 con 0x7f0ca014d680 2024-09-17T06:04:36.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0c9cff9640 1 --2- 172.21.15.122:0/1731891964 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f0c8c07c9f0 0x7f0c8c07ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0c9cff9640 1 -- 172.21.15.122:0/1731891964 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c8c07f550 con 0x7f0c8c07c9f0 2024-09-17T06:04:36.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0c9cff9640 1 -- 172.21.15.122:0/1731891964 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0c90094f10 con 0x7f0ca014d680 2024-09-17T06:04:36.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fc0d43ce640 1 -- 172.21.15.122:0/991821760 shutdown_connections 2024-09-17T06:04:36.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0eeb7b7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ee40b8ba0 0x7f0ee4202040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fc0d43ce640 1 -- 172.21.15.122:0/991821760 wait complete. 2024-09-17T06:04:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe412454640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4040064a0 0x7fe4040d70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49236/0 (socket says 172.21.15.122:49236) 2024-09-17T06:04:36.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe4146b8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe40404c5c0 con 0x7fe4040064a0 2024-09-17T06:04:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0ee9553640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ee40b8ba0 0x7f0ee4202040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0ee9553640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ee40b8ba0 0x7f0ee4202040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:50880/0 (socket says 172.21.15.122:50880) 2024-09-17T06:04:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0c9f7fe640 1 --2- 172.21.15.122:0/1731891964 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f0c8c07c9f0 0x7f0c8c07ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe4146b8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe404034840 con 0x7fe404044cc0 2024-09-17T06:04:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe4146b8640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe40404c740 con 0x7fe404032e50 2024-09-17T06:04:36.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f059affd640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0584073200 0x7f0584075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe412454640 1 -- 172.21.15.122:0/1102988005 learned_addr learned my addr 172.21.15.122:0/1102988005 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe412c55640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe404044cc0 0x7fe4040c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f059affd640 1 -- 172.21.15.122:0/632578430 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f05940953b0 con 0x7f05a4162f20 2024-09-17T06:04:36.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f059affd640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f058407c950 0x7f058407ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f059affd640 1 -- 172.21.15.122:0/632578430 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f059400ae50 con 0x7f058407c950 2024-09-17T06:04:36.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f059affd640 1 -- 172.21.15.122:0/632578430 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f05940957a0 con 0x7f05a4162f20 2024-09-17T06:04:36.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe411c53640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe404032e50 0x7fe4040d8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe412c55640 1 -- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe404032e50 msgr2=0x7fe4040d8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe412c55640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe404032e50 0x7fe4040d8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe412c55640 1 -- 172.21.15.122:0/1102988005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4040064a0 msgr2=0x7fe4040d70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe412c55640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4040064a0 0x7fe4040d70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe412c55640 1 -- 172.21.15.122:0/1102988005 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40404dc20 con 0x7fe404044cc0 2024-09-17T06:04:36.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0c9f7fe640 1 --2- 172.21.15.122:0/1731891964 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f0c8c07c9f0 0x7f0c8c07ee80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fa7a4f67640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790005160 0x7fa7a01eff40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa794009e20 tx=0x7fa79400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f4ad4a5b640 1 -- 172.21.15.122:0/4098826741 shutdown_connections 2024-09-17T06:04:36.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f4ad4a5b640 1 -- 172.21.15.122:0/4098826741 >> 172.21.15.122:0/4098826741 conn(0x7f4ac8051f70 msgr2=0x7f4ac8052380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f05a2d9d640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f058407c950 0x7f058407ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0ee9553640 1 -- 172.21.15.122:0/4224400636 learned_addr learned my addr 172.21.15.122:0/4224400636 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0c9ffff640 1 --2- 172.21.15.122:0/1731891964 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0c8c073230 0x7f0c8c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f0eeb7b7640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ee40c6780 0x7f0ee4201510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7fe412c55640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe404044cc0 0x7fe4040c3890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00c3c0 tx=0x7fe3fc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.987+0000 7f4ad4a5b640 1 -- 172.21.15.122:0/4098826741 shutdown_connections 2024-09-17T06:04:36.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0eeb7b7640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee4159b10 0x7f0ee414acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f05a259c640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0584073200 0x7f0584075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0eeb7b7640 1 -- 172.21.15.122:0/4224400636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4072be0 con 0x7f0ee40c6780 2024-09-17T06:04:36.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0eeb7b7640 1 -- 172.21.15.122:0/4224400636 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4072a60 con 0x7f0ee4159b10 2024-09-17T06:04:36.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0c9ffff640 1 --2- 172.21.15.122:0/1731891964 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0c8c073230 0x7f0c8c075740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800acd0 tx=0x7f0c9801dd50 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fc0d43ce640 1 Processor -- start 2024-09-17T06:04:36.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fc0d43ce640 1 -- start start 2024-09-17T06:04:36.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fa79d7fa640 1 -- 172.21.15.122:0/337902430 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79400ccc0 con 0x7fa790005160 2024-09-17T06:04:36.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fa79d7fa640 1 -- 172.21.15.122:0/337902430 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa794005020 con 0x7fa790005160 2024-09-17T06:04:36.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fa79d7fa640 1 -- 172.21.15.122:0/337902430 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794005470 con 0x7fa790005160 2024-09-17T06:04:36.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a0151960 con 0x7fa790005160 2024-09-17T06:04:36.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a01ef740 con 0x7fa790005160 2024-09-17T06:04:36.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0ee8d52640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ee40c6780 0x7f0ee4201510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0ee9d54640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee4159b10 0x7f0ee414acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0eeb7b7640 1 -- 172.21.15.122:0/4224400636 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee40c43c0 con 0x7f0ee40b8ba0 2024-09-17T06:04:36.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fe402ffd640 1 -- 172.21.15.122:0/1102988005 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc017070 con 0x7fe404044cc0 2024-09-17T06:04:36.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fe402ffd640 1 -- 172.21.15.122:0/1102988005 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3fc0053c0 con 0x7fe404044cc0 2024-09-17T06:04:36.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fe402ffd640 1 -- 172.21.15.122:0/1102988005 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0038b0 con 0x7fe404044cc0 2024-09-17T06:04:36.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f05a259c640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0584073200 0x7f0584075710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f058c009be0 tx=0x7f058c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f05a2d9d640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f058407c950 0x7f058407ede0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7a0152de0 con 0x7fa790005160 2024-09-17T06:04:36.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0ee9553640 1 -- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee4159b10 msgr2=0x7f0ee414acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0ee9553640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ee4159b10 0x7f0ee414acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0ee9553640 1 -- 172.21.15.122:0/4224400636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ee40c6780 msgr2=0x7f0ee4201510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0ee9553640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ee40c6780 0x7f0ee4201510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f4ad4a5b640 1 -- 172.21.15.122:0/4098826741 wait complete. 2024-09-17T06:04:36.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0ee9553640 1 -- 172.21.15.122:0/4224400636 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee4202580 con 0x7f0ee40b8ba0 2024-09-17T06:04:36.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fe4146b8640 1 -- 172.21.15.122:0/1102988005 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4040d8540 con 0x7fe404044cc0 2024-09-17T06:04:36.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fe4146b8640 1 -- 172.21.15.122:0/1102988005 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe40404f5f0 con 0x7fe404044cc0 2024-09-17T06:04:36.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0ee9553640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ee40b8ba0 0x7f0ee4202040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400b3f0 tx=0x7f0ed400b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0c9cff9640 1 -- 172.21.15.122:0/1731891964 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c8c07f550 con 0x7f0c8c07c9f0 2024-09-17T06:04:36.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f4ad4a5b640 1 Processor -- start 2024-09-17T06:04:36.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fc0d43ce640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0b8004810 0x7fc0cc0c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0ed9ffb640 1 -- 172.21.15.122:0/4224400636 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4015020 con 0x7f0ee40b8ba0 2024-09-17T06:04:36.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0ed9ffb640 1 -- 172.21.15.122:0/4224400636 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ed4011940 con 0x7f0ee40b8ba0 2024-09-17T06:04:36.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0eeb7b7640 1 -- 172.21.15.122:0/4224400636 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee4155370 con 0x7f0ee40b8ba0 2024-09-17T06:04:36.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0ed9ffb640 1 -- 172.21.15.122:0/4224400636 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4011d90 con 0x7f0ee40b8ba0 2024-09-17T06:04:36.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fe4146b8640 1 -- 172.21.15.122:0/1102988005 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe40404b8f0 con 0x7fe404044cc0 2024-09-17T06:04:36.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fc0d43ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0cc1f8fd0 0x7fc0cc14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f0eeb7b7640 1 -- 172.21.15.122:0/4224400636 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee40c8de0 con 0x7f0ee40b8ba0 2024-09-17T06:04:36.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fc0d216a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0b8004810 0x7fc0cc0c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fc0d216a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0b8004810 0x7fc0cc0c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:49456/0 (socket says 172.21.15.122:49456) 2024-09-17T06:04:36.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fc0d1969640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0cc1f8fd0 0x7fc0cc14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fc0d1969640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0cc1f8fd0 0x7fc0cc14fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49258/0 (socket says 172.21.15.122:49258) 2024-09-17T06:04:36.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fc0d43ce640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0cc14ed70 0x7fc0cc14f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7f4ad4a5b640 1 -- start start 2024-09-17T06:04:36.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.991+0000 7fc0d216a640 1 -- 172.21.15.122:0/4179798629 learned_addr learned my addr 172.21.15.122:0/4179798629 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc08c990 con 0x7fc0cc1f8fd0 2024-09-17T06:04:36.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc155970 con 0x7fc0b8004810 2024-09-17T06:04:36.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc0cc08cb10 con 0x7fc0cc14ed70 2024-09-17T06:04:36.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fb65e9aa640 1 -- 172.21.15.122:0/2528225723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65815b180 msgr2=0x7fb658155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fb65e9aa640 1 --2- 172.21.15.122:0/2528225723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65815b180 0x7fb658155390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009840 tx=0x7fb64c01f030 comp rx=0 tx=0).stop 2024-09-17T06:04:36.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fb65e9aa640 1 -- 172.21.15.122:0/2528225723 shutdown_connections 2024-09-17T06:04:36.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fb65e9aa640 1 --2- 172.21.15.122:0/2528225723 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb65806d8a0 0x7fb65806dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fb65e9aa640 1 --2- 172.21.15.122:0/2528225723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb65815b180 0x7fb658155390 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009840 tx=0x7fb64c01f030 comp rx=0 tx=0).stop 2024-09-17T06:04:36.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fb65e9aa640 1 -- 172.21.15.122:0/2528225723 >> 172.21.15.122:0/2528225723 conn(0x7fb6580ca340 msgr2=0x7fb6580ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4ad4a5b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ab8004810 0x7f4ac8163810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4ad4a5b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ac80d4f70 0x7f4ac81784e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4ad4a5b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ac8178a20 0x7f4ac8047de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4ad4a5b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac80dd620 con 0x7f4ac80d4f70 2024-09-17T06:04:36.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4ad4a5b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac80dd900 con 0x7f4ac8178a20 2024-09-17T06:04:36.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4aced9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ab8004810 0x7f4ac8163810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4aced9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ab8004810 0x7f4ac8163810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:50894/0 (socket says 172.21.15.122:50894) 2024-09-17T06:04:36.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4aced9d640 1 -- 172.21.15.122:0/2121943722 learned_addr learned my addr 172.21.15.122:0/2121943722 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4ad4a5b640 1 -- 172.21.15.122:0/2121943722 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac800c4d0 con 0x7f4ab8004810 2024-09-17T06:04:36.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4acf59e640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ac8178a20 0x7f4ac8047de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0d296b640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0cc14ed70 0x7fc0cc14f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0d1969640 1 -- 172.21.15.122:0/4179798629 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0cc14ed70 msgr2=0x7fc0cc14f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0d1969640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0cc14ed70 0x7fc0cc14f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0d1969640 1 -- 172.21.15.122:0/4179798629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0b8004810 msgr2=0x7fc0cc0c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0d1969640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0b8004810 0x7fc0cc0c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0d1969640 1 -- 172.21.15.122:0/4179798629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc159170 con 0x7fc0cc1f8fd0 2024-09-17T06:04:36.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0d1969640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0cc1f8fd0 0x7fc0cc14fb00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c1e0 tx=0x7fc0bc001e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f059affd640 1 -- 172.21.15.122:0/632578430 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f059400ae50 con 0x7f058407c950 2024-09-17T06:04:36.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fa79d7fa640 1 -- 172.21.15.122:0/337902430 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa7940137d0 con 0x7fa790005160 2024-09-17T06:04:36.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f0eeb7b7640 1 -- 172.21.15.122:0/4224400636 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ee41555b0 con 0x7f0ee40b8ba0 2024-09-17T06:04:36.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4ace59c640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ac80d4f70 0x7f4ac81784e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fa79d7fa640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa784073280 0x7fa784075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fa79d7fa640 1 -- 172.21.15.122:0/337902430 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa794099730 con 0x7fa790005160 2024-09-17T06:04:36.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fa79d7fa640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fa78407ca40 0x7fa78407eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fa79d7fa640 1 -- 172.21.15.122:0/337902430 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa78407f5a0 con 0x7fa78407ca40 2024-09-17T06:04:36.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fa79d7fa640 1 -- 172.21.15.122:0/337902430 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa794099c10 con 0x7fa790005160 2024-09-17T06:04:36.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4aced9d640 1 -- 172.21.15.122:0/2121943722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ac8178a20 msgr2=0x7f4ac8047de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4aced9d640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ac8178a20 0x7f4ac8047de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4aced9d640 1 -- 172.21.15.122:0/2121943722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ac80d4f70 msgr2=0x7f4ac81784e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4aced9d640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ac80d4f70 0x7f4ac81784e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4aced9d640 1 -- 172.21.15.122:0/2121943722 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac8163d50 con 0x7f4ab8004810 2024-09-17T06:04:36.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fa79ffff640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa784073280 0x7fa784075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fa7a5768640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fa78407ca40 0x7fa78407eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fb65e9aa640 1 -- 172.21.15.122:0/2528225723 shutdown_connections 2024-09-17T06:04:36.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4aced9d640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ab8004810 0x7f4ac8163810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000f6f0 tx=0x7f4ac000fbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fe402ffd640 1 -- 172.21.15.122:0/1102988005 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe3fc01a070 con 0x7fe404044cc0 2024-09-17T06:04:36.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fe402ffd640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe3f0073230 0x7fe3f0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fe402ffd640 1 -- 172.21.15.122:0/1102988005 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe3fc094130 con 0x7fe404044cc0 2024-09-17T06:04:36.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fe402ffd640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fe3f007c9f0 0x7fe3f007ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fe402ffd640 1 -- 172.21.15.122:0/1102988005 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3f007f550 con 0x7fe3f007c9f0 2024-09-17T06:04:36.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fe402ffd640 1 -- 172.21.15.122:0/1102988005 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe3fc094520 con 0x7fe404044cc0 2024-09-17T06:04:36.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fe412454640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe3f0073230 0x7fe3f0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0c2ffd640 1 -- 172.21.15.122:0/4179798629 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc003600 con 0x7fc0cc1f8fd0 2024-09-17T06:04:36.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0c2ffd640 1 -- 172.21.15.122:0/4179798629 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0bc003890 con 0x7fc0cc1f8fd0 2024-09-17T06:04:36.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0c2ffd640 1 -- 172.21.15.122:0/4179798629 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc003ce0 con 0x7fc0cc1f8fd0 2024-09-17T06:04:36.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fa7a5768640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fa78407ca40 0x7fa78407eed0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0cc0c7070 con 0x7fc0cc1f8fd0 2024-09-17T06:04:36.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fa79ffff640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa784073280 0x7fa784075790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa7a014d380 tx=0x7fa78c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fb65e9aa640 1 -- 172.21.15.122:0/2528225723 wait complete. 2024-09-17T06:04:36.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4ab77fe640 1 -- 172.21.15.122:0/2121943722 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0015070 con 0x7f4ab8004810 2024-09-17T06:04:36.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4ad4a5b640 1 -- 172.21.15.122:0/2121943722 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac81827a0 con 0x7f4ab8004810 2024-09-17T06:04:36.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4ad4a5b640 1 -- 172.21.15.122:0/2121943722 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac8163010 con 0x7f4ab8004810 2024-09-17T06:04:36.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4ab77fe640 1 -- 172.21.15.122:0/2121943722 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ac0006170 con 0x7f4ab8004810 2024-09-17T06:04:36.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f4ab77fe640 1 -- 172.21.15.122:0/2121943722 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0003840 con 0x7f4ab8004810 2024-09-17T06:04:36.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7fe411c53640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fe3f007c9f0 0x7fe3f007ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f0ed9ffb640 1 -- 172.21.15.122:0/4224400636 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0ed4018020 con 0x7f0ee40b8ba0 2024-09-17T06:04:36.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f0ed9ffb640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0ec8073300 0x7f0ec8075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.995+0000 7f0ed9ffb640 1 -- 172.21.15.122:0/4224400636 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0ed40943f0 con 0x7f0ee40b8ba0 2024-09-17T06:04:36.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7f0ed9ffb640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f0ec807ca50 0x7f0ec807eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7f0ee8d52640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0ec8073300 0x7f0ec8075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7f0ed9ffb640 1 -- 172.21.15.122:0/4224400636 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ed400de50 con 0x7f0ec807ca50 2024-09-17T06:04:36.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7f0ed9ffb640 1 -- 172.21.15.122:0/4224400636 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0ed409b050 con 0x7f0ee40b8ba0 2024-09-17T06:04:36.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7f0ee9d54640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f0ec807ca50 0x7f0ec807eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0cc0c7630 con 0x7fc0cc1f8fd0 2024-09-17T06:04:36.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0cc15b2c0 con 0x7fc0cc1f8fd0 2024-09-17T06:04:36.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fe412454640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe3f0073230 0x7fe3f0075740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe40c06a430 tx=0x7fe40c09a870 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fe411c53640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fe3f007c9f0 0x7fe3f007ee80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7f0ee8d52640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0ec8073300 0x7f0ec8075810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ee414be20 tx=0x7f0ee0007ea0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb65e9aa640 1 Processor -- start 2024-09-17T06:04:36.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7f4ad4a5b640 1 -- 172.21.15.122:0/2121943722 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ab0001040 con 0x7f4ab8004810 2024-09-17T06:04:36.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7f0ee9d54640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f0ec807ca50 0x7f0ec807eee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fa79d7fa640 1 -- 172.21.15.122:0/337902430 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa78407f5a0 con 0x7fa78407ca40 2024-09-17T06:04:36.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fc0c2ffd640 1 -- 172.21.15.122:0/4179798629 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc0bc0b9450 con 0x7fc0cc1f8fd0 2024-09-17T06:04:36.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fc0c2ffd640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc0b0073280 0x7fc0b0075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fc0c2ffd640 1 -- 172.21.15.122:0/4179798629 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc0bc006180 con 0x7fc0cc1f8fd0 2024-09-17T06:04:36.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fc0c2ffd640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc0b007ca40 0x7fc0b007eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fc0c2ffd640 1 -- 172.21.15.122:0/4179798629 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0b007f5a0 con 0x7fc0b007ca40 2024-09-17T06:04:36.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fc0c2ffd640 1 -- 172.21.15.122:0/4179798629 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc0bc133060 con 0x7fc0cc1f8fd0 2024-09-17T06:04:36.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb65e9aa640 1 -- start start 2024-09-17T06:04:36.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb65e9aa640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb65806d8a0 0x7fb658158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fc0d216a640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc0b0073280 0x7fc0b0075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fc0d296b640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc0b007ca40 0x7fc0b007eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb65e9aa640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6580c9620 0x7fb6581575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb65e9aa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6581e45b0 0x7fb658150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb657fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb65806d8a0 0x7fb658158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb657fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb65806d8a0 0x7fb658158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:50898/0 (socket says 172.21.15.122:50898) 2024-09-17T06:04:36.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fc0d296b640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc0b007ca40 0x7fc0b007eed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7f4ab77fe640 1 -- 172.21.15.122:0/2121943722 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4ac0018070 con 0x7f4ab8004810 2024-09-17T06:04:36.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb65cf47640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6581e45b0 0x7fb658150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb65cf47640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6581e45b0 0x7fb658150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49266/0 (socket says 172.21.15.122:49266) 2024-09-17T06:04:36.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb6577fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6580c9620 0x7fb6581575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb6577fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6580c9620 0x7fb6581575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:49476/0 (socket says 172.21.15.122:49476) 2024-09-17T06:04:36.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb657fff640 1 -- 172.21.15.122:0/3216877221 learned_addr learned my addr 172.21.15.122:0/3216877221 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb6580c8e20 con 0x7fb6581e45b0 2024-09-17T06:04:36.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:35.999+0000 7fc0d216a640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc0b0073280 0x7fc0b0075790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc0c800bb50 tx=0x7fc0c800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb6580c8b40 con 0x7fb6580c9620 2024-09-17T06:04:36.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb6580c9100 con 0x7fb65806d8a0 2024-09-17T06:04:36.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7f4ab77fe640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4abc073200 0x7f4abc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fc0c2ffd640 1 -- 172.21.15.122:0/4179798629 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0b007f5a0 con 0x7fc0b007ca40 2024-09-17T06:04:36.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7f4ab77fe640 1 -- 172.21.15.122:0/2121943722 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4ac0094ad0 con 0x7f4ab8004810 2024-09-17T06:04:36.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7f4ab77fe640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4abc07c9c0 0x7f4abc07ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7f4ab77fe640 1 -- 172.21.15.122:0/2121943722 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ac0024e50 con 0x7f4abc07c9c0 2024-09-17T06:04:36.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7f4ab77fe640 1 -- 172.21.15.122:0/2121943722 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4ac0094ec0 con 0x7f4ab8004810 2024-09-17T06:04:36.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7f4ace59c640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4abc073200 0x7f4abc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7f4acf59e640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4abc07c9c0 0x7f4abc07ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb657fff640 1 -- 172.21.15.122:0/3216877221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6580c9620 msgr2=0x7fb6581575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb657fff640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6580c9620 0x7fb6581575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb657fff640 1 -- 172.21.15.122:0/3216877221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6581e45b0 msgr2=0x7fb658150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb657fff640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6581e45b0 0x7fb658150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb657fff640 1 -- 172.21.15.122:0/3216877221 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb658157b10 con 0x7fb65806d8a0 2024-09-17T06:04:36.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb657fff640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb65806d8a0 0x7fb658158440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb64800c460 tx=0x7fb64800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb6577fe640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6580c9620 0x7fb6581575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:36.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb654ff9640 1 -- 172.21.15.122:0/3216877221 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648016020 con 0x7fb65806d8a0 2024-09-17T06:04:36.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7f4acf59e640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4abc07c9c0 0x7f4abc07ee50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65812ecb0 con 0x7fb65806d8a0 2024-09-17T06:04:36.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6580c6290 con 0x7fb65806d8a0 2024-09-17T06:04:36.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb6580c6670 con 0x7fb65806d8a0 2024-09-17T06:04:36.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7f4ace59c640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4abc073200 0x7f4abc075710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40b0000 tx=0x7f4ac4006040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb654ff9640 1 -- 172.21.15.122:0/3216877221 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb648012920 con 0x7fb65806d8a0 2024-09-17T06:04:36.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7f4ab77fe640 1 -- 172.21.15.122:0/2121943722 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ac0024e50 con 0x7f4abc07c9c0 2024-09-17T06:04:36.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.003+0000 7fb654ff9640 1 -- 172.21.15.122:0/3216877221 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648012d50 con 0x7fb65806d8a0 2024-09-17T06:04:36.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.007+0000 7fb654ff9640 1 -- 172.21.15.122:0/3216877221 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb648019020 con 0x7fb65806d8a0 2024-09-17T06:04:36.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.007+0000 7fb654ff9640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb644073200 0x7fb644075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.007+0000 7fb654ff9640 1 -- 172.21.15.122:0/3216877221 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb6480944f0 con 0x7fb65806d8a0 2024-09-17T06:04:36.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.007+0000 7fb654ff9640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fb64407c940 0x7fb64407edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.007+0000 7fb654ff9640 1 -- 172.21.15.122:0/3216877221 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb64800fe50 con 0x7fb64407c940 2024-09-17T06:04:36.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.007+0000 7fb654ff9640 1 -- 172.21.15.122:0/3216877221 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb6480948e0 con 0x7fb65806d8a0 2024-09-17T06:04:36.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.007+0000 7fb6577fe640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb644073200 0x7fb644075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.007+0000 7fb65cf47640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fb64407c940 0x7fb64407edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.007+0000 7fb65cf47640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fb64407c940 0x7fb64407edd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.007+0000 7fb6577fe640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb644073200 0x7fb644075710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0b2000 tx=0x7fb64c01d870 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.007+0000 7fb654ff9640 1 -- 172.21.15.122:0/3216877221 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb64800fe50 con 0x7fb64407c940 2024-09-17T06:04:36.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.011+0000 7f0ed9ffb640 1 -- 172.21.15.122:0/4224400636 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ed400de50 con 0x7f0ec807ca50 2024-09-17T06:04:36.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.011+0000 7fe402ffd640 1 -- 172.21.15.122:0/1102988005 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe3f007f550 con 0x7fe3f007c9f0 2024-09-17T06:04:36.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.015+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0cc0d03c0 con 0x7fc0b007ca40 2024-09-17T06:04:36.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.015+0000 7fc0c2ffd640 1 -- 172.21.15.122:0/4179798629 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc0cc0d03c0 con 0x7fc0b007ca40 2024-09-17T06:04:36.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.015+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc0b007ca40 msgr2=0x7fc0b007eed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.015+0000 7fc0d43ce640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc0b007ca40 0x7fc0b007eed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.015+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc0b0073280 msgr2=0x7fc0b0075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.015+0000 7fc0d43ce640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc0b0073280 0x7fc0b0075790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc0c800bb50 tx=0x7fc0c800b2e0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.015+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0cc1f8fd0 msgr2=0x7fc0cc14fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.015+0000 7fc0d43ce640 1 --2- 172.21.15.122:0/4179798629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0cc1f8fd0 0x7fc0cc14fb00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c1e0 tx=0x7fc0bc001e40 comp rx=0 tx=0).stop 2024-09-17T06:04:36.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.015+0000 7fc0d296b640 1 -- 172.21.15.122:0/4179798629 reap_dead start 2024-09-17T06:04:36.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.015+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 shutdown_connections 2024-09-17T06:04:36.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.015+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 >> 172.21.15.122:0/4179798629 conn(0x7fc0cc074ed0 msgr2=0x7fc0cc151120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.019+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 shutdown_connections 2024-09-17T06:04:36.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.019+0000 7fc0d43ce640 1 -- 172.21.15.122:0/4179798629 wait complete. 2024-09-17T06:04:36.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0c867fc640 1 -- 172.21.15.122:0/1731891964 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0c78002de0 con 0x7f0c8c07c9f0 2024-09-17T06:04:36.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0c9cff9640 1 -- 172.21.15.122:0/1731891964 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0c78002de0 con 0x7f0c8c07c9f0 2024-09-17T06:04:36.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0ca6908640 1 -- 172.21.15.122:0/1731891964 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f0c8c07c9f0 msgr2=0x7f0c8c07ee80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0ca6908640 1 --2- 172.21.15.122:0/1731891964 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f0c8c07c9f0 0x7f0c8c07ee80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0ca6908640 1 -- 172.21.15.122:0/1731891964 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0c8c073230 msgr2=0x7f0c8c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0ca6908640 1 --2- 172.21.15.122:0/1731891964 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0c8c073230 0x7f0c8c075740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800acd0 tx=0x7f0c9801dd50 comp rx=0 tx=0).stop 2024-09-17T06:04:36.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0ca6908640 1 -- 172.21.15.122:0/1731891964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ca014d680 msgr2=0x7f0ca0156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0ca6908640 1 --2- 172.21.15.122:0/1731891964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ca014d680 0x7f0ca0156430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000c460 tx=0x7f0c9000c920 comp rx=0 tx=0).stop 2024-09-17T06:04:36.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0ca4ea5640 1 -- 172.21.15.122:0/1731891964 reap_dead start 2024-09-17T06:04:36.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0ca6908640 1 -- 172.21.15.122:0/1731891964 shutdown_connections 2024-09-17T06:04:36.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0ca6908640 1 -- 172.21.15.122:0/1731891964 >> 172.21.15.122:0/1731891964 conn(0x7f0ca00722e0 msgr2=0x7f0ca006d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0ca6908640 1 -- 172.21.15.122:0/1731891964 shutdown_connections 2024-09-17T06:04:36.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.023+0000 7f0ca6908640 1 -- 172.21.15.122:0/1731891964 wait complete. 2024-09-17T06:04:36.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.027+0000 7f05a8cbe640 1 -- 172.21.15.122:0/632578430 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f05a40c33d0 con 0x7f058407c950 2024-09-17T06:04:36.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.027+0000 7f059affd640 1 -- 172.21.15.122:0/632578430 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f05a40c33d0 con 0x7f058407c950 2024-09-17T06:04:36.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.031+0000 7f0598ff9640 1 -- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f058407c950 msgr2=0x7f058407ede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.031+0000 7f0598ff9640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f058407c950 0x7f058407ede0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.031+0000 7f0598ff9640 1 -- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0584073200 msgr2=0x7f0584075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.031+0000 7f0598ff9640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0584073200 0x7f0584075710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f058c009be0 tx=0x7f058c0091e0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.031+0000 7f0598ff9640 1 -- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a4162f20 msgr2=0x7f05a414eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.031+0000 7f0598ff9640 1 --2- 172.21.15.122:0/632578430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05a4162f20 0x7f05a414eb80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0594001b90 tx=0x7f05940039d0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.031+0000 7f05a2d9d640 1 -- 172.21.15.122:0/632578430 reap_dead start 2024-09-17T06:04:36.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.031+0000 7f0598ff9640 1 -- 172.21.15.122:0/632578430 shutdown_connections 2024-09-17T06:04:36.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.031+0000 7f0598ff9640 1 -- 172.21.15.122:0/632578430 >> 172.21.15.122:0/632578430 conn(0x7f05a40746d0 msgr2=0x7f05a414cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.031+0000 7f0598ff9640 1 -- 172.21.15.122:0/632578430 shutdown_connections 2024-09-17T06:04:36.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.031+0000 7f0598ff9640 1 -- 172.21.15.122:0/632578430 wait complete. 2024-09-17T06:04:36.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.035+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb6581515c0 con 0x7fb64407c940 2024-09-17T06:04:36.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.035+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa7a0152de0 con 0x7fa78407ca40 2024-09-17T06:04:36.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4ad4a5b640 1 -- 172.21.15.122:0/2121943722 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ab0002d60 con 0x7f4abc07c9c0 2024-09-17T06:04:36.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fb654ff9640 1 -- 172.21.15.122:0/3216877221 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb6581515c0 con 0x7fb64407c940 2024-09-17T06:04:36.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fa79d7fa640 1 -- 172.21.15.122:0/337902430 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa7a0152de0 con 0x7fa78407ca40 2024-09-17T06:04:36.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4ab77fe640 1 -- 172.21.15.122:0/2121943722 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4ab0002d60 con 0x7f4abc07c9c0 2024-09-17T06:04:36.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fb64407c940 msgr2=0x7fb64407edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fb65e9aa640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fb64407c940 0x7fb64407edd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb644073200 msgr2=0x7fb644075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fb65e9aa640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb644073200 0x7fb644075710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0b2000 tx=0x7fb64c01d870 comp rx=0 tx=0).stop 2024-09-17T06:04:36.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb65806d8a0 msgr2=0x7fb658158440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fb65e9aa640 1 --2- 172.21.15.122:0/3216877221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb65806d8a0 0x7fb658158440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb64800c460 tx=0x7fb64800c920 comp rx=0 tx=0).stop 2024-09-17T06:04:36.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fb65cf47640 1 -- 172.21.15.122:0/3216877221 reap_dead start 2024-09-17T06:04:36.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4ab57fa640 1 -- 172.21.15.122:0/2121943722 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4abc07c9c0 msgr2=0x7f4abc07ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4ab57fa640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4abc07c9c0 0x7f4abc07ee50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4ab57fa640 1 -- 172.21.15.122:0/2121943722 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4abc073200 msgr2=0x7f4abc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4ab57fa640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4abc073200 0x7f4abc075710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40b0000 tx=0x7f4ac4006040 comp rx=0 tx=0).stop 2024-09-17T06:04:36.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4ab57fa640 1 -- 172.21.15.122:0/2121943722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ab8004810 msgr2=0x7f4ac8163810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4ab57fa640 1 --2- 172.21.15.122:0/2121943722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ab8004810 0x7f4ac8163810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000f6f0 tx=0x7f4ac000fbb0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 shutdown_connections 2024-09-17T06:04:36.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 >> 172.21.15.122:0/3216877221 conn(0x7fb6580ca340 msgr2=0x7fb65815a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4acf59e640 1 -- 172.21.15.122:0/2121943722 reap_dead start 2024-09-17T06:04:36.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4ab57fa640 1 -- 172.21.15.122:0/2121943722 shutdown_connections 2024-09-17T06:04:36.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4ab57fa640 1 -- 172.21.15.122:0/2121943722 >> 172.21.15.122:0/2121943722 conn(0x7f4ac8051f70 msgr2=0x7f4ac8169c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 shutdown_connections 2024-09-17T06:04:36.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4ab57fa640 1 -- 172.21.15.122:0/2121943722 shutdown_connections 2024-09-17T06:04:36.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fb65e9aa640 1 -- 172.21.15.122:0/3216877221 wait complete. 2024-09-17T06:04:36.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7f4ab57fa640 1 -- 172.21.15.122:0/2121943722 wait complete. 2024-09-17T06:04:36.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fa78407ca40 msgr2=0x7fa78407eed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fa7a71cb640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fa78407ca40 0x7fa78407eed0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa784073280 msgr2=0x7fa784075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fa7a71cb640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa784073280 0x7fa784075790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa7a014d380 tx=0x7fa78c009040 comp rx=0 tx=0).stop 2024-09-17T06:04:36.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790005160 msgr2=0x7fa7a01eff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fa7a71cb640 1 --2- 172.21.15.122:0/337902430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790005160 0x7fa7a01eff40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa794009e20 tx=0x7fa79400ed70 comp rx=0 tx=0).stop 2024-09-17T06:04:36.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fa7a5768640 1 -- 172.21.15.122:0/337902430 reap_dead start 2024-09-17T06:04:36.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 shutdown_connections 2024-09-17T06:04:36.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 >> 172.21.15.122:0/337902430 conn(0x7fa7a0070e40 msgr2=0x7fa7a00cbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 shutdown_connections 2024-09-17T06:04:36.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.039+0000 7fa7a71cb640 1 -- 172.21.15.122:0/337902430 wait complete. 2024-09-17T06:04:36.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe4146b8640 1 -- 172.21.15.122:0/1102988005 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe4040cbdd0 con 0x7fe3f007c9f0 2024-09-17T06:04:36.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7f0eeb7b7640 1 -- 172.21.15.122:0/4224400636 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ee415a730 con 0x7f0ec807ca50 2024-09-17T06:04:36.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7f0ed9ffb640 1 -- 172.21.15.122:0/4224400636 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0ee415a730 con 0x7f0ec807ca50 2024-09-17T06:04:36.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe402ffd640 1 -- 172.21.15.122:0/1102988005 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe4040cbdd0 con 0x7fe3f007c9f0 2024-09-17T06:04:36.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe4146b8640 1 -- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fe3f007c9f0 msgr2=0x7fe3f007ee80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe4146b8640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fe3f007c9f0 0x7fe3f007ee80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe4146b8640 1 -- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe3f0073230 msgr2=0x7fe3f0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe4146b8640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe3f0073230 0x7fe3f0075740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe40c06a430 tx=0x7fe40c09a870 comp rx=0 tx=0).stop 2024-09-17T06:04:36.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe4146b8640 1 -- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe404044cc0 msgr2=0x7fe4040c3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe4146b8640 1 --2- 172.21.15.122:0/1102988005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe404044cc0 0x7fe4040c3890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00c3c0 tx=0x7fe3fc00c880 comp rx=0 tx=0).stop 2024-09-17T06:04:36.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe412c55640 1 -- 172.21.15.122:0/1102988005 reap_dead start 2024-09-17T06:04:36.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe4146b8640 1 -- 172.21.15.122:0/1102988005 shutdown_connections 2024-09-17T06:04:36.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe4146b8640 1 -- 172.21.15.122:0/1102988005 >> 172.21.15.122:0/1102988005 conn(0x7fe40404fe40 msgr2=0x7fe4040d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe4146b8640 1 -- 172.21.15.122:0/1102988005 shutdown_connections 2024-09-17T06:04:36.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.043+0000 7fe4146b8640 1 -- 172.21.15.122:0/1102988005 wait complete. 2024-09-17T06:04:36.060 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.047+0000 7f0ecf7fe640 1 -- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f0ec807ca50 msgr2=0x7f0ec807eee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.047+0000 7f0ecf7fe640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f0ec807ca50 0x7f0ec807eee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.047+0000 7f0ecf7fe640 1 -- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0ec8073300 msgr2=0x7f0ec8075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.047+0000 7f0ecf7fe640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0ec8073300 0x7f0ec8075810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ee414be20 tx=0x7f0ee0007ea0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.047+0000 7f0ecf7fe640 1 -- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ee40b8ba0 msgr2=0x7f0ee4202040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.047+0000 7f0ecf7fe640 1 --2- 172.21.15.122:0/4224400636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ee40b8ba0 0x7f0ee4202040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400b3f0 tx=0x7f0ed400b8b0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.047+0000 7f0ee9d54640 1 -- 172.21.15.122:0/4224400636 reap_dead start 2024-09-17T06:04:36.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.047+0000 7f0ecf7fe640 1 -- 172.21.15.122:0/4224400636 shutdown_connections 2024-09-17T06:04:36.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.047+0000 7f0ecf7fe640 1 -- 172.21.15.122:0/4224400636 >> 172.21.15.122:0/4224400636 conn(0x7f0ee40746d0 msgr2=0x7f0ee415b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.062 INFO:teuthology.orchestra.run.smithi122.stdout:64424509451 2024-09-17T06:04:36.062 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T06:04:36.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.047+0000 7f0ecf7fe640 1 -- 172.21.15.122:0/4224400636 shutdown_connections 2024-09-17T06:04:36.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.047+0000 7f0ecf7fe640 1 -- 172.21.15.122:0/4224400636 wait complete. 2024-09-17T06:04:36.063 INFO:teuthology.orchestra.run.smithi122.stdout:64424509452 2024-09-17T06:04:36.064 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T06:04:36.069 INFO:teuthology.orchestra.run.smithi122.stdout:64424509451 2024-09-17T06:04:36.069 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T06:04:36.074 INFO:teuthology.orchestra.run.smithi122.stdout:64424509452 2024-09-17T06:04:36.075 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T06:04:36.076 INFO:teuthology.orchestra.run.smithi122.stdout:64424509450 2024-09-17T06:04:36.076 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T06:04:36.080 INFO:teuthology.orchestra.run.smithi122.stdout:64424509452 2024-09-17T06:04:36.080 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T06:04:36.082 INFO:teuthology.orchestra.run.smithi122.stdout:60129542154 2024-09-17T06:04:36.082 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T06:04:36.084 INFO:teuthology.orchestra.run.smithi122.stdout:64424509452 2024-09-17T06:04:36.084 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T06:04:36.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f6dd4756640 1 -- 172.21.15.122:0/1172401544 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6dcc075290 msgr2=0x7f6dcc15b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f6dd4756640 1 --2- 172.21.15.122:0/1172401544 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6dcc075290 0x7f6dcc15b1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009c80 tx=0x7f6dc401cb00 comp rx=0 tx=0).stop 2024-09-17T06:04:36.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f6dd4756640 1 -- 172.21.15.122:0/1172401544 shutdown_connections 2024-09-17T06:04:36.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f6dd4756640 1 --2- 172.21.15.122:0/1172401544 >> v2:172.21.15.173:3300/0 conn(0x7f6dcc0c65d0 0x7f6dcc150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f6dd4756640 1 --2- 172.21.15.122:0/1172401544 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6dcc075290 0x7f6dcc15b1a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f6dd4756640 1 -- 172.21.15.122:0/1172401544 >> 172.21.15.122:0/1172401544 conn(0x7f6dcc06d290 msgr2=0x7f6dcc06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f6dd4756640 1 -- 172.21.15.122:0/1172401544 shutdown_connections 2024-09-17T06:04:36.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f93ec68e640 1 -- 172.21.15.122:0/2293673330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93e40c4300 msgr2=0x7f93e415b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f93ec68e640 1 --2- 172.21.15.122:0/2293673330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93e40c4300 0x7f93e415b1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009c80 tx=0x7f93dc01cd10 comp rx=0 tx=0).stop 2024-09-17T06:04:36.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f93ec68e640 1 -- 172.21.15.122:0/2293673330 shutdown_connections 2024-09-17T06:04:36.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f93ec68e640 1 --2- 172.21.15.122:0/2293673330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93e40c4300 0x7f93e415b1a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f93ec68e640 1 -- 172.21.15.122:0/2293673330 >> 172.21.15.122:0/2293673330 conn(0x7f93e406d290 msgr2=0x7f93e406d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f93ec68e640 1 -- 172.21.15.122:0/2293673330 shutdown_connections 2024-09-17T06:04:36.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f6dd4756640 1 -- 172.21.15.122:0/1172401544 wait complete. 2024-09-17T06:04:36.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.271+0000 7f6dd4756640 1 Processor -- start 2024-09-17T06:04:36.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.271+0000 7f6dd4756640 1 -- start start 2024-09-17T06:04:36.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.267+0000 7f93ec68e640 1 -- 172.21.15.122:0/2293673330 wait complete. 2024-09-17T06:04:36.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.271+0000 7f93ec68e640 1 Processor -- start 2024-09-17T06:04:36.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.271+0000 7f93ec68e640 1 -- start start 2024-09-17T06:04:36.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.271+0000 7f6dd4756640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dcc075290 0x7f6dcc16a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.271+0000 7f6dd4756640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6dcc0c65d0 0x7f6dcc15e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd4756640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dcc0c6f60 0x7f6dcc15ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd24f2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dcc075290 0x7f6dcc16a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd24f2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dcc075290 0x7f6dcc16a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:49496/0 (socket says 172.21.15.122:49496) 2024-09-17T06:04:36.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd1cf1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6dcc0c65d0 0x7f6dcc15e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd1cf1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6dcc0c65d0 0x7f6dcc15e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:50914/0 (socket says 172.21.15.122:50914) 2024-09-17T06:04:36.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd2cf3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dcc0c6f60 0x7f6dcc15ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd2cf3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dcc0c6f60 0x7f6dcc15ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49280/0 (socket says 172.21.15.122:49280) 2024-09-17T06:04:36.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd24f2640 1 -- 172.21.15.122:0/2280616030 learned_addr learned my addr 172.21.15.122:0/2280616030 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd4756640 1 -- 172.21.15.122:0/2280616030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc0c4470 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd4756640 1 -- 172.21.15.122:0/2280616030 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc074e50 con 0x7f6dcc075290 2024-09-17T06:04:36.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd4756640 1 -- 172.21.15.122:0/2280616030 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6dcc0c7f10 con 0x7f6dcc0c65d0 2024-09-17T06:04:36.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd2cf3640 1 -- 172.21.15.122:0/2280616030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6dcc0c65d0 msgr2=0x7f6dcc15e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd2cf3640 1 --2- 172.21.15.122:0/2280616030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6dcc0c65d0 0x7f6dcc15e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd2cf3640 1 -- 172.21.15.122:0/2280616030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dcc075290 msgr2=0x7f6dcc16a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd2cf3640 1 --2- 172.21.15.122:0/2280616030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dcc075290 0x7f6dcc16a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd2cf3640 1 -- 172.21.15.122:0/2280616030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc150ce0 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd2cf3640 1 --2- 172.21.15.122:0/2280616030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dcc0c6f60 0x7f6dcc15ea70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800e640 tx=0x7f6dc800eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f93ec68e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93e4075290 0x7f93e415d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f93ec68e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93e40c4300 0x7f93e415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f93ea42a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93e4075290 0x7f93e415d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f93ea42a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93e4075290 0x7f93e415d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:50928/0 (socket says 172.21.15.122:50928) 2024-09-17T06:04:36.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f93e9c29640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93e40c4300 0x7f93e415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f93e9c29640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93e40c4300 0x7f93e415e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49290/0 (socket says 172.21.15.122:49290) 2024-09-17T06:04:36.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dc2ffd640 1 -- 172.21.15.122:0/2280616030 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8004220 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dc2ffd640 1 -- 172.21.15.122:0/2280616030 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dc8005020 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dc2ffd640 1 -- 172.21.15.122:0/2280616030 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8005470 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f93ea42a640 1 -- 172.21.15.122:0/2701510390 learned_addr learned my addr 172.21.15.122:0/2701510390 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.275+0000 7f6dd4756640 1 -- 172.21.15.122:0/2280616030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dcc157580 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.279+0000 7f6dd4756640 1 -- 172.21.15.122:0/2280616030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dcc15fd60 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.279+0000 7f6dc0ff9640 1 -- 172.21.15.122:0/2280616030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da80052a0 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.279+0000 7f6dc2ffd640 1 -- 172.21.15.122:0/2280616030 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6dc800c810 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.279+0000 7f6dc2ffd640 1 --2- 172.21.15.122:0/2280616030 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6db0073230 0x7f6db0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f6dd24f2640 1 --2- 172.21.15.122:0/2280616030 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6db0073230 0x7f6db0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7fd557ee8640 1 -- 172.21.15.122:0/3306724563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5480373c0 msgr2=0x7fd5480df5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7fd557ee8640 1 --2- 172.21.15.122:0/3306724563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5480373c0 0x7fd5480df5d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009900 tx=0x7fd54c01f0f0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7fd557ee8640 1 -- 172.21.15.122:0/3306724563 shutdown_connections 2024-09-17T06:04:36.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7fd557ee8640 1 --2- 172.21.15.122:0/3306724563 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd548007100 0x7fd5480495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7fd557ee8640 1 --2- 172.21.15.122:0/3306724563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5480373c0 0x7fd5480df5d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7fd557ee8640 1 -- 172.21.15.122:0/3306724563 >> 172.21.15.122:0/3306724563 conn(0x7fd548050bf0 msgr2=0x7fd548051000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7fd557ee8640 1 -- 172.21.15.122:0/3306724563 shutdown_connections 2024-09-17T06:04:36.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f93ec68e640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93e40c6f60 0x7f93e414eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f93e40cd070 con 0x7f93e40c4300 2024-09-17T06:04:36.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f93e40c6740 con 0x7f93e40c6f60 2024-09-17T06:04:36.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f93e40cd1f0 con 0x7f93e4075290 2024-09-17T06:04:36.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f6dd24f2640 1 --2- 172.21.15.122:0/2280616030 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6db0073230 0x7f6db0075740 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6dc401b1b0 tx=0x7f6dc401b340 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f93eac2b640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93e40c6f60 0x7f93e414eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f6dc2ffd640 1 -- 172.21.15.122:0/2280616030 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6dc8092bc0 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f93e9c29640 1 -- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93e4075290 msgr2=0x7f93e415d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f93e9c29640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93e4075290 0x7f93e415d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f93e9c29640 1 -- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93e40c6f60 msgr2=0x7f93e414eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f93e9c29640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93e40c6f60 0x7f93e414eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f93e9c29640 1 -- 172.21.15.122:0/2701510390 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e4156ae0 con 0x7f93e40c4300 2024-09-17T06:04:36.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7f93e9c29640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93e40c4300 0x7f93e415e070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f93d4000f70 tx=0x7f93d400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.283+0000 7fd557ee8640 1 -- 172.21.15.122:0/3306724563 wait complete. 2024-09-17T06:04:36.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd557ee8640 1 Processor -- start 2024-09-17T06:04:36.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd557ee8640 1 -- start start 2024-09-17T06:04:36.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd557ee8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd548007100 0x7fd54804d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd557ee8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd548007510 0x7fd54804de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd555c84640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd548007100 0x7fd54804d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd555483640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd548007510 0x7fd54804de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd555c84640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd548007100 0x7fd54804d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:49514/0 (socket says 172.21.15.122:49514) 2024-09-17T06:04:36.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd555c84640 1 -- 172.21.15.122:0/600849243 learned_addr learned my addr 172.21.15.122:0/600849243 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd555483640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd548007510 0x7fd54804de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49304/0 (socket says 172.21.15.122:49304) 2024-09-17T06:04:36.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd557ee8640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd54804b470 0x7fd5480d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd5480e27a0 con 0x7fd548007510 2024-09-17T06:04:36.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd5480e2260 con 0x7fd548007100 2024-09-17T06:04:36.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.287+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd5480e2fa0 con 0x7fd54804b470 2024-09-17T06:04:36.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7fd556485640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd54804b470 0x7fd5480d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7fd555c84640 1 -- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd54804b470 msgr2=0x7fd5480d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7fd555c84640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd54804b470 0x7fd5480d11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7fd555c84640 1 -- 172.21.15.122:0/600849243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd548007510 msgr2=0x7fd54804de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7fd555c84640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd548007510 0x7fd54804de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7fd555c84640 1 -- 172.21.15.122:0/600849243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5480e1c70 con 0x7fd548007100 2024-09-17T06:04:36.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7fd555c84640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd548007100 0x7fd54804d940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd54c01cd20 tx=0x7fd54c005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7fd5467fc640 1 -- 172.21.15.122:0/600849243 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0b5040 con 0x7fd548007100 2024-09-17T06:04:36.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7f93daffd640 1 -- 172.21.15.122:0/2701510390 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d4017070 con 0x7f93e40c4300 2024-09-17T06:04:36.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7f6dc2ffd640 1 -- 172.21.15.122:0/2280616030 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6dc805efe0 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e415dbc0 con 0x7f93e40c4300 2024-09-17T06:04:36.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e415c8c0 con 0x7f93e40c4300 2024-09-17T06:04:36.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e415b1a0 con 0x7f93e40c4300 2024-09-17T06:04:36.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5480d2ed0 con 0x7fd548007100 2024-09-17T06:04:36.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5480e1040 con 0x7fd548007100 2024-09-17T06:04:36.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7fd5467fc640 1 -- 172.21.15.122:0/600849243 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd54c0b1780 con 0x7fd548007100 2024-09-17T06:04:36.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7fd5467fc640 1 -- 172.21.15.122:0/600849243 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0b1bd0 con 0x7fd548007100 2024-09-17T06:04:36.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.291+0000 7f93daffd640 1 -- 172.21.15.122:0/2701510390 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93d4003600 con 0x7f93e40c4300 2024-09-17T06:04:36.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.295+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2250964662 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf6815d320 msgr2=0x7fcf68159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.295+0000 7fcf6d38c640 1 --2- 172.21.15.122:0/2250964662 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf6815d320 0x7fcf68159000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009870 tx=0x7fcf5801c880 comp rx=0 tx=0).stop 2024-09-17T06:04:36.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.295+0000 7f93daffd640 1 -- 172.21.15.122:0/2701510390 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d4021060 con 0x7f93e40c4300 2024-09-17T06:04:36.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.295+0000 7f93daffd640 1 -- 172.21.15.122:0/2701510390 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f93d401a070 con 0x7f93e40c4300 2024-09-17T06:04:36.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.295+0000 7f93daffd640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f93c80731b0 0x7f93c80756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.295+0000 7fd5467fc640 1 -- 172.21.15.122:0/600849243 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd54c0c1070 con 0x7fd548007100 2024-09-17T06:04:36.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.295+0000 7fd5467fc640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd534073200 0x7fd534075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.295+0000 7fd5467fc640 1 -- 172.21.15.122:0/600849243 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd54c1314a0 con 0x7fd548007100 2024-09-17T06:04:36.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.295+0000 7fd555483640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd534073200 0x7fd534075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.299+0000 7f93ea42a640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f93c80731b0 0x7f93c80756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.299+0000 7f93daffd640 1 -- 172.21.15.122:0/2701510390 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f93d405a910 con 0x7f93e40c4300 2024-09-17T06:04:36.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.299+0000 7fd555483640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd534073200 0x7fd534075710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd5480388a0 tx=0x7fd5400091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.299+0000 7f93ea42a640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f93c80731b0 0x7f93c80756c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f93e0001840 tx=0x7f93e0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5380052a0 con 0x7fd548007100 2024-09-17T06:04:36.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7f93daffd640 1 -- 172.21.15.122:0/2701510390 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f93d405e6a0 con 0x7f93e40c4300 2024-09-17T06:04:36.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7efd68135640 1 -- 172.21.15.122:0/904199441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd6006e370 msgr2=0x7efd601522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7efd68135640 1 --2- 172.21.15.122:0/904199441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd6006e370 0x7efd601522c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009900 tx=0x7efd5c01f0f0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7efd68135640 1 -- 172.21.15.122:0/904199441 shutdown_connections 2024-09-17T06:04:36.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7efd68135640 1 --2- 172.21.15.122:0/904199441 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd600c26f0 0x7efd600c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7efd68135640 1 --2- 172.21.15.122:0/904199441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd6006e370 0x7efd601522c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7efd68135640 1 -- 172.21.15.122:0/904199441 >> 172.21.15.122:0/904199441 conn(0x7efd600cd4f0 msgr2=0x7efd600cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7efd68135640 1 -- 172.21.15.122:0/904199441 shutdown_connections 2024-09-17T06:04:36.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7efd68135640 1 -- 172.21.15.122:0/904199441 wait complete. 2024-09-17T06:04:36.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2250964662 shutdown_connections 2024-09-17T06:04:36.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7fcf6d38c640 1 --2- 172.21.15.122:0/2250964662 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf6815d320 0x7fcf68159000 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2250964662 >> 172.21.15.122:0/2250964662 conn(0x7fcf6806ce90 msgr2=0x7fcf6806d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2250964662 shutdown_connections 2024-09-17T06:04:36.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.303+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2250964662 wait complete. 2024-09-17T06:04:36.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd68135640 1 Processor -- start 2024-09-17T06:04:36.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd68135640 1 -- start start 2024-09-17T06:04:36.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7fcf6d38c640 1 Processor -- start 2024-09-17T06:04:36.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7fcf6d38c640 1 -- start start 2024-09-17T06:04:36.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd68135640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd6006e370 0x7efd601639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd68135640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd600c26f0 0x7efd6014db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd65ed1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd6006e370 0x7efd601639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd65ed1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd6006e370 0x7efd601639f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49322/0 (socket says 172.21.15.122:49322) 2024-09-17T06:04:36.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd65ed1640 1 -- 172.21.15.122:0/884209231 learned_addr learned my addr 172.21.15.122:0/884209231 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd68135640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd600c3180 0x7efd60156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efd60158af0 con 0x7efd6006e370 2024-09-17T06:04:36.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efd60158810 con 0x7efd600c3180 2024-09-17T06:04:36.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7efd600c4240 con 0x7efd600c26f0 2024-09-17T06:04:36.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd65ed1640 1 -- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd600c26f0 msgr2=0x7efd6014db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd65ed1640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd600c26f0 0x7efd6014db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd65ed1640 1 -- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd600c3180 msgr2=0x7efd60156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd65ed1640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd600c3180 0x7efd60156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd65ed1640 1 -- 172.21.15.122:0/884209231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd60155d90 con 0x7efd6006e370 2024-09-17T06:04:36.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7efd65ed1640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd6006e370 0x7efd601639f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0b3040 tx=0x7efd5c003690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7fcf6d38c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf680c5410 0x7fcf681f98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7fcf6d38c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf680c9c30 0x7fcf68153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7fcf6d38c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf681efe50 0x7fcf6806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7fcf66ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf680c5410 0x7fcf681f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7fcf66ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf680c5410 0x7fcf681f98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49328/0 (socket says 172.21.15.122:49328) 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7fcf66ffd640 1 -- 172.21.15.122:0/2890650935 learned_addr learned my addr 172.21.15.122:0/2890650935 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2890650935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcf680ca210 con 0x7fcf680c5410 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2890650935 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcf680ca090 con 0x7fcf680c9c30 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.307+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2890650935 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680cef30 con 0x7fcf681efe50 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf667fc640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf680c9c30 0x7fcf68153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf677fe640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf681efe50 0x7fcf6806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf66ffd640 1 -- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf681efe50 msgr2=0x7fcf6806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf66ffd640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf681efe50 0x7fcf6806eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf66ffd640 1 -- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf680c9c30 msgr2=0x7fcf68153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf66ffd640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf680c9c30 0x7fcf68153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf66ffd640 1 -- 172.21.15.122:0/2890650935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf681f9e10 con 0x7fcf680c5410 2024-09-17T06:04:36.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf66ffd640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf680c5410 0x7fcf681f98d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcf5801cd60 tx=0x7fcf58004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf4f7fe640 1 -- 172.21.15.122:0/2890650935 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58004430 con 0x7fcf680c5410 2024-09-17T06:04:36.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf4f7fe640 1 -- 172.21.15.122:0/2890650935 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf580bd070 con 0x7fcf680c5410 2024-09-17T06:04:36.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2890650935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf681544d0 con 0x7fcf680c5410 2024-09-17T06:04:36.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf4f7fe640 1 -- 172.21.15.122:0/2890650935 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf580039b0 con 0x7fcf680c5410 2024-09-17T06:04:36.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2890650935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf680b4680 con 0x7fcf680c5410 2024-09-17T06:04:36.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf4d7fa640 1 -- 172.21.15.122:0/2890650935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf400052a0 con 0x7fcf680c5410 2024-09-17T06:04:36.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf4f7fe640 1 -- 172.21.15.122:0/2890650935 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcf58003b50 con 0x7fcf680c5410 2024-09-17T06:04:36.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.311+0000 7fcf4f7fe640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf54073230 0x7fcf54075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.315+0000 7fcf4f7fe640 1 -- 172.21.15.122:0/2890650935 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcf5812f840 con 0x7fcf680c5410 2024-09-17T06:04:36.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.315+0000 7fcf667fc640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf54073230 0x7fcf54075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.315+0000 7fcf667fc640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf54073230 0x7fcf54075740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcf680cc1e0 tx=0x7fcf5c009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.319+0000 7efd567fc640 1 -- 172.21.15.122:0/884209231 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0b5040 con 0x7efd6006e370 2024-09-17T06:04:36.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.319+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd60163f30 con 0x7efd6006e370 2024-09-17T06:04:36.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.319+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd60156010 con 0x7efd6006e370 2024-09-17T06:04:36.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.319+0000 7efd567fc640 1 -- 172.21.15.122:0/884209231 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd5c003c50 con 0x7efd6006e370 2024-09-17T06:04:36.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.319+0000 7fd5467fc640 1 -- 172.21.15.122:0/600849243 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd54c018c50 con 0x7fd548007100 2024-09-17T06:04:36.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.319+0000 7efd567fc640 1 -- 172.21.15.122:0/884209231 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0b05f0 con 0x7efd6006e370 2024-09-17T06:04:36.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.319+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd480052a0 con 0x7efd6006e370 2024-09-17T06:04:36.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.323+0000 7fcf4f7fe640 1 -- 172.21.15.122:0/2890650935 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fcf58016470 con 0x7fcf680c5410 2024-09-17T06:04:36.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.323+0000 7efd567fc640 1 -- 172.21.15.122:0/884209231 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efd5c0c2060 con 0x7efd6006e370 2024-09-17T06:04:36.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.323+0000 7efd567fc640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd44073280 0x7efd44075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.323+0000 7efd567fc640 1 -- 172.21.15.122:0/884209231 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efd5c0f8b60 con 0x7efd6006e370 2024-09-17T06:04:36.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.327+0000 7efd656d0640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd44073280 0x7efd44075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.327+0000 7efd656d0640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd44073280 0x7efd44075790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd60165b40 tx=0x7efd50006bb0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.331+0000 7efd567fc640 1 -- 172.21.15.122:0/884209231 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efd60155d90 con 0x7efd6006e370 2024-09-17T06:04:36.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f24acdf5640 1 -- 172.21.15.122:0/4252124351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a815c220 msgr2=0x7f24a80c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f24acdf5640 1 --2- 172.21.15.122:0/4252124351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a815c220 0x7f24a80c3960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f249c009900 tx=0x7f249c01f070 comp rx=0 tx=0).stop 2024-09-17T06:04:36.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f24acdf5640 1 -- 172.21.15.122:0/4252124351 shutdown_connections 2024-09-17T06:04:36.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f24acdf5640 1 --2- 172.21.15.122:0/4252124351 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24a806e010 0x7f24a80c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f24acdf5640 1 --2- 172.21.15.122:0/4252124351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a815c220 0x7f24a80c3960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f24acdf5640 1 -- 172.21.15.122:0/4252124351 >> 172.21.15.122:0/4252124351 conn(0x7f24a80ca380 msgr2=0x7f24a80ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f24acdf5640 1 -- 172.21.15.122:0/4252124351 shutdown_connections 2024-09-17T06:04:36.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f24acdf5640 1 -- 172.21.15.122:0/4252124351 wait complete. 2024-09-17T06:04:36.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f4801d22640 1 -- 172.21.15.122:0/3328558060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47ec003b50 msgr2=0x7f47ec003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f4801d22640 1 --2- 172.21.15.122:0/3328558060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47ec003b50 0x7f47ec003fa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47e8006fb0 tx=0x7f47e801f630 comp rx=0 tx=0).stop 2024-09-17T06:04:36.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f4801d22640 1 -- 172.21.15.122:0/3328558060 shutdown_connections 2024-09-17T06:04:36.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f4801d22640 1 --2- 172.21.15.122:0/3328558060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47ec003b50 0x7f47ec003fa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.355+0000 7f4801d22640 1 -- 172.21.15.122:0/3328558060 >> 172.21.15.122:0/3328558060 conn(0x7f47f4009d20 msgr2=0x7f47f400a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f4801d22640 1 -- 172.21.15.122:0/3328558060 shutdown_connections 2024-09-17T06:04:36.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f4801d22640 1 -- 172.21.15.122:0/3328558060 wait complete. 2024-09-17T06:04:36.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24acdf5640 1 Processor -- start 2024-09-17T06:04:36.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24acdf5640 1 -- start start 2024-09-17T06:04:36.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24acdf5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a806e010 0x7f24a80b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24acdf5640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24a80c2b10 0x7f24a81f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24acdf5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a815c220 0x7f24a8146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f4801d22640 1 Processor -- start 2024-09-17T06:04:36.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f4801d22640 1 -- start start 2024-09-17T06:04:36.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24a6d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a815c220 0x7f24a8146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24a6d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a815c220 0x7f24a8146310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49370/0 (socket says 172.21.15.122:49370) 2024-09-17T06:04:36.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24a659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a806e010 0x7f24a80b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24a6d9d640 1 -- 172.21.15.122:0/393929447 learned_addr learned my addr 172.21.15.122:0/393929447 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24a5d9b640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24a80c2b10 0x7f24a81f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f24a80c45d0 con 0x7f24a815c220 2024-09-17T06:04:36.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f24a815ba20 con 0x7f24a806e010 2024-09-17T06:04:36.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.359+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f24a80c4750 con 0x7f24a80c2b10 2024-09-17T06:04:36.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f24a6d9d640 1 -- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24a80c2b10 msgr2=0x7f24a81f9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f24a6d9d640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24a80c2b10 0x7f24a81f9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f24a6d9d640 1 -- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a806e010 msgr2=0x7f24a80b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f24a6d9d640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a806e010 0x7f24a80b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f24a6d9d640 1 -- 172.21.15.122:0/393929447 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a81fa500 con 0x7f24a815c220 2024-09-17T06:04:36.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f24a6d9d640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a815c220 0x7f24a8146310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f24a000eae0 tx=0x7f24a0009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f2496ffd640 1 -- 172.21.15.122:0/393929447 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a000cde0 con 0x7f24a815c220 2024-09-17T06:04:36.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a81fa710 con 0x7f24a815c220 2024-09-17T06:04:36.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a80c3b10 con 0x7f24a815c220 2024-09-17T06:04:36.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f2496ffd640 1 -- 172.21.15.122:0/393929447 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24a0004c20 con 0x7f24a815c220 2024-09-17T06:04:36.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801d22640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47ec003b50 0x7f47f4049590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801d22640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f4177eb0 0x7f47f400be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801d22640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47f4037930 0x7f47f40d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801d22640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f47f40df670 con 0x7f47ec003b50 2024-09-17T06:04:36.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801d22640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f47f40df390 con 0x7f47f4177eb0 2024-09-17T06:04:36.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801d22640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f47f404d960 con 0x7f47f4037930 2024-09-17T06:04:36.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f47fbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f4177eb0 0x7f47f400be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801521640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47f4037930 0x7f47f40d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801521640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47f4037930 0x7f47f40d2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:51000/0 (socket says 172.21.15.122:51000) 2024-09-17T06:04:36.366 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801521640 1 -- 172.21.15.122:0/2800127282 learned_addr learned my addr 172.21.15.122:0/2800127282 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f2496ffd640 1 -- 172.21.15.122:0/393929447 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0005020 con 0x7f24a815c220 2024-09-17T06:04:36.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801521640 1 -- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f4177eb0 msgr2=0x7f47f400be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801521640 1 --2- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f4177eb0 0x7f47f400be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801521640 1 -- 172.21.15.122:0/2800127282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47ec003b50 msgr2=0x7f47f4049590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801521640 1 --2- 172.21.15.122:0/2800127282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47ec003b50 0x7f47f4049590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801521640 1 -- 172.21.15.122:0/2800127282 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f40e1540 con 0x7f47f4037930 2024-09-17T06:04:36.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248c0052a0 con 0x7f24a815c220 2024-09-17T06:04:36.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f4801521640 1 --2- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47f4037930 0x7f47f40d2a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f47fc0668e0 tx=0x7f47fc076b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f86d4cc7640 1 -- 172.21.15.122:0/4230690070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86d00c4330 msgr2=0x7f86d00cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.363+0000 7f86d4cc7640 1 --2- 172.21.15.122:0/4230690070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86d00c4330 0x7f86d00cb150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009950 tx=0x7f86c001c7f0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.367+0000 7f2496ffd640 1 -- 172.21.15.122:0/393929447 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f24a00051c0 con 0x7f24a815c220 2024-09-17T06:04:36.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.367+0000 7f86d4cc7640 1 -- 172.21.15.122:0/4230690070 shutdown_connections 2024-09-17T06:04:36.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.367+0000 7f86d4cc7640 1 --2- 172.21.15.122:0/4230690070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86d00c4330 0x7f86d00cb150 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.367+0000 7f86d4cc7640 1 --2- 172.21.15.122:0/4230690070 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86d00c38c0 0x7f86d01534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.367+0000 7f86d4cc7640 1 -- 172.21.15.122:0/4230690070 >> 172.21.15.122:0/4230690070 conn(0x7f86d0070e40 msgr2=0x7f86d0071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.367+0000 7f2496ffd640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2488073300 0x7f2488075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.367+0000 7f2496ffd640 1 -- 172.21.15.122:0/393929447 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f24a00951e0 con 0x7f24a815c220 2024-09-17T06:04:36.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.367+0000 7f24a659c640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2488073300 0x7f2488075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.367+0000 7f24a659c640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2488073300 0x7f2488075810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2498007fd0 tx=0x7f2498009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.371+0000 7f86d4cc7640 1 -- 172.21.15.122:0/4230690070 shutdown_connections 2024-09-17T06:04:36.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.371+0000 7f2496ffd640 1 -- 172.21.15.122:0/393929447 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f24a005f8e0 con 0x7f24a815c220 2024-09-17T06:04:36.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.371+0000 7f47f97fa640 1 -- 172.21.15.122:0/2800127282 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc073ba0 con 0x7f47f4037930 2024-09-17T06:04:36.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.371+0000 7f4801d22640 1 -- 172.21.15.122:0/2800127282 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f40355f0 con 0x7f47f4037930 2024-09-17T06:04:36.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.371+0000 7f4801d22640 1 -- 172.21.15.122:0/2800127282 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f4035890 con 0x7f47f4037930 2024-09-17T06:04:36.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.371+0000 7f47f97fa640 1 -- 172.21.15.122:0/2800127282 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47fc073d40 con 0x7f47f4037930 2024-09-17T06:04:36.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.371+0000 7f47f97fa640 1 -- 172.21.15.122:0/2800127282 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc095650 con 0x7f47f4037930 2024-09-17T06:04:36.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.371+0000 7f86d4cc7640 1 -- 172.21.15.122:0/4230690070 wait complete. 2024-09-17T06:04:36.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86d4cc7640 1 Processor -- start 2024-09-17T06:04:36.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86d4cc7640 1 -- start start 2024-09-17T06:04:36.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86d4cc7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d00c38c0 0x7f86d0144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86d4cc7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86d00c4330 0x7f86d014f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86d00c4330 0x7f86d014f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86ce59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d00c38c0 0x7f86d0144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86d00c4330 0x7f86d014f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49390/0 (socket says 172.21.15.122:49390) 2024-09-17T06:04:36.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86ce59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d00c38c0 0x7f86d0144f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:49572/0 (socket says 172.21.15.122:49572) 2024-09-17T06:04:36.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86c7fff640 1 -- 172.21.15.122:0/3016860414 learned_addr learned my addr 172.21.15.122:0/3016860414 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:36.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86d4cc7640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86d00cb690 0x7f86d006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f4801d22640 1 -- 172.21.15.122:0/2800127282 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47dc0052a0 con 0x7f47f4037930 2024-09-17T06:04:36.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86d4cc7640 1 -- 172.21.15.122:0/3016860414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f86d015a160 con 0x7f86d00c4330 2024-09-17T06:04:36.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86d4cc7640 1 -- 172.21.15.122:0/3016860414 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f86d0159c40 con 0x7f86d00c38c0 2024-09-17T06:04:36.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86d4cc7640 1 -- 172.21.15.122:0/3016860414 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f86d00ca2a0 con 0x7f86d00cb690 2024-09-17T06:04:36.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86ced9d640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86d00cb690 0x7f86d006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86c7fff640 1 -- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86d00cb690 msgr2=0x7f86d006ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86c7fff640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86d00cb690 0x7f86d006ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86c7fff640 1 -- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d00c38c0 msgr2=0x7f86d0144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86c7fff640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d00c38c0 0x7f86d0144f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.375+0000 7f86c7fff640 1 -- 172.21.15.122:0/3016860414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d01454c0 con 0x7f86d00c4330 2024-09-17T06:04:36.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.379+0000 7f86c7fff640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86d00c4330 0x7f86d014f1b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f86c00098a0 tx=0x7f86c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.379+0000 7f86c6ffd640 1 -- 172.21.15.122:0/3016860414 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c00ba020 con 0x7f86d00c4330 2024-09-17T06:04:36.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.379+0000 7f86c6ffd640 1 -- 172.21.15.122:0/3016860414 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86c00036f0 con 0x7f86d00c4330 2024-09-17T06:04:36.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.379+0000 7f86d4cc7640 1 -- 172.21.15.122:0/3016860414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d0146490 con 0x7f86d00c4330 2024-09-17T06:04:36.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.379+0000 7f86c6ffd640 1 -- 172.21.15.122:0/3016860414 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c00b2040 con 0x7f86d00c4330 2024-09-17T06:04:36.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.379+0000 7f86d4cc7640 1 -- 172.21.15.122:0/3016860414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d01e4540 con 0x7f86d00c4330 2024-09-17T06:04:36.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.379+0000 7f86c6ffd640 1 -- 172.21.15.122:0/3016860414 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f86c00bd020 con 0x7f86d00c4330 2024-09-17T06:04:36.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.379+0000 7f86c6ffd640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f86b0073200 0x7f86b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.379+0000 7f86c6ffd640 1 -- 172.21.15.122:0/3016860414 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f86c012e860 con 0x7f86d00c4330 2024-09-17T06:04:36.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.383+0000 7f86ce59c640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f86b0073200 0x7f86b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.383+0000 7f86ce59c640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f86b0073200 0x7f86b0075710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f86b80098f0 tx=0x7f86b8006f90 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.387+0000 7f47f97fa640 1 -- 172.21.15.122:0/2800127282 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f47fc09c060 con 0x7f47f4037930 2024-09-17T06:04:36.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.387+0000 7f47f97fa640 1 --2- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f47e0073300 0x7f47e0075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:36.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.387+0000 7f47f97fa640 1 -- 172.21.15.122:0/2800127282 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f47fc110e80 con 0x7f47f4037930 2024-09-17T06:04:36.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.387+0000 7f4800d20640 1 --2- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f47e0073300 0x7f47e0075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:36.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.387+0000 7f4800d20640 1 --2- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f47e0073300 0x7f47e0075810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f47e80b0000 tx=0x7f47ec005840 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:36.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.391+0000 7f86c4ff9640 1 -- 172.21.15.122:0/3016860414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d00c9df0 con 0x7f86d00c4330 2024-09-17T06:04:36.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.395+0000 7f47f97fa640 1 -- 172.21.15.122:0/2800127282 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f47fc090070 con 0x7f47f4037930 2024-09-17T06:04:36.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.395+0000 7f86c6ffd640 1 -- 172.21.15.122:0/3016860414 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f86c0016470 con 0x7f86d00c4330 2024-09-17T06:04:36.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.615+0000 7f6dc0ff9640 1 -- 172.21.15.122:0/2280616030 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6da8005590 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.615+0000 7f6dc2ffd640 1 -- 172.21.15.122:0/2280616030 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6dc8063a10 con 0x7f6dcc0c6f60 2024-09-17T06:04:36.617 INFO:teuthology.orchestra.run.smithi122.stdout:64424509450 2024-09-17T06:04:36.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.619+0000 7f6dd4756640 1 -- 172.21.15.122:0/2280616030 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6db0073230 msgr2=0x7f6db0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.619+0000 7f6dd4756640 1 --2- 172.21.15.122:0/2280616030 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6db0073230 0x7f6db0075740 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6dc401b1b0 tx=0x7f6dc401b340 comp rx=0 tx=0).stop 2024-09-17T06:04:36.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.619+0000 7f6dd4756640 1 -- 172.21.15.122:0/2280616030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dcc0c6f60 msgr2=0x7f6dcc15ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.619+0000 7f6dd4756640 1 --2- 172.21.15.122:0/2280616030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dcc0c6f60 0x7f6dcc15ea70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800e640 tx=0x7f6dc800eb00 comp rx=0 tx=0).stop 2024-09-17T06:04:36.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.619+0000 7f6dd4756640 1 -- 172.21.15.122:0/2280616030 shutdown_connections 2024-09-17T06:04:36.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.619+0000 7f6dd4756640 1 --2- 172.21.15.122:0/2280616030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dcc0c6f60 0x7f6dcc15ea70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.619+0000 7f6dd4756640 1 --2- 172.21.15.122:0/2280616030 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6dcc0c65d0 0x7f6dcc15e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.619+0000 7f6dd4756640 1 --2- 172.21.15.122:0/2280616030 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6db0073230 0x7f6db0075740 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.619+0000 7f6dd4756640 1 --2- 172.21.15.122:0/2280616030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dcc075290 0x7f6dcc16a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.619+0000 7f6dd4756640 1 -- 172.21.15.122:0/2280616030 >> 172.21.15.122:0/2280616030 conn(0x7f6dcc06d290 msgr2=0x7f6dcc15b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.619+0000 7f6dd4756640 1 -- 172.21.15.122:0/2280616030 shutdown_connections 2024-09-17T06:04:36.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.619+0000 7f6dd4756640 1 -- 172.21.15.122:0/2280616030 wait complete. 2024-09-17T06:04:36.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.643+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f93e414ec60 con 0x7f93e40c4300 2024-09-17T06:04:36.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.643+0000 7f93daffd640 1 -- 172.21.15.122:0/2701510390 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f93d40630d0 con 0x7f93e40c4300 2024-09-17T06:04:36.647 INFO:teuthology.orchestra.run.smithi122.stdout:64424509451 2024-09-17T06:04:36.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.4 2024-09-17T06:04:36.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.647+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f93c80731b0 msgr2=0x7f93c80756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.647+0000 7f93ec68e640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f93c80731b0 0x7f93c80756c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f93e0001840 tx=0x7f93e0009040 comp rx=0 tx=0).stop 2024-09-17T06:04:36.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.647+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93e40c4300 msgr2=0x7f93e415e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.647+0000 7f93ec68e640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93e40c4300 0x7f93e415e070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f93d4000f70 tx=0x7f93d400c820 comp rx=0 tx=0).stop 2024-09-17T06:04:36.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.647+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 shutdown_connections 2024-09-17T06:04:36.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.647+0000 7f93ec68e640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f93c80731b0 0x7f93c80756c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.647+0000 7f93ec68e640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93e40c6f60 0x7f93e414eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.647+0000 7f93ec68e640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93e40c4300 0x7f93e415e070 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.647+0000 7f93ec68e640 1 --2- 172.21.15.122:0/2701510390 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93e4075290 0x7f93e415d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.647+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 >> 172.21.15.122:0/2701510390 conn(0x7f93e406d290 msgr2=0x7f93e40c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.647+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 shutdown_connections 2024-09-17T06:04:36.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.647+0000 7f93ec68e640 1 -- 172.21.15.122:0/2701510390 wait complete. 2024-09-17T06:04:36.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.655+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd538005590 con 0x7fd548007100 2024-09-17T06:04:36.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.659+0000 7fd5467fc640 1 -- 172.21.15.122:0/600849243 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd54c0fba90 con 0x7fd548007100 2024-09-17T06:04:36.663 INFO:teuthology.orchestra.run.smithi122.stdout:64424509451 2024-09-17T06:04:36.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.663+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd534073200 msgr2=0x7fd534075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.663+0000 7fd557ee8640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd534073200 0x7fd534075710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd5480388a0 tx=0x7fd5400091e0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.663+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd548007100 msgr2=0x7fd54804d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.663+0000 7fd557ee8640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd548007100 0x7fd54804d940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd54c01cd20 tx=0x7fd54c005770 comp rx=0 tx=0).stop 2024-09-17T06:04:36.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.663+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 shutdown_connections 2024-09-17T06:04:36.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.663+0000 7fd557ee8640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd54804b470 0x7fd5480d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.663+0000 7fd557ee8640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd548007510 0x7fd54804de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.663+0000 7fd557ee8640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd534073200 0x7fd534075710 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.663+0000 7fd557ee8640 1 --2- 172.21.15.122:0/600849243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd548007100 0x7fd54804d940 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.667+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 >> 172.21.15.122:0/600849243 conn(0x7fd548050bf0 msgr2=0x7fd5480d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.667+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 shutdown_connections 2024-09-17T06:04:36.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.667+0000 7fd557ee8640 1 -- 172.21.15.122:0/600849243 wait complete. 2024-09-17T06:04:36.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.671+0000 7fcf4d7fa640 1 -- 172.21.15.122:0/2890650935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcf40005590 con 0x7fcf680c5410 2024-09-17T06:04:36.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.671+0000 7fcf4f7fe640 1 -- 172.21.15.122:0/2890650935 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcf580fa400 con 0x7fcf680c5410 2024-09-17T06:04:36.675 INFO:teuthology.orchestra.run.smithi122.stdout:64424509450 2024-09-17T06:04:36.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.671+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf54073230 msgr2=0x7fcf54075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.671+0000 7fcf6d38c640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf54073230 0x7fcf54075740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcf680cc1e0 tx=0x7fcf5c009060 comp rx=0 tx=0).stop 2024-09-17T06:04:36.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.671+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2890650935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf680c5410 msgr2=0x7fcf681f98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.671+0000 7fcf6d38c640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf680c5410 0x7fcf681f98d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcf5801cd60 tx=0x7fcf58004040 comp rx=0 tx=0).stop 2024-09-17T06:04:36.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.675+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2890650935 shutdown_connections 2024-09-17T06:04:36.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.675+0000 7fcf6d38c640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf681efe50 0x7fcf6806eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.675+0000 7fcf6d38c640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf54073230 0x7fcf54075740 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.675+0000 7fcf6d38c640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf680c9c30 0x7fcf68153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.675+0000 7fcf6d38c640 1 --2- 172.21.15.122:0/2890650935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf680c5410 0x7fcf681f98d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.675+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2890650935 >> 172.21.15.122:0/2890650935 conn(0x7fcf6806ce90 msgr2=0x7fcf680cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.675+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2890650935 shutdown_connections 2024-09-17T06:04:36.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.675+0000 7fcf6d38c640 1 -- 172.21.15.122:0/2890650935 wait complete. 2024-09-17T06:04:36.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.675+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7efd48005860 con 0x7efd6006e370 2024-09-17T06:04:36.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.675+0000 7efd567fc640 1 -- 172.21.15.122:0/884209231 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd5c018c50 con 0x7efd6006e370 2024-09-17T06:04:36.679 INFO:teuthology.orchestra.run.smithi122.stdout:64424509449 2024-09-17T06:04:36.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.1 2024-09-17T06:04:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.679+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd44073280 msgr2=0x7efd44075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.679+0000 7efd68135640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd44073280 0x7efd44075790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd60165b40 tx=0x7efd50006bb0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.679+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd6006e370 msgr2=0x7efd601639f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.679+0000 7efd68135640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd6006e370 0x7efd601639f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0b3040 tx=0x7efd5c003690 comp rx=0 tx=0).stop 2024-09-17T06:04:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.683+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 shutdown_connections 2024-09-17T06:04:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.683+0000 7efd68135640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd44073280 0x7efd44075790 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.683+0000 7efd68135640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd600c3180 0x7efd60156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.683+0000 7efd68135640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd600c26f0 0x7efd6014db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.683+0000 7efd68135640 1 --2- 172.21.15.122:0/884209231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd6006e370 0x7efd601639f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.683+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 >> 172.21.15.122:0/884209231 conn(0x7efd600cd4f0 msgr2=0x7efd6014e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.683+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 shutdown_connections 2024-09-17T06:04:36.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.683+0000 7efd68135640 1 -- 172.21.15.122:0/884209231 wait complete. 2024-09-17T06:04:36.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.683+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f248c005590 con 0x7f24a815c220 2024-09-17T06:04:36.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.683+0000 7f2496ffd640 1 -- 172.21.15.122:0/393929447 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f24a0064310 con 0x7f24a815c220 2024-09-17T06:04:36.686 INFO:teuthology.orchestra.run.smithi122.stdout:64424509451 2024-09-17T06:04:36.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.687+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2488073300 msgr2=0x7f2488075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.687+0000 7f24acdf5640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2488073300 0x7f2488075810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2498007fd0 tx=0x7f2498009040 comp rx=0 tx=0).stop 2024-09-17T06:04:36.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.687+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a815c220 msgr2=0x7f24a8146310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.687+0000 7f24acdf5640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a815c220 0x7f24a8146310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f24a000eae0 tx=0x7f24a0009f70 comp rx=0 tx=0).stop 2024-09-17T06:04:36.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.687+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 shutdown_connections 2024-09-17T06:04:36.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.687+0000 7f24acdf5640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a815c220 0x7f24a8146310 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.687+0000 7f24acdf5640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24a80c2b10 0x7f24a81f9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.687+0000 7f24acdf5640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2488073300 0x7f2488075810 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.687+0000 7f24acdf5640 1 --2- 172.21.15.122:0/393929447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a806e010 0x7f24a80b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.687+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 >> 172.21.15.122:0/393929447 conn(0x7f24a80ca380 msgr2=0x7f24a8159360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.687+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 shutdown_connections 2024-09-17T06:04:36.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.687+0000 7f24acdf5640 1 -- 172.21.15.122:0/393929447 wait complete. 2024-09-17T06:04:36.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2024-09-17T06:04:36.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.7 2024-09-17T06:04:36.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-09-17T06:04:36.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.715+0000 7f86c4ff9640 1 -- 172.21.15.122:0/3016860414 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f86d0146b30 con 0x7f86d00c4330 2024-09-17T06:04:36.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.715+0000 7f86c6ffd640 1 -- 172.21.15.122:0/3016860414 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f86c00f8ef0 con 0x7f86d00c4330 2024-09-17T06:04:36.717 INFO:teuthology.orchestra.run.smithi122.stdout:60129542153 2024-09-17T06:04:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.715+0000 7f86c4ff9640 1 -- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f86b0073200 msgr2=0x7f86b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.715+0000 7f86c4ff9640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f86b0073200 0x7f86b0075710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f86b80098f0 tx=0x7f86b8006f90 comp rx=0 tx=0).stop 2024-09-17T06:04:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.715+0000 7f86c4ff9640 1 -- 172.21.15.122:0/3016860414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86d00c4330 msgr2=0x7f86d014f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.715+0000 7f86c4ff9640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86d00c4330 0x7f86d014f1b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f86c00098a0 tx=0x7f86c0004270 comp rx=0 tx=0).stop 2024-09-17T06:04:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.719+0000 7f86c4ff9640 1 -- 172.21.15.122:0/3016860414 shutdown_connections 2024-09-17T06:04:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.719+0000 7f86c4ff9640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f86d00cb690 0x7f86d006ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.719+0000 7f86c4ff9640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86d00c4330 0x7f86d014f1b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.719+0000 7f86c4ff9640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f86b0073200 0x7f86b0075710 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.719+0000 7f86c4ff9640 1 --2- 172.21.15.122:0/3016860414 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86d00c38c0 0x7f86d0144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.719+0000 7f86c4ff9640 1 -- 172.21.15.122:0/3016860414 >> 172.21.15.122:0/3016860414 conn(0x7f86d0070e40 msgr2=0x7f86d00b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.719+0000 7f86c4ff9640 1 -- 172.21.15.122:0/3016860414 shutdown_connections 2024-09-17T06:04:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.719+0000 7f86c4ff9640 1 -- 172.21.15.122:0/3016860414 wait complete. 2024-09-17T06:04:36.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.0 2024-09-17T06:04:36.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.727+0000 7f4801d22640 1 -- 172.21.15.122:0/2800127282 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f47dc005590 con 0x7f47f4037930 2024-09-17T06:04:36.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.727+0000 7f47f97fa640 1 -- 172.21.15.122:0/2800127282 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f47fc0dbc60 con 0x7f47f4037930 2024-09-17T06:04:36.730 INFO:teuthology.orchestra.run.smithi122.stdout:64424509451 2024-09-17T06:04:36.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.731+0000 7f4801d22640 1 -- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f47e0073300 msgr2=0x7f47e0075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.731+0000 7f4801d22640 1 --2- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f47e0073300 0x7f47e0075810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f47e80b0000 tx=0x7f47ec005840 comp rx=0 tx=0).stop 2024-09-17T06:04:36.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.731+0000 7f4801d22640 1 -- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47f4037930 msgr2=0x7f47f40d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:36.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.731+0000 7f4801d22640 1 --2- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47f4037930 0x7f47f40d2a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f47fc0668e0 tx=0x7f47fc076b40 comp rx=0 tx=0).stop 2024-09-17T06:04:36.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.731+0000 7f4801d22640 1 -- 172.21.15.122:0/2800127282 shutdown_connections 2024-09-17T06:04:36.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.731+0000 7f4801d22640 1 --2- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f47f4037930 0x7f47f40d2a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.731+0000 7f4801d22640 1 --2- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f47e0073300 0x7f47e0075810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.731+0000 7f4801d22640 1 --2- 172.21.15.122:0/2800127282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47f4177eb0 0x7f47f400be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.731+0000 7f4801d22640 1 --2- 172.21.15.122:0/2800127282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47ec003b50 0x7f47f4049590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:36.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.731+0000 7f4801d22640 1 -- 172.21.15.122:0/2800127282 >> 172.21.15.122:0/2800127282 conn(0x7f47f4009d20 msgr2=0x7f47f40d78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:36.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.731+0000 7f4801d22640 1 -- 172.21.15.122:0/2800127282 shutdown_connections 2024-09-17T06:04:36.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:36.731+0000 7f4801d22640 1 -- 172.21.15.122:0/2800127282 wait complete. 2024-09-17T06:04:36.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2024-09-17T06:04:36.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.2 2024-09-17T06:04:37.649 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T06:04:37.682 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T06:04:37.701 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T06:04:37.703 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T06:04:37.708 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T06:04:37.722 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T06:04:37.738 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T06:04:37.751 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T06:04:37.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.859+0000 7f7b028b8640 1 -- 172.21.15.122:0/2128188618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae40053a0 msgr2=0x7f7ae400ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.859+0000 7f7b028b8640 1 --2- 172.21.15.122:0/2128188618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae40053a0 0x7f7ae400ba50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7afc073f60 tx=0x7f7af401cb40 comp rx=0 tx=0).stop 2024-09-17T06:04:37.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.859+0000 7f7b028b8640 1 -- 172.21.15.122:0/2128188618 shutdown_connections 2024-09-17T06:04:37.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.859+0000 7f7b028b8640 1 --2- 172.21.15.122:0/2128188618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae40053a0 0x7f7ae400ba50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.859+0000 7f7b028b8640 1 -- 172.21.15.122:0/2128188618 >> 172.21.15.122:0/2128188618 conn(0x7f7afc06d290 msgr2=0x7f7afc06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:37.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.859+0000 7f7b028b8640 1 -- 172.21.15.122:0/2128188618 shutdown_connections 2024-09-17T06:04:37.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.859+0000 7f7b028b8640 1 -- 172.21.15.122:0/2128188618 wait complete. 2024-09-17T06:04:37.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.863+0000 7f7b028b8640 1 Processor -- start 2024-09-17T06:04:37.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.863+0000 7f7b028b8640 1 -- start start 2024-09-17T06:04:37.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b028b8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae40053a0 0x7f7afc1f9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b028b8640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7afc15f340 0x7f7afc14d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b028b8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7afc156aa0 0x7f7afc15d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b028b8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc074e50 con 0x7f7ae40053a0 2024-09-17T06:04:37.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b028b8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc0c60b0 con 0x7f7afc156aa0 2024-09-17T06:04:37.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b028b8640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7afc0c4470 con 0x7f7afc15f340 2024-09-17T06:04:37.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7afbfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae40053a0 0x7f7afc1f9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b00e55640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7afc156aa0 0x7f7afc15d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7afbfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae40053a0 0x7f7afc1f9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49396/0 (socket says 172.21.15.122:49396) 2024-09-17T06:04:37.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7afbfff640 1 -- 172.21.15.122:0/2424243889 learned_addr learned my addr 172.21.15.122:0/2424243889 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:37.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7afb7fe640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7afc15f340 0x7f7afc14d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b00e55640 1 -- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7afc15f340 msgr2=0x7f7afc14d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b00e55640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7afc15f340 0x7f7afc14d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b00e55640 1 -- 172.21.15.122:0/2424243889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae40053a0 msgr2=0x7f7afc1f9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b00e55640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae40053a0 0x7f7afc1f9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b00e55640 1 -- 172.21.15.122:0/2424243889 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc15e770 con 0x7f7afc156aa0 2024-09-17T06:04:37.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7afb7fe640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7afc15f340 0x7f7afc14d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:04:37.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.867+0000 7f7b00e55640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7afc156aa0 0x7f7afc15d240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0ca040 tx=0x7f7af4001ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:37.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.871+0000 7f7af8ff9640 1 -- 172.21.15.122:0/2424243889 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af4004c10 con 0x7f7afc156aa0 2024-09-17T06:04:37.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.871+0000 7f7af8ff9640 1 -- 172.21.15.122:0/2424243889 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7af40b4030 con 0x7f7afc156aa0 2024-09-17T06:04:37.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.871+0000 7f7af8ff9640 1 -- 172.21.15.122:0/2424243889 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af4006560 con 0x7f7afc156aa0 2024-09-17T06:04:37.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.871+0000 7f7b028b8640 1 -- 172.21.15.122:0/2424243889 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7afc1f9980 con 0x7f7afc156aa0 2024-09-17T06:04:37.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.871+0000 7f7b028b8640 1 -- 172.21.15.122:0/2424243889 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7afc155f20 con 0x7f7afc156aa0 2024-09-17T06:04:37.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.871+0000 7f7af8ff9640 1 -- 172.21.15.122:0/2424243889 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7af4006700 con 0x7f7afc156aa0 2024-09-17T06:04:37.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.871+0000 7f7af8ff9640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7ae8073250 0x7f7ae8075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.875+0000 7f7af8ff9640 1 -- 172.21.15.122:0/2424243889 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7af412eca0 con 0x7f7afc156aa0 2024-09-17T06:04:37.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.875+0000 7f7afbfff640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7ae8073250 0x7f7ae8075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.875+0000 7f7afbfff640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7ae8073250 0x7f7ae8075760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009bf0 tx=0x7f7af00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:37.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.879+0000 7f7b028b8640 1 -- 172.21.15.122:0/2424243889 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc0c7510 con 0x7f7afc156aa0 2024-09-17T06:04:37.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.891+0000 7f7af8ff9640 1 -- 172.21.15.122:0/2424243889 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7afc15e770 con 0x7f7afc156aa0 2024-09-17T06:04:37.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.923+0000 7f49837e6640 1 -- 172.21.15.122:0/1824098648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f497c074510 msgr2=0x7f497c0ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.923+0000 7f49837e6640 1 --2- 172.21.15.122:0/1824098648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f497c074510 0x7f497c0ccb60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f497c0cd750 tx=0x7f497401f600 comp rx=0 tx=0).stop 2024-09-17T06:04:37.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.927+0000 7f49837e6640 1 -- 172.21.15.122:0/1824098648 shutdown_connections 2024-09-17T06:04:37.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.927+0000 7f49837e6640 1 --2- 172.21.15.122:0/1824098648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f497c074510 0x7f497c0ccb60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.927+0000 7f49837e6640 1 --2- 172.21.15.122:0/1824098648 >> v2:172.21.15.173:3300/0 conn(0x7f497c0c9bb0 0x7f497c0c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.927+0000 7f49837e6640 1 -- 172.21.15.122:0/1824098648 >> 172.21.15.122:0/1824098648 conn(0x7f497c071e70 msgr2=0x7f497c072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:37.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.927+0000 7f49837e6640 1 -- 172.21.15.122:0/1824098648 shutdown_connections 2024-09-17T06:04:37.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.927+0000 7f49837e6640 1 -- 172.21.15.122:0/1824098648 wait complete. 2024-09-17T06:04:37.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.927+0000 7f49837e6640 1 Processor -- start 2024-09-17T06:04:37.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.927+0000 7f49837e6640 1 -- start start 2024-09-17T06:04:37.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f49837e6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f497c074510 0x7f497c142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f49837e6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f497c0c9bb0 0x7f497c1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f49837e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f497c0cd0a0 0x7f497c13cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f49837e6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f497c0c6ab0 con 0x7f497c0cd0a0 2024-09-17T06:04:37.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f49837e6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f497c0c67d0 con 0x7f497c0c9bb0 2024-09-17T06:04:37.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f49837e6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f497c0cc640 con 0x7f497c074510 2024-09-17T06:04:37.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f4981d83640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f497c0cd0a0 0x7f497c13cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f4981d83640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f497c0cd0a0 0x7f497c13cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49408/0 (socket says 172.21.15.122:49408) 2024-09-17T06:04:37.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f4981d83640 1 -- 172.21.15.122:0/2370677150 learned_addr learned my addr 172.21.15.122:0/2370677150 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:37.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f4981582640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f497c074510 0x7f497c142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f4980d81640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f497c0c9bb0 0x7f497c1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f4981d83640 1 -- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f497c074510 msgr2=0x7f497c142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f4981d83640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f497c074510 0x7f497c142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f4981d83640 1 -- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f497c0c9bb0 msgr2=0x7f497c1534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f4981d83640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f497c0c9bb0 0x7f497c1534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f4981d83640 1 -- 172.21.15.122:0/2370677150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c154e70 con 0x7f497c0cd0a0 2024-09-17T06:04:37.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f4981d83640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f497c0cd0a0 0x7f497c13cd60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f497800b3e0 tx=0x7f497800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:37.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f496dffb640 1 -- 172.21.15.122:0/2370677150 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978015020 con 0x7f497c0cd0a0 2024-09-17T06:04:37.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f496dffb640 1 -- 172.21.15.122:0/2370677150 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4978011940 con 0x7f497c0cd0a0 2024-09-17T06:04:37.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f496dffb640 1 -- 172.21.15.122:0/2370677150 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978011d90 con 0x7f497c0cd0a0 2024-09-17T06:04:37.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f49837e6640 1 -- 172.21.15.122:0/2370677150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c14b450 con 0x7f497c0cd0a0 2024-09-17T06:04:37.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.931+0000 7f49837e6640 1 -- 172.21.15.122:0/2370677150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c14cf50 con 0x7f497c0cd0a0 2024-09-17T06:04:37.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.935+0000 7f496dffb640 1 -- 172.21.15.122:0/2370677150 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4978018020 con 0x7f497c0cd0a0 2024-09-17T06:04:37.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.935+0000 7f496dffb640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4960073200 0x7f4960075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.935+0000 7f496dffb640 1 -- 172.21.15.122:0/2370677150 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f49780940b0 con 0x7f497c0cd0a0 2024-09-17T06:04:37.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.935+0000 7f49837e6640 1 -- 172.21.15.122:0/2370677150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f497c0c7ff0 con 0x7f497c0cd0a0 2024-09-17T06:04:37.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.935+0000 7f4981582640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4960073200 0x7f4960075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.939+0000 7f4981582640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4960073200 0x7f4960075710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4970006fd0 tx=0x7f4970009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:37.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.947+0000 7f496dffb640 1 -- 172.21.15.122:0/2370677150 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f497805e840 con 0x7f497c0cd0a0 2024-09-17T06:04:37.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.955+0000 7f4b6297a640 1 -- 172.21.15.122:0/566262292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c075290 msgr2=0x7f4b5c15b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.955+0000 7f4b6297a640 1 --2- 172.21.15.122:0/566262292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c075290 0x7f4b5c15b1a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009900 tx=0x7f4b5001c8e0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.955+0000 7f4b6297a640 1 -- 172.21.15.122:0/566262292 shutdown_connections 2024-09-17T06:04:37.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.955+0000 7f4b6297a640 1 --2- 172.21.15.122:0/566262292 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c0c6f60 0x7f4b5c0c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.955+0000 7f4b6297a640 1 --2- 172.21.15.122:0/566262292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c075290 0x7f4b5c15b1a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.955+0000 7f4b6297a640 1 -- 172.21.15.122:0/566262292 >> 172.21.15.122:0/566262292 conn(0x7f4b5c06d290 msgr2=0x7f4b5c06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:37.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.955+0000 7f4b6297a640 1 -- 172.21.15.122:0/566262292 shutdown_connections 2024-09-17T06:04:37.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.959+0000 7f39910a8640 1 -- 172.21.15.122:0/418945488 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39840e2ab0 msgr2=0x7f39840debe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.959+0000 7f39910a8640 1 --2- 172.21.15.122:0/418945488 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39840e2ab0 0x7f39840debe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f398c066410 tx=0x7f398c099640 comp rx=0 tx=0).stop 2024-09-17T06:04:37.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.955+0000 7f4b6297a640 1 -- 172.21.15.122:0/566262292 wait complete. 2024-09-17T06:04:37.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.959+0000 7f4b6297a640 1 Processor -- start 2024-09-17T06:04:37.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.959+0000 7f4b6297a640 1 -- start start 2024-09-17T06:04:37.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.959+0000 7f4b6297a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c075290 0x7f4b5c1492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b6297a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b5c0c6f60 0x7f4b5c147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b6297a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c0ccb30 0x7f4b5c1fc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b6297a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c153e90 con 0x7f4b5c0c6f60 2024-09-17T06:04:37.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b6297a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c0c7f10 con 0x7f4b5c0ccb30 2024-09-17T06:04:37.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b6297a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4b5c154010 con 0x7f4b5c075290 2024-09-17T06:04:37.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b5b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b5c0c6f60 0x7f4b5c147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b5b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b5c0c6f60 0x7f4b5c147dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49438/0 (socket says 172.21.15.122:49438) 2024-09-17T06:04:37.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b5b7fe640 1 -- 172.21.15.122:0/2324323227 learned_addr learned my addr 172.21.15.122:0/2324323227 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:37.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b5bfff640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c075290 0x7f4b5c1492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f39910a8640 1 -- 172.21.15.122:0/418945488 shutdown_connections 2024-09-17T06:04:37.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f39910a8640 1 --2- 172.21.15.122:0/418945488 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39840e2ab0 0x7f39840debe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f39910a8640 1 --2- 172.21.15.122:0/418945488 >> v2:172.21.15.173:3300/0 conn(0x7f3984007280 0x7f3984045340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f39910a8640 1 -- 172.21.15.122:0/418945488 >> 172.21.15.122:0/418945488 conn(0x7f398404fe40 msgr2=0x7f3984050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:37.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f39910a8640 1 -- 172.21.15.122:0/418945488 shutdown_connections 2024-09-17T06:04:37.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b60f17640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c0ccb30 0x7f4b5c1fc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b5b7fe640 1 -- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c075290 msgr2=0x7f4b5c1492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b5b7fe640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c075290 0x7f4b5c1492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b5b7fe640 1 -- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c0ccb30 msgr2=0x7f4b5c1fc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b5b7fe640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c0ccb30 0x7f4b5c1fc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b5b7fe640 1 -- 172.21.15.122:0/2324323227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5c15c360 con 0x7f4b5c0c6f60 2024-09-17T06:04:37.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7fe9fceef640 1 -- 172.21.15.122:0/2645344366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9e8004810 msgr2=0x7fe9e8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7fe9fceef640 1 --2- 172.21.15.122:0/2645344366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9e8004810 0x7fe9e8004c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0034020 tx=0x7fe9ec01c800 comp rx=0 tx=0).stop 2024-09-17T06:04:37.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7fe9fceef640 1 -- 172.21.15.122:0/2645344366 shutdown_connections 2024-09-17T06:04:37.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7fe9fceef640 1 --2- 172.21.15.122:0/2645344366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9e8004810 0x7fe9e8004c20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7fe9fceef640 1 -- 172.21.15.122:0/2645344366 >> 172.21.15.122:0/2645344366 conn(0x7fe9f0050f60 msgr2=0x7fe9f0051370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:37.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7fe9fceef640 1 -- 172.21.15.122:0/2645344366 shutdown_connections 2024-09-17T06:04:37.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7fe9fceef640 1 -- 172.21.15.122:0/2645344366 wait complete. 2024-09-17T06:04:37.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f39910a8640 1 -- 172.21.15.122:0/418945488 wait complete. 2024-09-17T06:04:37.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f39910a8640 1 Processor -- start 2024-09-17T06:04:37.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f4b5b7fe640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b5c0c6f60 0x7f4b5c147dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00e7a0 tx=0x7f4b4c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:37.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.963+0000 7f39910a8640 1 -- start start 2024-09-17T06:04:37.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f39910a8640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3984007280 0x7f39840ddda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f4b58ff9640 1 -- 172.21.15.122:0/2324323227 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c00ccc0 con 0x7f4b5c0c6f60 2024-09-17T06:04:37.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f4b58ff9640 1 -- 172.21.15.122:0/2324323227 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b4c010430 con 0x7f4b5c0c6f60 2024-09-17T06:04:37.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f4b58ff9640 1 -- 172.21.15.122:0/2324323227 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c010860 con 0x7f4b5c0c6f60 2024-09-17T06:04:37.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f4b6297a640 1 -- 172.21.15.122:0/2324323227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5c0cbd10 con 0x7f4b5c0c6f60 2024-09-17T06:04:37.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f4b6297a640 1 -- 172.21.15.122:0/2324323227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b5c0cb810 con 0x7f4b5c0c6f60 2024-09-17T06:04:37.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f39910a8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3984044cc0 0x7f39840d5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f39910a8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39840e2ab0 0x7f39840dcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f398ad9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3984007280 0x7f39840ddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f398ad9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3984007280 0x7f39840ddda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:51084/0 (socket says 172.21.15.122:51084) 2024-09-17T06:04:37.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f39910a8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f39840e2ec0 con 0x7f3984044cc0 2024-09-17T06:04:37.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f39910a8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f398404c630 con 0x7f39840e2ab0 2024-09-17T06:04:37.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f39910a8640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f398404bbd0 con 0x7f3984007280 2024-09-17T06:04:37.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f398ad9d640 1 -- 172.21.15.122:0/1016077509 learned_addr learned my addr 172.21.15.122:0/1016077509 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:37.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f398b59e640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39840e2ab0 0x7f39840dcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f4b6297a640 1 -- 172.21.15.122:0/2324323227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b5c15b1a0 con 0x7f4b5c0c6f60 2024-09-17T06:04:37.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f398ad9d640 1 -- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39840e2ab0 msgr2=0x7f39840dcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f398ad9d640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39840e2ab0 0x7f39840dcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f398ad9d640 1 -- 172.21.15.122:0/1016077509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3984044cc0 msgr2=0x7f39840d5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f398ad9d640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3984044cc0 0x7f39840d5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f398ad9d640 1 -- 172.21.15.122:0/1016077509 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39840df1d0 con 0x7f3984007280 2024-09-17T06:04:37.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f398ad9d640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3984007280 0x7f39840ddda0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f397c00e7d0 tx=0x7f397c00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:37.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f39737fe640 1 -- 172.21.15.122:0/1016077509 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c00ccc0 con 0x7f3984007280 2024-09-17T06:04:37.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f39910a8640 1 -- 172.21.15.122:0/1016077509 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39840df4b0 con 0x7f3984007280 2024-09-17T06:04:37.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7fe9fceef640 1 Processor -- start 2024-09-17T06:04:37.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7fe9fceef640 1 -- start start 2024-09-17T06:04:37.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f39737fe640 1 -- 172.21.15.122:0/1016077509 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f397c010430 con 0x7f3984007280 2024-09-17T06:04:37.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f39737fe640 1 -- 172.21.15.122:0/1016077509 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c010860 con 0x7f3984007280 2024-09-17T06:04:37.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f39910a8640 1 -- 172.21.15.122:0/1016077509 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39840d66b0 con 0x7f3984007280 2024-09-17T06:04:37.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7f39910a8640 1 -- 172.21.15.122:0/1016077509 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3984045340 con 0x7f3984007280 2024-09-17T06:04:37.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.967+0000 7f4b58ff9640 1 -- 172.21.15.122:0/2324323227 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4b4c010a00 con 0x7f4b5c0c6f60 2024-09-17T06:04:37.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7f4b58ff9640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4b48073230 0x7f4b48075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7f4b58ff9640 1 -- 172.21.15.122:0/2324323227 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4b4c094f70 con 0x7f4b5c0c6f60 2024-09-17T06:04:37.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7f4b5bfff640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4b48073230 0x7f4b48075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7efc7bcc7640 1 -- 172.21.15.122:0/3498114245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc7406d7e0 msgr2=0x7efc7406dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7efc7bcc7640 1 --2- 172.21.15.122:0/3498114245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc7406d7e0 0x7efc7406dbf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009bc0 tx=0x7efc6c01f3f0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7f4b5bfff640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4b48073230 0x7f4b48075740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b500af000 tx=0x7f4b5001b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:37.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7efc7bcc7640 1 -- 172.21.15.122:0/3498114245 shutdown_connections 2024-09-17T06:04:37.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7efc7bcc7640 1 --2- 172.21.15.122:0/3498114245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc7406d7e0 0x7efc7406dbf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7efc7bcc7640 1 --2- 172.21.15.122:0/3498114245 >> v2:172.21.15.122:3300/0 conn(0x7efc7406e370 0x7efc741522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7efc7bcc7640 1 -- 172.21.15.122:0/3498114245 >> 172.21.15.122:0/3498114245 conn(0x7efc740cd4f0 msgr2=0x7efc740cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:37.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7efc7bcc7640 1 -- 172.21.15.122:0/3498114245 shutdown_connections 2024-09-17T06:04:37.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9fceef640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e8004810 0x7fe9f00ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9fceef640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9f00cf2d0 0x7fe9f00dcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9fceef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f00ce800 0x7fe9f0178220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f77fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e8004810 0x7fe9f00ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f77fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e8004810 0x7fe9f00ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:49664/0 (socket says 172.21.15.122:49664) 2024-09-17T06:04:37.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f6ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9f00cf2d0 0x7fe9f00dcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f6ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9f00cf2d0 0x7fe9f00dcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:51100/0 (socket says 172.21.15.122:51100) 2024-09-17T06:04:37.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f00ce800 0x7fe9f0178220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f00ce800 0x7fe9f0178220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49454/0 (socket says 172.21.15.122:49454) 2024-09-17T06:04:37.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f77fe640 1 -- 172.21.15.122:0/1452960289 learned_addr learned my addr 172.21.15.122:0/1452960289 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:37.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f0035470 con 0x7fe9f00ce800 2024-09-17T06:04:37.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f004b970 con 0x7fe9e8004810 2024-09-17T06:04:37.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f00355f0 con 0x7fe9f00cf2d0 2024-09-17T06:04:37.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f7fff640 1 -- 172.21.15.122:0/1452960289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9f00cf2d0 msgr2=0x7fe9f00dcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f7fff640 1 --2- 172.21.15.122:0/1452960289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9f00cf2d0 0x7fe9f00dcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f7fff640 1 -- 172.21.15.122:0/1452960289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e8004810 msgr2=0x7fe9f00ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f7fff640 1 --2- 172.21.15.122:0/1452960289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e8004810 0x7fe9f00ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f7fff640 1 -- 172.21.15.122:0/1452960289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f00466f0 con 0x7fe9f00ce800 2024-09-17T06:04:37.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7f39737fe640 1 -- 172.21.15.122:0/1016077509 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f397c010a00 con 0x7f3984007280 2024-09-17T06:04:37.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7fe9f7fff640 1 --2- 172.21.15.122:0/1452960289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f00ce800 0x7fe9f0178220 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00dc800 tx=0x7fe9e400f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:37.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.971+0000 7efc7bcc7640 1 -- 172.21.15.122:0/3498114245 wait complete. 2024-09-17T06:04:37.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7f39737fe640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3978073230 0x7f3978075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7bcc7640 1 Processor -- start 2024-09-17T06:04:37.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7f39737fe640 1 -- 172.21.15.122:0/1016077509 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f397c095570 con 0x7f3984007280 2024-09-17T06:04:37.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7f398a59c640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3978073230 0x7f3978075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7bcc7640 1 -- start start 2024-09-17T06:04:37.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7f398a59c640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3978073230 0x7f3978075740 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39800036b0 tx=0x7f398000aa40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:37.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7bcc7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc7406e370 0x7efc74144d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7bcc7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc740c26f0 0x7efc740c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7bcc7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc74155c10 0x7efc74140630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7bcc7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efc74158af0 con 0x7efc74155c10 2024-09-17T06:04:37.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7bcc7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efc74158810 con 0x7efc740c26f0 2024-09-17T06:04:37.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7bcc7640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7efc740c4240 con 0x7efc7406e370 2024-09-17T06:04:37.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc79262640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc740c26f0 0x7efc740c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc79262640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc740c26f0 0x7efc740c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:49682/0 (socket says 172.21.15.122:49682) 2024-09-17T06:04:37.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc79262640 1 -- 172.21.15.122:0/78088223 learned_addr learned my addr 172.21.15.122:0/78088223 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:37.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7a264640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc74155c10 0x7efc74140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7a264640 1 -- 172.21.15.122:0/78088223 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc7406e370 msgr2=0x7efc74144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7a264640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc7406e370 0x7efc74144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7a264640 1 -- 172.21.15.122:0/78088223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc740c26f0 msgr2=0x7efc740c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7a264640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc740c26f0 0x7efc740c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:37.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.975+0000 7efc7a264640 1 -- 172.21.15.122:0/78088223 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc74145260 con 0x7efc74155c10 2024-09-17T06:04:37.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7efc7a264640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc74155c10 0x7efc74140630 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efc740c24f0 tx=0x7efc6c0b0ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:37.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7efc6a7fc640 1 -- 172.21.15.122:0/78088223 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0c0020 con 0x7efc74155c10 2024-09-17T06:04:37.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7efc6a7fc640 1 -- 172.21.15.122:0/78088223 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc6c0ba760 con 0x7efc74155c10 2024-09-17T06:04:37.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7efc7bcc7640 1 -- 172.21.15.122:0/78088223 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc74143280 con 0x7efc74155c10 2024-09-17T06:04:37.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7f4b58ff9640 1 -- 172.21.15.122:0/2324323227 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4b4c05f5f0 con 0x7f4b5c0c6f60 2024-09-17T06:04:37.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7efc6a7fc640 1 -- 172.21.15.122:0/78088223 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0b4040 con 0x7efc74155c10 2024-09-17T06:04:37.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7efc7bcc7640 1 -- 172.21.15.122:0/78088223 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc74142b90 con 0x7efc74155c10 2024-09-17T06:04:37.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7efc7bcc7640 1 -- 172.21.15.122:0/78088223 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7406ed50 con 0x7efc74155c10 2024-09-17T06:04:37.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7fe9e3fff640 1 -- 172.21.15.122:0/1452960289 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4008480 con 0x7fe9f00ce800 2024-09-17T06:04:37.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7fe9e3fff640 1 -- 172.21.15.122:0/1452960289 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9e4006720 con 0x7fe9f00ce800 2024-09-17T06:04:37.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7fe9e3fff640 1 -- 172.21.15.122:0/1452960289 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4006b90 con 0x7fe9f00ce800 2024-09-17T06:04:37.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f00469d0 con 0x7fe9f00ce800 2024-09-17T06:04:37.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.979+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f0050a40 con 0x7fe9f00ce800 2024-09-17T06:04:37.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.983+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f0005550 con 0x7fe9f00ce800 2024-09-17T06:04:37.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.983+0000 7efc6a7fc640 1 -- 172.21.15.122:0/78088223 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efc6c0af8e0 con 0x7efc74155c10 2024-09-17T06:04:37.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.983+0000 7efc6a7fc640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efc58073200 0x7efc58075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.983+0000 7efc6a7fc640 1 -- 172.21.15.122:0/78088223 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efc6c132da0 con 0x7efc74155c10 2024-09-17T06:04:37.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.983+0000 7efc79a63640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efc58073200 0x7efc58075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.983+0000 7efc79a63640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efc58073200 0x7efc58075710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efc6400a910 tx=0x7efc64005be0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:37.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.987+0000 7f39737fe640 1 -- 172.21.15.122:0/1016077509 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f397c05fe00 con 0x7f3984007280 2024-09-17T06:04:37.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.991+0000 7efc6a7fc640 1 -- 172.21.15.122:0/78088223 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efc6c018f50 con 0x7efc74155c10 2024-09-17T06:04:37.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.995+0000 7fe9e3fff640 1 -- 172.21.15.122:0/1452960289 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe9e4014070 con 0x7fe9f00ce800 2024-09-17T06:04:37.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.995+0000 7fe9e3fff640 1 --2- 172.21.15.122:0/1452960289 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe9dc073280 0x7fe9dc075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:37.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.995+0000 7fe9f77fe640 1 --2- 172.21.15.122:0/1452960289 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe9dc073280 0x7fe9dc075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:37.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.999+0000 7f4b4b42f640 1 -- 172.21.15.122:0/2176584690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b440ccdb0 msgr2=0x7f4b440cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:37.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.999+0000 7f4b4b42f640 1 --2- 172.21.15.122:0/2176584690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b440ccdb0 0x7f4b440cc1e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b4408e740 tx=0x7f4b4001c810 comp rx=0 tx=0).stop 2024-09-17T06:04:38.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.999+0000 7fe9f77fe640 1 --2- 172.21.15.122:0/1452960289 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe9dc073280 0x7fe9dc075790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8051240 tx=0x7fe9f808e040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:38.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.999+0000 7f4b4b42f640 1 -- 172.21.15.122:0/2176584690 shutdown_connections 2024-09-17T06:04:38.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.999+0000 7f4b4b42f640 1 --2- 172.21.15.122:0/2176584690 >> v2:172.21.15.173:3300/0 conn(0x7f4b4415bb80 0x7f4b440cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.999+0000 7f4b4b42f640 1 --2- 172.21.15.122:0/2176584690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b440ccdb0 0x7f4b440cc1e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.999+0000 7f4b4b42f640 1 -- 172.21.15.122:0/2176584690 >> 172.21.15.122:0/2176584690 conn(0x7f4b4408d450 msgr2=0x7f4b4406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.999+0000 7fe9e3fff640 1 -- 172.21.15.122:0/1452960289 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe9e4006d30 con 0x7fe9f00ce800 2024-09-17T06:04:38.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.999+0000 7f4b4b42f640 1 -- 172.21.15.122:0/2176584690 shutdown_connections 2024-09-17T06:04:38.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.999+0000 7f4b4b42f640 1 -- 172.21.15.122:0/2176584690 wait complete. 2024-09-17T06:04:38.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.999+0000 7f4b4b42f640 1 Processor -- start 2024-09-17T06:04:38.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:37.999+0000 7f4b4b42f640 1 -- start start 2024-09-17T06:04:38.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.003+0000 7f4b4b42f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b4406dab0 0x7f4b441565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.003+0000 7f4b4b42f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b440ccdb0 0x7f4b441ff070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.003+0000 7f4b491cb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b4406dab0 0x7f4b441565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.003+0000 7f4b491cb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b4406dab0 0x7f4b441565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:49706/0 (socket says 172.21.15.122:49706) 2024-09-17T06:04:38.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.003+0000 7f4b489ca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b440ccdb0 0x7f4b441ff070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.003+0000 7f4b489ca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b440ccdb0 0x7f4b441ff070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49470/0 (socket says 172.21.15.122:49470) 2024-09-17T06:04:38.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.003+0000 7f4b491cb640 1 -- 172.21.15.122:0/3340522663 learned_addr learned my addr 172.21.15.122:0/3340522663 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:38.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.003+0000 7f4b4b42f640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b4415bb80 0x7f4b4415dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.003+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4b44168690 con 0x7f4b440ccdb0 2024-09-17T06:04:38.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.003+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4b44168510 con 0x7f4b4406dab0 2024-09-17T06:04:38.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.003+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4b44168810 con 0x7f4b4415bb80 2024-09-17T06:04:38.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.003+0000 7f4b499cc640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b4415bb80 0x7f4b4415dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.007+0000 7f4b499cc640 1 -- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b4406dab0 msgr2=0x7f4b441565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.007+0000 7f4b499cc640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b4406dab0 0x7f4b441565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.007+0000 7f4b499cc640 1 -- 172.21.15.122:0/3340522663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b440ccdb0 msgr2=0x7f4b441ff070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.007+0000 7f4b499cc640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b440ccdb0 0x7f4b441ff070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.007+0000 7f4b499cc640 1 -- 172.21.15.122:0/3340522663 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b44156b10 con 0x7f4b4415bb80 2024-09-17T06:04:38.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.007+0000 7f4b499cc640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b4415bb80 0x7f4b4415dc10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00e990 tx=0x7f4b3c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:38.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.007+0000 7fe9e3fff640 1 -- 172.21.15.122:0/1452960289 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe9e401d070 con 0x7fe9f00ce800 2024-09-17T06:04:38.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.007+0000 7f4b39ffb640 1 -- 172.21.15.122:0/3340522663 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c004d30 con 0x7f4b4415bb80 2024-09-17T06:04:38.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.007+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b4414ffb0 con 0x7f4b4415bb80 2024-09-17T06:04:38.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.007+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b4415c1b0 con 0x7f4b4415bb80 2024-09-17T06:04:38.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.007+0000 7f4b39ffb640 1 -- 172.21.15.122:0/3340522663 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b3c00caa0 con 0x7f4b4415bb80 2024-09-17T06:04:38.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.007+0000 7f4b39ffb640 1 -- 172.21.15.122:0/3340522663 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c005020 con 0x7f4b4415bb80 2024-09-17T06:04:38.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.011+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b240052a0 con 0x7f4b4415bb80 2024-09-17T06:04:38.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.011+0000 7fa792ca7640 1 -- 172.21.15.122:0/1489046451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa78c074510 msgr2=0x7fa78c0ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.011+0000 7fa792ca7640 1 --2- 172.21.15.122:0/1489046451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa78c074510 0x7fa78c0ccb60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009840 tx=0x7fa77c01f050 comp rx=0 tx=0).stop 2024-09-17T06:04:38.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.011+0000 7fa792ca7640 1 -- 172.21.15.122:0/1489046451 shutdown_connections 2024-09-17T06:04:38.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.011+0000 7fa792ca7640 1 --2- 172.21.15.122:0/1489046451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa78c074510 0x7fa78c0ccb60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.011+0000 7fa792ca7640 1 --2- 172.21.15.122:0/1489046451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa78c0c9bb0 0x7fa78c0c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.011+0000 7fa792ca7640 1 -- 172.21.15.122:0/1489046451 >> 172.21.15.122:0/1489046451 conn(0x7fa78c071e70 msgr2=0x7fa78c072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.011+0000 7fa792ca7640 1 -- 172.21.15.122:0/1489046451 shutdown_connections 2024-09-17T06:04:38.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.011+0000 7fa792ca7640 1 -- 172.21.15.122:0/1489046451 wait complete. 2024-09-17T06:04:38.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.015+0000 7fa792ca7640 1 Processor -- start 2024-09-17T06:04:38.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.015+0000 7fa792ca7640 1 -- start start 2024-09-17T06:04:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.015+0000 7fa792ca7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa78c0c9bb0 0x7fa78c1489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.015+0000 7fa792ca7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c0cd0a0 0x7fa78c201140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.015+0000 7fa790a43640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa78c0c9bb0 0x7fa78c1489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.015+0000 7fa792ca7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa78c15ac50 0x7fa78c14a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa790a43640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa78c0c9bb0 0x7fa78c1489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:51146/0 (socket says 172.21.15.122:51146) 2024-09-17T06:04:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.015+0000 7fa78bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c0cd0a0 0x7fa78c201140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa78bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c0cd0a0 0x7fa78c201140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49474/0 (socket says 172.21.15.122:49474) 2024-09-17T06:04:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa792ca7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c0c6ab0 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa78bfff640 1 -- 172.21.15.122:0/2371701979 learned_addr learned my addr 172.21.15.122:0/2371701979 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:38.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa792ca7640 1 -- 172.21.15.122:0/2371701979 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c0c67d0 con 0x7fa78c15ac50 2024-09-17T06:04:38.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa792ca7640 1 -- 172.21.15.122:0/2371701979 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa78c0cc640 con 0x7fa78c0c9bb0 2024-09-17T06:04:38.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa791244640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa78c15ac50 0x7fa78c14a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa78bfff640 1 -- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa78c0c9bb0 msgr2=0x7fa78c1489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa78bfff640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa78c0c9bb0 0x7fa78c1489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa78bfff640 1 -- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa78c15ac50 msgr2=0x7fa78c14a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa78bfff640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa78c15ac50 0x7fa78c14a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa78bfff640 1 -- 172.21.15.122:0/2371701979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c1fded0 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa790a43640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa78c0c9bb0 0x7fa78c1489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:04:38.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa78bfff640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c0cd0a0 0x7fa78c201140 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009790 tx=0x7fa77c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:38.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa7897fa640 1 -- 172.21.15.122:0/2371701979 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0bf070 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa792ca7640 1 -- 172.21.15.122:0/2371701979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78c1fe1b0 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa792ca7640 1 -- 172.21.15.122:0/2371701979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78c14ae40 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa7897fa640 1 -- 172.21.15.122:0/2371701979 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa77c000e50 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.019+0000 7fa7897fa640 1 -- 172.21.15.122:0/2371701979 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0b5040 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.023+0000 7f4b39ffb640 1 -- 172.21.15.122:0/3340522663 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4b3c0051c0 con 0x7f4b4415bb80 2024-09-17T06:04:38.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.023+0000 7f4b39ffb640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4b28073200 0x7f4b28075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.023+0000 7f4b39ffb640 1 -- 172.21.15.122:0/3340522663 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4b3c094d80 con 0x7f4b4415bb80 2024-09-17T06:04:38.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.023+0000 7f4b491cb640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4b28073200 0x7f4b28075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.023+0000 7f4b491cb640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4b28073200 0x7f4b28075710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009230 tx=0x7f4b400a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:38.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.023+0000 7fa7897fa640 1 -- 172.21.15.122:0/2371701979 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa77c0b09f0 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.023+0000 7fa7897fa640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa778073430 0x7fa778075940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.023+0000 7fa790a43640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa778073430 0x7fa778075940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.023+0000 7fa7897fa640 1 -- 172.21.15.122:0/2371701979 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa77c0b07f0 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.027+0000 7fa792ca7640 1 -- 172.21.15.122:0/2371701979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa76c0052a0 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.027+0000 7fa790a43640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa778073430 0x7fa778075940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa780009f30 tx=0x7fa7800091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:38.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.027+0000 7f4b39ffb640 1 -- 172.21.15.122:0/3340522663 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4b3c016030 con 0x7f4b4415bb80 2024-09-17T06:04:38.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.035+0000 7fa7897fa640 1 -- 172.21.15.122:0/2371701979 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa77c018bb0 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.211+0000 7f7b028b8640 1 -- 172.21.15.122:0/2424243889 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7afc0ccc40 con 0x7f7afc156aa0 2024-09-17T06:04:38.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.211+0000 7f7af8ff9640 1 -- 172.21.15.122:0/2424243889 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7af40168f0 con 0x7f7afc156aa0 2024-09-17T06:04:38.213 INFO:teuthology.orchestra.run.smithi122.stdout:64424509452 2024-09-17T06:04:38.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.215+0000 7f7ae27fc640 1 -- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7ae8073250 msgr2=0x7f7ae8075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.215+0000 7f7ae27fc640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7ae8073250 0x7f7ae8075760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009bf0 tx=0x7f7af00091e0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.215+0000 7f7ae27fc640 1 -- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7afc156aa0 msgr2=0x7f7afc15d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.215+0000 7f7ae27fc640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7afc156aa0 0x7f7afc15d240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0ca040 tx=0x7f7af4001ad0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.219+0000 7f7ae27fc640 1 -- 172.21.15.122:0/2424243889 shutdown_connections 2024-09-17T06:04:38.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.219+0000 7f7ae27fc640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7ae8073250 0x7f7ae8075760 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.219+0000 7f7ae27fc640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7afc156aa0 0x7f7afc15d240 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.219+0000 7f7ae27fc640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7afc15f340 0x7f7afc14d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.219+0000 7f7ae27fc640 1 --2- 172.21.15.122:0/2424243889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ae40053a0 0x7f7afc1f9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.219+0000 7f7ae27fc640 1 -- 172.21.15.122:0/2424243889 >> 172.21.15.122:0/2424243889 conn(0x7f7afc06d290 msgr2=0x7f7afc0ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.219+0000 7f7ae27fc640 1 -- 172.21.15.122:0/2424243889 shutdown_connections 2024-09-17T06:04:38.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.219+0000 7f7ae27fc640 1 -- 172.21.15.122:0/2424243889 wait complete. 2024-09-17T06:04:38.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.4 2024-09-17T06:04:38.247 DEBUG:teuthology.parallel:result is None 2024-09-17T06:04:38.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.287+0000 7efc7bcc7640 1 -- 172.21.15.122:0/78088223 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7efc74069750 con 0x7efc74155c10 2024-09-17T06:04:38.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.287+0000 7efc6a7fc640 1 -- 172.21.15.122:0/78088223 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc6c0fda80 con 0x7efc74155c10 2024-09-17T06:04:38.289 INFO:teuthology.orchestra.run.smithi122.stdout:64424509453 2024-09-17T06:04:38.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.287+0000 7efc7bcc7640 1 -- 172.21.15.122:0/78088223 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efc58073200 msgr2=0x7efc58075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.287+0000 7efc7bcc7640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efc58073200 0x7efc58075710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efc6400a910 tx=0x7efc64005be0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.287+0000 7efc7bcc7640 1 -- 172.21.15.122:0/78088223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc74155c10 msgr2=0x7efc74140630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.287+0000 7efc7bcc7640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc74155c10 0x7efc74140630 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efc740c24f0 tx=0x7efc6c0b0ef0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.291+0000 7efc7bcc7640 1 -- 172.21.15.122:0/78088223 shutdown_connections 2024-09-17T06:04:38.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.291+0000 7efc7bcc7640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc74155c10 0x7efc74140630 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.291+0000 7f49837e6640 1 -- 172.21.15.122:0/2370677150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f497c0c3b30 con 0x7f497c0cd0a0 2024-09-17T06:04:38.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.291+0000 7efc7bcc7640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efc58073200 0x7efc58075710 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.291+0000 7efc7bcc7640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc740c26f0 0x7efc740c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.291+0000 7efc7bcc7640 1 --2- 172.21.15.122:0/78088223 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efc7406e370 0x7efc74144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.291+0000 7efc7bcc7640 1 -- 172.21.15.122:0/78088223 >> 172.21.15.122:0/78088223 conn(0x7efc740cd4f0 msgr2=0x7efc74144180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.291+0000 7efc7bcc7640 1 -- 172.21.15.122:0/78088223 shutdown_connections 2024-09-17T06:04:38.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.291+0000 7efc7bcc7640 1 -- 172.21.15.122:0/78088223 wait complete. 2024-09-17T06:04:38.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.291+0000 7f496dffb640 1 -- 172.21.15.122:0/2370677150 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4978063270 con 0x7f497c0cd0a0 2024-09-17T06:04:38.294 INFO:teuthology.orchestra.run.smithi122.stdout:64424509453 2024-09-17T06:04:38.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.291+0000 7f49837e6640 1 -- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4960073200 msgr2=0x7f4960075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.295+0000 7f49837e6640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4960073200 0x7f4960075710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4970006fd0 tx=0x7f4970009060 comp rx=0 tx=0).stop 2024-09-17T06:04:38.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.295+0000 7f49837e6640 1 -- 172.21.15.122:0/2370677150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f497c0cd0a0 msgr2=0x7f497c13cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.295+0000 7f49837e6640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f497c0cd0a0 0x7f497c13cd60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f497800b3e0 tx=0x7f497800b8a0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.295+0000 7f49837e6640 1 -- 172.21.15.122:0/2370677150 shutdown_connections 2024-09-17T06:04:38.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.295+0000 7f49837e6640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f497c0cd0a0 0x7f497c13cd60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.295+0000 7f49837e6640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4960073200 0x7f4960075710 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.295+0000 7f49837e6640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f497c0c9bb0 0x7f497c1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.295+0000 7f49837e6640 1 --2- 172.21.15.122:0/2370677150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f497c074510 0x7f497c142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.295+0000 7f49837e6640 1 -- 172.21.15.122:0/2370677150 >> 172.21.15.122:0/2370677150 conn(0x7f497c071e70 msgr2=0x7f497c14d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.295+0000 7f49837e6640 1 -- 172.21.15.122:0/2370677150 shutdown_connections 2024-09-17T06:04:38.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.295+0000 7f49837e6640 1 -- 172.21.15.122:0/2370677150 wait complete. 2024-09-17T06:04:38.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.303+0000 7f39910a8640 1 -- 172.21.15.122:0/1016077509 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f398404bf50 con 0x7f3984007280 2024-09-17T06:04:38.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.303+0000 7f39737fe640 1 -- 172.21.15.122:0/1016077509 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f397c064830 con 0x7f3984007280 2024-09-17T06:04:38.307 INFO:teuthology.orchestra.run.smithi122.stdout:64424509452 2024-09-17T06:04:38.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.307+0000 7f39910a8640 1 -- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3978073230 msgr2=0x7f3978075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.307+0000 7f39910a8640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3978073230 0x7f3978075740 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39800036b0 tx=0x7f398000aa40 comp rx=0 tx=0).stop 2024-09-17T06:04:38.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.307+0000 7f39910a8640 1 -- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3984007280 msgr2=0x7f39840ddda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.307+0000 7f39910a8640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3984007280 0x7f39840ddda0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f397c00e7d0 tx=0x7f397c00ec90 comp rx=0 tx=0).stop 2024-09-17T06:04:38.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.307+0000 7f39910a8640 1 -- 172.21.15.122:0/1016077509 shutdown_connections 2024-09-17T06:04:38.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.307+0000 7f39910a8640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3978073230 0x7f3978075740 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.307+0000 7f39910a8640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39840e2ab0 0x7f39840dcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.307+0000 7f39910a8640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3984044cc0 0x7f39840d5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.307+0000 7f39910a8640 1 --2- 172.21.15.122:0/1016077509 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3984007280 0x7f39840ddda0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.307+0000 7f39910a8640 1 -- 172.21.15.122:0/1016077509 >> 172.21.15.122:0/1016077509 conn(0x7f398404fe40 msgr2=0x7f39840d3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.307+0000 7f39910a8640 1 -- 172.21.15.122:0/1016077509 shutdown_connections 2024-09-17T06:04:38.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.307+0000 7f39910a8640 1 -- 172.21.15.122:0/1016077509 wait complete. 2024-09-17T06:04:38.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.7 2024-09-17T06:04:38.314 DEBUG:teuthology.parallel:result is None 2024-09-17T06:04:38.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.1 2024-09-17T06:04:38.327 DEBUG:teuthology.parallel:result is None 2024-09-17T06:04:38.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.331+0000 7f4b6297a640 1 -- 172.21.15.122:0/2324323227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4b5c151350 con 0x7f4b5c0c6f60 2024-09-17T06:04:38.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.331+0000 7f4b58ff9640 1 -- 172.21.15.122:0/2324323227 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b4c066070 con 0x7f4b5c0c6f60 2024-09-17T06:04:38.333 INFO:teuthology.orchestra.run.smithi122.stdout:64424509451 2024-09-17T06:04:38.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.335+0000 7f4b6297a640 1 -- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4b48073230 msgr2=0x7f4b48075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.335+0000 7f4b6297a640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4b48073230 0x7f4b48075740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b500af000 tx=0x7f4b5001b120 comp rx=0 tx=0).stop 2024-09-17T06:04:38.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.335+0000 7f4b6297a640 1 -- 172.21.15.122:0/2324323227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b5c0c6f60 msgr2=0x7f4b5c147dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.335+0000 7f4b6297a640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b5c0c6f60 0x7f4b5c147dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00e7a0 tx=0x7f4b4c00ec60 comp rx=0 tx=0).stop 2024-09-17T06:04:38.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.335+0000 7f4b6297a640 1 -- 172.21.15.122:0/2324323227 shutdown_connections 2024-09-17T06:04:38.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.335+0000 7f4b6297a640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4b48073230 0x7f4b48075740 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.335+0000 7f4b6297a640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c0ccb30 0x7f4b5c1fc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.335+0000 7f4b6297a640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b5c0c6f60 0x7f4b5c147dc0 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00e7a0 tx=0x7f4b4c00ec60 comp rx=0 tx=0).stop 2024-09-17T06:04:38.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.335+0000 7f4b6297a640 1 --2- 172.21.15.122:0/2324323227 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c075290 0x7f4b5c1492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.335+0000 7f4b6297a640 1 -- 172.21.15.122:0/2324323227 >> 172.21.15.122:0/2324323227 conn(0x7f4b5c06d290 msgr2=0x7f4b5c06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.335+0000 7f4b6297a640 1 -- 172.21.15.122:0/2324323227 shutdown_connections 2024-09-17T06:04:38.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.335+0000 7f4b6297a640 1 -- 172.21.15.122:0/2324323227 wait complete. 2024-09-17T06:04:38.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.3 2024-09-17T06:04:38.339 DEBUG:teuthology.parallel:result is None 2024-09-17T06:04:38.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.343+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4b24005590 con 0x7f4b4415bb80 2024-09-17T06:04:38.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.343+0000 7f4b39ffb640 1 -- 172.21.15.122:0/3340522663 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b3c05f400 con 0x7f4b4415bb80 2024-09-17T06:04:38.346 INFO:teuthology.orchestra.run.smithi122.stdout:64424509453 2024-09-17T06:04:38.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe9f0005270 con 0x7fe9f00ce800 2024-09-17T06:04:38.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7fe9e3fff640 1 -- 172.21.15.122:0/1452960289 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe9e4060bb0 con 0x7fe9f00ce800 2024-09-17T06:04:38.348 INFO:teuthology.orchestra.run.smithi122.stdout:60129542155 2024-09-17T06:04:38.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4b28073200 msgr2=0x7f4b28075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7f4b4b42f640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4b28073200 0x7f4b28075710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009230 tx=0x7f4b400a7040 comp rx=0 tx=0).stop 2024-09-17T06:04:38.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b4415bb80 msgr2=0x7f4b4415dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7f4b4b42f640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b4415bb80 0x7f4b4415dc10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00e990 tx=0x7f4b3c00ee50 comp rx=0 tx=0).stop 2024-09-17T06:04:38.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 shutdown_connections 2024-09-17T06:04:38.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7f4b4b42f640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b4415bb80 0x7f4b4415dc10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7f4b4b42f640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b440ccdb0 0x7f4b441ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7f4b4b42f640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4b28073200 0x7f4b28075710 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7f4b4b42f640 1 --2- 172.21.15.122:0/3340522663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b4406dab0 0x7f4b441565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 >> 172.21.15.122:0/3340522663 conn(0x7f4b4408d450 msgr2=0x7f4b440cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 shutdown_connections 2024-09-17T06:04:38.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.347+0000 7f4b4b42f640 1 -- 172.21.15.122:0/3340522663 wait complete. 2024-09-17T06:04:38.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.351+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe9dc073280 msgr2=0x7fe9dc075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.351+0000 7fe9fceef640 1 --2- 172.21.15.122:0/1452960289 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe9dc073280 0x7fe9dc075790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8051240 tx=0x7fe9f808e040 comp rx=0 tx=0).stop 2024-09-17T06:04:38.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.351+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f00ce800 msgr2=0x7fe9f0178220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.351+0000 7fe9fceef640 1 --2- 172.21.15.122:0/1452960289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f00ce800 0x7fe9f0178220 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00dc800 tx=0x7fe9e400f820 comp rx=0 tx=0).stop 2024-09-17T06:04:38.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.351+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 shutdown_connections 2024-09-17T06:04:38.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.351+0000 7fe9fceef640 1 --2- 172.21.15.122:0/1452960289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9f00ce800 0x7fe9f0178220 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.351+0000 7fe9fceef640 1 --2- 172.21.15.122:0/1452960289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9f00cf2d0 0x7fe9f00dcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.351+0000 7fe9fceef640 1 --2- 172.21.15.122:0/1452960289 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe9dc073280 0x7fe9dc075790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.351+0000 7fe9fceef640 1 --2- 172.21.15.122:0/1452960289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9e8004810 0x7fe9f00ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.351+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 >> 172.21.15.122:0/1452960289 conn(0x7fe9f0050f60 msgr2=0x7fe9f00065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.351+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 shutdown_connections 2024-09-17T06:04:38.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.351+0000 7fe9fceef640 1 -- 172.21.15.122:0/1452960289 wait complete. 2024-09-17T06:04:38.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.6 2024-09-17T06:04:38.358 DEBUG:teuthology.parallel:result is None 2024-09-17T06:04:38.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.363+0000 7fa792ca7640 1 -- 172.21.15.122:0/2371701979 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa76c005860 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.363+0000 7fa7897fa640 1 -- 172.21.15.122:0/2371701979 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa77c0fffe0 con 0x7fa78c0cd0a0 2024-09-17T06:04:38.365 INFO:teuthology.orchestra.run.smithi122.stdout:64424509453 2024-09-17T06:04:38.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.367+0000 7fa792ca7640 1 -- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa778073430 msgr2=0x7fa778075940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.367+0000 7fa792ca7640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa778073430 0x7fa778075940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa780009f30 tx=0x7fa7800091e0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.367+0000 7fa792ca7640 1 -- 172.21.15.122:0/2371701979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c0cd0a0 msgr2=0x7fa78c201140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.367+0000 7fa792ca7640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c0cd0a0 0x7fa78c201140 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009790 tx=0x7fa77c0056e0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.367+0000 7fa792ca7640 1 -- 172.21.15.122:0/2371701979 shutdown_connections 2024-09-17T06:04:38.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.367+0000 7fa792ca7640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa778073430 0x7fa778075940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.367+0000 7fa792ca7640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa78c15ac50 0x7fa78c14a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.367+0000 7fa792ca7640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c0cd0a0 0x7fa78c201140 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.367+0000 7fa792ca7640 1 --2- 172.21.15.122:0/2371701979 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa78c0c9bb0 0x7fa78c1489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.367+0000 7fa792ca7640 1 -- 172.21.15.122:0/2371701979 >> 172.21.15.122:0/2371701979 conn(0x7fa78c071e70 msgr2=0x7fa78c151420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.367+0000 7fa792ca7640 1 -- 172.21.15.122:0/2371701979 shutdown_connections 2024-09-17T06:04:38.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.367+0000 7fa792ca7640 1 -- 172.21.15.122:0/2371701979 wait complete. 2024-09-17T06:04:38.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.0 2024-09-17T06:04:38.369 DEBUG:teuthology.parallel:result is None 2024-09-17T06:04:38.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542155 for osd.5 2024-09-17T06:04:38.373 DEBUG:teuthology.parallel:result is None 2024-09-17T06:04:38.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.2 2024-09-17T06:04:38.385 DEBUG:teuthology.parallel:result is None 2024-09-17T06:04:38.385 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T06:04:38.385 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:04:38.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.567+0000 7fb928fea640 1 -- 172.21.15.122:0/2850896697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb910003a60 msgr2=0x7fb910003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.567+0000 7fb928fea640 1 --2- 172.21.15.122:0/2850896697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb910003a60 0x7fb910003ed0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00bb10 tx=0x7fb91c01cda0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.567+0000 7fb928fea640 1 -- 172.21.15.122:0/2850896697 shutdown_connections 2024-09-17T06:04:38.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.567+0000 7fb928fea640 1 --2- 172.21.15.122:0/2850896697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb910003a60 0x7fb910003ed0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.567+0000 7fb928fea640 1 -- 172.21.15.122:0/2850896697 >> 172.21.15.122:0/2850896697 conn(0x7fb92408d450 msgr2=0x7fb92406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.567+0000 7fb928fea640 1 -- 172.21.15.122:0/2850896697 shutdown_connections 2024-09-17T06:04:38.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.567+0000 7fb928fea640 1 -- 172.21.15.122:0/2850896697 wait complete. 2024-09-17T06:04:38.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.567+0000 7fb928fea640 1 Processor -- start 2024-09-17T06:04:38.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.567+0000 7fb928fea640 1 -- start start 2024-09-17T06:04:38.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb928fea640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb910003a60 0x7fb9241f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb928fea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92406faf0 0x7fb9240cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb928fea640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb92406ff00 0x7fb9240cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb928fea640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb92415b880 con 0x7fb92406faf0 2024-09-17T06:04:38.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb928fea640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb924155970 con 0x7fb910003a60 2024-09-17T06:04:38.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb928fea640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb92415ba00 con 0x7fb92406ff00 2024-09-17T06:04:38.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb921d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92406faf0 0x7fb9240cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb921d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92406faf0 0x7fb9240cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49502/0 (socket says 172.21.15.122:49502) 2024-09-17T06:04:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb921d9b640 1 -- 172.21.15.122:0/2178890714 learned_addr learned my addr 172.21.15.122:0/2178890714 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb92259c640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb910003a60 0x7fb9241f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb922d9d640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb92406ff00 0x7fb9240cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb921d9b640 1 -- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb92406ff00 msgr2=0x7fb9240cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb921d9b640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb92406ff00 0x7fb9240cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb921d9b640 1 -- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb910003a60 msgr2=0x7fb9241f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb921d9b640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb910003a60 0x7fb9241f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb921d9b640 1 -- 172.21.15.122:0/2178890714 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9241f5810 con 0x7fb92406faf0 2024-09-17T06:04:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb922d9d640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb92406ff00 0x7fb9240cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb92259c640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb910003a60 0x7fb9241f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb921d9b640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92406faf0 0x7fb9240cebc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb90c004e30 tx=0x7fb90c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb91affd640 1 -- 172.21.15.122:0/2178890714 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c015020 con 0x7fb92406faf0 2024-09-17T06:04:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb91affd640 1 -- 172.21.15.122:0/2178890714 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb90c011960 con 0x7fb92406faf0 2024-09-17T06:04:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb928fea640 1 -- 172.21.15.122:0/2178890714 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9241f4dd0 con 0x7fb92406faf0 2024-09-17T06:04:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb91affd640 1 -- 172.21.15.122:0/2178890714 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c011db0 con 0x7fb92406faf0 2024-09-17T06:04:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb928fea640 1 -- 172.21.15.122:0/2178890714 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9240ca790 con 0x7fb92406faf0 2024-09-17T06:04:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb928fea640 1 -- 172.21.15.122:0/2178890714 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92406f710 con 0x7fb92406faf0 2024-09-17T06:04:38.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb91affd640 1 -- 172.21.15.122:0/2178890714 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb90c018020 con 0x7fb92406faf0 2024-09-17T06:04:38.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.571+0000 7fb91affd640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb904073230 0x7fb904075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.575+0000 7fb91affd640 1 -- 172.21.15.122:0/2178890714 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb90c0955a0 con 0x7fb92406faf0 2024-09-17T06:04:38.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.575+0000 7fb92259c640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb904073230 0x7fb904075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.575+0000 7fb92259c640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb904073230 0x7fb904075740 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0b0000 tx=0x7fb91c019b40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:38.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.575+0000 7fb91affd640 1 -- 172.21.15.122:0/2178890714 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb90c01f020 con 0x7fb92406faf0 2024-09-17T06:04:38.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.731+0000 7fb928fea640 1 -- 172.21.15.122:0/2178890714 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9241f9280 con 0x7fb904073230 2024-09-17T06:04:38.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.747+0000 7fb91affd640 1 -- 172.21.15.122:0/2178890714 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332522 (secure 0 0 0) 0x7fb9241f9280 con 0x7fb904073230 2024-09-17T06:04:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:38.755 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:04:38.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.751+0000 7fb928fea640 1 -- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb904073230 msgr2=0x7fb904075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.751+0000 7fb928fea640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb904073230 0x7fb904075740 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0b0000 tx=0x7fb91c019b40 comp rx=0 tx=0).stop 2024-09-17T06:04:38.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.751+0000 7fb928fea640 1 -- 172.21.15.122:0/2178890714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92406faf0 msgr2=0x7fb9240cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.751+0000 7fb928fea640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92406faf0 0x7fb9240cebc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb90c004e30 tx=0x7fb90c001640 comp rx=0 tx=0).stop 2024-09-17T06:04:38.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.751+0000 7fb928fea640 1 -- 172.21.15.122:0/2178890714 shutdown_connections 2024-09-17T06:04:38.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.751+0000 7fb928fea640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb92406ff00 0x7fb9240cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.751+0000 7fb928fea640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92406faf0 0x7fb9240cebc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.751+0000 7fb928fea640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb904073230 0x7fb904075740 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.751+0000 7fb928fea640 1 --2- 172.21.15.122:0/2178890714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb910003a60 0x7fb9241f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.751+0000 7fb928fea640 1 -- 172.21.15.122:0/2178890714 >> 172.21.15.122:0/2178890714 conn(0x7fb92408d450 msgr2=0x7fb924152920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.751+0000 7fb928fea640 1 -- 172.21.15.122:0/2178890714 shutdown_connections 2024-09-17T06:04:38.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.751+0000 7fb928fea640 1 -- 172.21.15.122:0/2178890714 wait complete. 2024-09-17T06:04:38.773 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-09-17T06:04:37.522972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219568,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755152,"statfs":{"total":773094113280,"available":772869275648,"internally_reserved":0,"allocated":3416064,"data_stored":2037216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005389"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827969+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:04:14.827969+0000","last_peered":"2024-09-17T06:04:14.827969+0000","last_clean":"2024-09-17T06:04:14.827969+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:04:14.827969+0000","last_undegraded":"2024-09-17T06:04:14.827969+0000","last_fullsized":"2024-09-17T06:04:14.827969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914314+0000","last_change":"2024-09-17T06:04:08.851488+0000","last_active":"2024-09-17T06:04:13.914314+0000","last_peered":"2024-09-17T06:04:13.914314+0000","last_clean":"2024-09-17T06:04:13.914314+0000","last_became_active":"2024-09-17T06:04:08.847345+0000","last_became_peered":"2024-09-17T06:04:08.847345+0000","last_unstale":"2024-09-17T06:04:13.914314+0000","last_undegraded":"2024-09-17T06:04:13.914314+0000","last_fullsized":"2024-09-17T06:04:13.914314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912954+0000","last_change":"2024-09-17T06:04:13.045049+0000","last_active":"2024-09-17T06:04:13.912954+0000","last_peered":"2024-09-17T06:04:13.912954+0000","last_clean":"2024-09-17T06:04:13.912954+0000","last_became_active":"2024-09-17T06:04:13.041321+0000","last_became_peered":"2024-09-17T06:04:13.041321+0000","last_unstale":"2024-09-17T06:04:13.912954+0000","last_undegraded":"2024-09-17T06:04:13.912954+0000","last_fullsized":"2024-09-17T06:04:13.912954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.500551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914545+0000","last_change":"2024-09-17T06:04:07.834691+0000","last_active":"2024-09-17T06:04:13.914545+0000","last_peered":"2024-09-17T06:04:13.914545+0000","last_clean":"2024-09-17T06:04:13.914545+0000","last_became_active":"2024-09-17T06:04:07.834110+0000","last_became_peered":"2024-09-17T06:04:07.834110+0000","last_unstale":"2024-09-17T06:04:13.914545+0000","last_undegraded":"2024-09-17T06:04:13.914545+0000","last_fullsized":"2024-09-17T06:04:13.914545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827140+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:04:14.827140+0000","last_peered":"2024-09-17T06:04:14.827140+0000","last_clean":"2024-09-17T06:04:14.827140+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:04:14.827140+0000","last_undegraded":"2024-09-17T06:04:14.827140+0000","last_fullsized":"2024-09-17T06:04:14.827140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915612+0000","last_change":"2024-09-17T06:04:12.954966+0000","last_active":"2024-09-17T06:04:13.915612+0000","last_peered":"2024-09-17T06:04:13.915612+0000","last_clean":"2024-09-17T06:04:13.915612+0000","last_became_active":"2024-09-17T06:04:12.953915+0000","last_became_peered":"2024-09-17T06:04:12.953915+0000","last_unstale":"2024-09-17T06:04:13.915612+0000","last_undegraded":"2024-09-17T06:04:13.915612+0000","last_fullsized":"2024-09-17T06:04:13.915612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:54.009189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826543+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:04:14.826543+0000","last_peered":"2024-09-17T06:04:14.826543+0000","last_clean":"2024-09-17T06:04:14.826543+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:04:14.826543+0000","last_undegraded":"2024-09-17T06:04:14.826543+0000","last_fullsized":"2024-09-17T06:04:14.826543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922620+0000","last_change":"2024-09-17T06:04:08.847869+0000","last_active":"2024-09-17T06:04:13.922620+0000","last_peered":"2024-09-17T06:04:13.922620+0000","last_clean":"2024-09-17T06:04:13.922620+0000","last_became_active":"2024-09-17T06:04:08.847475+0000","last_became_peered":"2024-09-17T06:04:08.847475+0000","last_unstale":"2024-09-17T06:04:13.922620+0000","last_undegraded":"2024-09-17T06:04:13.922620+0000","last_fullsized":"2024-09-17T06:04:13.922620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:54.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.917090+0000","last_change":"2024-09-17T06:04:12.948833+0000","last_active":"2024-09-17T06:04:13.917090+0000","last_peered":"2024-09-17T06:04:13.917090+0000","last_clean":"2024-09-17T06:04:13.917090+0000","last_became_active":"2024-09-17T06:04:12.947705+0000","last_became_peered":"2024-09-17T06:04:12.947705+0000","last_unstale":"2024-09-17T06:04:13.917090+0000","last_undegraded":"2024-09-17T06:04:13.917090+0000","last_fullsized":"2024-09-17T06:04:13.917090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:46.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826033+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:04:14.826033+0000","last_peered":"2024-09-17T06:04:14.826033+0000","last_clean":"2024-09-17T06:04:14.826033+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:04:14.826033+0000","last_undegraded":"2024-09-17T06:04:14.826033+0000","last_fullsized":"2024-09-17T06:04:14.826033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923681+0000","last_change":"2024-09-17T06:04:08.850056+0000","last_active":"2024-09-17T06:04:13.923681+0000","last_peered":"2024-09-17T06:04:13.923681+0000","last_clean":"2024-09-17T06:04:13.923681+0000","last_became_active":"2024-09-17T06:04:08.847436+0000","last_became_peered":"2024-09-17T06:04:08.847436+0000","last_unstale":"2024-09-17T06:04:13.923681+0000","last_undegraded":"2024-09-17T06:04:13.923681+0000","last_fullsized":"2024-09-17T06:04:13.923681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:29.069085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916255+0000","last_change":"2024-09-17T06:04:12.951144+0000","last_active":"2024-09-17T06:04:13.916255+0000","last_peered":"2024-09-17T06:04:13.916255+0000","last_clean":"2024-09-17T06:04:13.916255+0000","last_became_active":"2024-09-17T06:04:12.950127+0000","last_became_peered":"2024-09-17T06:04:12.950127+0000","last_unstale":"2024-09-17T06:04:13.916255+0000","last_undegraded":"2024-09-17T06:04:13.916255+0000","last_fullsized":"2024-09-17T06:04:13.916255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:52.901835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.753568+0000","last_change":"2024-09-17T06:04:08.847906+0000","last_active":"2024-09-17T06:04:14.753568+0000","last_peered":"2024-09-17T06:04:14.753568+0000","last_clean":"2024-09-17T06:04:14.753568+0000","last_became_active":"2024-09-17T06:04:08.847601+0000","last_became_peered":"2024-09-17T06:04:08.847601+0000","last_unstale":"2024-09-17T06:04:14.753568+0000","last_undegraded":"2024-09-17T06:04:14.753568+0000","last_fullsized":"2024-09-17T06:04:14.753568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826490+0000","last_change":"2024-09-17T06:04:07.851351+0000","last_active":"2024-09-17T06:04:14.826490+0000","last_peered":"2024-09-17T06:04:14.826490+0000","last_clean":"2024-09-17T06:04:14.826490+0000","last_became_active":"2024-09-17T06:04:07.850947+0000","last_became_peered":"2024-09-17T06:04:07.850947+0000","last_unstale":"2024-09-17T06:04:14.826490+0000","last_undegraded":"2024-09-17T06:04:14.826490+0000","last_fullsized":"2024-09-17T06:04:14.826490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:43.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919163+0000","last_change":"2024-09-17T06:04:12.936732+0000","last_active":"2024-09-17T06:04:13.919163+0000","last_peered":"2024-09-17T06:04:13.919163+0000","last_clean":"2024-09-17T06:04:13.919163+0000","last_became_active":"2024-09-17T06:04:12.935512+0000","last_became_peered":"2024-09-17T06:04:12.935512+0000","last_unstale":"2024-09-17T06:04:13.919163+0000","last_undegraded":"2024-09-17T06:04:13.919163+0000","last_fullsized":"2024-09-17T06:04:13.919163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915113+0000","last_change":"2024-09-17T06:04:08.847093+0000","last_active":"2024-09-17T06:04:13.915113+0000","last_peered":"2024-09-17T06:04:13.915113+0000","last_clean":"2024-09-17T06:04:13.915113+0000","last_became_active":"2024-09-17T06:04:08.846716+0000","last_became_peered":"2024-09-17T06:04:08.846716+0000","last_unstale":"2024-09-17T06:04:13.915113+0000","last_undegraded":"2024-09-17T06:04:13.915113+0000","last_fullsized":"2024-09-17T06:04:13.915113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557626+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:04:14.557626+0000","last_peered":"2024-09-17T06:04:14.557626+0000","last_clean":"2024-09-17T06:04:14.557626+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:04:14.557626+0000","last_undegraded":"2024-09-17T06:04:14.557626+0000","last_fullsized":"2024-09-17T06:04:14.557626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918420+0000","last_change":"2024-09-17T06:04:12.951796+0000","last_active":"2024-09-17T06:04:13.918420+0000","last_peered":"2024-09-17T06:04:13.918420+0000","last_clean":"2024-09-17T06:04:13.918420+0000","last_became_active":"2024-09-17T06:04:12.948211+0000","last_became_peered":"2024-09-17T06:04:12.948211+0000","last_unstale":"2024-09-17T06:04:13.918420+0000","last_undegraded":"2024-09-17T06:04:13.918420+0000","last_fullsized":"2024-09-17T06:04:13.918420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:43.869350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913781+0000","last_change":"2024-09-17T06:04:08.850212+0000","last_active":"2024-09-17T06:04:13.913781+0000","last_peered":"2024-09-17T06:04:13.913781+0000","last_clean":"2024-09-17T06:04:13.913781+0000","last_became_active":"2024-09-17T06:04:08.835906+0000","last_became_peered":"2024-09-17T06:04:08.835906+0000","last_unstale":"2024-09-17T06:04:13.913781+0000","last_undegraded":"2024-09-17T06:04:13.913781+0000","last_fullsized":"2024-09-17T06:04:13.913781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556835+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:04:14.556835+0000","last_peered":"2024-09-17T06:04:14.556835+0000","last_clean":"2024-09-17T06:04:14.556835+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:04:14.556835+0000","last_undegraded":"2024-09-17T06:04:14.556835+0000","last_fullsized":"2024-09-17T06:04:14.556835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558516+0000","last_change":"2024-09-17T06:04:13.048882+0000","last_active":"2024-09-17T06:04:14.558516+0000","last_peered":"2024-09-17T06:04:14.558516+0000","last_clean":"2024-09-17T06:04:14.558516+0000","last_became_active":"2024-09-17T06:04:13.047684+0000","last_became_peered":"2024-09-17T06:04:13.047684+0000","last_unstale":"2024-09-17T06:04:14.558516+0000","last_undegraded":"2024-09-17T06:04:14.558516+0000","last_fullsized":"2024-09-17T06:04:14.558516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:21.270772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916697+0000","last_change":"2024-09-17T06:04:08.838033+0000","last_active":"2024-09-17T06:04:13.916697+0000","last_peered":"2024-09-17T06:04:13.916697+0000","last_clean":"2024-09-17T06:04:13.916697+0000","last_became_active":"2024-09-17T06:04:08.836402+0000","last_became_peered":"2024-09-17T06:04:08.836402+0000","last_unstale":"2024-09-17T06:04:13.916697+0000","last_undegraded":"2024-09-17T06:04:13.916697+0000","last_fullsized":"2024-09-17T06:04:13.916697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:12.374198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825530+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:04:14.825530+0000","last_peered":"2024-09-17T06:04:14.825530+0000","last_clean":"2024-09-17T06:04:14.825530+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:04:14.825530+0000","last_undegraded":"2024-09-17T06:04:14.825530+0000","last_fullsized":"2024-09-17T06:04:14.825530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919390+0000","last_change":"2024-09-17T06:04:12.949288+0000","last_active":"2024-09-17T06:04:13.919390+0000","last_peered":"2024-09-17T06:04:13.919390+0000","last_clean":"2024-09-17T06:04:13.919390+0000","last_became_active":"2024-09-17T06:04:12.947997+0000","last_became_peered":"2024-09-17T06:04:12.947997+0000","last_unstale":"2024-09-17T06:04:13.919390+0000","last_undegraded":"2024-09-17T06:04:13.919390+0000","last_fullsized":"2024-09-17T06:04:13.919390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827729+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:04:14.827729+0000","last_peered":"2024-09-17T06:04:14.827729+0000","last_clean":"2024-09-17T06:04:14.827729+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:04:14.827729+0000","last_undegraded":"2024-09-17T06:04:14.827729+0000","last_fullsized":"2024-09-17T06:04:14.827729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755401+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:04:14.755401+0000","last_peered":"2024-09-17T06:04:14.755401+0000","last_clean":"2024-09-17T06:04:14.755401+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:04:14.755401+0000","last_undegraded":"2024-09-17T06:04:14.755401+0000","last_fullsized":"2024-09-17T06:04:14.755401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915706+0000","last_change":"2024-09-17T06:04:13.039804+0000","last_active":"2024-09-17T06:04:13.915706+0000","last_peered":"2024-09-17T06:04:13.915706+0000","last_clean":"2024-09-17T06:04:13.915706+0000","last_became_active":"2024-09-17T06:04:13.038212+0000","last_became_peered":"2024-09-17T06:04:13.038212+0000","last_unstale":"2024-09-17T06:04:13.915706+0000","last_undegraded":"2024-09-17T06:04:13.915706+0000","last_fullsized":"2024-09-17T06:04:13.915706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:35.798927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915606+0000","last_change":"2024-09-17T06:04:08.853353+0000","last_active":"2024-09-17T06:04:13.915606+0000","last_peered":"2024-09-17T06:04:13.915606+0000","last_clean":"2024-09-17T06:04:13.915606+0000","last_became_active":"2024-09-17T06:04:08.852015+0000","last_became_peered":"2024-09-17T06:04:08.852015+0000","last_unstale":"2024-09-17T06:04:13.915606+0000","last_undegraded":"2024-09-17T06:04:13.915606+0000","last_fullsized":"2024-09-17T06:04:13.915606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558240+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:04:14.558240+0000","last_peered":"2024-09-17T06:04:14.558240+0000","last_clean":"2024-09-17T06:04:14.558240+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:04:14.558240+0000","last_undegraded":"2024-09-17T06:04:14.558240+0000","last_fullsized":"2024-09-17T06:04:14.558240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912658+0000","last_change":"2024-09-17T06:04:13.034589+0000","last_active":"2024-09-17T06:04:13.912658+0000","last_peered":"2024-09-17T06:04:13.912658+0000","last_clean":"2024-09-17T06:04:13.912658+0000","last_became_active":"2024-09-17T06:04:13.034080+0000","last_became_peered":"2024-09-17T06:04:13.034080+0000","last_unstale":"2024-09-17T06:04:13.912658+0000","last_undegraded":"2024-09-17T06:04:13.912658+0000","last_fullsized":"2024-09-17T06:04:13.912658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:16.669822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557861+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:04:14.557861+0000","last_peered":"2024-09-17T06:04:14.557861+0000","last_clean":"2024-09-17T06:04:14.557861+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:04:14.557861+0000","last_undegraded":"2024-09-17T06:04:14.557861+0000","last_fullsized":"2024-09-17T06:04:14.557861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826908+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:04:14.826908+0000","last_peered":"2024-09-17T06:04:14.826908+0000","last_clean":"2024-09-17T06:04:14.826908+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:04:14.826908+0000","last_undegraded":"2024-09-17T06:04:14.826908+0000","last_fullsized":"2024-09-17T06:04:14.826908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826528+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:04:14.826528+0000","last_peered":"2024-09-17T06:04:14.826528+0000","last_clean":"2024-09-17T06:04:14.826528+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:04:14.826528+0000","last_undegraded":"2024-09-17T06:04:14.826528+0000","last_fullsized":"2024-09-17T06:04:14.826528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923885+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:04:13.923885+0000","last_peered":"2024-09-17T06:04:13.923885+0000","last_clean":"2024-09-17T06:04:13.923885+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:04:13.923885+0000","last_undegraded":"2024-09-17T06:04:13.923885+0000","last_fullsized":"2024-09-17T06:04:13.923885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558155+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:04:14.558155+0000","last_peered":"2024-09-17T06:04:14.558155+0000","last_clean":"2024-09-17T06:04:14.558155+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:04:14.558155+0000","last_undegraded":"2024-09-17T06:04:14.558155+0000","last_fullsized":"2024-09-17T06:04:14.558155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556865+0000","last_change":"2024-09-17T06:04:12.942301+0000","last_active":"2024-09-17T06:04:14.556865+0000","last_peered":"2024-09-17T06:04:14.556865+0000","last_clean":"2024-09-17T06:04:14.556865+0000","last_became_active":"2024-09-17T06:04:12.941640+0000","last_became_peered":"2024-09-17T06:04:12.941640+0000","last_unstale":"2024-09-17T06:04:14.556865+0000","last_undegraded":"2024-09-17T06:04:14.556865+0000","last_fullsized":"2024-09-17T06:04:14.556865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:31.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918736+0000","last_change":"2024-09-17T06:04:08.838642+0000","last_active":"2024-09-17T06:04:13.918736+0000","last_peered":"2024-09-17T06:04:13.918736+0000","last_clean":"2024-09-17T06:04:13.918736+0000","last_became_active":"2024-09-17T06:04:08.835562+0000","last_became_peered":"2024-09-17T06:04:08.835562+0000","last_unstale":"2024-09-17T06:04:13.918736+0000","last_undegraded":"2024-09-17T06:04:13.918736+0000","last_fullsized":"2024-09-17T06:04:13.918736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:16.900376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922711+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:04:13.922711+0000","last_peered":"2024-09-17T06:04:13.922711+0000","last_clean":"2024-09-17T06:04:13.922711+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:04:13.922711+0000","last_undegraded":"2024-09-17T06:04:13.922711+0000","last_fullsized":"2024-09-17T06:04:13.922711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557663+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:04:14.557663+0000","last_peered":"2024-09-17T06:04:14.557663+0000","last_clean":"2024-09-17T06:04:14.557663+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:04:14.557663+0000","last_undegraded":"2024-09-17T06:04:14.557663+0000","last_fullsized":"2024-09-17T06:04:14.557663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556896+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:04:14.556896+0000","last_peered":"2024-09-17T06:04:14.556896+0000","last_clean":"2024-09-17T06:04:14.556896+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:04:14.556896+0000","last_undegraded":"2024-09-17T06:04:14.556896+0000","last_fullsized":"2024-09-17T06:04:14.556896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824198+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:04:14.824198+0000","last_peered":"2024-09-17T06:04:14.824198+0000","last_clean":"2024-09-17T06:04:14.824198+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:04:14.824198+0000","last_undegraded":"2024-09-17T06:04:14.824198+0000","last_fullsized":"2024-09-17T06:04:14.824198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558517+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:04:14.558517+0000","last_peered":"2024-09-17T06:04:14.558517+0000","last_clean":"2024-09-17T06:04:14.558517+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:04:14.558517+0000","last_undegraded":"2024-09-17T06:04:14.558517+0000","last_fullsized":"2024-09-17T06:04:14.558517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826003+0000","last_change":"2024-09-17T06:04:08.840359+0000","last_active":"2024-09-17T06:04:14.826003+0000","last_peered":"2024-09-17T06:04:14.826003+0000","last_clean":"2024-09-17T06:04:14.826003+0000","last_became_active":"2024-09-17T06:04:08.839822+0000","last_became_peered":"2024-09-17T06:04:08.839822+0000","last_unstale":"2024-09-17T06:04:14.826003+0000","last_undegraded":"2024-09-17T06:04:14.826003+0000","last_fullsized":"2024-09-17T06:04:14.826003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825413+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:04:14.825413+0000","last_peered":"2024-09-17T06:04:14.825413+0000","last_clean":"2024-09-17T06:04:14.825413+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:04:14.825413+0000","last_undegraded":"2024-09-17T06:04:14.825413+0000","last_fullsized":"2024-09-17T06:04:14.825413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827476+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:04:14.827476+0000","last_peered":"2024-09-17T06:04:14.827476+0000","last_clean":"2024-09-17T06:04:14.827476+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:04:14.827476+0000","last_undegraded":"2024-09-17T06:04:14.827476+0000","last_fullsized":"2024-09-17T06:04:14.827476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913432+0000","last_change":"2024-09-17T06:04:08.846617+0000","last_active":"2024-09-17T06:04:13.913432+0000","last_peered":"2024-09-17T06:04:13.913432+0000","last_clean":"2024-09-17T06:04:13.913432+0000","last_became_active":"2024-09-17T06:04:08.837049+0000","last_became_peered":"2024-09-17T06:04:08.837049+0000","last_unstale":"2024-09-17T06:04:13.913432+0000","last_undegraded":"2024-09-17T06:04:13.913432+0000","last_fullsized":"2024-09-17T06:04:13.913432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923114+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:04:13.923114+0000","last_peered":"2024-09-17T06:04:13.923114+0000","last_clean":"2024-09-17T06:04:13.923114+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:04:13.923114+0000","last_undegraded":"2024-09-17T06:04:13.923114+0000","last_fullsized":"2024-09-17T06:04:13.923114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825786+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:04:14.825786+0000","last_peered":"2024-09-17T06:04:14.825786+0000","last_clean":"2024-09-17T06:04:14.825786+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:04:14.825786+0000","last_undegraded":"2024-09-17T06:04:14.825786+0000","last_fullsized":"2024-09-17T06:04:14.825786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754281+0000","last_change":"2024-09-17T06:04:13.042118+0000","last_active":"2024-09-17T06:04:14.754281+0000","last_peered":"2024-09-17T06:04:14.754281+0000","last_clean":"2024-09-17T06:04:14.754281+0000","last_became_active":"2024-09-17T06:04:13.040403+0000","last_became_peered":"2024-09-17T06:04:13.040403+0000","last_unstale":"2024-09-17T06:04:14.754281+0000","last_undegraded":"2024-09-17T06:04:14.754281+0000","last_fullsized":"2024-09-17T06:04:14.754281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826117+0000","last_change":"2024-09-17T06:04:08.838758+0000","last_active":"2024-09-17T06:04:14.826117+0000","last_peered":"2024-09-17T06:04:14.826117+0000","last_clean":"2024-09-17T06:04:14.826117+0000","last_became_active":"2024-09-17T06:04:08.838386+0000","last_became_peered":"2024-09-17T06:04:08.838386+0000","last_unstale":"2024-09-17T06:04:14.826117+0000","last_undegraded":"2024-09-17T06:04:14.826117+0000","last_fullsized":"2024-09-17T06:04:14.826117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:03.255963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824908+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:04:14.824908+0000","last_peered":"2024-09-17T06:04:14.824908+0000","last_clean":"2024-09-17T06:04:14.824908+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:04:14.824908+0000","last_undegraded":"2024-09-17T06:04:14.824908+0000","last_fullsized":"2024-09-17T06:04:14.824908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.753747+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:04:14.753747+0000","last_peered":"2024-09-17T06:04:14.753747+0000","last_clean":"2024-09-17T06:04:14.753747+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:04:14.753747+0000","last_undegraded":"2024-09-17T06:04:14.753747+0000","last_fullsized":"2024-09-17T06:04:14.753747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922776+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:04:13.922776+0000","last_peered":"2024-09-17T06:04:13.922776+0000","last_clean":"2024-09-17T06:04:13.922776+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:04:13.922776+0000","last_undegraded":"2024-09-17T06:04:13.922776+0000","last_fullsized":"2024-09-17T06:04:13.922776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558194+0000","last_change":"2024-09-17T06:04:07.833230+0000","last_active":"2024-09-17T06:04:14.558194+0000","last_peered":"2024-09-17T06:04:14.558194+0000","last_clean":"2024-09-17T06:04:14.558194+0000","last_became_active":"2024-09-17T06:04:07.832307+0000","last_became_peered":"2024-09-17T06:04:07.832307+0000","last_unstale":"2024-09-17T06:04:14.558194+0000","last_undegraded":"2024-09-17T06:04:14.558194+0000","last_fullsized":"2024-09-17T06:04:14.558194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:15.843465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826765+0000","last_change":"2024-09-17T06:04:12.934060+0000","last_active":"2024-09-17T06:04:14.826765+0000","last_peered":"2024-09-17T06:04:14.826765+0000","last_clean":"2024-09-17T06:04:14.826765+0000","last_became_active":"2024-09-17T06:04:12.933545+0000","last_became_peered":"2024-09-17T06:04:12.933545+0000","last_unstale":"2024-09-17T06:04:14.826765+0000","last_undegraded":"2024-09-17T06:04:14.826765+0000","last_fullsized":"2024-09-17T06:04:14.826765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:29.393815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827267+0000","last_change":"2024-09-17T06:04:08.851525+0000","last_active":"2024-09-17T06:04:14.827267+0000","last_peered":"2024-09-17T06:04:14.827267+0000","last_clean":"2024-09-17T06:04:14.827267+0000","last_became_active":"2024-09-17T06:04:08.851117+0000","last_became_peered":"2024-09-17T06:04:08.851117+0000","last_unstale":"2024-09-17T06:04:14.827267+0000","last_undegraded":"2024-09-17T06:04:14.827267+0000","last_fullsized":"2024-09-17T06:04:14.827267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:53.071703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825390+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:04:14.825390+0000","last_peered":"2024-09-17T06:04:14.825390+0000","last_clean":"2024-09-17T06:04:14.825390+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:04:14.825390+0000","last_undegraded":"2024-09-17T06:04:14.825390+0000","last_fullsized":"2024-09-17T06:04:14.825390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921808+0000","last_change":"2024-09-17T06:04:13.042590+0000","last_active":"2024-09-17T06:04:13.921808+0000","last_peered":"2024-09-17T06:04:13.921808+0000","last_clean":"2024-09-17T06:04:13.921808+0000","last_became_active":"2024-09-17T06:04:13.041078+0000","last_became_peered":"2024-09-17T06:04:13.041078+0000","last_unstale":"2024-09-17T06:04:13.921808+0000","last_undegraded":"2024-09-17T06:04:13.921808+0000","last_fullsized":"2024-09-17T06:04:13.921808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:59.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826490+0000","last_change":"2024-09-17T06:04:08.848046+0000","last_active":"2024-09-17T06:04:14.826490+0000","last_peered":"2024-09-17T06:04:14.826490+0000","last_clean":"2024-09-17T06:04:14.826490+0000","last_became_active":"2024-09-17T06:04:08.847664+0000","last_became_peered":"2024-09-17T06:04:08.847664+0000","last_unstale":"2024-09-17T06:04:14.826490+0000","last_undegraded":"2024-09-17T06:04:14.826490+0000","last_fullsized":"2024-09-17T06:04:14.826490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:12.579790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919451+0000","last_change":"2024-09-17T06:04:07.841655+0000","last_active":"2024-09-17T06:04:13.919451+0000","last_peered":"2024-09-17T06:04:13.919451+0000","last_clean":"2024-09-17T06:04:13.919451+0000","last_became_active":"2024-09-17T06:04:07.840432+0000","last_became_peered":"2024-09-17T06:04:07.840432+0000","last_unstale":"2024-09-17T06:04:13.919451+0000","last_undegraded":"2024-09-17T06:04:13.919451+0000","last_fullsized":"2024-09-17T06:04:13.919451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:04.523110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915435+0000","last_change":"2024-09-17T06:04:12.955760+0000","last_active":"2024-09-17T06:04:13.915435+0000","last_peered":"2024-09-17T06:04:13.915435+0000","last_clean":"2024-09-17T06:04:13.915435+0000","last_became_active":"2024-09-17T06:04:12.954977+0000","last_became_peered":"2024-09-17T06:04:12.954977+0000","last_unstale":"2024-09-17T06:04:13.915435+0000","last_undegraded":"2024-09-17T06:04:13.915435+0000","last_fullsized":"2024-09-17T06:04:13.915435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:19.737903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825704+0000","last_change":"2024-09-17T06:04:08.849143+0000","last_active":"2024-09-17T06:04:14.825704+0000","last_peered":"2024-09-17T06:04:14.825704+0000","last_clean":"2024-09-17T06:04:14.825704+0000","last_became_active":"2024-09-17T06:04:08.848740+0000","last_became_peered":"2024-09-17T06:04:08.848740+0000","last_unstale":"2024-09-17T06:04:14.825704+0000","last_undegraded":"2024-09-17T06:04:14.825704+0000","last_fullsized":"2024-09-17T06:04:14.825704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.823997+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:04:14.823997+0000","last_peered":"2024-09-17T06:04:14.823997+0000","last_clean":"2024-09-17T06:04:14.823997+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:04:14.823997+0000","last_undegraded":"2024-09-17T06:04:14.823997+0000","last_fullsized":"2024-09-17T06:04:14.823997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827071+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:04:14.827071+0000","last_peered":"2024-09-17T06:04:14.827071+0000","last_clean":"2024-09-17T06:04:14.827071+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:04:14.827071+0000","last_undegraded":"2024-09-17T06:04:14.827071+0000","last_fullsized":"2024-09-17T06:04:14.827071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754000+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:04:14.754000+0000","last_peered":"2024-09-17T06:04:14.754000+0000","last_clean":"2024-09-17T06:04:14.754000+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:04:14.754000+0000","last_undegraded":"2024-09-17T06:04:14.754000+0000","last_fullsized":"2024-09-17T06:04:14.754000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754133+0000","last_change":"2024-09-17T06:04:07.849633+0000","last_active":"2024-09-17T06:04:14.754133+0000","last_peered":"2024-09-17T06:04:14.754133+0000","last_clean":"2024-09-17T06:04:14.754133+0000","last_became_active":"2024-09-17T06:04:07.848323+0000","last_became_peered":"2024-09-17T06:04:07.848323+0000","last_unstale":"2024-09-17T06:04:14.754133+0000","last_undegraded":"2024-09-17T06:04:14.754133+0000","last_fullsized":"2024-09-17T06:04:14.754133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915247+0000","last_change":"2024-09-17T06:04:13.036889+0000","last_active":"2024-09-17T06:04:13.915247+0000","last_peered":"2024-09-17T06:04:13.915247+0000","last_clean":"2024-09-17T06:04:13.915247+0000","last_became_active":"2024-09-17T06:04:13.035428+0000","last_became_peered":"2024-09-17T06:04:13.035428+0000","last_unstale":"2024-09-17T06:04:13.915247+0000","last_undegraded":"2024-09-17T06:04:13.915247+0000","last_fullsized":"2024-09-17T06:04:13.915247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:00.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826148+0000","last_change":"2024-09-17T06:04:08.848113+0000","last_active":"2024-09-17T06:04:14.826148+0000","last_peered":"2024-09-17T06:04:14.826148+0000","last_clean":"2024-09-17T06:04:14.826148+0000","last_became_active":"2024-09-17T06:04:08.847695+0000","last_became_peered":"2024-09-17T06:04:08.847695+0000","last_unstale":"2024-09-17T06:04:14.826148+0000","last_undegraded":"2024-09-17T06:04:14.826148+0000","last_fullsized":"2024-09-17T06:04:14.826148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:21.258775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922496+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:04:13.922496+0000","last_peered":"2024-09-17T06:04:13.922496+0000","last_clean":"2024-09-17T06:04:13.922496+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:04:13.922496+0000","last_undegraded":"2024-09-17T06:04:13.922496+0000","last_fullsized":"2024-09-17T06:04:13.922496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914403+0000","last_change":"2024-09-17T06:04:13.034560+0000","last_active":"2024-09-17T06:04:13.914403+0000","last_peered":"2024-09-17T06:04:13.914403+0000","last_clean":"2024-09-17T06:04:13.914403+0000","last_became_active":"2024-09-17T06:04:13.034023+0000","last_became_peered":"2024-09-17T06:04:13.034023+0000","last_unstale":"2024-09-17T06:04:13.914403+0000","last_undegraded":"2024-09-17T06:04:13.914403+0000","last_fullsized":"2024-09-17T06:04:13.914403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:04.549375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826605+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:04:14.826605+0000","last_peered":"2024-09-17T06:04:14.826605+0000","last_clean":"2024-09-17T06:04:14.826605+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:04:14.826605+0000","last_undegraded":"2024-09-17T06:04:14.826605+0000","last_fullsized":"2024-09-17T06:04:14.826605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827133+0000","last_change":"2024-09-17T06:04:07.837797+0000","last_active":"2024-09-17T06:04:14.827133+0000","last_peered":"2024-09-17T06:04:14.827133+0000","last_clean":"2024-09-17T06:04:14.827133+0000","last_became_active":"2024-09-17T06:04:07.837347+0000","last_became_peered":"2024-09-17T06:04:07.837347+0000","last_unstale":"2024-09-17T06:04:14.827133+0000","last_undegraded":"2024-09-17T06:04:14.827133+0000","last_fullsized":"2024-09-17T06:04:14.827133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.924037+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:04:13.924037+0000","last_peered":"2024-09-17T06:04:13.924037+0000","last_clean":"2024-09-17T06:04:13.924037+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:04:13.924037+0000","last_undegraded":"2024-09-17T06:04:13.924037+0000","last_fullsized":"2024-09-17T06:04:13.924037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826129+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:04:14.826129+0000","last_peered":"2024-09-17T06:04:14.826129+0000","last_clean":"2024-09-17T06:04:14.826129+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:04:14.826129+0000","last_undegraded":"2024-09-17T06:04:14.826129+0000","last_fullsized":"2024-09-17T06:04:14.826129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:22.322334+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:04:22.322334+0000","last_peered":"2024-09-17T06:04:22.322334+0000","last_clean":"2024-09-17T06:04:22.322334+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:04:22.322334+0000","last_undegraded":"2024-09-17T06:04:22.322334+0000","last_fullsized":"2024-09-17T06:04:22.322334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557256+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:04:14.557256+0000","last_peered":"2024-09-17T06:04:14.557256+0000","last_clean":"2024-09-17T06:04:14.557256+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:04:14.557256+0000","last_undegraded":"2024-09-17T06:04:14.557256+0000","last_fullsized":"2024-09-17T06:04:14.557256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919279+0000","last_change":"2024-09-17T06:04:08.842243+0000","last_active":"2024-09-17T06:04:13.919279+0000","last_peered":"2024-09-17T06:04:13.919279+0000","last_clean":"2024-09-17T06:04:13.919279+0000","last_became_active":"2024-09-17T06:04:08.841831+0000","last_became_peered":"2024-09-17T06:04:08.841831+0000","last_unstale":"2024-09-17T06:04:13.919279+0000","last_undegraded":"2024-09-17T06:04:13.919279+0000","last_fullsized":"2024-09-17T06:04:13.919279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:47.589819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557915+0000","last_change":"2024-09-17T06:04:07.852382+0000","last_active":"2024-09-17T06:04:14.557915+0000","last_peered":"2024-09-17T06:04:14.557915+0000","last_clean":"2024-09-17T06:04:14.557915+0000","last_became_active":"2024-09-17T06:04:07.851954+0000","last_became_peered":"2024-09-17T06:04:07.851954+0000","last_unstale":"2024-09-17T06:04:14.557915+0000","last_undegraded":"2024-09-17T06:04:14.557915+0000","last_fullsized":"2024-09-17T06:04:14.557915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918024+0000","last_change":"2024-09-17T06:04:12.942425+0000","last_active":"2024-09-17T06:04:13.918024+0000","last_peered":"2024-09-17T06:04:13.918024+0000","last_clean":"2024-09-17T06:04:13.918024+0000","last_became_active":"2024-09-17T06:04:12.937463+0000","last_became_peered":"2024-09-17T06:04:12.937463+0000","last_unstale":"2024-09-17T06:04:13.918024+0000","last_undegraded":"2024-09-17T06:04:13.918024+0000","last_fullsized":"2024-09-17T06:04:13.918024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:21.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827689+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:04:14.827689+0000","last_peered":"2024-09-17T06:04:14.827689+0000","last_clean":"2024-09-17T06:04:14.827689+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:04:14.827689+0000","last_undegraded":"2024-09-17T06:04:14.827689+0000","last_fullsized":"2024-09-17T06:04:14.827689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922956+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:04:13.922956+0000","last_peered":"2024-09-17T06:04:13.922956+0000","last_clean":"2024-09-17T06:04:13.922956+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:04:13.922956+0000","last_undegraded":"2024-09-17T06:04:13.922956+0000","last_fullsized":"2024-09-17T06:04:13.922956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913193+0000","last_change":"2024-09-17T06:04:12.956822+0000","last_active":"2024-09-17T06:04:13.913193+0000","last_peered":"2024-09-17T06:04:13.913193+0000","last_clean":"2024-09-17T06:04:13.913193+0000","last_became_active":"2024-09-17T06:04:12.956349+0000","last_became_peered":"2024-09-17T06:04:12.956349+0000","last_unstale":"2024-09-17T06:04:13.913193+0000","last_undegraded":"2024-09-17T06:04:13.913193+0000","last_fullsized":"2024-09-17T06:04:13.913193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:56.435215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922611+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:04:13.922611+0000","last_peered":"2024-09-17T06:04:13.922611+0000","last_clean":"2024-09-17T06:04:13.922611+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:04:13.922611+0000","last_undegraded":"2024-09-17T06:04:13.922611+0000","last_fullsized":"2024-09-17T06:04:13.922611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755152+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:04:14.755152+0000","last_peered":"2024-09-17T06:04:14.755152+0000","last_clean":"2024-09-17T06:04:14.755152+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:04:14.755152+0000","last_undegraded":"2024-09-17T06:04:14.755152+0000","last_fullsized":"2024-09-17T06:04:14.755152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913592+0000","last_change":"2024-09-17T06:04:13.043905+0000","last_active":"2024-09-17T06:04:13.913592+0000","last_peered":"2024-09-17T06:04:13.913592+0000","last_clean":"2024-09-17T06:04:13.913592+0000","last_became_active":"2024-09-17T06:04:13.041929+0000","last_became_peered":"2024-09-17T06:04:13.041929+0000","last_unstale":"2024-09-17T06:04:13.913592+0000","last_undegraded":"2024-09-17T06:04:13.913592+0000","last_fullsized":"2024-09-17T06:04:13.913592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:07.693245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827124+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:04:14.827124+0000","last_peered":"2024-09-17T06:04:14.827124+0000","last_clean":"2024-09-17T06:04:14.827124+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:04:14.827124+0000","last_undegraded":"2024-09-17T06:04:14.827124+0000","last_fullsized":"2024-09-17T06:04:14.827124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556560+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:04:14.556560+0000","last_peered":"2024-09-17T06:04:14.556560+0000","last_clean":"2024-09-17T06:04:14.556560+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:04:14.556560+0000","last_undegraded":"2024-09-17T06:04:14.556560+0000","last_fullsized":"2024-09-17T06:04:14.556560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921998+0000","last_change":"2024-09-17T06:04:07.857398+0000","last_active":"2024-09-17T06:04:13.921998+0000","last_peered":"2024-09-17T06:04:13.921998+0000","last_clean":"2024-09-17T06:04:13.921998+0000","last_became_active":"2024-09-17T06:04:07.856866+0000","last_became_peered":"2024-09-17T06:04:07.856866+0000","last_unstale":"2024-09-17T06:04:13.921998+0000","last_undegraded":"2024-09-17T06:04:13.921998+0000","last_fullsized":"2024-09-17T06:04:13.921998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754760+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:04:14.754760+0000","last_peered":"2024-09-17T06:04:14.754760+0000","last_clean":"2024-09-17T06:04:14.754760+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:04:14.754760+0000","last_undegraded":"2024-09-17T06:04:14.754760+0000","last_fullsized":"2024-09-17T06:04:14.754760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913448+0000","last_change":"2024-09-17T06:04:08.850811+0000","last_active":"2024-09-17T06:04:13.913448+0000","last_peered":"2024-09-17T06:04:13.913448+0000","last_clean":"2024-09-17T06:04:13.913448+0000","last_became_active":"2024-09-17T06:04:08.847235+0000","last_became_peered":"2024-09-17T06:04:08.847235+0000","last_unstale":"2024-09-17T06:04:13.913448+0000","last_undegraded":"2024-09-17T06:04:13.913448+0000","last_fullsized":"2024-09-17T06:04:13.913448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:21.794733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913694+0000","last_change":"2024-09-17T06:04:07.840224+0000","last_active":"2024-09-17T06:04:13.913694+0000","last_peered":"2024-09-17T06:04:13.913694+0000","last_clean":"2024-09-17T06:04:13.913694+0000","last_became_active":"2024-09-17T06:04:07.839703+0000","last_became_peered":"2024-09-17T06:04:07.839703+0000","last_unstale":"2024-09-17T06:04:13.913694+0000","last_undegraded":"2024-09-17T06:04:13.913694+0000","last_fullsized":"2024-09-17T06:04:13.913694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:01.141166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755032+0000","last_change":"2024-09-17T06:04:07.844255+0000","last_active":"2024-09-17T06:04:14.755032+0000","last_peered":"2024-09-17T06:04:14.755032+0000","last_clean":"2024-09-17T06:04:14.755032+0000","last_became_active":"2024-09-17T06:04:07.843380+0000","last_became_peered":"2024-09-17T06:04:07.843380+0000","last_unstale":"2024-09-17T06:04:14.755032+0000","last_undegraded":"2024-09-17T06:04:14.755032+0000","last_fullsized":"2024-09-17T06:04:14.755032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:28.720792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827019+0000","last_change":"2024-09-17T06:04:08.837656+0000","last_active":"2024-09-17T06:04:14.827019+0000","last_peered":"2024-09-17T06:04:14.827019+0000","last_clean":"2024-09-17T06:04:14.827019+0000","last_became_active":"2024-09-17T06:04:08.837157+0000","last_became_peered":"2024-09-17T06:04:08.837157+0000","last_unstale":"2024-09-17T06:04:14.827019+0000","last_undegraded":"2024-09-17T06:04:14.827019+0000","last_fullsized":"2024-09-17T06:04:14.827019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824605+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:04:14.824605+0000","last_peered":"2024-09-17T06:04:14.824605+0000","last_clean":"2024-09-17T06:04:14.824605+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:04:14.824605+0000","last_undegraded":"2024-09-17T06:04:14.824605+0000","last_fullsized":"2024-09-17T06:04:14.824605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915126+0000","last_change":"2024-09-17T06:04:07.848422+0000","last_active":"2024-09-17T06:04:13.915126+0000","last_peered":"2024-09-17T06:04:13.915126+0000","last_clean":"2024-09-17T06:04:13.915126+0000","last_became_active":"2024-09-17T06:04:07.847917+0000","last_became_peered":"2024-09-17T06:04:07.847917+0000","last_unstale":"2024-09-17T06:04:13.915126+0000","last_undegraded":"2024-09-17T06:04:13.915126+0000","last_fullsized":"2024-09-17T06:04:13.915126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:04.960985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916415+0000","last_change":"2024-09-17T06:04:08.831009+0000","last_active":"2024-09-17T06:04:13.916415+0000","last_peered":"2024-09-17T06:04:13.916415+0000","last_clean":"2024-09-17T06:04:13.916415+0000","last_became_active":"2024-09-17T06:04:08.830578+0000","last_became_peered":"2024-09-17T06:04:08.830578+0000","last_unstale":"2024-09-17T06:04:13.916415+0000","last_undegraded":"2024-09-17T06:04:13.916415+0000","last_fullsized":"2024-09-17T06:04:13.916415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:21.761554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914674+0000","last_change":"2024-09-17T06:04:12.953383+0000","last_active":"2024-09-17T06:04:13.914674+0000","last_peered":"2024-09-17T06:04:13.914674+0000","last_clean":"2024-09-17T06:04:13.914674+0000","last_became_active":"2024-09-17T06:04:12.952849+0000","last_became_peered":"2024-09-17T06:04:12.952849+0000","last_unstale":"2024-09-17T06:04:13.914674+0000","last_undegraded":"2024-09-17T06:04:13.914674+0000","last_fullsized":"2024-09-17T06:04:13.914674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:01.588798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754494+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:04:14.754494+0000","last_peered":"2024-09-17T06:04:14.754494+0000","last_clean":"2024-09-17T06:04:14.754494+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:04:14.754494+0000","last_undegraded":"2024-09-17T06:04:14.754494+0000","last_fullsized":"2024-09-17T06:04:14.754494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824042+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:04:14.824042+0000","last_peered":"2024-09-17T06:04:14.824042+0000","last_clean":"2024-09-17T06:04:14.824042+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:04:14.824042+0000","last_undegraded":"2024-09-17T06:04:14.824042+0000","last_fullsized":"2024-09-17T06:04:14.824042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922377+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:04:13.922377+0000","last_peered":"2024-09-17T06:04:13.922377+0000","last_clean":"2024-09-17T06:04:13.922377+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:04:13.922377+0000","last_undegraded":"2024-09-17T06:04:13.922377+0000","last_fullsized":"2024-09-17T06:04:13.922377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826836+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:04:14.826836+0000","last_peered":"2024-09-17T06:04:14.826836+0000","last_clean":"2024-09-17T06:04:14.826836+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:04:14.826836+0000","last_undegraded":"2024-09-17T06:04:14.826836+0000","last_fullsized":"2024-09-17T06:04:14.826836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914912+0000","last_change":"2024-09-17T06:04:08.853837+0000","last_active":"2024-09-17T06:04:13.914912+0000","last_peered":"2024-09-17T06:04:13.914912+0000","last_clean":"2024-09-17T06:04:13.914912+0000","last_became_active":"2024-09-17T06:04:08.847311+0000","last_became_peered":"2024-09-17T06:04:08.847311+0000","last_unstale":"2024-09-17T06:04:13.914912+0000","last_undegraded":"2024-09-17T06:04:13.914912+0000","last_fullsized":"2024-09-17T06:04:13.914912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:39.705332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557384+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:04:14.557384+0000","last_peered":"2024-09-17T06:04:14.557384+0000","last_clean":"2024-09-17T06:04:14.557384+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:04:14.557384+0000","last_undegraded":"2024-09-17T06:04:14.557384+0000","last_fullsized":"2024-09-17T06:04:14.557384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755114+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:04:14.755114+0000","last_peered":"2024-09-17T06:04:14.755114+0000","last_clean":"2024-09-17T06:04:14.755114+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:04:14.755114+0000","last_undegraded":"2024-09-17T06:04:14.755114+0000","last_fullsized":"2024-09-17T06:04:14.755114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915505+0000","last_change":"2024-09-17T06:04:08.847264+0000","last_active":"2024-09-17T06:04:13.915505+0000","last_peered":"2024-09-17T06:04:13.915505+0000","last_clean":"2024-09-17T06:04:13.915505+0000","last_became_active":"2024-09-17T06:04:08.846741+0000","last_became_peered":"2024-09-17T06:04:08.846741+0000","last_unstale":"2024-09-17T06:04:13.915505+0000","last_undegraded":"2024-09-17T06:04:13.915505+0000","last_fullsized":"2024-09-17T06:04:13.915505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921907+0000","last_change":"2024-09-17T06:04:08.856656+0000","last_active":"2024-09-17T06:04:13.921907+0000","last_peered":"2024-09-17T06:04:13.921907+0000","last_clean":"2024-09-17T06:04:13.921907+0000","last_became_active":"2024-09-17T06:04:08.855496+0000","last_became_peered":"2024-09-17T06:04:08.855496+0000","last_unstale":"2024-09-17T06:04:13.921907+0000","last_undegraded":"2024-09-17T06:04:13.921907+0000","last_fullsized":"2024-09-17T06:04:13.921907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913105+0000","last_change":"2024-09-17T06:04:08.851245+0000","last_active":"2024-09-17T06:04:13.913105+0000","last_peered":"2024-09-17T06:04:13.913105+0000","last_clean":"2024-09-17T06:04:13.913105+0000","last_became_active":"2024-09-17T06:04:08.847488+0000","last_became_peered":"2024-09-17T06:04:08.847488+0000","last_unstale":"2024-09-17T06:04:13.913105+0000","last_undegraded":"2024-09-17T06:04:13.913105+0000","last_fullsized":"2024-09-17T06:04:13.913105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922140+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:04:13.922140+0000","last_peered":"2024-09-17T06:04:13.922140+0000","last_clean":"2024-09-17T06:04:13.922140+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:04:13.922140+0000","last_undegraded":"2024-09-17T06:04:13.922140+0000","last_fullsized":"2024-09-17T06:04:13.922140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826398+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:04:14.826398+0000","last_peered":"2024-09-17T06:04:14.826398+0000","last_clean":"2024-09-17T06:04:14.826398+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:04:14.826398+0000","last_undegraded":"2024-09-17T06:04:14.826398+0000","last_fullsized":"2024-09-17T06:04:14.826398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754421+0000","last_change":"2024-09-17T06:04:08.847877+0000","last_active":"2024-09-17T06:04:14.754421+0000","last_peered":"2024-09-17T06:04:14.754421+0000","last_clean":"2024-09-17T06:04:14.754421+0000","last_became_active":"2024-09-17T06:04:08.847538+0000","last_became_peered":"2024-09-17T06:04:08.847538+0000","last_unstale":"2024-09-17T06:04:14.754421+0000","last_undegraded":"2024-09-17T06:04:14.754421+0000","last_fullsized":"2024-09-17T06:04:14.754421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826750+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:04:14.826750+0000","last_peered":"2024-09-17T06:04:14.826750+0000","last_clean":"2024-09-17T06:04:14.826750+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:04:14.826750+0000","last_undegraded":"2024-09-17T06:04:14.826750+0000","last_fullsized":"2024-09-17T06:04:14.826750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825216+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:04:14.825216+0000","last_peered":"2024-09-17T06:04:14.825216+0000","last_clean":"2024-09-17T06:04:14.825216+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:04:14.825216+0000","last_undegraded":"2024-09-17T06:04:14.825216+0000","last_fullsized":"2024-09-17T06:04:14.825216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923600+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:04:13.923600+0000","last_peered":"2024-09-17T06:04:13.923600+0000","last_clean":"2024-09-17T06:04:13.923600+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:04:13.923600+0000","last_undegraded":"2024-09-17T06:04:13.923600+0000","last_fullsized":"2024-09-17T06:04:13.923600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921566+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:04:13.921566+0000","last_peered":"2024-09-17T06:04:13.921566+0000","last_clean":"2024-09-17T06:04:13.921566+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:04:13.921566+0000","last_undegraded":"2024-09-17T06:04:13.921566+0000","last_fullsized":"2024-09-17T06:04:13.921566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556805+0000","last_change":"2024-09-17T06:04:08.824718+0000","last_active":"2024-09-17T06:04:14.556805+0000","last_peered":"2024-09-17T06:04:14.556805+0000","last_clean":"2024-09-17T06:04:14.556805+0000","last_became_active":"2024-09-17T06:04:08.823771+0000","last_became_peered":"2024-09-17T06:04:08.823771+0000","last_unstale":"2024-09-17T06:04:14.556805+0000","last_undegraded":"2024-09-17T06:04:14.556805+0000","last_fullsized":"2024-09-17T06:04:14.556805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:53.735092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826605+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:04:14.826605+0000","last_peered":"2024-09-17T06:04:14.826605+0000","last_clean":"2024-09-17T06:04:14.826605+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:04:14.826605+0000","last_undegraded":"2024-09-17T06:04:14.826605+0000","last_fullsized":"2024-09-17T06:04:14.826605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914823+0000","last_change":"2024-09-17T06:04:08.850255+0000","last_active":"2024-09-17T06:04:13.914823+0000","last_peered":"2024-09-17T06:04:13.914823+0000","last_clean":"2024-09-17T06:04:13.914823+0000","last_became_active":"2024-09-17T06:04:08.847637+0000","last_became_peered":"2024-09-17T06:04:08.847637+0000","last_unstale":"2024-09-17T06:04:13.914823+0000","last_undegraded":"2024-09-17T06:04:13.914823+0000","last_fullsized":"2024-09-17T06:04:13.914823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919159+0000","last_change":"2024-09-17T06:04:08.845829+0000","last_active":"2024-09-17T06:04:13.919159+0000","last_peered":"2024-09-17T06:04:13.919159+0000","last_clean":"2024-09-17T06:04:13.919159+0000","last_became_active":"2024-09-17T06:04:08.845441+0000","last_became_peered":"2024-09-17T06:04:08.845441+0000","last_unstale":"2024-09-17T06:04:13.919159+0000","last_undegraded":"2024-09-17T06:04:13.919159+0000","last_fullsized":"2024-09-17T06:04:13.919159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:38.878124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754889+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:04:14.754889+0000","last_peered":"2024-09-17T06:04:14.754889+0000","last_clean":"2024-09-17T06:04:14.754889+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:04:14.754889+0000","last_undegraded":"2024-09-17T06:04:14.754889+0000","last_fullsized":"2024-09-17T06:04:14.754889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755103+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:04:14.755103+0000","last_peered":"2024-09-17T06:04:14.755103+0000","last_clean":"2024-09-17T06:04:14.755103+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:04:14.755103+0000","last_undegraded":"2024-09-17T06:04:14.755103+0000","last_fullsized":"2024-09-17T06:04:14.755103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827068+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:04:14.827068+0000","last_peered":"2024-09-17T06:04:14.827068+0000","last_clean":"2024-09-17T06:04:14.827068+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:04:14.827068+0000","last_undegraded":"2024-09-17T06:04:14.827068+0000","last_fullsized":"2024-09-17T06:04:14.827068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912650+0000","last_change":"2024-09-17T06:04:08.853473+0000","last_active":"2024-09-17T06:04:13.912650+0000","last_peered":"2024-09-17T06:04:13.912650+0000","last_clean":"2024-09-17T06:04:13.912650+0000","last_became_active":"2024-09-17T06:04:08.851946+0000","last_became_peered":"2024-09-17T06:04:08.851946+0000","last_unstale":"2024-09-17T06:04:13.912650+0000","last_undegraded":"2024-09-17T06:04:13.912650+0000","last_fullsized":"2024-09-17T06:04:13.912650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825436+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:04:14.825436+0000","last_peered":"2024-09-17T06:04:14.825436+0000","last_clean":"2024-09-17T06:04:14.825436+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:04:14.825436+0000","last_undegraded":"2024-09-17T06:04:14.825436+0000","last_fullsized":"2024-09-17T06:04:14.825436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921983+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:04:13.921983+0000","last_peered":"2024-09-17T06:04:13.921983+0000","last_clean":"2024-09-17T06:04:13.921983+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:04:13.921983+0000","last_undegraded":"2024-09-17T06:04:13.921983+0000","last_fullsized":"2024-09-17T06:04:13.921983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825723+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:04:14.825723+0000","last_peered":"2024-09-17T06:04:14.825723+0000","last_clean":"2024-09-17T06:04:14.825723+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:04:14.825723+0000","last_undegraded":"2024-09-17T06:04:14.825723+0000","last_fullsized":"2024-09-17T06:04:14.825723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922399+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:04:13.922399+0000","last_peered":"2024-09-17T06:04:13.922399+0000","last_clean":"2024-09-17T06:04:13.922399+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:04:13.922399+0000","last_undegraded":"2024-09-17T06:04:13.922399+0000","last_fullsized":"2024-09-17T06:04:13.922399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825947+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:04:14.825947+0000","last_peered":"2024-09-17T06:04:14.825947+0000","last_clean":"2024-09-17T06:04:14.825947+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:04:14.825947+0000","last_undegraded":"2024-09-17T06:04:14.825947+0000","last_fullsized":"2024-09-17T06:04:14.825947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558186+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:04:14.558186+0000","last_peered":"2024-09-17T06:04:14.558186+0000","last_clean":"2024-09-17T06:04:14.558186+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:04:14.558186+0000","last_undegraded":"2024-09-17T06:04:14.558186+0000","last_fullsized":"2024-09-17T06:04:14.558186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826777+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:04:14.826777+0000","last_peered":"2024-09-17T06:04:14.826777+0000","last_clean":"2024-09-17T06:04:14.826777+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:04:14.826777+0000","last_undegraded":"2024-09-17T06:04:14.826777+0000","last_fullsized":"2024-09-17T06:04:14.826777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":876544,"data_stored":696906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":106060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":105990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:04:38.778 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:04:38.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.951+0000 7f64b23b0640 1 -- 172.21.15.122:0/1885557372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6498004d50 msgr2=0x7f64980051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.951+0000 7f64b23b0640 1 --2- 172.21.15.122:0/1885557372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6498004d50 0x7f64980051a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0b8110 tx=0x7f64a401d150 comp rx=0 tx=0).stop 2024-09-17T06:04:38.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.951+0000 7f64b094d640 1 -- 172.21.15.122:0/1885557372 reap_dead start 2024-09-17T06:04:38.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.951+0000 7f64b23b0640 1 -- 172.21.15.122:0/1885557372 shutdown_connections 2024-09-17T06:04:38.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.951+0000 7f64b23b0640 1 -- 172.21.15.122:0/1885557372 >> 172.21.15.122:0/1885557372 conn(0x7f64ac0746d0 msgr2=0x7f64ac074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:38.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.951+0000 7f64b23b0640 1 -- 172.21.15.122:0/1885557372 shutdown_connections 2024-09-17T06:04:38.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.951+0000 7f64b23b0640 1 -- 172.21.15.122:0/1885557372 wait complete. 2024-09-17T06:04:38.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.951+0000 7f64b23b0640 1 Processor -- start 2024-09-17T06:04:38.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.951+0000 7f64b23b0640 1 -- start start 2024-09-17T06:04:38.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64b23b0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6498004d50 0x7f64ac1e1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64b23b0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64ac1eee00 0x7f64ac15a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64b23b0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64ac1e3700 0x7f64ac146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64b23b0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac158a70 con 0x7f6498004d50 2024-09-17T06:04:38.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64b23b0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac158790 con 0x7f64ac1eee00 2024-09-17T06:04:38.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64b23b0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f64ac158d50 con 0x7f64ac1e3700 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64abfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6498004d50 0x7f64ac1e1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64abfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6498004d50 0x7f64ac1e1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49518/0 (socket says 172.21.15.122:49518) 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64abfff640 1 -- 172.21.15.122:0/4288643824 learned_addr learned my addr 172.21.15.122:0/4288643824 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64a37fe640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64ac1eee00 0x7f64ac15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64b094d640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64ac1e3700 0x7f64ac146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64abfff640 1 -- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64ac1e3700 msgr2=0x7f64ac146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64abfff640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64ac1e3700 0x7f64ac146280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64abfff640 1 -- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64ac1eee00 msgr2=0x7f64ac15a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64abfff640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64ac1eee00 0x7f64ac15a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64abfff640 1 -- 172.21.15.122:0/4288643824 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac0c9770 con 0x7f6498004d50 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64a37fe640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64ac1eee00 0x7f64ac15a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64abfff640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6498004d50 0x7f64ac1e1270 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f649c00d7e0 tx=0x7f649c00dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64a97fa640 1 -- 172.21.15.122:0/4288643824 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c018070 con 0x7f6498004d50 2024-09-17T06:04:38.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64a97fa640 1 -- 172.21.15.122:0/4288643824 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f649c0052e0 con 0x7f6498004d50 2024-09-17T06:04:38.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64b23b0640 1 -- 172.21.15.122:0/4288643824 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ac159da0 con 0x7f6498004d50 2024-09-17T06:04:38.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64a97fa640 1 -- 172.21.15.122:0/4288643824 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c00b920 con 0x7f6498004d50 2024-09-17T06:04:38.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64b23b0640 1 -- 172.21.15.122:0/4288643824 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ac1ee600 con 0x7f6498004d50 2024-09-17T06:04:38.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64b23b0640 1 -- 172.21.15.122:0/4288643824 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ac152540 con 0x7f6498004d50 2024-09-17T06:04:38.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.955+0000 7f64a97fa640 1 -- 172.21.15.122:0/4288643824 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f649c01b070 con 0x7f6498004d50 2024-09-17T06:04:38.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.959+0000 7f64a97fa640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f648c073200 0x7f648c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:38.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.959+0000 7f64a97fa640 1 -- 172.21.15.122:0/4288643824 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f649c094320 con 0x7f6498004d50 2024-09-17T06:04:38.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.959+0000 7f64a37fe640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f648c073200 0x7f648c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:38.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.959+0000 7f64a37fe640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f648c073200 0x7f648c075710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6494005fd0 tx=0x7f6494005ea0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:38.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:38.959+0000 7f64a97fa640 1 -- 172.21.15.122:0/4288643824 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f649c05eb20 con 0x7f6498004d50 2024-09-17T06:04:39.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.115+0000 7f64b23b0640 1 -- 172.21.15.122:0/4288643824 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64ac1e17b0 con 0x7f648c073200 2024-09-17T06:04:39.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.131+0000 7f64a97fa640 1 -- 172.21.15.122:0/4288643824 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332522 (secure 0 0 0) 0x7f64ac1e17b0 con 0x7f648c073200 2024-09-17T06:04:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:39.138 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:04:39.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.135+0000 7f64b23b0640 1 -- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f648c073200 msgr2=0x7f648c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:39.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.135+0000 7f64b23b0640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f648c073200 0x7f648c075710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6494005fd0 tx=0x7f6494005ea0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.135+0000 7f64b23b0640 1 -- 172.21.15.122:0/4288643824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6498004d50 msgr2=0x7f64ac1e1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:39.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.135+0000 7f64b23b0640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6498004d50 0x7f64ac1e1270 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f649c00d7e0 tx=0x7f649c00dca0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.135+0000 7f64b23b0640 1 -- 172.21.15.122:0/4288643824 shutdown_connections 2024-09-17T06:04:39.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.135+0000 7f64b23b0640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64ac1e3700 0x7f64ac146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.135+0000 7f64b23b0640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f648c073200 0x7f648c075710 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.135+0000 7f64b23b0640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64ac1eee00 0x7f64ac15a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.135+0000 7f64b23b0640 1 --2- 172.21.15.122:0/4288643824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6498004d50 0x7f64ac1e1270 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.135+0000 7f64b23b0640 1 -- 172.21.15.122:0/4288643824 >> 172.21.15.122:0/4288643824 conn(0x7f64ac0746d0 msgr2=0x7f64ac1564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:39.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.135+0000 7f64b23b0640 1 -- 172.21.15.122:0/4288643824 shutdown_connections 2024-09-17T06:04:39.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.135+0000 7f64b23b0640 1 -- 172.21.15.122:0/4288643824 wait complete. 2024-09-17T06:04:39.156 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-09-17T06:04:37.522972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219568,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755152,"statfs":{"total":773094113280,"available":772869275648,"internally_reserved":0,"allocated":3416064,"data_stored":2037216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005389"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827969+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:04:14.827969+0000","last_peered":"2024-09-17T06:04:14.827969+0000","last_clean":"2024-09-17T06:04:14.827969+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:04:14.827969+0000","last_undegraded":"2024-09-17T06:04:14.827969+0000","last_fullsized":"2024-09-17T06:04:14.827969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914314+0000","last_change":"2024-09-17T06:04:08.851488+0000","last_active":"2024-09-17T06:04:13.914314+0000","last_peered":"2024-09-17T06:04:13.914314+0000","last_clean":"2024-09-17T06:04:13.914314+0000","last_became_active":"2024-09-17T06:04:08.847345+0000","last_became_peered":"2024-09-17T06:04:08.847345+0000","last_unstale":"2024-09-17T06:04:13.914314+0000","last_undegraded":"2024-09-17T06:04:13.914314+0000","last_fullsized":"2024-09-17T06:04:13.914314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912954+0000","last_change":"2024-09-17T06:04:13.045049+0000","last_active":"2024-09-17T06:04:13.912954+0000","last_peered":"2024-09-17T06:04:13.912954+0000","last_clean":"2024-09-17T06:04:13.912954+0000","last_became_active":"2024-09-17T06:04:13.041321+0000","last_became_peered":"2024-09-17T06:04:13.041321+0000","last_unstale":"2024-09-17T06:04:13.912954+0000","last_undegraded":"2024-09-17T06:04:13.912954+0000","last_fullsized":"2024-09-17T06:04:13.912954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.500551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914545+0000","last_change":"2024-09-17T06:04:07.834691+0000","last_active":"2024-09-17T06:04:13.914545+0000","last_peered":"2024-09-17T06:04:13.914545+0000","last_clean":"2024-09-17T06:04:13.914545+0000","last_became_active":"2024-09-17T06:04:07.834110+0000","last_became_peered":"2024-09-17T06:04:07.834110+0000","last_unstale":"2024-09-17T06:04:13.914545+0000","last_undegraded":"2024-09-17T06:04:13.914545+0000","last_fullsized":"2024-09-17T06:04:13.914545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827140+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:04:14.827140+0000","last_peered":"2024-09-17T06:04:14.827140+0000","last_clean":"2024-09-17T06:04:14.827140+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:04:14.827140+0000","last_undegraded":"2024-09-17T06:04:14.827140+0000","last_fullsized":"2024-09-17T06:04:14.827140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915612+0000","last_change":"2024-09-17T06:04:12.954966+0000","last_active":"2024-09-17T06:04:13.915612+0000","last_peered":"2024-09-17T06:04:13.915612+0000","last_clean":"2024-09-17T06:04:13.915612+0000","last_became_active":"2024-09-17T06:04:12.953915+0000","last_became_peered":"2024-09-17T06:04:12.953915+0000","last_unstale":"2024-09-17T06:04:13.915612+0000","last_undegraded":"2024-09-17T06:04:13.915612+0000","last_fullsized":"2024-09-17T06:04:13.915612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:54.009189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826543+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:04:14.826543+0000","last_peered":"2024-09-17T06:04:14.826543+0000","last_clean":"2024-09-17T06:04:14.826543+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:04:14.826543+0000","last_undegraded":"2024-09-17T06:04:14.826543+0000","last_fullsized":"2024-09-17T06:04:14.826543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922620+0000","last_change":"2024-09-17T06:04:08.847869+0000","last_active":"2024-09-17T06:04:13.922620+0000","last_peered":"2024-09-17T06:04:13.922620+0000","last_clean":"2024-09-17T06:04:13.922620+0000","last_became_active":"2024-09-17T06:04:08.847475+0000","last_became_peered":"2024-09-17T06:04:08.847475+0000","last_unstale":"2024-09-17T06:04:13.922620+0000","last_undegraded":"2024-09-17T06:04:13.922620+0000","last_fullsized":"2024-09-17T06:04:13.922620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:54.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.917090+0000","last_change":"2024-09-17T06:04:12.948833+0000","last_active":"2024-09-17T06:04:13.917090+0000","last_peered":"2024-09-17T06:04:13.917090+0000","last_clean":"2024-09-17T06:04:13.917090+0000","last_became_active":"2024-09-17T06:04:12.947705+0000","last_became_peered":"2024-09-17T06:04:12.947705+0000","last_unstale":"2024-09-17T06:04:13.917090+0000","last_undegraded":"2024-09-17T06:04:13.917090+0000","last_fullsized":"2024-09-17T06:04:13.917090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:46.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826033+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:04:14.826033+0000","last_peered":"2024-09-17T06:04:14.826033+0000","last_clean":"2024-09-17T06:04:14.826033+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:04:14.826033+0000","last_undegraded":"2024-09-17T06:04:14.826033+0000","last_fullsized":"2024-09-17T06:04:14.826033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923681+0000","last_change":"2024-09-17T06:04:08.850056+0000","last_active":"2024-09-17T06:04:13.923681+0000","last_peered":"2024-09-17T06:04:13.923681+0000","last_clean":"2024-09-17T06:04:13.923681+0000","last_became_active":"2024-09-17T06:04:08.847436+0000","last_became_peered":"2024-09-17T06:04:08.847436+0000","last_unstale":"2024-09-17T06:04:13.923681+0000","last_undegraded":"2024-09-17T06:04:13.923681+0000","last_fullsized":"2024-09-17T06:04:13.923681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:29.069085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916255+0000","last_change":"2024-09-17T06:04:12.951144+0000","last_active":"2024-09-17T06:04:13.916255+0000","last_peered":"2024-09-17T06:04:13.916255+0000","last_clean":"2024-09-17T06:04:13.916255+0000","last_became_active":"2024-09-17T06:04:12.950127+0000","last_became_peered":"2024-09-17T06:04:12.950127+0000","last_unstale":"2024-09-17T06:04:13.916255+0000","last_undegraded":"2024-09-17T06:04:13.916255+0000","last_fullsized":"2024-09-17T06:04:13.916255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:52.901835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.753568+0000","last_change":"2024-09-17T06:04:08.847906+0000","last_active":"2024-09-17T06:04:14.753568+0000","last_peered":"2024-09-17T06:04:14.753568+0000","last_clean":"2024-09-17T06:04:14.753568+0000","last_became_active":"2024-09-17T06:04:08.847601+0000","last_became_peered":"2024-09-17T06:04:08.847601+0000","last_unstale":"2024-09-17T06:04:14.753568+0000","last_undegraded":"2024-09-17T06:04:14.753568+0000","last_fullsized":"2024-09-17T06:04:14.753568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826490+0000","last_change":"2024-09-17T06:04:07.851351+0000","last_active":"2024-09-17T06:04:14.826490+0000","last_peered":"2024-09-17T06:04:14.826490+0000","last_clean":"2024-09-17T06:04:14.826490+0000","last_became_active":"2024-09-17T06:04:07.850947+0000","last_became_peered":"2024-09-17T06:04:07.850947+0000","last_unstale":"2024-09-17T06:04:14.826490+0000","last_undegraded":"2024-09-17T06:04:14.826490+0000","last_fullsized":"2024-09-17T06:04:14.826490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:43.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919163+0000","last_change":"2024-09-17T06:04:12.936732+0000","last_active":"2024-09-17T06:04:13.919163+0000","last_peered":"2024-09-17T06:04:13.919163+0000","last_clean":"2024-09-17T06:04:13.919163+0000","last_became_active":"2024-09-17T06:04:12.935512+0000","last_became_peered":"2024-09-17T06:04:12.935512+0000","last_unstale":"2024-09-17T06:04:13.919163+0000","last_undegraded":"2024-09-17T06:04:13.919163+0000","last_fullsized":"2024-09-17T06:04:13.919163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915113+0000","last_change":"2024-09-17T06:04:08.847093+0000","last_active":"2024-09-17T06:04:13.915113+0000","last_peered":"2024-09-17T06:04:13.915113+0000","last_clean":"2024-09-17T06:04:13.915113+0000","last_became_active":"2024-09-17T06:04:08.846716+0000","last_became_peered":"2024-09-17T06:04:08.846716+0000","last_unstale":"2024-09-17T06:04:13.915113+0000","last_undegraded":"2024-09-17T06:04:13.915113+0000","last_fullsized":"2024-09-17T06:04:13.915113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557626+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:04:14.557626+0000","last_peered":"2024-09-17T06:04:14.557626+0000","last_clean":"2024-09-17T06:04:14.557626+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:04:14.557626+0000","last_undegraded":"2024-09-17T06:04:14.557626+0000","last_fullsized":"2024-09-17T06:04:14.557626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918420+0000","last_change":"2024-09-17T06:04:12.951796+0000","last_active":"2024-09-17T06:04:13.918420+0000","last_peered":"2024-09-17T06:04:13.918420+0000","last_clean":"2024-09-17T06:04:13.918420+0000","last_became_active":"2024-09-17T06:04:12.948211+0000","last_became_peered":"2024-09-17T06:04:12.948211+0000","last_unstale":"2024-09-17T06:04:13.918420+0000","last_undegraded":"2024-09-17T06:04:13.918420+0000","last_fullsized":"2024-09-17T06:04:13.918420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:43.869350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913781+0000","last_change":"2024-09-17T06:04:08.850212+0000","last_active":"2024-09-17T06:04:13.913781+0000","last_peered":"2024-09-17T06:04:13.913781+0000","last_clean":"2024-09-17T06:04:13.913781+0000","last_became_active":"2024-09-17T06:04:08.835906+0000","last_became_peered":"2024-09-17T06:04:08.835906+0000","last_unstale":"2024-09-17T06:04:13.913781+0000","last_undegraded":"2024-09-17T06:04:13.913781+0000","last_fullsized":"2024-09-17T06:04:13.913781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556835+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:04:14.556835+0000","last_peered":"2024-09-17T06:04:14.556835+0000","last_clean":"2024-09-17T06:04:14.556835+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:04:14.556835+0000","last_undegraded":"2024-09-17T06:04:14.556835+0000","last_fullsized":"2024-09-17T06:04:14.556835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558516+0000","last_change":"2024-09-17T06:04:13.048882+0000","last_active":"2024-09-17T06:04:14.558516+0000","last_peered":"2024-09-17T06:04:14.558516+0000","last_clean":"2024-09-17T06:04:14.558516+0000","last_became_active":"2024-09-17T06:04:13.047684+0000","last_became_peered":"2024-09-17T06:04:13.047684+0000","last_unstale":"2024-09-17T06:04:14.558516+0000","last_undegraded":"2024-09-17T06:04:14.558516+0000","last_fullsized":"2024-09-17T06:04:14.558516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:21.270772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916697+0000","last_change":"2024-09-17T06:04:08.838033+0000","last_active":"2024-09-17T06:04:13.916697+0000","last_peered":"2024-09-17T06:04:13.916697+0000","last_clean":"2024-09-17T06:04:13.916697+0000","last_became_active":"2024-09-17T06:04:08.836402+0000","last_became_peered":"2024-09-17T06:04:08.836402+0000","last_unstale":"2024-09-17T06:04:13.916697+0000","last_undegraded":"2024-09-17T06:04:13.916697+0000","last_fullsized":"2024-09-17T06:04:13.916697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:12.374198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825530+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:04:14.825530+0000","last_peered":"2024-09-17T06:04:14.825530+0000","last_clean":"2024-09-17T06:04:14.825530+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:04:14.825530+0000","last_undegraded":"2024-09-17T06:04:14.825530+0000","last_fullsized":"2024-09-17T06:04:14.825530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919390+0000","last_change":"2024-09-17T06:04:12.949288+0000","last_active":"2024-09-17T06:04:13.919390+0000","last_peered":"2024-09-17T06:04:13.919390+0000","last_clean":"2024-09-17T06:04:13.919390+0000","last_became_active":"2024-09-17T06:04:12.947997+0000","last_became_peered":"2024-09-17T06:04:12.947997+0000","last_unstale":"2024-09-17T06:04:13.919390+0000","last_undegraded":"2024-09-17T06:04:13.919390+0000","last_fullsized":"2024-09-17T06:04:13.919390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827729+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:04:14.827729+0000","last_peered":"2024-09-17T06:04:14.827729+0000","last_clean":"2024-09-17T06:04:14.827729+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:04:14.827729+0000","last_undegraded":"2024-09-17T06:04:14.827729+0000","last_fullsized":"2024-09-17T06:04:14.827729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755401+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:04:14.755401+0000","last_peered":"2024-09-17T06:04:14.755401+0000","last_clean":"2024-09-17T06:04:14.755401+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:04:14.755401+0000","last_undegraded":"2024-09-17T06:04:14.755401+0000","last_fullsized":"2024-09-17T06:04:14.755401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915706+0000","last_change":"2024-09-17T06:04:13.039804+0000","last_active":"2024-09-17T06:04:13.915706+0000","last_peered":"2024-09-17T06:04:13.915706+0000","last_clean":"2024-09-17T06:04:13.915706+0000","last_became_active":"2024-09-17T06:04:13.038212+0000","last_became_peered":"2024-09-17T06:04:13.038212+0000","last_unstale":"2024-09-17T06:04:13.915706+0000","last_undegraded":"2024-09-17T06:04:13.915706+0000","last_fullsized":"2024-09-17T06:04:13.915706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:35.798927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915606+0000","last_change":"2024-09-17T06:04:08.853353+0000","last_active":"2024-09-17T06:04:13.915606+0000","last_peered":"2024-09-17T06:04:13.915606+0000","last_clean":"2024-09-17T06:04:13.915606+0000","last_became_active":"2024-09-17T06:04:08.852015+0000","last_became_peered":"2024-09-17T06:04:08.852015+0000","last_unstale":"2024-09-17T06:04:13.915606+0000","last_undegraded":"2024-09-17T06:04:13.915606+0000","last_fullsized":"2024-09-17T06:04:13.915606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558240+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:04:14.558240+0000","last_peered":"2024-09-17T06:04:14.558240+0000","last_clean":"2024-09-17T06:04:14.558240+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:04:14.558240+0000","last_undegraded":"2024-09-17T06:04:14.558240+0000","last_fullsized":"2024-09-17T06:04:14.558240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912658+0000","last_change":"2024-09-17T06:04:13.034589+0000","last_active":"2024-09-17T06:04:13.912658+0000","last_peered":"2024-09-17T06:04:13.912658+0000","last_clean":"2024-09-17T06:04:13.912658+0000","last_became_active":"2024-09-17T06:04:13.034080+0000","last_became_peered":"2024-09-17T06:04:13.034080+0000","last_unstale":"2024-09-17T06:04:13.912658+0000","last_undegraded":"2024-09-17T06:04:13.912658+0000","last_fullsized":"2024-09-17T06:04:13.912658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:16.669822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557861+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:04:14.557861+0000","last_peered":"2024-09-17T06:04:14.557861+0000","last_clean":"2024-09-17T06:04:14.557861+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:04:14.557861+0000","last_undegraded":"2024-09-17T06:04:14.557861+0000","last_fullsized":"2024-09-17T06:04:14.557861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826908+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:04:14.826908+0000","last_peered":"2024-09-17T06:04:14.826908+0000","last_clean":"2024-09-17T06:04:14.826908+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:04:14.826908+0000","last_undegraded":"2024-09-17T06:04:14.826908+0000","last_fullsized":"2024-09-17T06:04:14.826908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826528+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:04:14.826528+0000","last_peered":"2024-09-17T06:04:14.826528+0000","last_clean":"2024-09-17T06:04:14.826528+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:04:14.826528+0000","last_undegraded":"2024-09-17T06:04:14.826528+0000","last_fullsized":"2024-09-17T06:04:14.826528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923885+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:04:13.923885+0000","last_peered":"2024-09-17T06:04:13.923885+0000","last_clean":"2024-09-17T06:04:13.923885+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:04:13.923885+0000","last_undegraded":"2024-09-17T06:04:13.923885+0000","last_fullsized":"2024-09-17T06:04:13.923885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558155+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:04:14.558155+0000","last_peered":"2024-09-17T06:04:14.558155+0000","last_clean":"2024-09-17T06:04:14.558155+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:04:14.558155+0000","last_undegraded":"2024-09-17T06:04:14.558155+0000","last_fullsized":"2024-09-17T06:04:14.558155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556865+0000","last_change":"2024-09-17T06:04:12.942301+0000","last_active":"2024-09-17T06:04:14.556865+0000","last_peered":"2024-09-17T06:04:14.556865+0000","last_clean":"2024-09-17T06:04:14.556865+0000","last_became_active":"2024-09-17T06:04:12.941640+0000","last_became_peered":"2024-09-17T06:04:12.941640+0000","last_unstale":"2024-09-17T06:04:14.556865+0000","last_undegraded":"2024-09-17T06:04:14.556865+0000","last_fullsized":"2024-09-17T06:04:14.556865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:31.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918736+0000","last_change":"2024-09-17T06:04:08.838642+0000","last_active":"2024-09-17T06:04:13.918736+0000","last_peered":"2024-09-17T06:04:13.918736+0000","last_clean":"2024-09-17T06:04:13.918736+0000","last_became_active":"2024-09-17T06:04:08.835562+0000","last_became_peered":"2024-09-17T06:04:08.835562+0000","last_unstale":"2024-09-17T06:04:13.918736+0000","last_undegraded":"2024-09-17T06:04:13.918736+0000","last_fullsized":"2024-09-17T06:04:13.918736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:16.900376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922711+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:04:13.922711+0000","last_peered":"2024-09-17T06:04:13.922711+0000","last_clean":"2024-09-17T06:04:13.922711+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:04:13.922711+0000","last_undegraded":"2024-09-17T06:04:13.922711+0000","last_fullsized":"2024-09-17T06:04:13.922711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557663+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:04:14.557663+0000","last_peered":"2024-09-17T06:04:14.557663+0000","last_clean":"2024-09-17T06:04:14.557663+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:04:14.557663+0000","last_undegraded":"2024-09-17T06:04:14.557663+0000","last_fullsized":"2024-09-17T06:04:14.557663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556896+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:04:14.556896+0000","last_peered":"2024-09-17T06:04:14.556896+0000","last_clean":"2024-09-17T06:04:14.556896+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:04:14.556896+0000","last_undegraded":"2024-09-17T06:04:14.556896+0000","last_fullsized":"2024-09-17T06:04:14.556896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824198+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:04:14.824198+0000","last_peered":"2024-09-17T06:04:14.824198+0000","last_clean":"2024-09-17T06:04:14.824198+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:04:14.824198+0000","last_undegraded":"2024-09-17T06:04:14.824198+0000","last_fullsized":"2024-09-17T06:04:14.824198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558517+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:04:14.558517+0000","last_peered":"2024-09-17T06:04:14.558517+0000","last_clean":"2024-09-17T06:04:14.558517+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:04:14.558517+0000","last_undegraded":"2024-09-17T06:04:14.558517+0000","last_fullsized":"2024-09-17T06:04:14.558517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826003+0000","last_change":"2024-09-17T06:04:08.840359+0000","last_active":"2024-09-17T06:04:14.826003+0000","last_peered":"2024-09-17T06:04:14.826003+0000","last_clean":"2024-09-17T06:04:14.826003+0000","last_became_active":"2024-09-17T06:04:08.839822+0000","last_became_peered":"2024-09-17T06:04:08.839822+0000","last_unstale":"2024-09-17T06:04:14.826003+0000","last_undegraded":"2024-09-17T06:04:14.826003+0000","last_fullsized":"2024-09-17T06:04:14.826003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825413+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:04:14.825413+0000","last_peered":"2024-09-17T06:04:14.825413+0000","last_clean":"2024-09-17T06:04:14.825413+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:04:14.825413+0000","last_undegraded":"2024-09-17T06:04:14.825413+0000","last_fullsized":"2024-09-17T06:04:14.825413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827476+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:04:14.827476+0000","last_peered":"2024-09-17T06:04:14.827476+0000","last_clean":"2024-09-17T06:04:14.827476+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:04:14.827476+0000","last_undegraded":"2024-09-17T06:04:14.827476+0000","last_fullsized":"2024-09-17T06:04:14.827476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913432+0000","last_change":"2024-09-17T06:04:08.846617+0000","last_active":"2024-09-17T06:04:13.913432+0000","last_peered":"2024-09-17T06:04:13.913432+0000","last_clean":"2024-09-17T06:04:13.913432+0000","last_became_active":"2024-09-17T06:04:08.837049+0000","last_became_peered":"2024-09-17T06:04:08.837049+0000","last_unstale":"2024-09-17T06:04:13.913432+0000","last_undegraded":"2024-09-17T06:04:13.913432+0000","last_fullsized":"2024-09-17T06:04:13.913432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923114+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:04:13.923114+0000","last_peered":"2024-09-17T06:04:13.923114+0000","last_clean":"2024-09-17T06:04:13.923114+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:04:13.923114+0000","last_undegraded":"2024-09-17T06:04:13.923114+0000","last_fullsized":"2024-09-17T06:04:13.923114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825786+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:04:14.825786+0000","last_peered":"2024-09-17T06:04:14.825786+0000","last_clean":"2024-09-17T06:04:14.825786+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:04:14.825786+0000","last_undegraded":"2024-09-17T06:04:14.825786+0000","last_fullsized":"2024-09-17T06:04:14.825786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754281+0000","last_change":"2024-09-17T06:04:13.042118+0000","last_active":"2024-09-17T06:04:14.754281+0000","last_peered":"2024-09-17T06:04:14.754281+0000","last_clean":"2024-09-17T06:04:14.754281+0000","last_became_active":"2024-09-17T06:04:13.040403+0000","last_became_peered":"2024-09-17T06:04:13.040403+0000","last_unstale":"2024-09-17T06:04:14.754281+0000","last_undegraded":"2024-09-17T06:04:14.754281+0000","last_fullsized":"2024-09-17T06:04:14.754281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826117+0000","last_change":"2024-09-17T06:04:08.838758+0000","last_active":"2024-09-17T06:04:14.826117+0000","last_peered":"2024-09-17T06:04:14.826117+0000","last_clean":"2024-09-17T06:04:14.826117+0000","last_became_active":"2024-09-17T06:04:08.838386+0000","last_became_peered":"2024-09-17T06:04:08.838386+0000","last_unstale":"2024-09-17T06:04:14.826117+0000","last_undegraded":"2024-09-17T06:04:14.826117+0000","last_fullsized":"2024-09-17T06:04:14.826117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:03.255963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824908+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:04:14.824908+0000","last_peered":"2024-09-17T06:04:14.824908+0000","last_clean":"2024-09-17T06:04:14.824908+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:04:14.824908+0000","last_undegraded":"2024-09-17T06:04:14.824908+0000","last_fullsized":"2024-09-17T06:04:14.824908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.753747+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:04:14.753747+0000","last_peered":"2024-09-17T06:04:14.753747+0000","last_clean":"2024-09-17T06:04:14.753747+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:04:14.753747+0000","last_undegraded":"2024-09-17T06:04:14.753747+0000","last_fullsized":"2024-09-17T06:04:14.753747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922776+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:04:13.922776+0000","last_peered":"2024-09-17T06:04:13.922776+0000","last_clean":"2024-09-17T06:04:13.922776+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:04:13.922776+0000","last_undegraded":"2024-09-17T06:04:13.922776+0000","last_fullsized":"2024-09-17T06:04:13.922776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558194+0000","last_change":"2024-09-17T06:04:07.833230+0000","last_active":"2024-09-17T06:04:14.558194+0000","last_peered":"2024-09-17T06:04:14.558194+0000","last_clean":"2024-09-17T06:04:14.558194+0000","last_became_active":"2024-09-17T06:04:07.832307+0000","last_became_peered":"2024-09-17T06:04:07.832307+0000","last_unstale":"2024-09-17T06:04:14.558194+0000","last_undegraded":"2024-09-17T06:04:14.558194+0000","last_fullsized":"2024-09-17T06:04:14.558194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:15.843465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826765+0000","last_change":"2024-09-17T06:04:12.934060+0000","last_active":"2024-09-17T06:04:14.826765+0000","last_peered":"2024-09-17T06:04:14.826765+0000","last_clean":"2024-09-17T06:04:14.826765+0000","last_became_active":"2024-09-17T06:04:12.933545+0000","last_became_peered":"2024-09-17T06:04:12.933545+0000","last_unstale":"2024-09-17T06:04:14.826765+0000","last_undegraded":"2024-09-17T06:04:14.826765+0000","last_fullsized":"2024-09-17T06:04:14.826765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:29.393815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827267+0000","last_change":"2024-09-17T06:04:08.851525+0000","last_active":"2024-09-17T06:04:14.827267+0000","last_peered":"2024-09-17T06:04:14.827267+0000","last_clean":"2024-09-17T06:04:14.827267+0000","last_became_active":"2024-09-17T06:04:08.851117+0000","last_became_peered":"2024-09-17T06:04:08.851117+0000","last_unstale":"2024-09-17T06:04:14.827267+0000","last_undegraded":"2024-09-17T06:04:14.827267+0000","last_fullsized":"2024-09-17T06:04:14.827267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:53.071703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825390+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:04:14.825390+0000","last_peered":"2024-09-17T06:04:14.825390+0000","last_clean":"2024-09-17T06:04:14.825390+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:04:14.825390+0000","last_undegraded":"2024-09-17T06:04:14.825390+0000","last_fullsized":"2024-09-17T06:04:14.825390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921808+0000","last_change":"2024-09-17T06:04:13.042590+0000","last_active":"2024-09-17T06:04:13.921808+0000","last_peered":"2024-09-17T06:04:13.921808+0000","last_clean":"2024-09-17T06:04:13.921808+0000","last_became_active":"2024-09-17T06:04:13.041078+0000","last_became_peered":"2024-09-17T06:04:13.041078+0000","last_unstale":"2024-09-17T06:04:13.921808+0000","last_undegraded":"2024-09-17T06:04:13.921808+0000","last_fullsized":"2024-09-17T06:04:13.921808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:59.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826490+0000","last_change":"2024-09-17T06:04:08.848046+0000","last_active":"2024-09-17T06:04:14.826490+0000","last_peered":"2024-09-17T06:04:14.826490+0000","last_clean":"2024-09-17T06:04:14.826490+0000","last_became_active":"2024-09-17T06:04:08.847664+0000","last_became_peered":"2024-09-17T06:04:08.847664+0000","last_unstale":"2024-09-17T06:04:14.826490+0000","last_undegraded":"2024-09-17T06:04:14.826490+0000","last_fullsized":"2024-09-17T06:04:14.826490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:12.579790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919451+0000","last_change":"2024-09-17T06:04:07.841655+0000","last_active":"2024-09-17T06:04:13.919451+0000","last_peered":"2024-09-17T06:04:13.919451+0000","last_clean":"2024-09-17T06:04:13.919451+0000","last_became_active":"2024-09-17T06:04:07.840432+0000","last_became_peered":"2024-09-17T06:04:07.840432+0000","last_unstale":"2024-09-17T06:04:13.919451+0000","last_undegraded":"2024-09-17T06:04:13.919451+0000","last_fullsized":"2024-09-17T06:04:13.919451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:04.523110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915435+0000","last_change":"2024-09-17T06:04:12.955760+0000","last_active":"2024-09-17T06:04:13.915435+0000","last_peered":"2024-09-17T06:04:13.915435+0000","last_clean":"2024-09-17T06:04:13.915435+0000","last_became_active":"2024-09-17T06:04:12.954977+0000","last_became_peered":"2024-09-17T06:04:12.954977+0000","last_unstale":"2024-09-17T06:04:13.915435+0000","last_undegraded":"2024-09-17T06:04:13.915435+0000","last_fullsized":"2024-09-17T06:04:13.915435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:19.737903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825704+0000","last_change":"2024-09-17T06:04:08.849143+0000","last_active":"2024-09-17T06:04:14.825704+0000","last_peered":"2024-09-17T06:04:14.825704+0000","last_clean":"2024-09-17T06:04:14.825704+0000","last_became_active":"2024-09-17T06:04:08.848740+0000","last_became_peered":"2024-09-17T06:04:08.848740+0000","last_unstale":"2024-09-17T06:04:14.825704+0000","last_undegraded":"2024-09-17T06:04:14.825704+0000","last_fullsized":"2024-09-17T06:04:14.825704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.823997+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:04:14.823997+0000","last_peered":"2024-09-17T06:04:14.823997+0000","last_clean":"2024-09-17T06:04:14.823997+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:04:14.823997+0000","last_undegraded":"2024-09-17T06:04:14.823997+0000","last_fullsized":"2024-09-17T06:04:14.823997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827071+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:04:14.827071+0000","last_peered":"2024-09-17T06:04:14.827071+0000","last_clean":"2024-09-17T06:04:14.827071+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:04:14.827071+0000","last_undegraded":"2024-09-17T06:04:14.827071+0000","last_fullsized":"2024-09-17T06:04:14.827071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754000+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:04:14.754000+0000","last_peered":"2024-09-17T06:04:14.754000+0000","last_clean":"2024-09-17T06:04:14.754000+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:04:14.754000+0000","last_undegraded":"2024-09-17T06:04:14.754000+0000","last_fullsized":"2024-09-17T06:04:14.754000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754133+0000","last_change":"2024-09-17T06:04:07.849633+0000","last_active":"2024-09-17T06:04:14.754133+0000","last_peered":"2024-09-17T06:04:14.754133+0000","last_clean":"2024-09-17T06:04:14.754133+0000","last_became_active":"2024-09-17T06:04:07.848323+0000","last_became_peered":"2024-09-17T06:04:07.848323+0000","last_unstale":"2024-09-17T06:04:14.754133+0000","last_undegraded":"2024-09-17T06:04:14.754133+0000","last_fullsized":"2024-09-17T06:04:14.754133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915247+0000","last_change":"2024-09-17T06:04:13.036889+0000","last_active":"2024-09-17T06:04:13.915247+0000","last_peered":"2024-09-17T06:04:13.915247+0000","last_clean":"2024-09-17T06:04:13.915247+0000","last_became_active":"2024-09-17T06:04:13.035428+0000","last_became_peered":"2024-09-17T06:04:13.035428+0000","last_unstale":"2024-09-17T06:04:13.915247+0000","last_undegraded":"2024-09-17T06:04:13.915247+0000","last_fullsized":"2024-09-17T06:04:13.915247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:00.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826148+0000","last_change":"2024-09-17T06:04:08.848113+0000","last_active":"2024-09-17T06:04:14.826148+0000","last_peered":"2024-09-17T06:04:14.826148+0000","last_clean":"2024-09-17T06:04:14.826148+0000","last_became_active":"2024-09-17T06:04:08.847695+0000","last_became_peered":"2024-09-17T06:04:08.847695+0000","last_unstale":"2024-09-17T06:04:14.826148+0000","last_undegraded":"2024-09-17T06:04:14.826148+0000","last_fullsized":"2024-09-17T06:04:14.826148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:21.258775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922496+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:04:13.922496+0000","last_peered":"2024-09-17T06:04:13.922496+0000","last_clean":"2024-09-17T06:04:13.922496+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:04:13.922496+0000","last_undegraded":"2024-09-17T06:04:13.922496+0000","last_fullsized":"2024-09-17T06:04:13.922496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914403+0000","last_change":"2024-09-17T06:04:13.034560+0000","last_active":"2024-09-17T06:04:13.914403+0000","last_peered":"2024-09-17T06:04:13.914403+0000","last_clean":"2024-09-17T06:04:13.914403+0000","last_became_active":"2024-09-17T06:04:13.034023+0000","last_became_peered":"2024-09-17T06:04:13.034023+0000","last_unstale":"2024-09-17T06:04:13.914403+0000","last_undegraded":"2024-09-17T06:04:13.914403+0000","last_fullsized":"2024-09-17T06:04:13.914403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:04.549375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826605+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:04:14.826605+0000","last_peered":"2024-09-17T06:04:14.826605+0000","last_clean":"2024-09-17T06:04:14.826605+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:04:14.826605+0000","last_undegraded":"2024-09-17T06:04:14.826605+0000","last_fullsized":"2024-09-17T06:04:14.826605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827133+0000","last_change":"2024-09-17T06:04:07.837797+0000","last_active":"2024-09-17T06:04:14.827133+0000","last_peered":"2024-09-17T06:04:14.827133+0000","last_clean":"2024-09-17T06:04:14.827133+0000","last_became_active":"2024-09-17T06:04:07.837347+0000","last_became_peered":"2024-09-17T06:04:07.837347+0000","last_unstale":"2024-09-17T06:04:14.827133+0000","last_undegraded":"2024-09-17T06:04:14.827133+0000","last_fullsized":"2024-09-17T06:04:14.827133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.924037+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:04:13.924037+0000","last_peered":"2024-09-17T06:04:13.924037+0000","last_clean":"2024-09-17T06:04:13.924037+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:04:13.924037+0000","last_undegraded":"2024-09-17T06:04:13.924037+0000","last_fullsized":"2024-09-17T06:04:13.924037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826129+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:04:14.826129+0000","last_peered":"2024-09-17T06:04:14.826129+0000","last_clean":"2024-09-17T06:04:14.826129+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:04:14.826129+0000","last_undegraded":"2024-09-17T06:04:14.826129+0000","last_fullsized":"2024-09-17T06:04:14.826129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:22.322334+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:04:22.322334+0000","last_peered":"2024-09-17T06:04:22.322334+0000","last_clean":"2024-09-17T06:04:22.322334+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:04:22.322334+0000","last_undegraded":"2024-09-17T06:04:22.322334+0000","last_fullsized":"2024-09-17T06:04:22.322334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557256+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:04:14.557256+0000","last_peered":"2024-09-17T06:04:14.557256+0000","last_clean":"2024-09-17T06:04:14.557256+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:04:14.557256+0000","last_undegraded":"2024-09-17T06:04:14.557256+0000","last_fullsized":"2024-09-17T06:04:14.557256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919279+0000","last_change":"2024-09-17T06:04:08.842243+0000","last_active":"2024-09-17T06:04:13.919279+0000","last_peered":"2024-09-17T06:04:13.919279+0000","last_clean":"2024-09-17T06:04:13.919279+0000","last_became_active":"2024-09-17T06:04:08.841831+0000","last_became_peered":"2024-09-17T06:04:08.841831+0000","last_unstale":"2024-09-17T06:04:13.919279+0000","last_undegraded":"2024-09-17T06:04:13.919279+0000","last_fullsized":"2024-09-17T06:04:13.919279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:47.589819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557915+0000","last_change":"2024-09-17T06:04:07.852382+0000","last_active":"2024-09-17T06:04:14.557915+0000","last_peered":"2024-09-17T06:04:14.557915+0000","last_clean":"2024-09-17T06:04:14.557915+0000","last_became_active":"2024-09-17T06:04:07.851954+0000","last_became_peered":"2024-09-17T06:04:07.851954+0000","last_unstale":"2024-09-17T06:04:14.557915+0000","last_undegraded":"2024-09-17T06:04:14.557915+0000","last_fullsized":"2024-09-17T06:04:14.557915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918024+0000","last_change":"2024-09-17T06:04:12.942425+0000","last_active":"2024-09-17T06:04:13.918024+0000","last_peered":"2024-09-17T06:04:13.918024+0000","last_clean":"2024-09-17T06:04:13.918024+0000","last_became_active":"2024-09-17T06:04:12.937463+0000","last_became_peered":"2024-09-17T06:04:12.937463+0000","last_unstale":"2024-09-17T06:04:13.918024+0000","last_undegraded":"2024-09-17T06:04:13.918024+0000","last_fullsized":"2024-09-17T06:04:13.918024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:21.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827689+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:04:14.827689+0000","last_peered":"2024-09-17T06:04:14.827689+0000","last_clean":"2024-09-17T06:04:14.827689+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:04:14.827689+0000","last_undegraded":"2024-09-17T06:04:14.827689+0000","last_fullsized":"2024-09-17T06:04:14.827689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922956+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:04:13.922956+0000","last_peered":"2024-09-17T06:04:13.922956+0000","last_clean":"2024-09-17T06:04:13.922956+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:04:13.922956+0000","last_undegraded":"2024-09-17T06:04:13.922956+0000","last_fullsized":"2024-09-17T06:04:13.922956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913193+0000","last_change":"2024-09-17T06:04:12.956822+0000","last_active":"2024-09-17T06:04:13.913193+0000","last_peered":"2024-09-17T06:04:13.913193+0000","last_clean":"2024-09-17T06:04:13.913193+0000","last_became_active":"2024-09-17T06:04:12.956349+0000","last_became_peered":"2024-09-17T06:04:12.956349+0000","last_unstale":"2024-09-17T06:04:13.913193+0000","last_undegraded":"2024-09-17T06:04:13.913193+0000","last_fullsized":"2024-09-17T06:04:13.913193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:56.435215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922611+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:04:13.922611+0000","last_peered":"2024-09-17T06:04:13.922611+0000","last_clean":"2024-09-17T06:04:13.922611+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:04:13.922611+0000","last_undegraded":"2024-09-17T06:04:13.922611+0000","last_fullsized":"2024-09-17T06:04:13.922611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755152+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:04:14.755152+0000","last_peered":"2024-09-17T06:04:14.755152+0000","last_clean":"2024-09-17T06:04:14.755152+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:04:14.755152+0000","last_undegraded":"2024-09-17T06:04:14.755152+0000","last_fullsized":"2024-09-17T06:04:14.755152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913592+0000","last_change":"2024-09-17T06:04:13.043905+0000","last_active":"2024-09-17T06:04:13.913592+0000","last_peered":"2024-09-17T06:04:13.913592+0000","last_clean":"2024-09-17T06:04:13.913592+0000","last_became_active":"2024-09-17T06:04:13.041929+0000","last_became_peered":"2024-09-17T06:04:13.041929+0000","last_unstale":"2024-09-17T06:04:13.913592+0000","last_undegraded":"2024-09-17T06:04:13.913592+0000","last_fullsized":"2024-09-17T06:04:13.913592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:07.693245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827124+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:04:14.827124+0000","last_peered":"2024-09-17T06:04:14.827124+0000","last_clean":"2024-09-17T06:04:14.827124+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:04:14.827124+0000","last_undegraded":"2024-09-17T06:04:14.827124+0000","last_fullsized":"2024-09-17T06:04:14.827124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556560+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:04:14.556560+0000","last_peered":"2024-09-17T06:04:14.556560+0000","last_clean":"2024-09-17T06:04:14.556560+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:04:14.556560+0000","last_undegraded":"2024-09-17T06:04:14.556560+0000","last_fullsized":"2024-09-17T06:04:14.556560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921998+0000","last_change":"2024-09-17T06:04:07.857398+0000","last_active":"2024-09-17T06:04:13.921998+0000","last_peered":"2024-09-17T06:04:13.921998+0000","last_clean":"2024-09-17T06:04:13.921998+0000","last_became_active":"2024-09-17T06:04:07.856866+0000","last_became_peered":"2024-09-17T06:04:07.856866+0000","last_unstale":"2024-09-17T06:04:13.921998+0000","last_undegraded":"2024-09-17T06:04:13.921998+0000","last_fullsized":"2024-09-17T06:04:13.921998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754760+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:04:14.754760+0000","last_peered":"2024-09-17T06:04:14.754760+0000","last_clean":"2024-09-17T06:04:14.754760+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:04:14.754760+0000","last_undegraded":"2024-09-17T06:04:14.754760+0000","last_fullsized":"2024-09-17T06:04:14.754760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913448+0000","last_change":"2024-09-17T06:04:08.850811+0000","last_active":"2024-09-17T06:04:13.913448+0000","last_peered":"2024-09-17T06:04:13.913448+0000","last_clean":"2024-09-17T06:04:13.913448+0000","last_became_active":"2024-09-17T06:04:08.847235+0000","last_became_peered":"2024-09-17T06:04:08.847235+0000","last_unstale":"2024-09-17T06:04:13.913448+0000","last_undegraded":"2024-09-17T06:04:13.913448+0000","last_fullsized":"2024-09-17T06:04:13.913448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:21.794733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913694+0000","last_change":"2024-09-17T06:04:07.840224+0000","last_active":"2024-09-17T06:04:13.913694+0000","last_peered":"2024-09-17T06:04:13.913694+0000","last_clean":"2024-09-17T06:04:13.913694+0000","last_became_active":"2024-09-17T06:04:07.839703+0000","last_became_peered":"2024-09-17T06:04:07.839703+0000","last_unstale":"2024-09-17T06:04:13.913694+0000","last_undegraded":"2024-09-17T06:04:13.913694+0000","last_fullsized":"2024-09-17T06:04:13.913694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:01.141166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755032+0000","last_change":"2024-09-17T06:04:07.844255+0000","last_active":"2024-09-17T06:04:14.755032+0000","last_peered":"2024-09-17T06:04:14.755032+0000","last_clean":"2024-09-17T06:04:14.755032+0000","last_became_active":"2024-09-17T06:04:07.843380+0000","last_became_peered":"2024-09-17T06:04:07.843380+0000","last_unstale":"2024-09-17T06:04:14.755032+0000","last_undegraded":"2024-09-17T06:04:14.755032+0000","last_fullsized":"2024-09-17T06:04:14.755032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:28.720792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827019+0000","last_change":"2024-09-17T06:04:08.837656+0000","last_active":"2024-09-17T06:04:14.827019+0000","last_peered":"2024-09-17T06:04:14.827019+0000","last_clean":"2024-09-17T06:04:14.827019+0000","last_became_active":"2024-09-17T06:04:08.837157+0000","last_became_peered":"2024-09-17T06:04:08.837157+0000","last_unstale":"2024-09-17T06:04:14.827019+0000","last_undegraded":"2024-09-17T06:04:14.827019+0000","last_fullsized":"2024-09-17T06:04:14.827019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824605+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:04:14.824605+0000","last_peered":"2024-09-17T06:04:14.824605+0000","last_clean":"2024-09-17T06:04:14.824605+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:04:14.824605+0000","last_undegraded":"2024-09-17T06:04:14.824605+0000","last_fullsized":"2024-09-17T06:04:14.824605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915126+0000","last_change":"2024-09-17T06:04:07.848422+0000","last_active":"2024-09-17T06:04:13.915126+0000","last_peered":"2024-09-17T06:04:13.915126+0000","last_clean":"2024-09-17T06:04:13.915126+0000","last_became_active":"2024-09-17T06:04:07.847917+0000","last_became_peered":"2024-09-17T06:04:07.847917+0000","last_unstale":"2024-09-17T06:04:13.915126+0000","last_undegraded":"2024-09-17T06:04:13.915126+0000","last_fullsized":"2024-09-17T06:04:13.915126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:04.960985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916415+0000","last_change":"2024-09-17T06:04:08.831009+0000","last_active":"2024-09-17T06:04:13.916415+0000","last_peered":"2024-09-17T06:04:13.916415+0000","last_clean":"2024-09-17T06:04:13.916415+0000","last_became_active":"2024-09-17T06:04:08.830578+0000","last_became_peered":"2024-09-17T06:04:08.830578+0000","last_unstale":"2024-09-17T06:04:13.916415+0000","last_undegraded":"2024-09-17T06:04:13.916415+0000","last_fullsized":"2024-09-17T06:04:13.916415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:21.761554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914674+0000","last_change":"2024-09-17T06:04:12.953383+0000","last_active":"2024-09-17T06:04:13.914674+0000","last_peered":"2024-09-17T06:04:13.914674+0000","last_clean":"2024-09-17T06:04:13.914674+0000","last_became_active":"2024-09-17T06:04:12.952849+0000","last_became_peered":"2024-09-17T06:04:12.952849+0000","last_unstale":"2024-09-17T06:04:13.914674+0000","last_undegraded":"2024-09-17T06:04:13.914674+0000","last_fullsized":"2024-09-17T06:04:13.914674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:01.588798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754494+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:04:14.754494+0000","last_peered":"2024-09-17T06:04:14.754494+0000","last_clean":"2024-09-17T06:04:14.754494+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:04:14.754494+0000","last_undegraded":"2024-09-17T06:04:14.754494+0000","last_fullsized":"2024-09-17T06:04:14.754494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824042+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:04:14.824042+0000","last_peered":"2024-09-17T06:04:14.824042+0000","last_clean":"2024-09-17T06:04:14.824042+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:04:14.824042+0000","last_undegraded":"2024-09-17T06:04:14.824042+0000","last_fullsized":"2024-09-17T06:04:14.824042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922377+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:04:13.922377+0000","last_peered":"2024-09-17T06:04:13.922377+0000","last_clean":"2024-09-17T06:04:13.922377+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:04:13.922377+0000","last_undegraded":"2024-09-17T06:04:13.922377+0000","last_fullsized":"2024-09-17T06:04:13.922377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826836+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:04:14.826836+0000","last_peered":"2024-09-17T06:04:14.826836+0000","last_clean":"2024-09-17T06:04:14.826836+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:04:14.826836+0000","last_undegraded":"2024-09-17T06:04:14.826836+0000","last_fullsized":"2024-09-17T06:04:14.826836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914912+0000","last_change":"2024-09-17T06:04:08.853837+0000","last_active":"2024-09-17T06:04:13.914912+0000","last_peered":"2024-09-17T06:04:13.914912+0000","last_clean":"2024-09-17T06:04:13.914912+0000","last_became_active":"2024-09-17T06:04:08.847311+0000","last_became_peered":"2024-09-17T06:04:08.847311+0000","last_unstale":"2024-09-17T06:04:13.914912+0000","last_undegraded":"2024-09-17T06:04:13.914912+0000","last_fullsized":"2024-09-17T06:04:13.914912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:39.705332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557384+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:04:14.557384+0000","last_peered":"2024-09-17T06:04:14.557384+0000","last_clean":"2024-09-17T06:04:14.557384+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:04:14.557384+0000","last_undegraded":"2024-09-17T06:04:14.557384+0000","last_fullsized":"2024-09-17T06:04:14.557384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755114+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:04:14.755114+0000","last_peered":"2024-09-17T06:04:14.755114+0000","last_clean":"2024-09-17T06:04:14.755114+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:04:14.755114+0000","last_undegraded":"2024-09-17T06:04:14.755114+0000","last_fullsized":"2024-09-17T06:04:14.755114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915505+0000","last_change":"2024-09-17T06:04:08.847264+0000","last_active":"2024-09-17T06:04:13.915505+0000","last_peered":"2024-09-17T06:04:13.915505+0000","last_clean":"2024-09-17T06:04:13.915505+0000","last_became_active":"2024-09-17T06:04:08.846741+0000","last_became_peered":"2024-09-17T06:04:08.846741+0000","last_unstale":"2024-09-17T06:04:13.915505+0000","last_undegraded":"2024-09-17T06:04:13.915505+0000","last_fullsized":"2024-09-17T06:04:13.915505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921907+0000","last_change":"2024-09-17T06:04:08.856656+0000","last_active":"2024-09-17T06:04:13.921907+0000","last_peered":"2024-09-17T06:04:13.921907+0000","last_clean":"2024-09-17T06:04:13.921907+0000","last_became_active":"2024-09-17T06:04:08.855496+0000","last_became_peered":"2024-09-17T06:04:08.855496+0000","last_unstale":"2024-09-17T06:04:13.921907+0000","last_undegraded":"2024-09-17T06:04:13.921907+0000","last_fullsized":"2024-09-17T06:04:13.921907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913105+0000","last_change":"2024-09-17T06:04:08.851245+0000","last_active":"2024-09-17T06:04:13.913105+0000","last_peered":"2024-09-17T06:04:13.913105+0000","last_clean":"2024-09-17T06:04:13.913105+0000","last_became_active":"2024-09-17T06:04:08.847488+0000","last_became_peered":"2024-09-17T06:04:08.847488+0000","last_unstale":"2024-09-17T06:04:13.913105+0000","last_undegraded":"2024-09-17T06:04:13.913105+0000","last_fullsized":"2024-09-17T06:04:13.913105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922140+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:04:13.922140+0000","last_peered":"2024-09-17T06:04:13.922140+0000","last_clean":"2024-09-17T06:04:13.922140+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:04:13.922140+0000","last_undegraded":"2024-09-17T06:04:13.922140+0000","last_fullsized":"2024-09-17T06:04:13.922140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826398+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:04:14.826398+0000","last_peered":"2024-09-17T06:04:14.826398+0000","last_clean":"2024-09-17T06:04:14.826398+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:04:14.826398+0000","last_undegraded":"2024-09-17T06:04:14.826398+0000","last_fullsized":"2024-09-17T06:04:14.826398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754421+0000","last_change":"2024-09-17T06:04:08.847877+0000","last_active":"2024-09-17T06:04:14.754421+0000","last_peered":"2024-09-17T06:04:14.754421+0000","last_clean":"2024-09-17T06:04:14.754421+0000","last_became_active":"2024-09-17T06:04:08.847538+0000","last_became_peered":"2024-09-17T06:04:08.847538+0000","last_unstale":"2024-09-17T06:04:14.754421+0000","last_undegraded":"2024-09-17T06:04:14.754421+0000","last_fullsized":"2024-09-17T06:04:14.754421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826750+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:04:14.826750+0000","last_peered":"2024-09-17T06:04:14.826750+0000","last_clean":"2024-09-17T06:04:14.826750+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:04:14.826750+0000","last_undegraded":"2024-09-17T06:04:14.826750+0000","last_fullsized":"2024-09-17T06:04:14.826750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825216+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:04:14.825216+0000","last_peered":"2024-09-17T06:04:14.825216+0000","last_clean":"2024-09-17T06:04:14.825216+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:04:14.825216+0000","last_undegraded":"2024-09-17T06:04:14.825216+0000","last_fullsized":"2024-09-17T06:04:14.825216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923600+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:04:13.923600+0000","last_peered":"2024-09-17T06:04:13.923600+0000","last_clean":"2024-09-17T06:04:13.923600+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:04:13.923600+0000","last_undegraded":"2024-09-17T06:04:13.923600+0000","last_fullsized":"2024-09-17T06:04:13.923600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921566+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:04:13.921566+0000","last_peered":"2024-09-17T06:04:13.921566+0000","last_clean":"2024-09-17T06:04:13.921566+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:04:13.921566+0000","last_undegraded":"2024-09-17T06:04:13.921566+0000","last_fullsized":"2024-09-17T06:04:13.921566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556805+0000","last_change":"2024-09-17T06:04:08.824718+0000","last_active":"2024-09-17T06:04:14.556805+0000","last_peered":"2024-09-17T06:04:14.556805+0000","last_clean":"2024-09-17T06:04:14.556805+0000","last_became_active":"2024-09-17T06:04:08.823771+0000","last_became_peered":"2024-09-17T06:04:08.823771+0000","last_unstale":"2024-09-17T06:04:14.556805+0000","last_undegraded":"2024-09-17T06:04:14.556805+0000","last_fullsized":"2024-09-17T06:04:14.556805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:53.735092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826605+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:04:14.826605+0000","last_peered":"2024-09-17T06:04:14.826605+0000","last_clean":"2024-09-17T06:04:14.826605+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:04:14.826605+0000","last_undegraded":"2024-09-17T06:04:14.826605+0000","last_fullsized":"2024-09-17T06:04:14.826605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914823+0000","last_change":"2024-09-17T06:04:08.850255+0000","last_active":"2024-09-17T06:04:13.914823+0000","last_peered":"2024-09-17T06:04:13.914823+0000","last_clean":"2024-09-17T06:04:13.914823+0000","last_became_active":"2024-09-17T06:04:08.847637+0000","last_became_peered":"2024-09-17T06:04:08.847637+0000","last_unstale":"2024-09-17T06:04:13.914823+0000","last_undegraded":"2024-09-17T06:04:13.914823+0000","last_fullsized":"2024-09-17T06:04:13.914823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919159+0000","last_change":"2024-09-17T06:04:08.845829+0000","last_active":"2024-09-17T06:04:13.919159+0000","last_peered":"2024-09-17T06:04:13.919159+0000","last_clean":"2024-09-17T06:04:13.919159+0000","last_became_active":"2024-09-17T06:04:08.845441+0000","last_became_peered":"2024-09-17T06:04:08.845441+0000","last_unstale":"2024-09-17T06:04:13.919159+0000","last_undegraded":"2024-09-17T06:04:13.919159+0000","last_fullsized":"2024-09-17T06:04:13.919159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:38.878124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754889+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:04:14.754889+0000","last_peered":"2024-09-17T06:04:14.754889+0000","last_clean":"2024-09-17T06:04:14.754889+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:04:14.754889+0000","last_undegraded":"2024-09-17T06:04:14.754889+0000","last_fullsized":"2024-09-17T06:04:14.754889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755103+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:04:14.755103+0000","last_peered":"2024-09-17T06:04:14.755103+0000","last_clean":"2024-09-17T06:04:14.755103+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:04:14.755103+0000","last_undegraded":"2024-09-17T06:04:14.755103+0000","last_fullsized":"2024-09-17T06:04:14.755103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827068+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:04:14.827068+0000","last_peered":"2024-09-17T06:04:14.827068+0000","last_clean":"2024-09-17T06:04:14.827068+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:04:14.827068+0000","last_undegraded":"2024-09-17T06:04:14.827068+0000","last_fullsized":"2024-09-17T06:04:14.827068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912650+0000","last_change":"2024-09-17T06:04:08.853473+0000","last_active":"2024-09-17T06:04:13.912650+0000","last_peered":"2024-09-17T06:04:13.912650+0000","last_clean":"2024-09-17T06:04:13.912650+0000","last_became_active":"2024-09-17T06:04:08.851946+0000","last_became_peered":"2024-09-17T06:04:08.851946+0000","last_unstale":"2024-09-17T06:04:13.912650+0000","last_undegraded":"2024-09-17T06:04:13.912650+0000","last_fullsized":"2024-09-17T06:04:13.912650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825436+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:04:14.825436+0000","last_peered":"2024-09-17T06:04:14.825436+0000","last_clean":"2024-09-17T06:04:14.825436+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:04:14.825436+0000","last_undegraded":"2024-09-17T06:04:14.825436+0000","last_fullsized":"2024-09-17T06:04:14.825436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921983+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:04:13.921983+0000","last_peered":"2024-09-17T06:04:13.921983+0000","last_clean":"2024-09-17T06:04:13.921983+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:04:13.921983+0000","last_undegraded":"2024-09-17T06:04:13.921983+0000","last_fullsized":"2024-09-17T06:04:13.921983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825723+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:04:14.825723+0000","last_peered":"2024-09-17T06:04:14.825723+0000","last_clean":"2024-09-17T06:04:14.825723+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:04:14.825723+0000","last_undegraded":"2024-09-17T06:04:14.825723+0000","last_fullsized":"2024-09-17T06:04:14.825723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922399+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:04:13.922399+0000","last_peered":"2024-09-17T06:04:13.922399+0000","last_clean":"2024-09-17T06:04:13.922399+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:04:13.922399+0000","last_undegraded":"2024-09-17T06:04:13.922399+0000","last_fullsized":"2024-09-17T06:04:13.922399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825947+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:04:14.825947+0000","last_peered":"2024-09-17T06:04:14.825947+0000","last_clean":"2024-09-17T06:04:14.825947+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:04:14.825947+0000","last_undegraded":"2024-09-17T06:04:14.825947+0000","last_fullsized":"2024-09-17T06:04:14.825947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558186+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:04:14.558186+0000","last_peered":"2024-09-17T06:04:14.558186+0000","last_clean":"2024-09-17T06:04:14.558186+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:04:14.558186+0000","last_undegraded":"2024-09-17T06:04:14.558186+0000","last_fullsized":"2024-09-17T06:04:14.558186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826777+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:04:14.826777+0000","last_peered":"2024-09-17T06:04:14.826777+0000","last_clean":"2024-09-17T06:04:14.826777+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:04:14.826777+0000","last_undegraded":"2024-09-17T06:04:14.826777+0000","last_fullsized":"2024-09-17T06:04:14.826777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":876544,"data_stored":696906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":106060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":105990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:04:39.161 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T06:04:39.161 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T06:04:39.161 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T06:04:39.161 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T06:04:39.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.339+0000 7fefc994a640 1 -- 172.21.15.122:0/1643605372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc406dfa0 msgr2=0x7fefc40b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:39.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.339+0000 7fefc994a640 1 --2- 172.21.15.122:0/1643605372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc406dfa0 0x7fefc40b2fb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fefc406ecb0 tx=0x7fefbc01f580 comp rx=0 tx=0).stop 2024-09-17T06:04:39.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.339+0000 7fefc994a640 1 -- 172.21.15.122:0/1643605372 shutdown_connections 2024-09-17T06:04:39.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.339+0000 7fefc994a640 1 --2- 172.21.15.122:0/1643605372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc406dfa0 0x7fefc40b2fb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.339+0000 7fefc994a640 1 --2- 172.21.15.122:0/1643605372 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefc4152670 0x7fefc40b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.339+0000 7fefc994a640 1 --2- 172.21.15.122:0/1643605372 >> v2:172.21.15.173:3300/0 conn(0x7fefc4068db0 0x7fefc4152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.339+0000 7fefc994a640 1 -- 172.21.15.122:0/1643605372 >> 172.21.15.122:0/1643605372 conn(0x7fefc40c9af0 msgr2=0x7fefc40c9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:39.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.339+0000 7fefc994a640 1 -- 172.21.15.122:0/1643605372 shutdown_connections 2024-09-17T06:04:39.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.339+0000 7fefc994a640 1 -- 172.21.15.122:0/1643605372 wait complete. 2024-09-17T06:04:39.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc994a640 1 Processor -- start 2024-09-17T06:04:39.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc994a640 1 -- start start 2024-09-17T06:04:39.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc994a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc4068db0 0x7fefc40c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:39.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc994a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefc406dfa0 0x7fefc40c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:39.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc994a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefc4152670 0x7fefc40c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:39.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc994a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fefc40c2b80 con 0x7fefc4068db0 2024-09-17T06:04:39.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc994a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fefc4159010 con 0x7fefc4152670 2024-09-17T06:04:39.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc994a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fefc40c2d00 con 0x7fefc406dfa0 2024-09-17T06:04:39.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc4068db0 0x7fefc40c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:39.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc4068db0 0x7fefc40c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49538/0 (socket says 172.21.15.122:49538) 2024-09-17T06:04:39.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc2ffd640 1 -- 172.21.15.122:0/296171309 learned_addr learned my addr 172.21.15.122:0/296171309 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:39.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc37fe640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefc4152670 0x7fefc40c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:39.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc2ffd640 1 -- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefc406dfa0 msgr2=0x7fefc40c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefba7fc640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefc406dfa0 0x7fefc40c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc2ffd640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefc406dfa0 0x7fefc40c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc2ffd640 1 -- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefc4152670 msgr2=0x7fefc40c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc2ffd640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefc4152670 0x7fefc40c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc2ffd640 1 -- 172.21.15.122:0/296171309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc40cc660 con 0x7fefc4068db0 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc37fe640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefc4152670 0x7fefc40c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc2ffd640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc4068db0 0x7fefc40c8af0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fefb400d6d0 tx=0x7fefb400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc0ff9640 1 -- 172.21.15.122:0/296171309 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb4017070 con 0x7fefc4068db0 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc0ff9640 1 -- 172.21.15.122:0/296171309 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefb4004310 con 0x7fefc4068db0 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc994a640 1 -- 172.21.15.122:0/296171309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc40c7cd0 con 0x7fefc4068db0 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc0ff9640 1 -- 172.21.15.122:0/296171309 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb4005280 con 0x7fefc4068db0 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc994a640 1 -- 172.21.15.122:0/296171309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc41efc10 con 0x7fefc4068db0 2024-09-17T06:04:39.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.343+0000 7fefc994a640 1 -- 172.21.15.122:0/296171309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefc4152130 con 0x7fefc4068db0 2024-09-17T06:04:39.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.347+0000 7fefc0ff9640 1 -- 172.21.15.122:0/296171309 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fefb4005420 con 0x7fefc4068db0 2024-09-17T06:04:39.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.347+0000 7fefc0ff9640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fefa4073200 0x7fefa4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:39.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.347+0000 7fefc0ff9640 1 -- 172.21.15.122:0/296171309 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fefb40948a0 con 0x7fefc4068db0 2024-09-17T06:04:39.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.347+0000 7fefba7fc640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fefa4073200 0x7fefa4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:39.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.347+0000 7fefba7fc640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fefa4073200 0x7fefa4075710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fefac0058d0 tx=0x7fefac005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:39.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.351+0000 7fefc0ff9640 1 -- 172.21.15.122:0/296171309 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fefb4020020 con 0x7fefc4068db0 2024-09-17T06:04:39.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 -- 172.21.15.122:0/296171309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fefc4069390 con 0x7fefc4068db0 2024-09-17T06:04:39.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc0ff9640 1 -- 172.21.15.122:0/296171309 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fefb405f6a0 con 0x7fefc4068db0 2024-09-17T06:04:39.545 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:39.545 INFO:teuthology.orchestra.run.smithi122.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T06:04:39.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 -- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fefa4073200 msgr2=0x7fefa4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:39.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fefa4073200 0x7fefa4075710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fefac0058d0 tx=0x7fefac005860 comp rx=0 tx=0).stop 2024-09-17T06:04:39.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 -- 172.21.15.122:0/296171309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc4068db0 msgr2=0x7fefc40c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:39.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc4068db0 0x7fefc40c8af0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fefb400d6d0 tx=0x7fefb400db90 comp rx=0 tx=0).stop 2024-09-17T06:04:39.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 -- 172.21.15.122:0/296171309 shutdown_connections 2024-09-17T06:04:39.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fefa4073200 0x7fefa4075710 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefc4152670 0x7fefc40c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefc406dfa0 0x7fefc40c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 --2- 172.21.15.122:0/296171309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc4068db0 0x7fefc40c8af0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 -- 172.21.15.122:0/296171309 >> 172.21.15.122:0/296171309 conn(0x7fefc40c9af0 msgr2=0x7fefc4157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:39.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 -- 172.21.15.122:0/296171309 shutdown_connections 2024-09-17T06:04:39.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.543+0000 7fefc994a640 1 -- 172.21.15.122:0/296171309 wait complete. 2024-09-17T06:04:39.566 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T06:04:39.566 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T06:04:39.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.703+0000 7fd849eb2640 1 -- 172.21.15.122:0/3257403480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd844151990 msgr2=0x7fd8440c2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:39.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.703+0000 7fd849eb2640 1 --2- 172.21.15.122:0/3257403480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd844151990 0x7fd8440c2080 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd838009840 tx=0x7fd83801f010 comp rx=0 tx=0).stop 2024-09-17T06:04:39.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.703+0000 7fd849eb2640 1 -- 172.21.15.122:0/3257403480 shutdown_connections 2024-09-17T06:04:39.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.703+0000 7fd849eb2640 1 --2- 172.21.15.122:0/3257403480 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8440c25c0 0x7fd8440c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.703+0000 7fd849eb2640 1 --2- 172.21.15.122:0/3257403480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd844151990 0x7fd8440c2080 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.703+0000 7fd849eb2640 1 -- 172.21.15.122:0/3257403480 >> 172.21.15.122:0/3257403480 conn(0x7fd8440cd060 msgr2=0x7fd8440cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:39.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.703+0000 7fd849eb2640 1 -- 172.21.15.122:0/3257403480 shutdown_connections 2024-09-17T06:04:39.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.703+0000 7fd849eb2640 1 -- 172.21.15.122:0/3257403480 wait complete. 2024-09-17T06:04:39.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.703+0000 7fd849eb2640 1 Processor -- start 2024-09-17T06:04:39.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.703+0000 7fd849eb2640 1 -- start start 2024-09-17T06:04:39.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.703+0000 7fd849eb2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8440c25c0 0x7fd8440c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:39.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.703+0000 7fd849eb2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8440c7a60 0x7fd844146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:39.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd849eb2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd844151990 0x7fd8440c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:39.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd849eb2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd8440c4220 con 0x7fd844151990 2024-09-17T06:04:39.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd849eb2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd8440c40a0 con 0x7fd8440c7a60 2024-09-17T06:04:39.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd849eb2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd844151da0 con 0x7fd8440c25c0 2024-09-17T06:04:39.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd843fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd844151990 0x7fd8440c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:39.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd843fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd844151990 0x7fd8440c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49554/0 (socket says 172.21.15.122:49554) 2024-09-17T06:04:39.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd843fff640 1 -- 172.21.15.122:0/3678562036 learned_addr learned my addr 172.21.15.122:0/3678562036 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:39.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd842ffd640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8440c7a60 0x7fd844146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:39.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd8437fe640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8440c25c0 0x7fd8440c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:39.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd843fff640 1 -- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8440c25c0 msgr2=0x7fd8440c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:39.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd843fff640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8440c25c0 0x7fd8440c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd843fff640 1 -- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8440c7a60 msgr2=0x7fd844146040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:39.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd843fff640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8440c7a60 0x7fd844146040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd843fff640 1 -- 172.21.15.122:0/3678562036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8440c4c80 con 0x7fd844151990 2024-09-17T06:04:39.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd843fff640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd844151990 0x7fd8440c5cf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00cae0 tx=0x7fd83c00a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:39.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd82bfff640 1 -- 172.21.15.122:0/3678562036 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00ae30 con 0x7fd844151990 2024-09-17T06:04:39.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd82bfff640 1 -- 172.21.15.122:0/3678562036 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd83c00f560 con 0x7fd844151990 2024-09-17T06:04:39.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd849eb2640 1 -- 172.21.15.122:0/3678562036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8441f01b0 con 0x7fd844151990 2024-09-17T06:04:39.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd82bfff640 1 -- 172.21.15.122:0/3678562036 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00f9b0 con 0x7fd844151990 2024-09-17T06:04:39.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd849eb2640 1 -- 172.21.15.122:0/3678562036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd844149300 con 0x7fd844151990 2024-09-17T06:04:39.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd849eb2640 1 -- 172.21.15.122:0/3678562036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8440c2080 con 0x7fd844151990 2024-09-17T06:04:39.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd82bfff640 1 -- 172.21.15.122:0/3678562036 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd83c00fb50 con 0x7fd844151990 2024-09-17T06:04:39.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd82bfff640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd830073230 0x7fd830075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:39.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd82bfff640 1 -- 172.21.15.122:0/3678562036 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd83c095000 con 0x7fd844151990 2024-09-17T06:04:39.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.707+0000 7fd8437fe640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd830073230 0x7fd830075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:39.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.711+0000 7fd8437fe640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd830073230 0x7fd830075740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd834000f70 tx=0x7fd834009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:39.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.715+0000 7fd82bfff640 1 -- 172.21.15.122:0/3678562036 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd83c014030 con 0x7fd844151990 2024-09-17T06:04:39.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.907+0000 7fd849eb2640 1 -- 172.21.15.122:0/3678562036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8441507a0 con 0x7fd844151990 2024-09-17T06:04:39.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd82bfff640 1 -- 172.21.15.122:0/3678562036 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7fd83c05fe00 con 0x7fd844151990 2024-09-17T06:04:39.913 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:39.913 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":9,"btime":"2024-09-17T06:04:32:633995+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1941177833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1941177833},{"type":"v1","addr":"172.21.15.173:6835","nonce":1941177833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3902874091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3902874091},{"type":"v1","addr":"172.21.15.122:6833","nonce":3902874091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2868113442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2868113442},{"type":"v1","addr":"172.21.15.122:6836","nonce":2868113442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1552928786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1552928786},{"type":"v1","addr":"172.21.15.122:6837","nonce":1552928786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4447,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2188047562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2188047562},{"type":"v1","addr":"172.21.15.173:6837","nonce":2188047562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T06:04:08.229792+0000","modified":"2024-09-17T06:04:32.027039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4450":{"gid":4450,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6839/1694851531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":1694851531},{"type":"v1","addr":"172.21.15.173:6839","nonce":1694851531}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4450,"qdb_cluster":[4450]},"id":1}]} 2024-09-17T06:04:39.913 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 9 2024-09-17T06:04:39.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd849eb2640 1 -- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd830073230 msgr2=0x7fd830075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:39.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd849eb2640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd830073230 0x7fd830075740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd834000f70 tx=0x7fd834009040 comp rx=0 tx=0).stop 2024-09-17T06:04:39.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd849eb2640 1 -- 172.21.15.122:0/3678562036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd844151990 msgr2=0x7fd8440c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:39.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd849eb2640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd844151990 0x7fd8440c5cf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00cae0 tx=0x7fd83c00a250 comp rx=0 tx=0).stop 2024-09-17T06:04:39.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd849eb2640 1 -- 172.21.15.122:0/3678562036 shutdown_connections 2024-09-17T06:04:39.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd849eb2640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd844151990 0x7fd8440c5cf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd849eb2640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd830073230 0x7fd830075740 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd849eb2640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8440c7a60 0x7fd844146040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd849eb2640 1 --2- 172.21.15.122:0/3678562036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd8440c25c0 0x7fd8440c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:39.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd849eb2640 1 -- 172.21.15.122:0/3678562036 >> 172.21.15.122:0/3678562036 conn(0x7fd8440cd060 msgr2=0x7fd84414fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:39.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd849eb2640 1 -- 172.21.15.122:0/3678562036 shutdown_connections 2024-09-17T06:04:39.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:39.911+0000 7fd849eb2640 1 -- 172.21.15.122:0/3678562036 wait complete. 2024-09-17T06:04:39.933 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T06:04:40.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.083+0000 7f20b7c2d640 1 -- 172.21.15.122:0/2536963732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20b00c38c0 msgr2=0x7f20b01534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.083+0000 7f20b7c2d640 1 --2- 172.21.15.122:0/2536963732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20b00c38c0 0x7f20b01534d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009840 tx=0x7f20ac01c820 comp rx=0 tx=0).stop 2024-09-17T06:04:40.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.083+0000 7f20b7c2d640 1 -- 172.21.15.122:0/2536963732 shutdown_connections 2024-09-17T06:04:40.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.083+0000 7f20b7c2d640 1 --2- 172.21.15.122:0/2536963732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20b00c38c0 0x7f20b01534d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.083+0000 7f20b7c2d640 1 -- 172.21.15.122:0/2536963732 >> 172.21.15.122:0/2536963732 conn(0x7f20b0070e40 msgr2=0x7f20b0071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:40.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.083+0000 7f20b7c2d640 1 -- 172.21.15.122:0/2536963732 shutdown_connections 2024-09-17T06:04:40.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.083+0000 7f20b7c2d640 1 -- 172.21.15.122:0/2536963732 wait complete. 2024-09-17T06:04:40.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b7c2d640 1 Processor -- start 2024-09-17T06:04:40.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b7c2d640 1 -- start start 2024-09-17T06:04:40.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b7c2d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20b00c38c0 0x7f20b00c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:40.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b7c2d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20b00c4330 0x7f20b014cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:40.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b7c2d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20b00cedf0 0x7f20b01f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:40.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b7c2d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f20b015a160 con 0x7f20b00c38c0 2024-09-17T06:04:40.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b7c2d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20b00cf610 con 0x7f20b00cedf0 2024-09-17T06:04:40.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b7c2d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f20b00ca2a0 con 0x7f20b00c4330 2024-09-17T06:04:40.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b59c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20b00c38c0 0x7f20b00c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:40.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b59c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20b00c38c0 0x7f20b00c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49576/0 (socket says 172.21.15.122:49576) 2024-09-17T06:04:40.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b59c9640 1 -- 172.21.15.122:0/54307236 learned_addr learned my addr 172.21.15.122:0/54307236 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:40.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b61ca640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20b00cedf0 0x7f20b01f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:40.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b59c9640 1 -- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20b00c4330 msgr2=0x7f20b014cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b59c9640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20b00c4330 0x7f20b014cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b59c9640 1 -- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20b00cedf0 msgr2=0x7f20b01f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b59c9640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20b00cedf0 0x7f20b01f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b59c9640 1 -- 172.21.15.122:0/54307236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b00c83e0 con 0x7f20b00c38c0 2024-09-17T06:04:40.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b61ca640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20b00cedf0 0x7f20b01f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:40.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b59c9640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20b00c38c0 0x7f20b00c7ea0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f20ac01aed0 tx=0x7f20ac004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:40.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20a27fc640 1 -- 172.21.15.122:0/54307236 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0bb070 con 0x7f20b00c38c0 2024-09-17T06:04:40.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20a27fc640 1 -- 172.21.15.122:0/54307236 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20ac005030 con 0x7f20b00c38c0 2024-09-17T06:04:40.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b7c2d640 1 -- 172.21.15.122:0/54307236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b00c6e00 con 0x7f20b00c38c0 2024-09-17T06:04:40.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20a27fc640 1 -- 172.21.15.122:0/54307236 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0b2040 con 0x7f20b00c38c0 2024-09-17T06:04:40.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.087+0000 7f20b7c2d640 1 -- 172.21.15.122:0/54307236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b00c73c0 con 0x7f20b00c38c0 2024-09-17T06:04:40.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.091+0000 7f20b7c2d640 1 -- 172.21.15.122:0/54307236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b014c2e0 con 0x7f20b00c38c0 2024-09-17T06:04:40.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.091+0000 7f20a27fc640 1 -- 172.21.15.122:0/54307236 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f20ac0be070 con 0x7f20b00c38c0 2024-09-17T06:04:40.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.091+0000 7f20a27fc640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2094073230 0x7f2094075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:40.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.091+0000 7f20a27fc640 1 -- 172.21.15.122:0/54307236 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f20ac12df60 con 0x7f20b00c38c0 2024-09-17T06:04:40.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.091+0000 7f20b51c8640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2094073230 0x7f2094075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:40.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.091+0000 7f20b51c8640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2094073230 0x7f2094075740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f20b014bbd0 tx=0x7f20a4007cc0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:40.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.095+0000 7f20a27fc640 1 -- 172.21.15.122:0/54307236 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f20ac016410 con 0x7f20b00c38c0 2024-09-17T06:04:40.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.299+0000 7f20b7c2d640 1 -- 172.21.15.122:0/54307236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20b014c000 con 0x7f20b00c38c0 2024-09-17T06:04:40.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20a27fc640 1 -- 172.21.15.122:0/54307236 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7f20ac0f8d60 con 0x7f20b00c38c0 2024-09-17T06:04:40.304 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:40.304 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":9,"btime":"2024-09-17T06:04:32:633995+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1941177833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1941177833},{"type":"v1","addr":"172.21.15.173:6835","nonce":1941177833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3902874091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3902874091},{"type":"v1","addr":"172.21.15.122:6833","nonce":3902874091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2868113442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2868113442},{"type":"v1","addr":"172.21.15.122:6836","nonce":2868113442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1552928786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1552928786},{"type":"v1","addr":"172.21.15.122:6837","nonce":1552928786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4447,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2188047562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2188047562},{"type":"v1","addr":"172.21.15.173:6837","nonce":2188047562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T06:04:08.229792+0000","modified":"2024-09-17T06:04:32.027039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4450":{"gid":4450,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6839/1694851531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":1694851531},{"type":"v1","addr":"172.21.15.173:6839","nonce":1694851531}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4450,"qdb_cluster":[4450]},"id":1}]} 2024-09-17T06:04:40.304 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 9 2024-09-17T06:04:40.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20b7c2d640 1 -- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2094073230 msgr2=0x7f2094075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20b7c2d640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2094073230 0x7f2094075740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f20b014bbd0 tx=0x7f20a4007cc0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20b7c2d640 1 -- 172.21.15.122:0/54307236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20b00c38c0 msgr2=0x7f20b00c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20b7c2d640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20b00c38c0 0x7f20b00c7ea0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f20ac01aed0 tx=0x7f20ac004040 comp rx=0 tx=0).stop 2024-09-17T06:04:40.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20b7c2d640 1 -- 172.21.15.122:0/54307236 shutdown_connections 2024-09-17T06:04:40.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20b7c2d640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2094073230 0x7f2094075740 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20b7c2d640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20b00cedf0 0x7f20b01f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20b7c2d640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20b00c4330 0x7f20b014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20b7c2d640 1 --2- 172.21.15.122:0/54307236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20b00c38c0 0x7f20b00c7ea0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20b7c2d640 1 -- 172.21.15.122:0/54307236 >> 172.21.15.122:0/54307236 conn(0x7f20b0070e40 msgr2=0x7f20b0072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:40.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20b7c2d640 1 -- 172.21.15.122:0/54307236 shutdown_connections 2024-09-17T06:04:40.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.303+0000 7f20b7c2d640 1 -- 172.21.15.122:0/54307236 wait complete. 2024-09-17T06:04:40.327 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:04:40.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.483+0000 7f630b242640 1 -- 172.21.15.122:0/3282424878 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6304159b30 msgr2=0x7f6304072270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.483+0000 7f630b242640 1 --2- 172.21.15.122:0/3282424878 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6304159b30 0x7f6304072270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009900 tx=0x7f62ec01f0d0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.483+0000 7f630b242640 1 -- 172.21.15.122:0/3282424878 shutdown_connections 2024-09-17T06:04:40.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.483+0000 7f630b242640 1 --2- 172.21.15.122:0/3282424878 >> v2:172.21.15.173:3300/0 conn(0x7f63040727b0 0x7f630415aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.483+0000 7f630b242640 1 --2- 172.21.15.122:0/3282424878 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6304159b30 0x7f6304072270 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.483+0000 7f630b242640 1 -- 172.21.15.122:0/3282424878 >> 172.21.15.122:0/3282424878 conn(0x7f63040746d0 msgr2=0x7f6304074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:40.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.483+0000 7f630b242640 1 -- 172.21.15.122:0/3282424878 shutdown_connections 2024-09-17T06:04:40.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.483+0000 7f630b242640 1 -- 172.21.15.122:0/3282424878 wait complete. 2024-09-17T06:04:40.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f630b242640 1 Processor -- start 2024-09-17T06:04:40.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f630b242640 1 -- start start 2024-09-17T06:04:40.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f630b242640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63040727b0 0x7f6304144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:40.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f630b242640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63040c6780 0x7f63041441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:40.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f630b242640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6304159b30 0x7f6304146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:40.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f630b242640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f630415d470 con 0x7f63040c6780 2024-09-17T06:04:40.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f630b242640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f630415d190 con 0x7f6304159b30 2024-09-17T06:04:40.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f630b242640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6304159f40 con 0x7f63040727b0 2024-09-17T06:04:40.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f6303fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63040c6780 0x7f63041441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:40.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f6303fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63040c6780 0x7f63041441f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49584/0 (socket says 172.21.15.122:49584) 2024-09-17T06:04:40.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f6303fff640 1 -- 172.21.15.122:0/500246395 learned_addr learned my addr 172.21.15.122:0/500246395 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:40.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f6308fde640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63040727b0 0x7f6304144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:40.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f63097df640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6304159b30 0x7f6304146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:40.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f6303fff640 1 -- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63040727b0 msgr2=0x7f6304144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f6303fff640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63040727b0 0x7f6304144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f6303fff640 1 -- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6304159b30 msgr2=0x7f6304146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f6303fff640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6304159b30 0x7f6304146a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.487+0000 7f6303fff640 1 -- 172.21.15.122:0/500246395 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6304076aa0 con 0x7f63040c6780 2024-09-17T06:04:40.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.491+0000 7f6303fff640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63040c6780 0x7f63041441f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009230 tx=0x7f62ec005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:40.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.491+0000 7f63017fa640 1 -- 172.21.15.122:0/500246395 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0b5040 con 0x7f63040c6780 2024-09-17T06:04:40.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.491+0000 7f63017fa640 1 -- 172.21.15.122:0/500246395 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62ec0047c0 con 0x7f63040c6780 2024-09-17T06:04:40.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.491+0000 7f630b242640 1 -- 172.21.15.122:0/500246395 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63041e5460 con 0x7f63040c6780 2024-09-17T06:04:40.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.491+0000 7f63017fa640 1 -- 172.21.15.122:0/500246395 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec004bd0 con 0x7f63040c6780 2024-09-17T06:04:40.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.491+0000 7f630b242640 1 -- 172.21.15.122:0/500246395 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63041e2870 con 0x7f63040c6780 2024-09-17T06:04:40.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.491+0000 7f630b242640 1 -- 172.21.15.122:0/500246395 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6304072270 con 0x7f63040c6780 2024-09-17T06:04:40.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.491+0000 7f63017fa640 1 -- 172.21.15.122:0/500246395 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f62ec0c0060 con 0x7f63040c6780 2024-09-17T06:04:40.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.491+0000 7f63017fa640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f62e4073230 0x7f62e4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:40.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.491+0000 7f63017fa640 1 -- 172.21.15.122:0/500246395 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f62ec131900 con 0x7f63040c6780 2024-09-17T06:04:40.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.491+0000 7f6308fde640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f62e4073230 0x7f62e4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:40.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.491+0000 7f6308fde640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f62e4073230 0x7f62e4075740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f62f4001cf0 tx=0x7f62f4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:40.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.495+0000 7f63017fa640 1 -- 172.21.15.122:0/500246395 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f62ec018c30 con 0x7f63040c6780 2024-09-17T06:04:40.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.655+0000 7f630b242640 1 -- 172.21.15.122:0/500246395 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63040c3650 con 0x7f63040c6780 2024-09-17T06:04:40.661 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.659+0000 7f63017fa640 1 -- 172.21.15.122:0/500246395 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7f62ec0fc5e0 con 0x7f63040c6780 2024-09-17T06:04:40.661 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:40.661 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":26,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:04:13.331438+0000","last_up_change":"2024-09-17T06:03:56.580331+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6811","nonce":920798795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6813","nonce":920798795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6817","nonce":920798795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":920798795},{"type":"v1","addr":"172.21.15.173:6815","nonce":920798795}]},"public_addr":"172.21.15.173:6811/920798795","cluster_addr":"172.21.15.173:6813/920798795","heartbeat_back_addr":"172.21.15.173:6817/920798795","heartbeat_front_addr":"172.21.15.173:6815/920798795","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:04:40.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.659+0000 7f630b242640 1 -- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f62e4073230 msgr2=0x7f62e4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.659+0000 7f630b242640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f62e4073230 0x7f62e4075740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f62f4001cf0 tx=0x7f62f4009040 comp rx=0 tx=0).stop 2024-09-17T06:04:40.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.659+0000 7f630b242640 1 -- 172.21.15.122:0/500246395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63040c6780 msgr2=0x7f63041441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.659+0000 7f630b242640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63040c6780 0x7f63041441f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009230 tx=0x7f62ec005770 comp rx=0 tx=0).stop 2024-09-17T06:04:40.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.663+0000 7f630b242640 1 -- 172.21.15.122:0/500246395 shutdown_connections 2024-09-17T06:04:40.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.663+0000 7f630b242640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f62e4073230 0x7f62e4075740 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.663+0000 7f630b242640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6304159b30 0x7f6304146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.663+0000 7f630b242640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63040c6780 0x7f63041441f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.663+0000 7f630b242640 1 --2- 172.21.15.122:0/500246395 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63040727b0 0x7f6304144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.663+0000 7f630b242640 1 -- 172.21.15.122:0/500246395 >> 172.21.15.122:0/500246395 conn(0x7f63040746d0 msgr2=0x7f6304151fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:40.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.663+0000 7f630b242640 1 -- 172.21.15.122:0/500246395 shutdown_connections 2024-09-17T06:04:40.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.663+0000 7f630b242640 1 -- 172.21.15.122:0/500246395 wait complete. 2024-09-17T06:04:40.682 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T06:04:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.835+0000 7ffb1cb06640 1 -- 172.21.15.122:0/1243024838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb180ccdb0 msgr2=0x7ffb180cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.835+0000 7ffb1cb06640 1 --2- 172.21.15.122:0/1243024838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb180ccdb0 0x7ffb180cc1e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffb180b3d00 tx=0x7ffb0801cd10 comp rx=0 tx=0).stop 2024-09-17T06:04:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.835+0000 7ffb1cb06640 1 -- 172.21.15.122:0/1243024838 shutdown_connections 2024-09-17T06:04:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.835+0000 7ffb1cb06640 1 --2- 172.21.15.122:0/1243024838 >> v2:172.21.15.173:3300/0 conn(0x7ffb1806dab0 0x7ffb180cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.835+0000 7ffb1cb06640 1 --2- 172.21.15.122:0/1243024838 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb180cbb40 0x7ffb1815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.835+0000 7ffb1cb06640 1 --2- 172.21.15.122:0/1243024838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb180ccdb0 0x7ffb180cc1e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.835+0000 7ffb1cb06640 1 -- 172.21.15.122:0/1243024838 >> 172.21.15.122:0/1243024838 conn(0x7ffb1808d450 msgr2=0x7ffb1806ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.835+0000 7ffb1cb06640 1 -- 172.21.15.122:0/1243024838 shutdown_connections 2024-09-17T06:04:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.835+0000 7ffb1cb06640 1 -- 172.21.15.122:0/1243024838 wait complete. 2024-09-17T06:04:40.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1cb06640 1 Processor -- start 2024-09-17T06:04:40.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1cb06640 1 -- start start 2024-09-17T06:04:40.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1cb06640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb1806dab0 0x7ffb1815d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:40.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1cb06640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb180cbb40 0x7ffb18149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:40.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1cb06640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb180ccdb0 0x7ffb1814a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:40.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1cb06640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1806ff20 con 0x7ffb180ccdb0 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1cb06640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18155970 con 0x7ffb180cbb40 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1cb06640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ffb180700a0 con 0x7ffb1806dab0 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb16d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb180ccdb0 0x7ffb1814a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb16d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb180ccdb0 0x7ffb1814a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49596/0 (socket says 172.21.15.122:49596) 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb16d9d640 1 -- 172.21.15.122:0/3655464571 learned_addr learned my addr 172.21.15.122:0/3655464571 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb0dd9b640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb180cbb40 0x7ffb18149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1659c640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb1806dab0 0x7ffb1815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb16d9d640 1 -- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb1806dab0 msgr2=0x7ffb1815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb16d9d640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb1806dab0 0x7ffb1815d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb16d9d640 1 -- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb180cbb40 msgr2=0x7ffb18149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb16d9d640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb180cbb40 0x7ffb18149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb16d9d640 1 -- 172.21.15.122:0/3655464571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb18155ce0 con 0x7ffb180ccdb0 2024-09-17T06:04:40.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1659c640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb1806dab0 0x7ffb1815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:40.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb16d9d640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb180ccdb0 0x7ffb1814a070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000b4c0 tx=0x7ffb1000b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:40.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb0f7fe640 1 -- 172.21.15.122:0/3655464571 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10015020 con 0x7ffb180ccdb0 2024-09-17T06:04:40.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb0f7fe640 1 -- 172.21.15.122:0/3655464571 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb10011940 con 0x7ffb180ccdb0 2024-09-17T06:04:40.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1cb06640 1 -- 172.21.15.122:0/3655464571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb18155fc0 con 0x7ffb180ccdb0 2024-09-17T06:04:40.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb0f7fe640 1 -- 172.21.15.122:0/3655464571 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10011d90 con 0x7ffb180ccdb0 2024-09-17T06:04:40.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1cb06640 1 -- 172.21.15.122:0/3655464571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb181567c0 con 0x7ffb180ccdb0 2024-09-17T06:04:40.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.839+0000 7ffb1cb06640 1 -- 172.21.15.122:0/3655464571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb18158a60 con 0x7ffb180ccdb0 2024-09-17T06:04:40.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.843+0000 7ffb0f7fe640 1 -- 172.21.15.122:0/3655464571 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffb10018020 con 0x7ffb180ccdb0 2024-09-17T06:04:40.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.843+0000 7ffb0f7fe640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ffaf8073230 0x7ffaf8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:40.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.843+0000 7ffb0f7fe640 1 -- 172.21.15.122:0/3655464571 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ffb10094440 con 0x7ffb180ccdb0 2024-09-17T06:04:40.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.843+0000 7ffb1659c640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ffaf8073230 0x7ffaf8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:40.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.843+0000 7ffb1659c640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ffaf8073230 0x7ffaf8075740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffb080af000 tx=0x7ffb0801b550 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:40.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:40.847+0000 7ffb0f7fe640 1 -- 172.21.15.122:0/3655464571 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ffb1001f020 con 0x7ffb180ccdb0 2024-09-17T06:04:41.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.051+0000 7ffb1cb06640 1 -- 172.21.15.122:0/3655464571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb1815b470 con 0x7ffb180ccdb0 2024-09-17T06:04:41.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb0f7fe640 1 -- 172.21.15.122:0/3655464571 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7ffb1005f120 con 0x7ffb180ccdb0 2024-09-17T06:04:41.056 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:41.056 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":9,"btime":"2024-09-17T06:04:32:633995+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1941177833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1941177833},{"type":"v1","addr":"172.21.15.173:6835","nonce":1941177833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3902874091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3902874091},{"type":"v1","addr":"172.21.15.122:6833","nonce":3902874091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2868113442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2868113442},{"type":"v1","addr":"172.21.15.122:6836","nonce":2868113442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1552928786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1552928786},{"type":"v1","addr":"172.21.15.122:6837","nonce":1552928786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4447,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2188047562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2188047562},{"type":"v1","addr":"172.21.15.173:6837","nonce":2188047562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T06:04:08.229792+0000","modified":"2024-09-17T06:04:32.027039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4450":{"gid":4450,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6839/1694851531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":1694851531},{"type":"v1","addr":"172.21.15.173:6839","nonce":1694851531}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4450,"qdb_cluster":[4450]},"id":1}]} 2024-09-17T06:04:41.056 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 9 2024-09-17T06:04:41.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb1cb06640 1 -- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ffaf8073230 msgr2=0x7ffaf8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:41.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb1cb06640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ffaf8073230 0x7ffaf8075740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffb080af000 tx=0x7ffb0801b550 comp rx=0 tx=0).stop 2024-09-17T06:04:41.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb1cb06640 1 -- 172.21.15.122:0/3655464571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb180ccdb0 msgr2=0x7ffb1814a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:41.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb1cb06640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb180ccdb0 0x7ffb1814a070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000b4c0 tx=0x7ffb1000b980 comp rx=0 tx=0).stop 2024-09-17T06:04:41.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb1cb06640 1 -- 172.21.15.122:0/3655464571 shutdown_connections 2024-09-17T06:04:41.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb1cb06640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb180ccdb0 0x7ffb1814a070 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb1cb06640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ffaf8073230 0x7ffaf8075740 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb1cb06640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb180cbb40 0x7ffb18149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb1cb06640 1 --2- 172.21.15.122:0/3655464571 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb1806dab0 0x7ffb1815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb1cb06640 1 -- 172.21.15.122:0/3655464571 >> 172.21.15.122:0/3655464571 conn(0x7ffb1808d450 msgr2=0x7ffb181542c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:41.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb1cb06640 1 -- 172.21.15.122:0/3655464571 shutdown_connections 2024-09-17T06:04:41.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.055+0000 7ffb1cb06640 1 -- 172.21.15.122:0/3655464571 wait complete. 2024-09-17T06:04:41.681 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T06:04:08.229792+0000', 'modified': '2024-09-17T06:04:32.027039+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4450}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4450': {'gid': 4450, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.173:6839/1694851531', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 1694851531}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 1694851531}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4450, 'qdb_cluster': [4450]} 2024-09-17T06:04:41.681 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T06:04:41.682 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T06:04:41.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.839+0000 7fd02211f640 1 -- 172.21.15.122:0/3593054003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd01c152210 msgr2=0x7fd01c1629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:41.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.839+0000 7fd02211f640 1 --2- 172.21.15.122:0/3593054003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd01c152210 0x7fd01c1629d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009900 tx=0x7fd00c01c8b0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.839+0000 7fd02211f640 1 -- 172.21.15.122:0/3593054003 shutdown_connections 2024-09-17T06:04:41.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.839+0000 7fd02211f640 1 --2- 172.21.15.122:0/3593054003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd01c152210 0x7fd01c1629d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.839+0000 7fd02211f640 1 --2- 172.21.15.122:0/3593054003 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd01c06ebd0 0x7fd01c0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.839+0000 7fd02211f640 1 -- 172.21.15.122:0/3593054003 >> 172.21.15.122:0/3593054003 conn(0x7fd01c073240 msgr2=0x7fd01c0cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:41.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.839+0000 7fd02211f640 1 -- 172.21.15.122:0/3593054003 shutdown_connections 2024-09-17T06:04:41.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.839+0000 7fd02211f640 1 -- 172.21.15.122:0/3593054003 wait complete. 2024-09-17T06:04:41.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd02211f640 1 Processor -- start 2024-09-17T06:04:41.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd02211f640 1 -- start start 2024-09-17T06:04:41.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd02211f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd01c06ce90 0x7fd01c145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd02211f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd01c06ebd0 0x7fd01c1f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd02211f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd01c152210 0x7fd01c157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd02211f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c0c2270 con 0x7fd01c152210 2024-09-17T06:04:41.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd02211f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c0c20f0 con 0x7fd01c06ebd0 2024-09-17T06:04:41.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd02211f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd01c0c2e80 con 0x7fd01c06ce90 2024-09-17T06:04:41.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd01bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd01c152210 0x7fd01c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd01bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd01c152210 0x7fd01c157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49622/0 (socket says 172.21.15.122:49622) 2024-09-17T06:04:41.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd01bfff640 1 -- 172.21.15.122:0/144605005 learned_addr learned my addr 172.21.15.122:0/144605005 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:41.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd01bfff640 1 -- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd01c06ce90 msgr2=0x7fd01c145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:41.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd01b7fe640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd01c06ce90 0x7fd01c145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd01bfff640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd01c06ce90 0x7fd01c145eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd01affd640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd01c06ebd0 0x7fd01c1f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd01bfff640 1 -- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd01c06ebd0 msgr2=0x7fd01c1f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:41.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd01bfff640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd01c06ebd0 0x7fd01c1f52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd01bfff640 1 -- 172.21.15.122:0/144605005 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c1f5820 con 0x7fd01c152210 2024-09-17T06:04:41.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd01bfff640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd01c152210 0x7fd01c157370 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0b0040 tx=0x7fd00c0a5760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:41.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd003fff640 1 -- 172.21.15.122:0/144605005 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0b2040 con 0x7fd01c152210 2024-09-17T06:04:41.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd003fff640 1 -- 172.21.15.122:0/144605005 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd00c004430 con 0x7fd01c152210 2024-09-17T06:04:41.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd02211f640 1 -- 172.21.15.122:0/144605005 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01c156820 con 0x7fd01c152210 2024-09-17T06:04:41.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd003fff640 1 -- 172.21.15.122:0/144605005 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c003860 con 0x7fd01c152210 2024-09-17T06:04:41.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.843+0000 7fd02211f640 1 -- 172.21.15.122:0/144605005 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01c0cb2b0 con 0x7fd01c152210 2024-09-17T06:04:41.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd003fff640 1 -- 172.21.15.122:0/144605005 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd00c0bf060 con 0x7fd01c152210 2024-09-17T06:04:41.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd003fff640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd008073230 0x7fd008075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd003fff640 1 -- 172.21.15.122:0/144605005 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd00c12e0e0 con 0x7fd01c152210 2024-09-17T06:04:41.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd01b7fe640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd008073230 0x7fd008075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd0293ea000 1 Processor -- start 2024-09-17T06:04:41.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd0293ea000 1 -- start start 2024-09-17T06:04:41.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd01b7fe640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd008073230 0x7fd008075740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd014007bf0 tx=0x7fd014007240 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:41.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd0293ea000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 0x55e2b67e01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd0293ea000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b67e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd0293ea000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b6685ca0 0x55e2b67e5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd0293ea000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e2b66c2410 con 0x55e2b669c950 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd0293ea000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e2b65ffb40 con 0x55e2b6685ca0 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd0293ea000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x55e2b65eef70 con 0x55e2b62ac460 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd01affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b67e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd01affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b67e4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49630/0 (socket says 172.21.15.122:49630) 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd01affd640 1 -- 172.21.15.122:0/3223711734 learned_addr learned my addr 172.21.15.122:0/3223711734 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd01b7fe640 1 --2- 172.21.15.122:0/3223711734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 0x55e2b67e01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd01bfff640 1 --2- 172.21.15.122:0/3223711734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b6685ca0 0x55e2b67e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd01affd640 1 -- 172.21.15.122:0/3223711734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 msgr2=0x55e2b67e01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd01affd640 1 --2- 172.21.15.122:0/3223711734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 0x55e2b67e01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd01affd640 1 -- 172.21.15.122:0/3223711734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b6685ca0 msgr2=0x55e2b67e5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd01affd640 1 --2- 172.21.15.122:0/3223711734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b6685ca0 0x55e2b67e5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.847+0000 7fd01affd640 1 -- 172.21.15.122:0/3223711734 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b65b65b0 con 0x55e2b669c950 2024-09-17T06:04:41.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd01affd640 1 --2- 172.21.15.122:0/3223711734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b67e4c40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd01000b9f0 tx=0x7fd01000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99bdd72e963ae6a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:41.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0017fa640 1 -- 172.21.15.122:0/3223711734 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01000de50 con 0x55e2b669c950 2024-09-17T06:04:41.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0017fa640 1 -- 172.21.15.122:0/3223711734 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd010017420 con 0x55e2b669c950 2024-09-17T06:04:41.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0017fa640 1 -- 172.21.15.122:0/3223711734 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd010017850 con 0x55e2b669c950 2024-09-17T06:04:41.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 -- 172.21.15.122:0/3223711734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 msgr2=0x55e2b67e4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:41.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 --2- 172.21.15.122:0/3223711734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b67e4c40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd01000b9f0 tx=0x7fd01000beb0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 -- 172.21.15.122:0/3223711734 shutdown_connections 2024-09-17T06:04:41.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 --2- 172.21.15.122:0/3223711734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b6685ca0 0x55e2b67e5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 --2- 172.21.15.122:0/3223711734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b67e4c40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 --2- 172.21.15.122:0/3223711734 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 0x55e2b67e01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 -- 172.21.15.122:0/3223711734 >> 172.21.15.122:0/3223711734 conn(0x55e2b6772d90 msgr2=0x55e2b67e2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:41.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 -- 172.21.15.122:0/3223711734 shutdown_connections 2024-09-17T06:04:41.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 -- 172.21.15.122:0/3223711734 wait complete. 2024-09-17T06:04:41.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 -- start start 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 Processor -- start 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 0x55e2b67df1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b6685ca0 0x55e2b67df6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b67dfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e2b65895f0 con 0x55e2b669c950 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e2b65f2d80 con 0x55e2b6685ca0 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x55e2b6595520 con 0x55e2b62ac460 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd0293ea000 10 client.0 _ll_register_callbacks cb 0x55e2b6599830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd01bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b67dfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd01bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b67dfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49632/0 (socket says 172.21.15.122:49632) 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd01bfff640 1 -- 172.21.15.122:0/2456167242 learned_addr learned my addr 172.21.15.122:0/2456167242 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd01b7fe640 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 0x55e2b67df1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd01affd640 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b6685ca0 0x55e2b67df6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd01bfff640 1 -- 172.21.15.122:0/2456167242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 msgr2=0x55e2b67df1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd01bfff640 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 0x55e2b67df1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd01bfff640 1 -- 172.21.15.122:0/2456167242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b6685ca0 msgr2=0x55e2b67df6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd01bfff640 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b6685ca0 0x55e2b67df6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd01bfff640 1 -- 172.21.15.122:0/2456167242 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2b658d190 con 0x55e2b669c950 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fd01bfff640 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b67dfc20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0f85a0 tx=0x7fd00c0f82b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbbd6dd2d413cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.851+0000 7fcffa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fcffa7fc640 1 -- 172.21.15.122:0/2456167242 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0fd2d0 con 0x55e2b669c950 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fcffa7fc640 1 -- 172.21.15.122:0/2456167242 <== mon.0 v2:172.21.15.122:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd00c101f00 con 0x55e2b669c950 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 -- 172.21.15.122:0/2456167242 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e2b6587110 con 0x55e2b669c950 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fcffa7fc640 1 -- 172.21.15.122:0/2456167242 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fd00c102180 con 0x55e2b669c950 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 10 client.4815 fetch_fsmap learned FSMap version 9 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 -- 172.21.15.122:0/2456167242 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e2b6673f10 con 0x55e2b669c950 2024-09-17T06:04:41.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fcffa7fc640 1 -- 172.21.15.122:0/2456167242 <== mon.0 v2:172.21.15.122:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e2b6587110 con 0x55e2b669c950 2024-09-17T06:04:41.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fcffa7fc640 1 -- 172.21.15.122:0/2456167242 <== mon.0 v2:172.21.15.122:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fd00c118470 con 0x55e2b669c950 2024-09-17T06:04:41.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 10 client.4815 fetch_fsmap finished waiting for FSMap version 9 2024-09-17T06:04:41.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 10 client.4815 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T06:04:41.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 20 client.4815 populate_metadata read hostname 'smithi122' 2024-09-17T06:04:41.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55e2b62917d0 0x55e2b67fa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 4 client.4815 mds_command: new command op to 4450 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T06:04:41.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 -- 172.21.15.122:0/2456167242 --> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2b6601a90 con 0x55e2b62917d0 2024-09-17T06:04:41.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd01b7fe640 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55e2b62917d0 0x55e2b67fa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fcffa7fc640 10 client.4815 ms_handle_connect on v2:172.21.15.173:6838/1694851531 2024-09-17T06:04:41.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd01b7fe640 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55e2b62917d0 0x55e2b67fa2e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=675a5c4c1d5b443a server_cookie=c81001f705a5541a in_seq=0 out_seq=0 2024-09-17T06:04:41.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fcffa7fc640 1 -- 172.21.15.122:0/2456167242 <== mds.0 v2:172.21.15.173:6838/1694851531 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e2b6601a90 con 0x55e2b62917d0 2024-09-17T06:04:41.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fcffa7fc640 10 client.4815 handle_command_reply: tid=0 2024-09-17T06:04:41.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 client.4815 shutdown 2024-09-17T06:04:41.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 -- 172.21.15.122:0/2456167242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 msgr2=0x55e2b67dfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:41.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b67dfc20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0f85a0 tx=0x7fd00c0f82b0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 -- 172.21.15.122:0/2456167242 shutdown_connections 2024-09-17T06:04:41.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55e2b62917d0 0x55e2b67fa2e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b67dfc20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fcffa7fc640 0 client.4815 ms_handle_reset on v2:172.21.15.173:6838/1694851531 2024-09-17T06:04:41.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b6685ca0 0x55e2b67df6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 --2- 172.21.15.122:0/2456167242 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 0x55e2b67df1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 -- 172.21.15.122:0/2456167242 >> 172.21.15.122:0/2456167242 conn(0x55e2b6772d90 msgr2=0x55e2b67a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:41.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 -- 172.21.15.122:0/2456167242 shutdown_connections 2024-09-17T06:04:41.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 1 -- 172.21.15.122:0/2456167242 wait complete. 2024-09-17T06:04:41.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.855+0000 7fd0293ea000 20 client.4815 trim_cache size 0 max 16384 2024-09-17T06:04:41.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd0293ea000 1 Processor -- start 2024-09-17T06:04:41.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd0293ea000 1 -- start start 2024-09-17T06:04:41.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd0293ea000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 0x55e2b67a2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd0293ea000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b6685ca0 0x55e2b6851f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd0293ea000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b669c950 0x55e2b68524a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd0293ea000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c203760 con 0x55e2b6685ca0 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd0293ea000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c202640 con 0x55e2b669c950 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd0293ea000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd01c1f8df0 con 0x55e2b62ac460 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd01affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b6685ca0 0x55e2b6851f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd01affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b6685ca0 0x55e2b6851f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49638/0 (socket says 172.21.15.122:49638) 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd01affd640 1 -- 172.21.15.122:0/1750058564 learned_addr learned my addr 172.21.15.122:0/1750058564 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd01b7fe640 1 --2- 172.21.15.122:0/1750058564 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 0x55e2b67a2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd01bfff640 1 --2- 172.21.15.122:0/1750058564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b669c950 0x55e2b68524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd01affd640 1 -- 172.21.15.122:0/1750058564 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 msgr2=0x55e2b67a2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd01affd640 1 --2- 172.21.15.122:0/1750058564 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 0x55e2b67a2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd01affd640 1 -- 172.21.15.122:0/1750058564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b669c950 msgr2=0x55e2b68524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:41.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd01affd640 1 --2- 172.21.15.122:0/1750058564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b669c950 0x55e2b68524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd01affd640 1 -- 172.21.15.122:0/1750058564 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b664adb0 con 0x55e2b6685ca0 2024-09-17T06:04:41.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd01affd640 1 --2- 172.21.15.122:0/1750058564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b6685ca0 0x55e2b6851f60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0100058d0 tx=0x7fd0100046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d81985bd884d49 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:41.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd000ff9640 1 -- 172.21.15.122:0/1750058564 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd010027070 con 0x55e2b6685ca0 2024-09-17T06:04:41.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd000ff9640 1 -- 172.21.15.122:0/1750058564 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd010005020 con 0x55e2b6685ca0 2024-09-17T06:04:41.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.875+0000 7fd000ff9640 1 -- 172.21.15.122:0/1750058564 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd010005490 con 0x55e2b6685ca0 2024-09-17T06:04:41.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 -- 172.21.15.122:0/1750058564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b6685ca0 msgr2=0x55e2b6851f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:41.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 --2- 172.21.15.122:0/1750058564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b6685ca0 0x55e2b6851f60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0100058d0 tx=0x7fd0100046d0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 -- 172.21.15.122:0/1750058564 shutdown_connections 2024-09-17T06:04:41.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 --2- 172.21.15.122:0/1750058564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b669c950 0x55e2b68524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 --2- 172.21.15.122:0/1750058564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b6685ca0 0x55e2b6851f60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 --2- 172.21.15.122:0/1750058564 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b62ac460 0x55e2b67a2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 -- 172.21.15.122:0/1750058564 >> 172.21.15.122:0/1750058564 conn(0x55e2b6772d90 msgr2=0x55e2b67df5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:41.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 -- 172.21.15.122:0/1750058564 shutdown_connections 2024-09-17T06:04:41.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 -- 172.21.15.122:0/1750058564 wait complete. 2024-09-17T06:04:41.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 -- start start 2024-09-17T06:04:41.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 Processor -- start 2024-09-17T06:04:41.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b62ac460 0x55e2b685ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b6685ca0 0x55e2b685f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b685f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c2012c0 con 0x55e2b669c950 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c201fa0 con 0x55e2b62ac460 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd01c201910 con 0x55e2b6685ca0 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 10 client.0 _ll_register_callbacks cb 0x7fd00c005f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b685f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b685f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49650/0 (socket says 172.21.15.122:49650) 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01bfff640 1 -- 172.21.15.122:0/3291926373 learned_addr learned my addr 172.21.15.122:0/3291926373 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01b7fe640 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b62ac460 0x55e2b685ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01affd640 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b6685ca0 0x55e2b685f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01bfff640 1 -- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b6685ca0 msgr2=0x55e2b685f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01bfff640 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b6685ca0 0x55e2b685f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01bfff640 1 -- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b62ac460 msgr2=0x55e2b685ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01bfff640 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b62ac460 0x55e2b685ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01bfff640 1 -- 172.21.15.122:0/3291926373 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2b65b5ab0 con 0x55e2b669c950 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01b7fe640 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b62ac460 0x55e2b685ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01affd640 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b6685ca0 0x55e2b685f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd01bfff640 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b685f8a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd00c01d150 tx=0x7fd00c0fd2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a64019eadfb31 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fcffa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fcffa7fc640 1 -- 172.21.15.122:0/3291926373 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0f4ef0 con 0x55e2b669c950 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fcffa7fc640 1 -- 172.21.15.122:0/3291926373 <== mon.0 v2:172.21.15.122:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd00c0f9d20 con 0x55e2b669c950 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 -- 172.21.15.122:0/3291926373 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd010005020 con 0x55e2b669c950 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fcffa7fc640 1 -- 172.21.15.122:0/3291926373 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fd00c0f41f0 con 0x55e2b669c950 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 10 client.4821 fetch_fsmap learned FSMap version 9 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 -- 172.21.15.122:0/3291926373 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e2b6594070 con 0x55e2b669c950 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fcffa7fc640 1 -- 172.21.15.122:0/3291926373 <== mon.0 v2:172.21.15.122:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd010005020 con 0x55e2b669c950 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fcffa7fc640 1 -- 172.21.15.122:0/3291926373 <== mon.0 v2:172.21.15.122:3300/0 5 ==== fsmap(e 9) ==== 4720+0+0 (secure 0 0 0) 0x7fd00c0f7570 con 0x55e2b669c950 2024-09-17T06:04:41.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 10 client.4821 fetch_fsmap finished waiting for FSMap version 9 2024-09-17T06:04:41.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 10 client.4821 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T06:04:41.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 20 client.4821 populate_metadata read hostname 'smithi122' 2024-09-17T06:04:41.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55e2b627f830 0x55e2b67f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:41.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 4 client.4821 mds_command: new command op to 4450 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T06:04:41.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.879+0000 7fd0293ea000 1 -- 172.21.15.122:0/3291926373 --> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] -- command(tid 0: {"prefix": "status"}) -- 0x55e2b6800600 con 0x55e2b627f830 2024-09-17T06:04:41.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd01b7fe640 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55e2b627f830 0x55e2b67f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:41.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd01b7fe640 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55e2b627f830 0x55e2b67f4fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bd290822ad2a68b server_cookie=c55e5bf35657482e in_seq=0 out_seq=0 2024-09-17T06:04:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fcffa7fc640 10 client.4821 ms_handle_connect on v2:172.21.15.173:6838/1694851531 2024-09-17T06:04:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fcffa7fc640 1 -- 172.21.15.122:0/3291926373 <== mds.0 v2:172.21.15.173:6838/1694851531 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55e2b6800600 con 0x55e2b627f830 2024-09-17T06:04:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fcffa7fc640 10 client.4821 handle_command_reply: tid=0 2024-09-17T06:04:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd0293ea000 1 client.4821 shutdown 2024-09-17T06:04:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd0293ea000 1 -- 172.21.15.122:0/3291926373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 msgr2=0x55e2b685f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd0293ea000 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b685f8a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd00c01d150 tx=0x7fd00c0fd2d0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd0293ea000 1 -- 172.21.15.122:0/3291926373 shutdown_connections 2024-09-17T06:04:41.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd0293ea000 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:6838/1694851531,v1:172.21.15.173:6839/1694851531] conn(0x55e2b627f830 0x55e2b67f4fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd0293ea000 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2b669c950 0x55e2b685f8a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fcffa7fc640 0 client.4821 ms_handle_reset on v2:172.21.15.173:6838/1694851531 2024-09-17T06:04:41.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd0293ea000 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55e2b6685ca0 0x55e2b685f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd0293ea000 1 --2- 172.21.15.122:0/3291926373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2b62ac460 0x55e2b685ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd0293ea000 1 -- 172.21.15.122:0/3291926373 >> 172.21.15.122:0/3291926373 conn(0x55e2b6772d90 msgr2=0x55e2b67a1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:41.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd0293ea000 1 -- 172.21.15.122:0/3291926373 shutdown_connections 2024-09-17T06:04:41.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd0293ea000 1 -- 172.21.15.122:0/3291926373 wait complete. 2024-09-17T06:04:41.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd0293ea000 20 client.4821 trim_cache size 0 max 16384 2024-09-17T06:04:41.893 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:04:41.894 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_fsid": "5aff0fc3-254a-48aa-be08-0081a34bd09c", 2024-09-17T06:04:41.894 INFO:teuthology.orchestra.run.smithi122.stdout: "whoami": 0, 2024-09-17T06:04:41.894 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4450, 2024-09-17T06:04:41.894 INFO:teuthology.orchestra.run.smithi122.stdout: "want_state": "up:active", 2024-09-17T06:04:41.894 INFO:teuthology.orchestra.run.smithi122.stdout: "state": "up:active", 2024-09-17T06:04:41.894 INFO:teuthology.orchestra.run.smithi122.stdout: "fs_name": "cephfs", 2024-09-17T06:04:41.894 INFO:teuthology.orchestra.run.smithi122.stdout: "rank_uptime": 33.072413959000002, 2024-09-17T06:04:41.894 INFO:teuthology.orchestra.run.smithi122.stdout: "mdsmap_epoch": 9, 2024-09-17T06:04:41.894 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_epoch": 26, 2024-09-17T06:04:41.894 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_epoch_barrier": 26, 2024-09-17T06:04:41.894 INFO:teuthology.orchestra.run.smithi122.stdout: "uptime": 39.042342380000001 2024-09-17T06:04:41.894 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:04:41.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd02211f640 1 -- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd008073230 msgr2=0x7fd008075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:41.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd02211f640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd008073230 0x7fd008075740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd014007bf0 tx=0x7fd014007240 comp rx=0 tx=0).stop 2024-09-17T06:04:41.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd02211f640 1 -- 172.21.15.122:0/144605005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd01c152210 msgr2=0x7fd01c157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:41.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd02211f640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd01c152210 0x7fd01c157370 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0b0040 tx=0x7fd00c0a5760 comp rx=0 tx=0).stop 2024-09-17T06:04:41.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd02211f640 1 -- 172.21.15.122:0/144605005 shutdown_connections 2024-09-17T06:04:41.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd02211f640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd01c152210 0x7fd01c157370 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd02211f640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd008073230 0x7fd008075740 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd02211f640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd01c06ebd0 0x7fd01c1f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd02211f640 1 --2- 172.21.15.122:0/144605005 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd01c06ce90 0x7fd01c145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:41.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd02211f640 1 -- 172.21.15.122:0/144605005 >> 172.21.15.122:0/144605005 conn(0x7fd01c073240 msgr2=0x7fd01c0c8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:41.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd02211f640 1 -- 172.21.15.122:0/144605005 shutdown_connections 2024-09-17T06:04:41.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:41.883+0000 7fd02211f640 1 -- 172.21.15.122:0/144605005 wait complete. 2024-09-17T06:04:41.904 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-17T06:04:41.915 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-17T06:04:41.915 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-17T06:04:41.915 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-17T06:04:41.916 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T06:04:41.916 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T06:04:41.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:41.916 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-09-17T06:04:41.921 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-17T06:04:41.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:41.921 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T06:04:41.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:41.976 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link delete ceph-brx 2024-09-17T06:04:42.149 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-17T06:04:42.149 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T06:04:42.149 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T06:04:42.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 -- 172.21.15.122:0/1128055542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cb00cc640 msgr2=0x7f7cb00cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:42.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 --2- 172.21.15.122:0/1128055542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cb00cc640 0x7f7cb00cca50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009840 tx=0x7f7ca001c820 comp rx=0 tx=0).stop 2024-09-17T06:04:42.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 -- 172.21.15.122:0/1128055542 shutdown_connections 2024-09-17T06:04:42.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 --2- 172.21.15.122:0/1128055542 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7cb00ccf90 0x7f7cb0162110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:42.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 --2- 172.21.15.122:0/1128055542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cb00cc640 0x7f7cb00cca50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:42.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 -- 172.21.15.122:0/1128055542 >> 172.21.15.122:0/1128055542 conn(0x7f7cb00746d0 msgr2=0x7f7cb0074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:42.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 -- 172.21.15.122:0/1128055542 shutdown_connections 2024-09-17T06:04:42.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 -- 172.21.15.122:0/1128055542 wait complete. 2024-09-17T06:04:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 Processor -- start 2024-09-17T06:04:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 -- start start 2024-09-17T06:04:42.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7cb00cc640 0x7f7cb014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:42.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cb014e140 0x7f7cb014a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:42.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cb0154b70 0x7f7cb0154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb00c9ff0 con 0x7f7cb014e140 2024-09-17T06:04:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb00c9e70 con 0x7f7cb0154b70 2024-09-17T06:04:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb82c1640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb0074310 con 0x7f7cb00cc640 2024-09-17T06:04:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb585c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cb014e140 0x7f7cb014a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb585c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cb014e140 0x7f7cb014a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49662/0 (socket says 172.21.15.122:49662) 2024-09-17T06:04:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.303+0000 7f7cb585c640 1 -- 172.21.15.122:0/3770105528 learned_addr learned my addr 172.21.15.122:0/3770105528 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb605d640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7cb00cc640 0x7f7cb014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb685e640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cb0154b70 0x7f7cb0154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb585c640 1 -- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7cb00cc640 msgr2=0x7f7cb014af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb585c640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7cb00cc640 0x7f7cb014af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb585c640 1 -- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cb0154b70 msgr2=0x7f7cb0154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb585c640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cb0154b70 0x7f7cb0154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:42.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb585c640 1 -- 172.21.15.122:0/3770105528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb014b4d0 con 0x7f7cb014e140 2024-09-17T06:04:42.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb605d640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7cb00cc640 0x7f7cb014af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:42.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb585c640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cb014e140 0x7f7cb014a370 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000c10 tx=0x7f7ca00a6580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:42.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7ca6ffd640 1 -- 172.21.15.122:0/3770105528 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00ac030 con 0x7f7cb014e140 2024-09-17T06:04:42.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7ca6ffd640 1 -- 172.21.15.122:0/3770105528 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ca0005430 con 0x7f7cb014e140 2024-09-17T06:04:42.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7ca6ffd640 1 -- 172.21.15.122:0/3770105528 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00046d0 con 0x7f7cb014e140 2024-09-17T06:04:42.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb82c1640 1 -- 172.21.15.122:0/3770105528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb01521d0 con 0x7f7cb014e140 2024-09-17T06:04:42.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb82c1640 1 -- 172.21.15.122:0/3770105528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb0153480 con 0x7f7cb014e140 2024-09-17T06:04:42.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb82c1640 1 -- 172.21.15.122:0/3770105528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb014e550 con 0x7f7cb014e140 2024-09-17T06:04:42.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7ca6ffd640 1 -- 172.21.15.122:0/3770105528 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7ca00af070 con 0x7f7cb014e140 2024-09-17T06:04:42.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7ca6ffd640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7c94073200 0x7f7c94075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:42.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7ca6ffd640 1 -- 172.21.15.122:0/3770105528 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7ca012eb10 con 0x7f7cb014e140 2024-09-17T06:04:42.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.307+0000 7f7cb605d640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7c94073200 0x7f7c94075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:42.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.311+0000 7f7cb605d640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7c94073200 0x7f7c94075710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7cac001630 tx=0x7f7cac009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:42.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.311+0000 7f7ca6ffd640 1 -- 172.21.15.122:0/3770105528 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7ca0016410 con 0x7f7cb014e140 2024-09-17T06:04:42.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 -- 172.21.15.122:0/3770105528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7cb00cb5a0 con 0x7f7cb014e140 2024-09-17T06:04:42.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7ca6ffd640 1 -- 172.21.15.122:0/3770105528 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f7ca00f9860 con 0x7f7cb014e140 2024-09-17T06:04:42.520 INFO:teuthology.orchestra.run.smithi122.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T06:04:42.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 -- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7c94073200 msgr2=0x7f7c94075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:42.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7c94073200 0x7f7c94075710 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7cac001630 tx=0x7f7cac009040 comp rx=0 tx=0).stop 2024-09-17T06:04:42.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 -- 172.21.15.122:0/3770105528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cb014e140 msgr2=0x7f7cb014a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:42.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cb014e140 0x7f7cb014a370 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000c10 tx=0x7f7ca00a6580 comp rx=0 tx=0).stop 2024-09-17T06:04:42.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 -- 172.21.15.122:0/3770105528 shutdown_connections 2024-09-17T06:04:42.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7c94073200 0x7f7c94075710 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:42.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cb0154b70 0x7f7cb0154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:42.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cb014e140 0x7f7cb014a370 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:42.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 --2- 172.21.15.122:0/3770105528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7cb00cc640 0x7f7cb014af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:42.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 -- 172.21.15.122:0/3770105528 >> 172.21.15.122:0/3770105528 conn(0x7f7cb00746d0 msgr2=0x7f7cb00c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:42.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 -- 172.21.15.122:0/3770105528 shutdown_connections 2024-09-17T06:04:42.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42.519+0000 7f7cb82c1640 1 -- 172.21.15.122:0/3770105528 wait complete. 2024-09-17T06:04:42.542 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T06:04:42.542 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T06:04:42.542 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2024-09-17T06:04:42.542 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T06:04:42.542 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T06:04:42.542 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T06:04:42.542 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T06:04:42.542 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T06:04:42.542 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T06:04:42.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:42.543 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2024-09-17T06:04:42.548 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T06:04:42.548 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T06:04:42.548 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T06:04:42.548 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f0 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f1 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T06:04:42.549 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42468sec preferred_lft 42468sec 2024-09-17T06:04:42.550 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::ec4:7aff:fe8f:d515/64 scope link 2024-09-17T06:04:42.550 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-09-17T06:04:42.550 INFO:teuthology.orchestra.run.smithi122.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T06:04:42.550 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 02:42:d7:61:66:b1 brd ff:ff:ff:ff:ff:ff 2024-09-17T06:04:42.550 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T06:04:42.550 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-09-17T06:04:42.550 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T06:04:42.550 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T06:04:42.550 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-17T06:04:42.550 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add name ceph-brx type bridge 2024-09-17T06:04:42.550 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip addr flush dev ceph-brx 2024-09-17T06:04:42.550 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set ceph-brx up 2024-09-17T06:04:42.551 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T06:04:42.551 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-17T06:04:42.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T06:04:42.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:42.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:42.671 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T06:04:42.729 INFO:teuthology.orchestra.run.smithi122.stdout:1 2024-09-17T06:04:42.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:42.730 DEBUG:teuthology.orchestra.run.smithi122:> route 2024-09-17T06:04:42.778 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2024-09-17T06:04:42.778 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T06:04:42.778 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T06:04:42.778 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T06:04:42.778 INFO:teuthology.orchestra.run.smithi122.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T06:04:42.778 INFO:teuthology.orchestra.run.smithi122.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T06:04:42.778 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T06:04:42.779 INFO:teuthology.orchestra.run.smithi122.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T06:04:42.779 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T06:04:42.779 INFO:teuthology.orchestra.run.smithi122.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T06:04:42.779 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T06:04:42.779 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T06:04:42.779 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-17T06:04:42.779 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T06:04:42.779 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T06:04:42.779 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T06:04:42.779 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-17T06:04:42.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T06:04:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:42.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:42.895 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-09-17T06:04:42.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:42.945 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list-id 2024-09-17T06:04:42.993 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T06:04:42.994 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-17T06:04:42.994 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T06:04:42.994 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T06:04:42.994 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-17T06:04:43.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T06:04:43.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:43.107 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T06:04:43.108 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T06:04:43.108 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-17T06:04:43.108 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T06:04:43.108 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T06:04:43.108 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T06:04:43.108 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T06:04:43.109 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T06:04:43.109 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-17T06:04:43.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T06:04:43.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:43.202 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T06:04:43.203 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-17T06:04:43.203 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2024-09-17T06:04:43.203 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T06:04:43.203 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-17T06:04:43.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T06:04:43.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:43.305 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T06:04:43.305 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T06:04:43.306 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T06:04:43.351 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T06:04:43.351 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T06:04:43.351 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T06:04:43.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo modprobe fuse 2024-09-17T06:04:43.457 DEBUG:teuthology.orchestra.run.smithi122:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T06:04:43.504 INFO:teuthology.orchestra.run.smithi122.stdout:/sys 2024-09-17T06:04:43.505 INFO:teuthology.orchestra.run.smithi122.stdout:/proc 2024-09-17T06:04:43.505 INFO:teuthology.orchestra.run.smithi122.stdout:/dev 2024-09-17T06:04:43.505 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/pts 2024-09-17T06:04:43.505 INFO:teuthology.orchestra.run.smithi122.stdout:/run 2024-09-17T06:04:43.505 INFO:teuthology.orchestra.run.smithi122.stdout:/ 2024-09-17T06:04:43.505 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/security 2024-09-17T06:04:43.505 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/shm 2024-09-17T06:04:43.505 INFO:teuthology.orchestra.run.smithi122.stdout:/run/lock 2024-09-17T06:04:43.505 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/cgroup 2024-09-17T06:04:43.505 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/pstore 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/bpf 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/hugepages 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/mqueue 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/debug 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/tracing 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/fs/nfsd 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/fuse/connections 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/config 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-sysusers.service 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/run/rpc_pipefs 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/run/user/1000 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph 2024-09-17T06:04:43.506 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T06:04:43.507 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T06:04:43.507 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T06:04:43.507 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T06:04:43.507 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns 2024-09-17T06:04:43.507 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T06:04:43.507 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T06:04:43.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:43.508 DEBUG:teuthology.orchestra.run.smithi122:> ls /sys/fs/fuse/connections 2024-09-17T06:04:43.556 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T06:04:43.556 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T06:04:43.601 DEBUG:teuthology.orchestra.run.smithi122:> sudo modprobe fuse 2024-09-17T06:04:43.615 DEBUG:teuthology.orchestra.run.smithi122:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T06:04:43.665 INFO:teuthology.orchestra.run.smithi122.stdout:/sys 2024-09-17T06:04:43.665 INFO:teuthology.orchestra.run.smithi122.stdout:/proc 2024-09-17T06:04:43.665 INFO:teuthology.orchestra.run.smithi122.stdout:/dev 2024-09-17T06:04:43.665 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/pts 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/run 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/ 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/security 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/shm 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/run/lock 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/cgroup 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/pstore 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/bpf 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/hugepages 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/mqueue 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/debug 2024-09-17T06:04:43.666 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/tracing 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/fs/nfsd 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/fuse/connections 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/config 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-sysusers.service 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/run/rpc_pipefs 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/run/user/1000 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns 2024-09-17T06:04:43.667 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T06:04:43.668 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T06:04:43.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:43.668 DEBUG:teuthology.orchestra.run.smithi122:> ls /sys/fs/fuse/connections 2024-09-17T06:04:43.711 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi122.stderr:2024-09-17T06:04:43.711+0000 7f4049a4c580 -1 init, newargv = 0x7f4038001090 newargc=15 2024-09-17T06:04:43.712 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi122.stderr:ceph-fuse[37080]: starting ceph client 2024-09-17T06:04:43.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi122.stderr:ceph-fuse[37080]: starting fuse 2024-09-17T06:04:44.813 DEBUG:teuthology.orchestra.run.smithi122:> sudo modprobe fuse 2024-09-17T06:04:44.934 DEBUG:teuthology.orchestra.run.smithi122:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T06:04:44.982 INFO:teuthology.orchestra.run.smithi122.stdout:/sys 2024-09-17T06:04:44.983 INFO:teuthology.orchestra.run.smithi122.stdout:/proc 2024-09-17T06:04:44.983 INFO:teuthology.orchestra.run.smithi122.stdout:/dev 2024-09-17T06:04:44.983 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/pts 2024-09-17T06:04:44.983 INFO:teuthology.orchestra.run.smithi122.stdout:/run 2024-09-17T06:04:44.983 INFO:teuthology.orchestra.run.smithi122.stdout:/ 2024-09-17T06:04:44.983 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/security 2024-09-17T06:04:44.983 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/shm 2024-09-17T06:04:44.983 INFO:teuthology.orchestra.run.smithi122.stdout:/run/lock 2024-09-17T06:04:44.983 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/cgroup 2024-09-17T06:04:44.983 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/pstore 2024-09-17T06:04:44.983 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/bpf 2024-09-17T06:04:44.983 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T06:04:44.984 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/hugepages 2024-09-17T06:04:44.984 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/mqueue 2024-09-17T06:04:44.984 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/debug 2024-09-17T06:04:44.984 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/tracing 2024-09-17T06:04:44.984 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/fs/nfsd 2024-09-17T06:04:44.984 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/fuse/connections 2024-09-17T06:04:44.984 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/config 2024-09-17T06:04:44.984 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-sysusers.service 2024-09-17T06:04:44.984 INFO:teuthology.orchestra.run.smithi122.stdout:/run/rpc_pipefs 2024-09-17T06:04:44.984 INFO:teuthology.orchestra.run.smithi122.stdout:/run/user/1000 2024-09-17T06:04:44.984 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph 2024-09-17T06:04:44.984 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T06:04:44.985 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T06:04:44.985 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T06:04:44.985 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T06:04:44.985 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns 2024-09-17T06:04:44.985 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T06:04:44.985 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T06:04:44.985 INFO:teuthology.orchestra.run.smithi122.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-17T06:04:44.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:44.986 DEBUG:teuthology.orchestra.run.smithi122:> ls /sys/fs/fuse/connections 2024-09-17T06:04:45.032 INFO:teuthology.orchestra.run.smithi122.stdout:45 2024-09-17T06:04:45.032 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-17T06:04:45.033 DEBUG:teuthology.orchestra.run.smithi122:> sudo stdin-killer -- python3 -c ' 2024-09-17T06:04:45.033 DEBUG:teuthology.orchestra.run.smithi122:> import glob 2024-09-17T06:04:45.033 DEBUG:teuthology.orchestra.run.smithi122:> import re 2024-09-17T06:04:45.033 DEBUG:teuthology.orchestra.run.smithi122:> import os 2024-09-17T06:04:45.033 DEBUG:teuthology.orchestra.run.smithi122:> import subprocess 2024-09-17T06:04:45.033 DEBUG:teuthology.orchestra.run.smithi122:> 2024-09-17T06:04:45.033 DEBUG:teuthology.orchestra.run.smithi122:> def _find_admin_socket(client_name): 2024-09-17T06:04:45.033 DEBUG:teuthology.orchestra.run.smithi122:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T06:04:45.033 DEBUG:teuthology.orchestra.run.smithi122:> files = glob.glob(asok_path) 2024-09-17T06:04:45.033 DEBUG:teuthology.orchestra.run.smithi122:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T06:04:45.033 DEBUG:teuthology.orchestra.run.smithi122:> 2024-09-17T06:04:45.033 DEBUG:teuthology.orchestra.run.smithi122:> # Given a non-glob path, it better be there 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> if "*" not in asok_path: 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> assert(len(files) == 1) 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> return files[0] 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> for f in files: 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> contents = proc_f.read() 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> if mountpoint in contents: 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> return f 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> print(_find_admin_socket("client.0")) 2024-09-17T06:04:45.034 DEBUG:teuthology.orchestra.run.smithi122:> ' 2024-09-17T06:04:45.157 INFO:teuthology.orchestra.run.smithi122.stdout:/var/run/ceph/ceph-client.0.37080.asok 2024-09-17T06:04:45.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T06:04:45.168 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37080.asok 2024-09-17T06:04:45.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:45.169 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37080.asok status 2024-09-17T06:04:45.347 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:04:45.347 INFO:teuthology.orchestra.run.smithi122.stdout: "metadata": { 2024-09-17T06:04:45.347 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_sha1": "ce1b342bf8c6349a8c90cd607f83bff2443f21cf", 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_version": "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)", 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: "entity_id": "0", 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: "hostname": "smithi122", 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: "pid": "37080", 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: "root": "/" 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: "dentry_count": 0, 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: "dentry_pinned_count": 0, 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4839, 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: "inst": { 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: "name": { 2024-09-17T06:04:45.348 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "client", 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: "num": 4839 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": { 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "192.168.0.1:0", 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2091475061 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": { 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "192.168.0.1:0", 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2091475061 2024-09-17T06:04:45.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:45.350 INFO:teuthology.orchestra.run.smithi122.stdout: "inst_str": "client.4839 192.168.0.1:0/2091475061", 2024-09-17T06:04:45.350 INFO:teuthology.orchestra.run.smithi122.stdout: "addr_str": "192.168.0.1:0/2091475061", 2024-09-17T06:04:45.350 INFO:teuthology.orchestra.run.smithi122.stdout: "inode_count": 1, 2024-09-17T06:04:45.350 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_epoch": 9, 2024-09-17T06:04:45.350 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_epoch": 26, 2024-09-17T06:04:45.350 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_epoch_barrier": 0, 2024-09-17T06:04:45.350 INFO:teuthology.orchestra.run.smithi122.stdout: "blocklisted": false, 2024-09-17T06:04:45.350 INFO:teuthology.orchestra.run.smithi122.stdout: "fs_name": "cephfs" 2024-09-17T06:04:45.350 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:04:45.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:45.364 DEBUG:teuthology.orchestra.run.smithi122:> stat --file-system '--printf=%T 2024-09-17T06:04:45.364 DEBUG:teuthology.orchestra.run.smithi122:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T06:04:45.369 INFO:teuthology.orchestra.run.smithi122.stdout:fuseblk 2024-09-17T06:04:45.370 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T06:04:45.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:04:45.370 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T06:04:45.422 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-17T06:04:45.472 INFO:tasks.thrashosds:config is {'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-17T06:04:45.472 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_shutdown_timeout': 120}, 'mds': {'mds oft prefetch dirfrags': True, 'mds_sleep_rank_change': 5000000.0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T06:04:45.472 INFO:tasks.thrashosds:config is {'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-17T06:04:45.473 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-17T06:04:45.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.631+0000 7f89a31bd640 1 -- 172.21.15.122:0/3126496880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c153310 msgr2=0x7f899c15aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:45.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.631+0000 7f89a31bd640 1 --2- 172.21.15.122:0/3126496880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c153310 0x7f899c15aa30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f899c0c3a80 tx=0x7f899401f580 comp rx=0 tx=0).stop 2024-09-17T06:04:45.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.631+0000 7f89a31bd640 1 -- 172.21.15.122:0/3126496880 shutdown_connections 2024-09-17T06:04:45.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.631+0000 7f89a31bd640 1 --2- 172.21.15.122:0/3126496880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c153310 0x7f899c15aa30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:45.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.631+0000 7f89a31bd640 1 --2- 172.21.15.122:0/3126496880 >> v2:172.21.15.173:3300/0 conn(0x7f899c0c6780 0x7f899c159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:45.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.631+0000 7f89a31bd640 1 -- 172.21.15.122:0/3126496880 >> 172.21.15.122:0/3126496880 conn(0x7f899c0746d0 msgr2=0x7f899c074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:45.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.631+0000 7f89a31bd640 1 -- 172.21.15.122:0/3126496880 shutdown_connections 2024-09-17T06:04:45.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.631+0000 7f89a31bd640 1 -- 172.21.15.122:0/3126496880 wait complete. 2024-09-17T06:04:45.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.631+0000 7f89a31bd640 1 Processor -- start 2024-09-17T06:04:45.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.631+0000 7f89a31bd640 1 -- start start 2024-09-17T06:04:45.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a31bd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f899c0c6780 0x7f899c0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:45.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a31bd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f899c152f00 0x7f899c147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:45.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a31bd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c153310 0x7f899c146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:45.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a31bd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f899c15d470 con 0x7f899c153310 2024-09-17T06:04:45.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a31bd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f899c15d190 con 0x7f899c0c6780 2024-09-17T06:04:45.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a31bd640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f899c0b8cf0 con 0x7f899c152f00 2024-09-17T06:04:45.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a175a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c153310 0x7f899c146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:45.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a175a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c153310 0x7f899c146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34982/0 (socket says 172.21.15.122:34982) 2024-09-17T06:04:45.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a175a640 1 -- 172.21.15.122:0/43135022 learned_addr learned my addr 172.21.15.122:0/43135022 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:45.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f8993fff640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f899c152f00 0x7f899c147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:45.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a0f59640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f899c0c6780 0x7f899c0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:45.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a175a640 1 -- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f899c152f00 msgr2=0x7f899c147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:45.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a175a640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f899c152f00 0x7f899c147e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:45.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a175a640 1 -- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f899c0c6780 msgr2=0x7f899c0cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:45.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a175a640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f899c0c6780 0x7f899c0cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:45.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a175a640 1 -- 172.21.15.122:0/43135022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c0cc310 con 0x7f899c153310 2024-09-17T06:04:45.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f8993fff640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f899c152f00 0x7f899c147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:45.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a0f59640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f899c0c6780 0x7f899c0cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:45.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a175a640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c153310 0x7f899c146fc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f899401dc30 tx=0x7f8994005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:45.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89917fa640 1 -- 172.21.15.122:0/43135022 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89940b5040 con 0x7f899c153310 2024-09-17T06:04:45.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89917fa640 1 -- 172.21.15.122:0/43135022 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89940be070 con 0x7f899c153310 2024-09-17T06:04:45.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89917fa640 1 -- 172.21.15.122:0/43135022 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89940b0aa0 con 0x7f899c153310 2024-09-17T06:04:45.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a31bd640 1 -- 172.21.15.122:0/43135022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c0ccfd0 con 0x7f899c153310 2024-09-17T06:04:45.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a31bd640 1 -- 172.21.15.122:0/43135022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c0cb8b0 con 0x7f899c153310 2024-09-17T06:04:45.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89a31bd640 1 -- 172.21.15.122:0/43135022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c0cc4e0 con 0x7f899c153310 2024-09-17T06:04:45.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.635+0000 7f89917fa640 1 -- 172.21.15.122:0/43135022 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f89940b0c40 con 0x7f899c153310 2024-09-17T06:04:45.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.639+0000 7f89917fa640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8988073200 0x7f8988075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:45.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.639+0000 7f89917fa640 1 -- 172.21.15.122:0/43135022 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8994132380 con 0x7f899c153310 2024-09-17T06:04:45.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.639+0000 7f89a0f59640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8988073200 0x7f8988075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:45.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.639+0000 7f89a0f59640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8988073200 0x7f8988075710 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f89980058d0 tx=0x7f8998005ca0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:45.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.643+0000 7f89917fa640 1 -- 172.21.15.122:0/43135022 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f89940190e0 con 0x7f899c153310 2024-09-17T06:04:45.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.815+0000 7f89a31bd640 1 -- 172.21.15.122:0/43135022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mgr_debug_aggressive_pg_num_changes}] v 0) -- 0x7f899c0c71f0 con 0x7f899c153310 2024-09-17T06:04:45.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.823+0000 7f89917fa640 1 -- 172.21.15.122:0/43135022 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr_debug_aggressive_pg_num_changes}]=0 v37)=0 v37) ==== 136+0+0 (secure 0 0 0) 0x7f89940fd180 con 0x7f899c153310 2024-09-17T06:04:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.827+0000 7f89a31bd640 1 -- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8988073200 msgr2=0x7f8988075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.827+0000 7f89a31bd640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8988073200 0x7f8988075710 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f89980058d0 tx=0x7f8998005ca0 comp rx=0 tx=0).stop 2024-09-17T06:04:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.827+0000 7f89a31bd640 1 -- 172.21.15.122:0/43135022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c153310 msgr2=0x7f899c146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.827+0000 7f89a31bd640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c153310 0x7f899c146fc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f899401dc30 tx=0x7f8994005b10 comp rx=0 tx=0).stop 2024-09-17T06:04:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.827+0000 7f89a31bd640 1 -- 172.21.15.122:0/43135022 shutdown_connections 2024-09-17T06:04:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.827+0000 7f89a31bd640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c153310 0x7f899c146fc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.827+0000 7f89a31bd640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f899c152f00 0x7f899c147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.827+0000 7f89a31bd640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8988073200 0x7f8988075710 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.827+0000 7f89a31bd640 1 --2- 172.21.15.122:0/43135022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f899c0c6780 0x7f899c0cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.827+0000 7f89a31bd640 1 -- 172.21.15.122:0/43135022 >> 172.21.15.122:0/43135022 conn(0x7f899c0746d0 msgr2=0x7f899c149030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.827+0000 7f89a31bd640 1 -- 172.21.15.122:0/43135022 shutdown_connections 2024-09-17T06:04:45.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:45.827+0000 7f89a31bd640 1 -- 172.21.15.122:0/43135022 wait complete. 2024-09-17T06:04:45.848 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-17T06:04:45.848 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T06:04:45.848 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:04:46.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.007+0000 7f9c7b031640 1 -- 172.21.15.122:0/910872297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c7406eb90 msgr2=0x7f9c741620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.007+0000 7f9c7b031640 1 --2- 172.21.15.122:0/910872297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c7406eb90 0x7f9c741620f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009c80 tx=0x7f9c6c01cd10 comp rx=0 tx=0).stop 2024-09-17T06:04:46.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.007+0000 7f9c7b031640 1 -- 172.21.15.122:0/910872297 shutdown_connections 2024-09-17T06:04:46.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.007+0000 7f9c7b031640 1 --2- 172.21.15.122:0/910872297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c7406eb90 0x7f9c741620f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.007+0000 7f9c7b031640 1 --2- 172.21.15.122:0/910872297 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c740c3440 0x7f9c7414e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.007+0000 7f9c7b031640 1 -- 172.21.15.122:0/910872297 >> 172.21.15.122:0/910872297 conn(0x7f9c74070c10 msgr2=0x7f9c74072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:46.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.007+0000 7f9c7b031640 1 -- 172.21.15.122:0/910872297 shutdown_connections 2024-09-17T06:04:46.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.007+0000 7f9c7b031640 1 -- 172.21.15.122:0/910872297 wait complete. 2024-09-17T06:04:46.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c7b031640 1 Processor -- start 2024-09-17T06:04:46.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c7b031640 1 -- start start 2024-09-17T06:04:46.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c7b031640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c7406e780 0x7f9c741f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:46.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c7b031640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c7406eb90 0x7f9c7414f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:46.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c7b031640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c740c3440 0x7f9c74144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:46.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c7b031640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9c74151d30 con 0x7f9c7406eb90 2024-09-17T06:04:46.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c7b031640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9c74151eb0 con 0x7f9c740c3440 2024-09-17T06:04:46.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c7b031640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9c740c3a00 con 0x7f9c7406e780 2024-09-17T06:04:46.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c6bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c7406eb90 0x7f9c7414f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:46.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c6bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c7406eb90 0x7f9c7414f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34986/0 (socket says 172.21.15.122:34986) 2024-09-17T06:04:46.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c6bfff640 1 -- 172.21.15.122:0/1101791790 learned_addr learned my addr 172.21.15.122:0/1101791790 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:46.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c78dcd640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c7406e780 0x7f9c741f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:46.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c795ce640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c740c3440 0x7f9c74144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:46.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c6bfff640 1 -- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c7406e780 msgr2=0x7f9c741f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c6bfff640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c7406e780 0x7f9c741f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c6bfff640 1 -- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c740c3440 msgr2=0x7f9c74144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c6bfff640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c740c3440 0x7f9c74144960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c6bfff640 1 -- 172.21.15.122:0/1101791790 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c74155650 con 0x7f9c7406eb90 2024-09-17T06:04:46.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c6bfff640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c7406eb90 0x7f9c7414f2b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9c6400c3f0 tx=0x7f9c6400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:46.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c697fa640 1 -- 172.21.15.122:0/1101791790 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c64017070 con 0x7f9c7406eb90 2024-09-17T06:04:46.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c697fa640 1 -- 172.21.15.122:0/1101791790 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c640053c0 con 0x7f9c7406eb90 2024-09-17T06:04:46.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c7b031640 1 -- 172.21.15.122:0/1101791790 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c741f0950 con 0x7f9c7406eb90 2024-09-17T06:04:46.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c697fa640 1 -- 172.21.15.122:0/1101791790 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c64003860 con 0x7f9c7406eb90 2024-09-17T06:04:46.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.011+0000 7f9c7b031640 1 -- 172.21.15.122:0/1101791790 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c741f0f10 con 0x7f9c7406eb90 2024-09-17T06:04:46.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.015+0000 7f9c7b031640 1 -- 172.21.15.122:0/1101791790 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c740c4110 con 0x7f9c7406eb90 2024-09-17T06:04:46.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.015+0000 7f9c697fa640 1 -- 172.21.15.122:0/1101791790 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9c6401a070 con 0x7f9c7406eb90 2024-09-17T06:04:46.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.015+0000 7f9c697fa640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9c60073200 0x7f9c60075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:46.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.015+0000 7f9c697fa640 1 -- 172.21.15.122:0/1101791790 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9c64093980 con 0x7f9c7406eb90 2024-09-17T06:04:46.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.015+0000 7f9c78dcd640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9c60073200 0x7f9c60075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:46.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.015+0000 7f9c78dcd640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9c60073200 0x7f9c60075710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000abe0 tx=0x7f9c7000a2f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:46.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.019+0000 7f9c697fa640 1 -- 172.21.15.122:0/1101791790 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9c64001090 con 0x7f9c7406eb90 2024-09-17T06:04:46.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.187+0000 7f9c7b031640 1 -- 172.21.15.122:0/1101791790 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c7406e2e0 con 0x7f9c60073200 2024-09-17T06:04:46.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.203+0000 7f9c697fa640 1 -- 172.21.15.122:0/1101791790 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7f9c70070300 con 0x7f9c60073200 2024-09-17T06:04:46.208 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:46.211 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:04:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.207+0000 7f9c7b031640 1 -- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9c60073200 msgr2=0x7f9c60075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.207+0000 7f9c7b031640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9c60073200 0x7f9c60075710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000abe0 tx=0x7f9c7000a2f0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.207+0000 7f9c7b031640 1 -- 172.21.15.122:0/1101791790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c7406eb90 msgr2=0x7f9c7414f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.207+0000 7f9c7b031640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c7406eb90 0x7f9c7414f2b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9c6400c3f0 tx=0x7f9c6400c8b0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.207+0000 7f9c7b031640 1 -- 172.21.15.122:0/1101791790 shutdown_connections 2024-09-17T06:04:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.207+0000 7f9c7b031640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9c60073200 0x7f9c60075710 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.207+0000 7f9c7b031640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c740c3440 0x7f9c74144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.207+0000 7f9c7b031640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c7406eb90 0x7f9c7414f2b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.207+0000 7f9c7b031640 1 --2- 172.21.15.122:0/1101791790 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9c7406e780 0x7f9c741f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.207+0000 7f9c7b031640 1 -- 172.21.15.122:0/1101791790 >> 172.21.15.122:0/1101791790 conn(0x7f9c74070c10 msgr2=0x7f9c740c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.207+0000 7f9c7b031640 1 -- 172.21.15.122:0/1101791790 shutdown_connections 2024-09-17T06:04:46.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.207+0000 7f9c7b031640 1 -- 172.21.15.122:0/1101791790 wait complete. 2024-09-17T06:04:46.231 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-17T06:04:45.526849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219568,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755152,"statfs":{"total":773094113280,"available":772869275648,"internally_reserved":0,"allocated":3416064,"data_stored":2037216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005778"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827969+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:04:14.827969+0000","last_peered":"2024-09-17T06:04:14.827969+0000","last_clean":"2024-09-17T06:04:14.827969+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:04:14.827969+0000","last_undegraded":"2024-09-17T06:04:14.827969+0000","last_fullsized":"2024-09-17T06:04:14.827969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914314+0000","last_change":"2024-09-17T06:04:08.851488+0000","last_active":"2024-09-17T06:04:13.914314+0000","last_peered":"2024-09-17T06:04:13.914314+0000","last_clean":"2024-09-17T06:04:13.914314+0000","last_became_active":"2024-09-17T06:04:08.847345+0000","last_became_peered":"2024-09-17T06:04:08.847345+0000","last_unstale":"2024-09-17T06:04:13.914314+0000","last_undegraded":"2024-09-17T06:04:13.914314+0000","last_fullsized":"2024-09-17T06:04:13.914314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912954+0000","last_change":"2024-09-17T06:04:13.045049+0000","last_active":"2024-09-17T06:04:13.912954+0000","last_peered":"2024-09-17T06:04:13.912954+0000","last_clean":"2024-09-17T06:04:13.912954+0000","last_became_active":"2024-09-17T06:04:13.041321+0000","last_became_peered":"2024-09-17T06:04:13.041321+0000","last_unstale":"2024-09-17T06:04:13.912954+0000","last_undegraded":"2024-09-17T06:04:13.912954+0000","last_fullsized":"2024-09-17T06:04:13.912954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.500551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914545+0000","last_change":"2024-09-17T06:04:07.834691+0000","last_active":"2024-09-17T06:04:13.914545+0000","last_peered":"2024-09-17T06:04:13.914545+0000","last_clean":"2024-09-17T06:04:13.914545+0000","last_became_active":"2024-09-17T06:04:07.834110+0000","last_became_peered":"2024-09-17T06:04:07.834110+0000","last_unstale":"2024-09-17T06:04:13.914545+0000","last_undegraded":"2024-09-17T06:04:13.914545+0000","last_fullsized":"2024-09-17T06:04:13.914545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827140+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:04:14.827140+0000","last_peered":"2024-09-17T06:04:14.827140+0000","last_clean":"2024-09-17T06:04:14.827140+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:04:14.827140+0000","last_undegraded":"2024-09-17T06:04:14.827140+0000","last_fullsized":"2024-09-17T06:04:14.827140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915612+0000","last_change":"2024-09-17T06:04:12.954966+0000","last_active":"2024-09-17T06:04:13.915612+0000","last_peered":"2024-09-17T06:04:13.915612+0000","last_clean":"2024-09-17T06:04:13.915612+0000","last_became_active":"2024-09-17T06:04:12.953915+0000","last_became_peered":"2024-09-17T06:04:12.953915+0000","last_unstale":"2024-09-17T06:04:13.915612+0000","last_undegraded":"2024-09-17T06:04:13.915612+0000","last_fullsized":"2024-09-17T06:04:13.915612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:54.009189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826543+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:04:14.826543+0000","last_peered":"2024-09-17T06:04:14.826543+0000","last_clean":"2024-09-17T06:04:14.826543+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:04:14.826543+0000","last_undegraded":"2024-09-17T06:04:14.826543+0000","last_fullsized":"2024-09-17T06:04:14.826543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922620+0000","last_change":"2024-09-17T06:04:08.847869+0000","last_active":"2024-09-17T06:04:13.922620+0000","last_peered":"2024-09-17T06:04:13.922620+0000","last_clean":"2024-09-17T06:04:13.922620+0000","last_became_active":"2024-09-17T06:04:08.847475+0000","last_became_peered":"2024-09-17T06:04:08.847475+0000","last_unstale":"2024-09-17T06:04:13.922620+0000","last_undegraded":"2024-09-17T06:04:13.922620+0000","last_fullsized":"2024-09-17T06:04:13.922620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:54.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.917090+0000","last_change":"2024-09-17T06:04:12.948833+0000","last_active":"2024-09-17T06:04:13.917090+0000","last_peered":"2024-09-17T06:04:13.917090+0000","last_clean":"2024-09-17T06:04:13.917090+0000","last_became_active":"2024-09-17T06:04:12.947705+0000","last_became_peered":"2024-09-17T06:04:12.947705+0000","last_unstale":"2024-09-17T06:04:13.917090+0000","last_undegraded":"2024-09-17T06:04:13.917090+0000","last_fullsized":"2024-09-17T06:04:13.917090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:46.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826033+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:04:14.826033+0000","last_peered":"2024-09-17T06:04:14.826033+0000","last_clean":"2024-09-17T06:04:14.826033+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:04:14.826033+0000","last_undegraded":"2024-09-17T06:04:14.826033+0000","last_fullsized":"2024-09-17T06:04:14.826033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923681+0000","last_change":"2024-09-17T06:04:08.850056+0000","last_active":"2024-09-17T06:04:13.923681+0000","last_peered":"2024-09-17T06:04:13.923681+0000","last_clean":"2024-09-17T06:04:13.923681+0000","last_became_active":"2024-09-17T06:04:08.847436+0000","last_became_peered":"2024-09-17T06:04:08.847436+0000","last_unstale":"2024-09-17T06:04:13.923681+0000","last_undegraded":"2024-09-17T06:04:13.923681+0000","last_fullsized":"2024-09-17T06:04:13.923681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:29.069085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916255+0000","last_change":"2024-09-17T06:04:12.951144+0000","last_active":"2024-09-17T06:04:13.916255+0000","last_peered":"2024-09-17T06:04:13.916255+0000","last_clean":"2024-09-17T06:04:13.916255+0000","last_became_active":"2024-09-17T06:04:12.950127+0000","last_became_peered":"2024-09-17T06:04:12.950127+0000","last_unstale":"2024-09-17T06:04:13.916255+0000","last_undegraded":"2024-09-17T06:04:13.916255+0000","last_fullsized":"2024-09-17T06:04:13.916255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:52.901835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.753568+0000","last_change":"2024-09-17T06:04:08.847906+0000","last_active":"2024-09-17T06:04:14.753568+0000","last_peered":"2024-09-17T06:04:14.753568+0000","last_clean":"2024-09-17T06:04:14.753568+0000","last_became_active":"2024-09-17T06:04:08.847601+0000","last_became_peered":"2024-09-17T06:04:08.847601+0000","last_unstale":"2024-09-17T06:04:14.753568+0000","last_undegraded":"2024-09-17T06:04:14.753568+0000","last_fullsized":"2024-09-17T06:04:14.753568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826490+0000","last_change":"2024-09-17T06:04:07.851351+0000","last_active":"2024-09-17T06:04:14.826490+0000","last_peered":"2024-09-17T06:04:14.826490+0000","last_clean":"2024-09-17T06:04:14.826490+0000","last_became_active":"2024-09-17T06:04:07.850947+0000","last_became_peered":"2024-09-17T06:04:07.850947+0000","last_unstale":"2024-09-17T06:04:14.826490+0000","last_undegraded":"2024-09-17T06:04:14.826490+0000","last_fullsized":"2024-09-17T06:04:14.826490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:43.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919163+0000","last_change":"2024-09-17T06:04:12.936732+0000","last_active":"2024-09-17T06:04:13.919163+0000","last_peered":"2024-09-17T06:04:13.919163+0000","last_clean":"2024-09-17T06:04:13.919163+0000","last_became_active":"2024-09-17T06:04:12.935512+0000","last_became_peered":"2024-09-17T06:04:12.935512+0000","last_unstale":"2024-09-17T06:04:13.919163+0000","last_undegraded":"2024-09-17T06:04:13.919163+0000","last_fullsized":"2024-09-17T06:04:13.919163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915113+0000","last_change":"2024-09-17T06:04:08.847093+0000","last_active":"2024-09-17T06:04:13.915113+0000","last_peered":"2024-09-17T06:04:13.915113+0000","last_clean":"2024-09-17T06:04:13.915113+0000","last_became_active":"2024-09-17T06:04:08.846716+0000","last_became_peered":"2024-09-17T06:04:08.846716+0000","last_unstale":"2024-09-17T06:04:13.915113+0000","last_undegraded":"2024-09-17T06:04:13.915113+0000","last_fullsized":"2024-09-17T06:04:13.915113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557626+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:04:14.557626+0000","last_peered":"2024-09-17T06:04:14.557626+0000","last_clean":"2024-09-17T06:04:14.557626+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:04:14.557626+0000","last_undegraded":"2024-09-17T06:04:14.557626+0000","last_fullsized":"2024-09-17T06:04:14.557626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918420+0000","last_change":"2024-09-17T06:04:12.951796+0000","last_active":"2024-09-17T06:04:13.918420+0000","last_peered":"2024-09-17T06:04:13.918420+0000","last_clean":"2024-09-17T06:04:13.918420+0000","last_became_active":"2024-09-17T06:04:12.948211+0000","last_became_peered":"2024-09-17T06:04:12.948211+0000","last_unstale":"2024-09-17T06:04:13.918420+0000","last_undegraded":"2024-09-17T06:04:13.918420+0000","last_fullsized":"2024-09-17T06:04:13.918420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:43.869350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913781+0000","last_change":"2024-09-17T06:04:08.850212+0000","last_active":"2024-09-17T06:04:13.913781+0000","last_peered":"2024-09-17T06:04:13.913781+0000","last_clean":"2024-09-17T06:04:13.913781+0000","last_became_active":"2024-09-17T06:04:08.835906+0000","last_became_peered":"2024-09-17T06:04:08.835906+0000","last_unstale":"2024-09-17T06:04:13.913781+0000","last_undegraded":"2024-09-17T06:04:13.913781+0000","last_fullsized":"2024-09-17T06:04:13.913781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556835+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:04:14.556835+0000","last_peered":"2024-09-17T06:04:14.556835+0000","last_clean":"2024-09-17T06:04:14.556835+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:04:14.556835+0000","last_undegraded":"2024-09-17T06:04:14.556835+0000","last_fullsized":"2024-09-17T06:04:14.556835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558516+0000","last_change":"2024-09-17T06:04:13.048882+0000","last_active":"2024-09-17T06:04:14.558516+0000","last_peered":"2024-09-17T06:04:14.558516+0000","last_clean":"2024-09-17T06:04:14.558516+0000","last_became_active":"2024-09-17T06:04:13.047684+0000","last_became_peered":"2024-09-17T06:04:13.047684+0000","last_unstale":"2024-09-17T06:04:14.558516+0000","last_undegraded":"2024-09-17T06:04:14.558516+0000","last_fullsized":"2024-09-17T06:04:14.558516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:21.270772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916697+0000","last_change":"2024-09-17T06:04:08.838033+0000","last_active":"2024-09-17T06:04:13.916697+0000","last_peered":"2024-09-17T06:04:13.916697+0000","last_clean":"2024-09-17T06:04:13.916697+0000","last_became_active":"2024-09-17T06:04:08.836402+0000","last_became_peered":"2024-09-17T06:04:08.836402+0000","last_unstale":"2024-09-17T06:04:13.916697+0000","last_undegraded":"2024-09-17T06:04:13.916697+0000","last_fullsized":"2024-09-17T06:04:13.916697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:12.374198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825530+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:04:14.825530+0000","last_peered":"2024-09-17T06:04:14.825530+0000","last_clean":"2024-09-17T06:04:14.825530+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:04:14.825530+0000","last_undegraded":"2024-09-17T06:04:14.825530+0000","last_fullsized":"2024-09-17T06:04:14.825530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919390+0000","last_change":"2024-09-17T06:04:12.949288+0000","last_active":"2024-09-17T06:04:13.919390+0000","last_peered":"2024-09-17T06:04:13.919390+0000","last_clean":"2024-09-17T06:04:13.919390+0000","last_became_active":"2024-09-17T06:04:12.947997+0000","last_became_peered":"2024-09-17T06:04:12.947997+0000","last_unstale":"2024-09-17T06:04:13.919390+0000","last_undegraded":"2024-09-17T06:04:13.919390+0000","last_fullsized":"2024-09-17T06:04:13.919390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827729+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:04:14.827729+0000","last_peered":"2024-09-17T06:04:14.827729+0000","last_clean":"2024-09-17T06:04:14.827729+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:04:14.827729+0000","last_undegraded":"2024-09-17T06:04:14.827729+0000","last_fullsized":"2024-09-17T06:04:14.827729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755401+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:04:14.755401+0000","last_peered":"2024-09-17T06:04:14.755401+0000","last_clean":"2024-09-17T06:04:14.755401+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:04:14.755401+0000","last_undegraded":"2024-09-17T06:04:14.755401+0000","last_fullsized":"2024-09-17T06:04:14.755401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915706+0000","last_change":"2024-09-17T06:04:13.039804+0000","last_active":"2024-09-17T06:04:13.915706+0000","last_peered":"2024-09-17T06:04:13.915706+0000","last_clean":"2024-09-17T06:04:13.915706+0000","last_became_active":"2024-09-17T06:04:13.038212+0000","last_became_peered":"2024-09-17T06:04:13.038212+0000","last_unstale":"2024-09-17T06:04:13.915706+0000","last_undegraded":"2024-09-17T06:04:13.915706+0000","last_fullsized":"2024-09-17T06:04:13.915706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:35.798927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915606+0000","last_change":"2024-09-17T06:04:08.853353+0000","last_active":"2024-09-17T06:04:13.915606+0000","last_peered":"2024-09-17T06:04:13.915606+0000","last_clean":"2024-09-17T06:04:13.915606+0000","last_became_active":"2024-09-17T06:04:08.852015+0000","last_became_peered":"2024-09-17T06:04:08.852015+0000","last_unstale":"2024-09-17T06:04:13.915606+0000","last_undegraded":"2024-09-17T06:04:13.915606+0000","last_fullsized":"2024-09-17T06:04:13.915606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558240+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:04:14.558240+0000","last_peered":"2024-09-17T06:04:14.558240+0000","last_clean":"2024-09-17T06:04:14.558240+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:04:14.558240+0000","last_undegraded":"2024-09-17T06:04:14.558240+0000","last_fullsized":"2024-09-17T06:04:14.558240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912658+0000","last_change":"2024-09-17T06:04:13.034589+0000","last_active":"2024-09-17T06:04:13.912658+0000","last_peered":"2024-09-17T06:04:13.912658+0000","last_clean":"2024-09-17T06:04:13.912658+0000","last_became_active":"2024-09-17T06:04:13.034080+0000","last_became_peered":"2024-09-17T06:04:13.034080+0000","last_unstale":"2024-09-17T06:04:13.912658+0000","last_undegraded":"2024-09-17T06:04:13.912658+0000","last_fullsized":"2024-09-17T06:04:13.912658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:16.669822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557861+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:04:14.557861+0000","last_peered":"2024-09-17T06:04:14.557861+0000","last_clean":"2024-09-17T06:04:14.557861+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:04:14.557861+0000","last_undegraded":"2024-09-17T06:04:14.557861+0000","last_fullsized":"2024-09-17T06:04:14.557861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826908+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:04:14.826908+0000","last_peered":"2024-09-17T06:04:14.826908+0000","last_clean":"2024-09-17T06:04:14.826908+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:04:14.826908+0000","last_undegraded":"2024-09-17T06:04:14.826908+0000","last_fullsized":"2024-09-17T06:04:14.826908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826528+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:04:14.826528+0000","last_peered":"2024-09-17T06:04:14.826528+0000","last_clean":"2024-09-17T06:04:14.826528+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:04:14.826528+0000","last_undegraded":"2024-09-17T06:04:14.826528+0000","last_fullsized":"2024-09-17T06:04:14.826528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923885+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:04:13.923885+0000","last_peered":"2024-09-17T06:04:13.923885+0000","last_clean":"2024-09-17T06:04:13.923885+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:04:13.923885+0000","last_undegraded":"2024-09-17T06:04:13.923885+0000","last_fullsized":"2024-09-17T06:04:13.923885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558155+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:04:14.558155+0000","last_peered":"2024-09-17T06:04:14.558155+0000","last_clean":"2024-09-17T06:04:14.558155+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:04:14.558155+0000","last_undegraded":"2024-09-17T06:04:14.558155+0000","last_fullsized":"2024-09-17T06:04:14.558155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556865+0000","last_change":"2024-09-17T06:04:12.942301+0000","last_active":"2024-09-17T06:04:14.556865+0000","last_peered":"2024-09-17T06:04:14.556865+0000","last_clean":"2024-09-17T06:04:14.556865+0000","last_became_active":"2024-09-17T06:04:12.941640+0000","last_became_peered":"2024-09-17T06:04:12.941640+0000","last_unstale":"2024-09-17T06:04:14.556865+0000","last_undegraded":"2024-09-17T06:04:14.556865+0000","last_fullsized":"2024-09-17T06:04:14.556865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:31.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918736+0000","last_change":"2024-09-17T06:04:08.838642+0000","last_active":"2024-09-17T06:04:13.918736+0000","last_peered":"2024-09-17T06:04:13.918736+0000","last_clean":"2024-09-17T06:04:13.918736+0000","last_became_active":"2024-09-17T06:04:08.835562+0000","last_became_peered":"2024-09-17T06:04:08.835562+0000","last_unstale":"2024-09-17T06:04:13.918736+0000","last_undegraded":"2024-09-17T06:04:13.918736+0000","last_fullsized":"2024-09-17T06:04:13.918736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:16.900376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922711+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:04:13.922711+0000","last_peered":"2024-09-17T06:04:13.922711+0000","last_clean":"2024-09-17T06:04:13.922711+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:04:13.922711+0000","last_undegraded":"2024-09-17T06:04:13.922711+0000","last_fullsized":"2024-09-17T06:04:13.922711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557663+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:04:14.557663+0000","last_peered":"2024-09-17T06:04:14.557663+0000","last_clean":"2024-09-17T06:04:14.557663+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:04:14.557663+0000","last_undegraded":"2024-09-17T06:04:14.557663+0000","last_fullsized":"2024-09-17T06:04:14.557663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556896+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:04:14.556896+0000","last_peered":"2024-09-17T06:04:14.556896+0000","last_clean":"2024-09-17T06:04:14.556896+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:04:14.556896+0000","last_undegraded":"2024-09-17T06:04:14.556896+0000","last_fullsized":"2024-09-17T06:04:14.556896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824198+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:04:14.824198+0000","last_peered":"2024-09-17T06:04:14.824198+0000","last_clean":"2024-09-17T06:04:14.824198+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:04:14.824198+0000","last_undegraded":"2024-09-17T06:04:14.824198+0000","last_fullsized":"2024-09-17T06:04:14.824198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558517+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:04:14.558517+0000","last_peered":"2024-09-17T06:04:14.558517+0000","last_clean":"2024-09-17T06:04:14.558517+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:04:14.558517+0000","last_undegraded":"2024-09-17T06:04:14.558517+0000","last_fullsized":"2024-09-17T06:04:14.558517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826003+0000","last_change":"2024-09-17T06:04:08.840359+0000","last_active":"2024-09-17T06:04:14.826003+0000","last_peered":"2024-09-17T06:04:14.826003+0000","last_clean":"2024-09-17T06:04:14.826003+0000","last_became_active":"2024-09-17T06:04:08.839822+0000","last_became_peered":"2024-09-17T06:04:08.839822+0000","last_unstale":"2024-09-17T06:04:14.826003+0000","last_undegraded":"2024-09-17T06:04:14.826003+0000","last_fullsized":"2024-09-17T06:04:14.826003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825413+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:04:14.825413+0000","last_peered":"2024-09-17T06:04:14.825413+0000","last_clean":"2024-09-17T06:04:14.825413+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:04:14.825413+0000","last_undegraded":"2024-09-17T06:04:14.825413+0000","last_fullsized":"2024-09-17T06:04:14.825413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827476+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:04:14.827476+0000","last_peered":"2024-09-17T06:04:14.827476+0000","last_clean":"2024-09-17T06:04:14.827476+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:04:14.827476+0000","last_undegraded":"2024-09-17T06:04:14.827476+0000","last_fullsized":"2024-09-17T06:04:14.827476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913432+0000","last_change":"2024-09-17T06:04:08.846617+0000","last_active":"2024-09-17T06:04:13.913432+0000","last_peered":"2024-09-17T06:04:13.913432+0000","last_clean":"2024-09-17T06:04:13.913432+0000","last_became_active":"2024-09-17T06:04:08.837049+0000","last_became_peered":"2024-09-17T06:04:08.837049+0000","last_unstale":"2024-09-17T06:04:13.913432+0000","last_undegraded":"2024-09-17T06:04:13.913432+0000","last_fullsized":"2024-09-17T06:04:13.913432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923114+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:04:13.923114+0000","last_peered":"2024-09-17T06:04:13.923114+0000","last_clean":"2024-09-17T06:04:13.923114+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:04:13.923114+0000","last_undegraded":"2024-09-17T06:04:13.923114+0000","last_fullsized":"2024-09-17T06:04:13.923114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825786+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:04:14.825786+0000","last_peered":"2024-09-17T06:04:14.825786+0000","last_clean":"2024-09-17T06:04:14.825786+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:04:14.825786+0000","last_undegraded":"2024-09-17T06:04:14.825786+0000","last_fullsized":"2024-09-17T06:04:14.825786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754281+0000","last_change":"2024-09-17T06:04:13.042118+0000","last_active":"2024-09-17T06:04:14.754281+0000","last_peered":"2024-09-17T06:04:14.754281+0000","last_clean":"2024-09-17T06:04:14.754281+0000","last_became_active":"2024-09-17T06:04:13.040403+0000","last_became_peered":"2024-09-17T06:04:13.040403+0000","last_unstale":"2024-09-17T06:04:14.754281+0000","last_undegraded":"2024-09-17T06:04:14.754281+0000","last_fullsized":"2024-09-17T06:04:14.754281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826117+0000","last_change":"2024-09-17T06:04:08.838758+0000","last_active":"2024-09-17T06:04:14.826117+0000","last_peered":"2024-09-17T06:04:14.826117+0000","last_clean":"2024-09-17T06:04:14.826117+0000","last_became_active":"2024-09-17T06:04:08.838386+0000","last_became_peered":"2024-09-17T06:04:08.838386+0000","last_unstale":"2024-09-17T06:04:14.826117+0000","last_undegraded":"2024-09-17T06:04:14.826117+0000","last_fullsized":"2024-09-17T06:04:14.826117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:03.255963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824908+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:04:14.824908+0000","last_peered":"2024-09-17T06:04:14.824908+0000","last_clean":"2024-09-17T06:04:14.824908+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:04:14.824908+0000","last_undegraded":"2024-09-17T06:04:14.824908+0000","last_fullsized":"2024-09-17T06:04:14.824908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.753747+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:04:14.753747+0000","last_peered":"2024-09-17T06:04:14.753747+0000","last_clean":"2024-09-17T06:04:14.753747+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:04:14.753747+0000","last_undegraded":"2024-09-17T06:04:14.753747+0000","last_fullsized":"2024-09-17T06:04:14.753747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922776+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:04:13.922776+0000","last_peered":"2024-09-17T06:04:13.922776+0000","last_clean":"2024-09-17T06:04:13.922776+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:04:13.922776+0000","last_undegraded":"2024-09-17T06:04:13.922776+0000","last_fullsized":"2024-09-17T06:04:13.922776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558194+0000","last_change":"2024-09-17T06:04:07.833230+0000","last_active":"2024-09-17T06:04:14.558194+0000","last_peered":"2024-09-17T06:04:14.558194+0000","last_clean":"2024-09-17T06:04:14.558194+0000","last_became_active":"2024-09-17T06:04:07.832307+0000","last_became_peered":"2024-09-17T06:04:07.832307+0000","last_unstale":"2024-09-17T06:04:14.558194+0000","last_undegraded":"2024-09-17T06:04:14.558194+0000","last_fullsized":"2024-09-17T06:04:14.558194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:15.843465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826765+0000","last_change":"2024-09-17T06:04:12.934060+0000","last_active":"2024-09-17T06:04:14.826765+0000","last_peered":"2024-09-17T06:04:14.826765+0000","last_clean":"2024-09-17T06:04:14.826765+0000","last_became_active":"2024-09-17T06:04:12.933545+0000","last_became_peered":"2024-09-17T06:04:12.933545+0000","last_unstale":"2024-09-17T06:04:14.826765+0000","last_undegraded":"2024-09-17T06:04:14.826765+0000","last_fullsized":"2024-09-17T06:04:14.826765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:29.393815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827267+0000","last_change":"2024-09-17T06:04:08.851525+0000","last_active":"2024-09-17T06:04:14.827267+0000","last_peered":"2024-09-17T06:04:14.827267+0000","last_clean":"2024-09-17T06:04:14.827267+0000","last_became_active":"2024-09-17T06:04:08.851117+0000","last_became_peered":"2024-09-17T06:04:08.851117+0000","last_unstale":"2024-09-17T06:04:14.827267+0000","last_undegraded":"2024-09-17T06:04:14.827267+0000","last_fullsized":"2024-09-17T06:04:14.827267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:53.071703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825390+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:04:14.825390+0000","last_peered":"2024-09-17T06:04:14.825390+0000","last_clean":"2024-09-17T06:04:14.825390+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:04:14.825390+0000","last_undegraded":"2024-09-17T06:04:14.825390+0000","last_fullsized":"2024-09-17T06:04:14.825390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921808+0000","last_change":"2024-09-17T06:04:13.042590+0000","last_active":"2024-09-17T06:04:13.921808+0000","last_peered":"2024-09-17T06:04:13.921808+0000","last_clean":"2024-09-17T06:04:13.921808+0000","last_became_active":"2024-09-17T06:04:13.041078+0000","last_became_peered":"2024-09-17T06:04:13.041078+0000","last_unstale":"2024-09-17T06:04:13.921808+0000","last_undegraded":"2024-09-17T06:04:13.921808+0000","last_fullsized":"2024-09-17T06:04:13.921808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:59.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826490+0000","last_change":"2024-09-17T06:04:08.848046+0000","last_active":"2024-09-17T06:04:14.826490+0000","last_peered":"2024-09-17T06:04:14.826490+0000","last_clean":"2024-09-17T06:04:14.826490+0000","last_became_active":"2024-09-17T06:04:08.847664+0000","last_became_peered":"2024-09-17T06:04:08.847664+0000","last_unstale":"2024-09-17T06:04:14.826490+0000","last_undegraded":"2024-09-17T06:04:14.826490+0000","last_fullsized":"2024-09-17T06:04:14.826490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:12.579790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919451+0000","last_change":"2024-09-17T06:04:07.841655+0000","last_active":"2024-09-17T06:04:13.919451+0000","last_peered":"2024-09-17T06:04:13.919451+0000","last_clean":"2024-09-17T06:04:13.919451+0000","last_became_active":"2024-09-17T06:04:07.840432+0000","last_became_peered":"2024-09-17T06:04:07.840432+0000","last_unstale":"2024-09-17T06:04:13.919451+0000","last_undegraded":"2024-09-17T06:04:13.919451+0000","last_fullsized":"2024-09-17T06:04:13.919451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:04.523110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915435+0000","last_change":"2024-09-17T06:04:12.955760+0000","last_active":"2024-09-17T06:04:13.915435+0000","last_peered":"2024-09-17T06:04:13.915435+0000","last_clean":"2024-09-17T06:04:13.915435+0000","last_became_active":"2024-09-17T06:04:12.954977+0000","last_became_peered":"2024-09-17T06:04:12.954977+0000","last_unstale":"2024-09-17T06:04:13.915435+0000","last_undegraded":"2024-09-17T06:04:13.915435+0000","last_fullsized":"2024-09-17T06:04:13.915435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:19.737903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825704+0000","last_change":"2024-09-17T06:04:08.849143+0000","last_active":"2024-09-17T06:04:14.825704+0000","last_peered":"2024-09-17T06:04:14.825704+0000","last_clean":"2024-09-17T06:04:14.825704+0000","last_became_active":"2024-09-17T06:04:08.848740+0000","last_became_peered":"2024-09-17T06:04:08.848740+0000","last_unstale":"2024-09-17T06:04:14.825704+0000","last_undegraded":"2024-09-17T06:04:14.825704+0000","last_fullsized":"2024-09-17T06:04:14.825704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.823997+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:04:14.823997+0000","last_peered":"2024-09-17T06:04:14.823997+0000","last_clean":"2024-09-17T06:04:14.823997+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:04:14.823997+0000","last_undegraded":"2024-09-17T06:04:14.823997+0000","last_fullsized":"2024-09-17T06:04:14.823997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827071+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:04:14.827071+0000","last_peered":"2024-09-17T06:04:14.827071+0000","last_clean":"2024-09-17T06:04:14.827071+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:04:14.827071+0000","last_undegraded":"2024-09-17T06:04:14.827071+0000","last_fullsized":"2024-09-17T06:04:14.827071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754000+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:04:14.754000+0000","last_peered":"2024-09-17T06:04:14.754000+0000","last_clean":"2024-09-17T06:04:14.754000+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:04:14.754000+0000","last_undegraded":"2024-09-17T06:04:14.754000+0000","last_fullsized":"2024-09-17T06:04:14.754000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754133+0000","last_change":"2024-09-17T06:04:07.849633+0000","last_active":"2024-09-17T06:04:14.754133+0000","last_peered":"2024-09-17T06:04:14.754133+0000","last_clean":"2024-09-17T06:04:14.754133+0000","last_became_active":"2024-09-17T06:04:07.848323+0000","last_became_peered":"2024-09-17T06:04:07.848323+0000","last_unstale":"2024-09-17T06:04:14.754133+0000","last_undegraded":"2024-09-17T06:04:14.754133+0000","last_fullsized":"2024-09-17T06:04:14.754133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915247+0000","last_change":"2024-09-17T06:04:13.036889+0000","last_active":"2024-09-17T06:04:13.915247+0000","last_peered":"2024-09-17T06:04:13.915247+0000","last_clean":"2024-09-17T06:04:13.915247+0000","last_became_active":"2024-09-17T06:04:13.035428+0000","last_became_peered":"2024-09-17T06:04:13.035428+0000","last_unstale":"2024-09-17T06:04:13.915247+0000","last_undegraded":"2024-09-17T06:04:13.915247+0000","last_fullsized":"2024-09-17T06:04:13.915247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:00.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826148+0000","last_change":"2024-09-17T06:04:08.848113+0000","last_active":"2024-09-17T06:04:14.826148+0000","last_peered":"2024-09-17T06:04:14.826148+0000","last_clean":"2024-09-17T06:04:14.826148+0000","last_became_active":"2024-09-17T06:04:08.847695+0000","last_became_peered":"2024-09-17T06:04:08.847695+0000","last_unstale":"2024-09-17T06:04:14.826148+0000","last_undegraded":"2024-09-17T06:04:14.826148+0000","last_fullsized":"2024-09-17T06:04:14.826148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:21.258775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922496+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:04:13.922496+0000","last_peered":"2024-09-17T06:04:13.922496+0000","last_clean":"2024-09-17T06:04:13.922496+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:04:13.922496+0000","last_undegraded":"2024-09-17T06:04:13.922496+0000","last_fullsized":"2024-09-17T06:04:13.922496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914403+0000","last_change":"2024-09-17T06:04:13.034560+0000","last_active":"2024-09-17T06:04:13.914403+0000","last_peered":"2024-09-17T06:04:13.914403+0000","last_clean":"2024-09-17T06:04:13.914403+0000","last_became_active":"2024-09-17T06:04:13.034023+0000","last_became_peered":"2024-09-17T06:04:13.034023+0000","last_unstale":"2024-09-17T06:04:13.914403+0000","last_undegraded":"2024-09-17T06:04:13.914403+0000","last_fullsized":"2024-09-17T06:04:13.914403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:04.549375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826605+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:04:14.826605+0000","last_peered":"2024-09-17T06:04:14.826605+0000","last_clean":"2024-09-17T06:04:14.826605+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:04:14.826605+0000","last_undegraded":"2024-09-17T06:04:14.826605+0000","last_fullsized":"2024-09-17T06:04:14.826605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827133+0000","last_change":"2024-09-17T06:04:07.837797+0000","last_active":"2024-09-17T06:04:14.827133+0000","last_peered":"2024-09-17T06:04:14.827133+0000","last_clean":"2024-09-17T06:04:14.827133+0000","last_became_active":"2024-09-17T06:04:07.837347+0000","last_became_peered":"2024-09-17T06:04:07.837347+0000","last_unstale":"2024-09-17T06:04:14.827133+0000","last_undegraded":"2024-09-17T06:04:14.827133+0000","last_fullsized":"2024-09-17T06:04:14.827133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.924037+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:04:13.924037+0000","last_peered":"2024-09-17T06:04:13.924037+0000","last_clean":"2024-09-17T06:04:13.924037+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:04:13.924037+0000","last_undegraded":"2024-09-17T06:04:13.924037+0000","last_fullsized":"2024-09-17T06:04:13.924037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826129+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:04:14.826129+0000","last_peered":"2024-09-17T06:04:14.826129+0000","last_clean":"2024-09-17T06:04:14.826129+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:04:14.826129+0000","last_undegraded":"2024-09-17T06:04:14.826129+0000","last_fullsized":"2024-09-17T06:04:14.826129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:22.322334+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:04:22.322334+0000","last_peered":"2024-09-17T06:04:22.322334+0000","last_clean":"2024-09-17T06:04:22.322334+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:04:22.322334+0000","last_undegraded":"2024-09-17T06:04:22.322334+0000","last_fullsized":"2024-09-17T06:04:22.322334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557256+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:04:14.557256+0000","last_peered":"2024-09-17T06:04:14.557256+0000","last_clean":"2024-09-17T06:04:14.557256+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:04:14.557256+0000","last_undegraded":"2024-09-17T06:04:14.557256+0000","last_fullsized":"2024-09-17T06:04:14.557256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919279+0000","last_change":"2024-09-17T06:04:08.842243+0000","last_active":"2024-09-17T06:04:13.919279+0000","last_peered":"2024-09-17T06:04:13.919279+0000","last_clean":"2024-09-17T06:04:13.919279+0000","last_became_active":"2024-09-17T06:04:08.841831+0000","last_became_peered":"2024-09-17T06:04:08.841831+0000","last_unstale":"2024-09-17T06:04:13.919279+0000","last_undegraded":"2024-09-17T06:04:13.919279+0000","last_fullsized":"2024-09-17T06:04:13.919279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:47.589819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557915+0000","last_change":"2024-09-17T06:04:07.852382+0000","last_active":"2024-09-17T06:04:14.557915+0000","last_peered":"2024-09-17T06:04:14.557915+0000","last_clean":"2024-09-17T06:04:14.557915+0000","last_became_active":"2024-09-17T06:04:07.851954+0000","last_became_peered":"2024-09-17T06:04:07.851954+0000","last_unstale":"2024-09-17T06:04:14.557915+0000","last_undegraded":"2024-09-17T06:04:14.557915+0000","last_fullsized":"2024-09-17T06:04:14.557915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918024+0000","last_change":"2024-09-17T06:04:12.942425+0000","last_active":"2024-09-17T06:04:13.918024+0000","last_peered":"2024-09-17T06:04:13.918024+0000","last_clean":"2024-09-17T06:04:13.918024+0000","last_became_active":"2024-09-17T06:04:12.937463+0000","last_became_peered":"2024-09-17T06:04:12.937463+0000","last_unstale":"2024-09-17T06:04:13.918024+0000","last_undegraded":"2024-09-17T06:04:13.918024+0000","last_fullsized":"2024-09-17T06:04:13.918024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:21.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827689+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:04:14.827689+0000","last_peered":"2024-09-17T06:04:14.827689+0000","last_clean":"2024-09-17T06:04:14.827689+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:04:14.827689+0000","last_undegraded":"2024-09-17T06:04:14.827689+0000","last_fullsized":"2024-09-17T06:04:14.827689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922956+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:04:13.922956+0000","last_peered":"2024-09-17T06:04:13.922956+0000","last_clean":"2024-09-17T06:04:13.922956+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:04:13.922956+0000","last_undegraded":"2024-09-17T06:04:13.922956+0000","last_fullsized":"2024-09-17T06:04:13.922956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913193+0000","last_change":"2024-09-17T06:04:12.956822+0000","last_active":"2024-09-17T06:04:13.913193+0000","last_peered":"2024-09-17T06:04:13.913193+0000","last_clean":"2024-09-17T06:04:13.913193+0000","last_became_active":"2024-09-17T06:04:12.956349+0000","last_became_peered":"2024-09-17T06:04:12.956349+0000","last_unstale":"2024-09-17T06:04:13.913193+0000","last_undegraded":"2024-09-17T06:04:13.913193+0000","last_fullsized":"2024-09-17T06:04:13.913193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:56.435215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922611+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:04:13.922611+0000","last_peered":"2024-09-17T06:04:13.922611+0000","last_clean":"2024-09-17T06:04:13.922611+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:04:13.922611+0000","last_undegraded":"2024-09-17T06:04:13.922611+0000","last_fullsized":"2024-09-17T06:04:13.922611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755152+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:04:14.755152+0000","last_peered":"2024-09-17T06:04:14.755152+0000","last_clean":"2024-09-17T06:04:14.755152+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:04:14.755152+0000","last_undegraded":"2024-09-17T06:04:14.755152+0000","last_fullsized":"2024-09-17T06:04:14.755152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913592+0000","last_change":"2024-09-17T06:04:13.043905+0000","last_active":"2024-09-17T06:04:13.913592+0000","last_peered":"2024-09-17T06:04:13.913592+0000","last_clean":"2024-09-17T06:04:13.913592+0000","last_became_active":"2024-09-17T06:04:13.041929+0000","last_became_peered":"2024-09-17T06:04:13.041929+0000","last_unstale":"2024-09-17T06:04:13.913592+0000","last_undegraded":"2024-09-17T06:04:13.913592+0000","last_fullsized":"2024-09-17T06:04:13.913592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:07.693245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827124+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:04:14.827124+0000","last_peered":"2024-09-17T06:04:14.827124+0000","last_clean":"2024-09-17T06:04:14.827124+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:04:14.827124+0000","last_undegraded":"2024-09-17T06:04:14.827124+0000","last_fullsized":"2024-09-17T06:04:14.827124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556560+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:04:14.556560+0000","last_peered":"2024-09-17T06:04:14.556560+0000","last_clean":"2024-09-17T06:04:14.556560+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:04:14.556560+0000","last_undegraded":"2024-09-17T06:04:14.556560+0000","last_fullsized":"2024-09-17T06:04:14.556560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921998+0000","last_change":"2024-09-17T06:04:07.857398+0000","last_active":"2024-09-17T06:04:13.921998+0000","last_peered":"2024-09-17T06:04:13.921998+0000","last_clean":"2024-09-17T06:04:13.921998+0000","last_became_active":"2024-09-17T06:04:07.856866+0000","last_became_peered":"2024-09-17T06:04:07.856866+0000","last_unstale":"2024-09-17T06:04:13.921998+0000","last_undegraded":"2024-09-17T06:04:13.921998+0000","last_fullsized":"2024-09-17T06:04:13.921998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754760+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:04:14.754760+0000","last_peered":"2024-09-17T06:04:14.754760+0000","last_clean":"2024-09-17T06:04:14.754760+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:04:14.754760+0000","last_undegraded":"2024-09-17T06:04:14.754760+0000","last_fullsized":"2024-09-17T06:04:14.754760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913448+0000","last_change":"2024-09-17T06:04:08.850811+0000","last_active":"2024-09-17T06:04:13.913448+0000","last_peered":"2024-09-17T06:04:13.913448+0000","last_clean":"2024-09-17T06:04:13.913448+0000","last_became_active":"2024-09-17T06:04:08.847235+0000","last_became_peered":"2024-09-17T06:04:08.847235+0000","last_unstale":"2024-09-17T06:04:13.913448+0000","last_undegraded":"2024-09-17T06:04:13.913448+0000","last_fullsized":"2024-09-17T06:04:13.913448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:21.794733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913694+0000","last_change":"2024-09-17T06:04:07.840224+0000","last_active":"2024-09-17T06:04:13.913694+0000","last_peered":"2024-09-17T06:04:13.913694+0000","last_clean":"2024-09-17T06:04:13.913694+0000","last_became_active":"2024-09-17T06:04:07.839703+0000","last_became_peered":"2024-09-17T06:04:07.839703+0000","last_unstale":"2024-09-17T06:04:13.913694+0000","last_undegraded":"2024-09-17T06:04:13.913694+0000","last_fullsized":"2024-09-17T06:04:13.913694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:01.141166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755032+0000","last_change":"2024-09-17T06:04:07.844255+0000","last_active":"2024-09-17T06:04:14.755032+0000","last_peered":"2024-09-17T06:04:14.755032+0000","last_clean":"2024-09-17T06:04:14.755032+0000","last_became_active":"2024-09-17T06:04:07.843380+0000","last_became_peered":"2024-09-17T06:04:07.843380+0000","last_unstale":"2024-09-17T06:04:14.755032+0000","last_undegraded":"2024-09-17T06:04:14.755032+0000","last_fullsized":"2024-09-17T06:04:14.755032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:28.720792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827019+0000","last_change":"2024-09-17T06:04:08.837656+0000","last_active":"2024-09-17T06:04:14.827019+0000","last_peered":"2024-09-17T06:04:14.827019+0000","last_clean":"2024-09-17T06:04:14.827019+0000","last_became_active":"2024-09-17T06:04:08.837157+0000","last_became_peered":"2024-09-17T06:04:08.837157+0000","last_unstale":"2024-09-17T06:04:14.827019+0000","last_undegraded":"2024-09-17T06:04:14.827019+0000","last_fullsized":"2024-09-17T06:04:14.827019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824605+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:04:14.824605+0000","last_peered":"2024-09-17T06:04:14.824605+0000","last_clean":"2024-09-17T06:04:14.824605+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:04:14.824605+0000","last_undegraded":"2024-09-17T06:04:14.824605+0000","last_fullsized":"2024-09-17T06:04:14.824605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915126+0000","last_change":"2024-09-17T06:04:07.848422+0000","last_active":"2024-09-17T06:04:13.915126+0000","last_peered":"2024-09-17T06:04:13.915126+0000","last_clean":"2024-09-17T06:04:13.915126+0000","last_became_active":"2024-09-17T06:04:07.847917+0000","last_became_peered":"2024-09-17T06:04:07.847917+0000","last_unstale":"2024-09-17T06:04:13.915126+0000","last_undegraded":"2024-09-17T06:04:13.915126+0000","last_fullsized":"2024-09-17T06:04:13.915126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:04.960985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916415+0000","last_change":"2024-09-17T06:04:08.831009+0000","last_active":"2024-09-17T06:04:13.916415+0000","last_peered":"2024-09-17T06:04:13.916415+0000","last_clean":"2024-09-17T06:04:13.916415+0000","last_became_active":"2024-09-17T06:04:08.830578+0000","last_became_peered":"2024-09-17T06:04:08.830578+0000","last_unstale":"2024-09-17T06:04:13.916415+0000","last_undegraded":"2024-09-17T06:04:13.916415+0000","last_fullsized":"2024-09-17T06:04:13.916415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:21.761554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914674+0000","last_change":"2024-09-17T06:04:12.953383+0000","last_active":"2024-09-17T06:04:13.914674+0000","last_peered":"2024-09-17T06:04:13.914674+0000","last_clean":"2024-09-17T06:04:13.914674+0000","last_became_active":"2024-09-17T06:04:12.952849+0000","last_became_peered":"2024-09-17T06:04:12.952849+0000","last_unstale":"2024-09-17T06:04:13.914674+0000","last_undegraded":"2024-09-17T06:04:13.914674+0000","last_fullsized":"2024-09-17T06:04:13.914674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:01.588798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754494+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:04:14.754494+0000","last_peered":"2024-09-17T06:04:14.754494+0000","last_clean":"2024-09-17T06:04:14.754494+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:04:14.754494+0000","last_undegraded":"2024-09-17T06:04:14.754494+0000","last_fullsized":"2024-09-17T06:04:14.754494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824042+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:04:14.824042+0000","last_peered":"2024-09-17T06:04:14.824042+0000","last_clean":"2024-09-17T06:04:14.824042+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:04:14.824042+0000","last_undegraded":"2024-09-17T06:04:14.824042+0000","last_fullsized":"2024-09-17T06:04:14.824042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922377+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:04:13.922377+0000","last_peered":"2024-09-17T06:04:13.922377+0000","last_clean":"2024-09-17T06:04:13.922377+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:04:13.922377+0000","last_undegraded":"2024-09-17T06:04:13.922377+0000","last_fullsized":"2024-09-17T06:04:13.922377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826836+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:04:14.826836+0000","last_peered":"2024-09-17T06:04:14.826836+0000","last_clean":"2024-09-17T06:04:14.826836+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:04:14.826836+0000","last_undegraded":"2024-09-17T06:04:14.826836+0000","last_fullsized":"2024-09-17T06:04:14.826836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914912+0000","last_change":"2024-09-17T06:04:08.853837+0000","last_active":"2024-09-17T06:04:13.914912+0000","last_peered":"2024-09-17T06:04:13.914912+0000","last_clean":"2024-09-17T06:04:13.914912+0000","last_became_active":"2024-09-17T06:04:08.847311+0000","last_became_peered":"2024-09-17T06:04:08.847311+0000","last_unstale":"2024-09-17T06:04:13.914912+0000","last_undegraded":"2024-09-17T06:04:13.914912+0000","last_fullsized":"2024-09-17T06:04:13.914912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:39.705332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557384+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:04:14.557384+0000","last_peered":"2024-09-17T06:04:14.557384+0000","last_clean":"2024-09-17T06:04:14.557384+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:04:14.557384+0000","last_undegraded":"2024-09-17T06:04:14.557384+0000","last_fullsized":"2024-09-17T06:04:14.557384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755114+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:04:14.755114+0000","last_peered":"2024-09-17T06:04:14.755114+0000","last_clean":"2024-09-17T06:04:14.755114+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:04:14.755114+0000","last_undegraded":"2024-09-17T06:04:14.755114+0000","last_fullsized":"2024-09-17T06:04:14.755114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915505+0000","last_change":"2024-09-17T06:04:08.847264+0000","last_active":"2024-09-17T06:04:13.915505+0000","last_peered":"2024-09-17T06:04:13.915505+0000","last_clean":"2024-09-17T06:04:13.915505+0000","last_became_active":"2024-09-17T06:04:08.846741+0000","last_became_peered":"2024-09-17T06:04:08.846741+0000","last_unstale":"2024-09-17T06:04:13.915505+0000","last_undegraded":"2024-09-17T06:04:13.915505+0000","last_fullsized":"2024-09-17T06:04:13.915505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921907+0000","last_change":"2024-09-17T06:04:08.856656+0000","last_active":"2024-09-17T06:04:13.921907+0000","last_peered":"2024-09-17T06:04:13.921907+0000","last_clean":"2024-09-17T06:04:13.921907+0000","last_became_active":"2024-09-17T06:04:08.855496+0000","last_became_peered":"2024-09-17T06:04:08.855496+0000","last_unstale":"2024-09-17T06:04:13.921907+0000","last_undegraded":"2024-09-17T06:04:13.921907+0000","last_fullsized":"2024-09-17T06:04:13.921907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913105+0000","last_change":"2024-09-17T06:04:08.851245+0000","last_active":"2024-09-17T06:04:13.913105+0000","last_peered":"2024-09-17T06:04:13.913105+0000","last_clean":"2024-09-17T06:04:13.913105+0000","last_became_active":"2024-09-17T06:04:08.847488+0000","last_became_peered":"2024-09-17T06:04:08.847488+0000","last_unstale":"2024-09-17T06:04:13.913105+0000","last_undegraded":"2024-09-17T06:04:13.913105+0000","last_fullsized":"2024-09-17T06:04:13.913105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922140+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:04:13.922140+0000","last_peered":"2024-09-17T06:04:13.922140+0000","last_clean":"2024-09-17T06:04:13.922140+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:04:13.922140+0000","last_undegraded":"2024-09-17T06:04:13.922140+0000","last_fullsized":"2024-09-17T06:04:13.922140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826398+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:04:14.826398+0000","last_peered":"2024-09-17T06:04:14.826398+0000","last_clean":"2024-09-17T06:04:14.826398+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:04:14.826398+0000","last_undegraded":"2024-09-17T06:04:14.826398+0000","last_fullsized":"2024-09-17T06:04:14.826398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754421+0000","last_change":"2024-09-17T06:04:08.847877+0000","last_active":"2024-09-17T06:04:14.754421+0000","last_peered":"2024-09-17T06:04:14.754421+0000","last_clean":"2024-09-17T06:04:14.754421+0000","last_became_active":"2024-09-17T06:04:08.847538+0000","last_became_peered":"2024-09-17T06:04:08.847538+0000","last_unstale":"2024-09-17T06:04:14.754421+0000","last_undegraded":"2024-09-17T06:04:14.754421+0000","last_fullsized":"2024-09-17T06:04:14.754421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826750+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:04:14.826750+0000","last_peered":"2024-09-17T06:04:14.826750+0000","last_clean":"2024-09-17T06:04:14.826750+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:04:14.826750+0000","last_undegraded":"2024-09-17T06:04:14.826750+0000","last_fullsized":"2024-09-17T06:04:14.826750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825216+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:04:14.825216+0000","last_peered":"2024-09-17T06:04:14.825216+0000","last_clean":"2024-09-17T06:04:14.825216+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:04:14.825216+0000","last_undegraded":"2024-09-17T06:04:14.825216+0000","last_fullsized":"2024-09-17T06:04:14.825216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923600+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:04:13.923600+0000","last_peered":"2024-09-17T06:04:13.923600+0000","last_clean":"2024-09-17T06:04:13.923600+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:04:13.923600+0000","last_undegraded":"2024-09-17T06:04:13.923600+0000","last_fullsized":"2024-09-17T06:04:13.923600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921566+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:04:13.921566+0000","last_peered":"2024-09-17T06:04:13.921566+0000","last_clean":"2024-09-17T06:04:13.921566+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:04:13.921566+0000","last_undegraded":"2024-09-17T06:04:13.921566+0000","last_fullsized":"2024-09-17T06:04:13.921566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556805+0000","last_change":"2024-09-17T06:04:08.824718+0000","last_active":"2024-09-17T06:04:14.556805+0000","last_peered":"2024-09-17T06:04:14.556805+0000","last_clean":"2024-09-17T06:04:14.556805+0000","last_became_active":"2024-09-17T06:04:08.823771+0000","last_became_peered":"2024-09-17T06:04:08.823771+0000","last_unstale":"2024-09-17T06:04:14.556805+0000","last_undegraded":"2024-09-17T06:04:14.556805+0000","last_fullsized":"2024-09-17T06:04:14.556805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:53.735092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826605+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:04:14.826605+0000","last_peered":"2024-09-17T06:04:14.826605+0000","last_clean":"2024-09-17T06:04:14.826605+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:04:14.826605+0000","last_undegraded":"2024-09-17T06:04:14.826605+0000","last_fullsized":"2024-09-17T06:04:14.826605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914823+0000","last_change":"2024-09-17T06:04:08.850255+0000","last_active":"2024-09-17T06:04:13.914823+0000","last_peered":"2024-09-17T06:04:13.914823+0000","last_clean":"2024-09-17T06:04:13.914823+0000","last_became_active":"2024-09-17T06:04:08.847637+0000","last_became_peered":"2024-09-17T06:04:08.847637+0000","last_unstale":"2024-09-17T06:04:13.914823+0000","last_undegraded":"2024-09-17T06:04:13.914823+0000","last_fullsized":"2024-09-17T06:04:13.914823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919159+0000","last_change":"2024-09-17T06:04:08.845829+0000","last_active":"2024-09-17T06:04:13.919159+0000","last_peered":"2024-09-17T06:04:13.919159+0000","last_clean":"2024-09-17T06:04:13.919159+0000","last_became_active":"2024-09-17T06:04:08.845441+0000","last_became_peered":"2024-09-17T06:04:08.845441+0000","last_unstale":"2024-09-17T06:04:13.919159+0000","last_undegraded":"2024-09-17T06:04:13.919159+0000","last_fullsized":"2024-09-17T06:04:13.919159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:38.878124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754889+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:04:14.754889+0000","last_peered":"2024-09-17T06:04:14.754889+0000","last_clean":"2024-09-17T06:04:14.754889+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:04:14.754889+0000","last_undegraded":"2024-09-17T06:04:14.754889+0000","last_fullsized":"2024-09-17T06:04:14.754889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755103+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:04:14.755103+0000","last_peered":"2024-09-17T06:04:14.755103+0000","last_clean":"2024-09-17T06:04:14.755103+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:04:14.755103+0000","last_undegraded":"2024-09-17T06:04:14.755103+0000","last_fullsized":"2024-09-17T06:04:14.755103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827068+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:04:14.827068+0000","last_peered":"2024-09-17T06:04:14.827068+0000","last_clean":"2024-09-17T06:04:14.827068+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:04:14.827068+0000","last_undegraded":"2024-09-17T06:04:14.827068+0000","last_fullsized":"2024-09-17T06:04:14.827068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912650+0000","last_change":"2024-09-17T06:04:08.853473+0000","last_active":"2024-09-17T06:04:13.912650+0000","last_peered":"2024-09-17T06:04:13.912650+0000","last_clean":"2024-09-17T06:04:13.912650+0000","last_became_active":"2024-09-17T06:04:08.851946+0000","last_became_peered":"2024-09-17T06:04:08.851946+0000","last_unstale":"2024-09-17T06:04:13.912650+0000","last_undegraded":"2024-09-17T06:04:13.912650+0000","last_fullsized":"2024-09-17T06:04:13.912650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825436+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:04:14.825436+0000","last_peered":"2024-09-17T06:04:14.825436+0000","last_clean":"2024-09-17T06:04:14.825436+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:04:14.825436+0000","last_undegraded":"2024-09-17T06:04:14.825436+0000","last_fullsized":"2024-09-17T06:04:14.825436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921983+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:04:13.921983+0000","last_peered":"2024-09-17T06:04:13.921983+0000","last_clean":"2024-09-17T06:04:13.921983+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:04:13.921983+0000","last_undegraded":"2024-09-17T06:04:13.921983+0000","last_fullsized":"2024-09-17T06:04:13.921983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825723+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:04:14.825723+0000","last_peered":"2024-09-17T06:04:14.825723+0000","last_clean":"2024-09-17T06:04:14.825723+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:04:14.825723+0000","last_undegraded":"2024-09-17T06:04:14.825723+0000","last_fullsized":"2024-09-17T06:04:14.825723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922399+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:04:13.922399+0000","last_peered":"2024-09-17T06:04:13.922399+0000","last_clean":"2024-09-17T06:04:13.922399+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:04:13.922399+0000","last_undegraded":"2024-09-17T06:04:13.922399+0000","last_fullsized":"2024-09-17T06:04:13.922399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825947+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:04:14.825947+0000","last_peered":"2024-09-17T06:04:14.825947+0000","last_clean":"2024-09-17T06:04:14.825947+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:04:14.825947+0000","last_undegraded":"2024-09-17T06:04:14.825947+0000","last_fullsized":"2024-09-17T06:04:14.825947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558186+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:04:14.558186+0000","last_peered":"2024-09-17T06:04:14.558186+0000","last_clean":"2024-09-17T06:04:14.558186+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:04:14.558186+0000","last_undegraded":"2024-09-17T06:04:14.558186+0000","last_fullsized":"2024-09-17T06:04:14.558186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826777+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:04:14.826777+0000","last_peered":"2024-09-17T06:04:14.826777+0000","last_clean":"2024-09-17T06:04:14.826777+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:04:14.826777+0000","last_undegraded":"2024-09-17T06:04:14.826777+0000","last_fullsized":"2024-09-17T06:04:14.826777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":876544,"data_stored":696906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":106060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":105990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:04:46.236 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:04:46.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.431+0000 7f34973c6640 1 -- 172.21.15.122:0/768396580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f347c003a60 msgr2=0x7f347c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.431+0000 7f34973c6640 1 --2- 172.21.15.122:0/768396580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f347c003a60 0x7f347c003ed0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f348c001dc0 tx=0x7f348c01cb10 comp rx=0 tx=0).stop 2024-09-17T06:04:46.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.431+0000 7f34973c6640 1 -- 172.21.15.122:0/768396580 shutdown_connections 2024-09-17T06:04:46.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.431+0000 7f34973c6640 1 --2- 172.21.15.122:0/768396580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f347c003a60 0x7f347c003ed0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.431+0000 7f34973c6640 1 -- 172.21.15.122:0/768396580 >> 172.21.15.122:0/768396580 conn(0x7f349008ccd0 msgr2=0x7f349008d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:46.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.431+0000 7f34973c6640 1 -- 172.21.15.122:0/768396580 shutdown_connections 2024-09-17T06:04:46.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.431+0000 7f34973c6640 1 -- 172.21.15.122:0/768396580 wait complete. 2024-09-17T06:04:46.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.435+0000 7f34973c6640 1 Processor -- start 2024-09-17T06:04:46.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.435+0000 7f34973c6640 1 -- start start 2024-09-17T06:04:46.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.435+0000 7f34973c6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f347c003a60 0x7f349014ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:46.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.435+0000 7f34973c6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349015cf60 0x7f349014a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:46.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.435+0000 7f34973c6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f349014a5d0 0x7f3490150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:46.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.435+0000 7f34973c6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f349015eb40 con 0x7f349015cf60 2024-09-17T06:04:46.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.435+0000 7f34973c6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f34900cce60 con 0x7f347c003a60 2024-09-17T06:04:46.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.435+0000 7f34973c6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f34900c5ea0 con 0x7f349014a5d0 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.435+0000 7f3494961640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349015cf60 0x7f349014a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.435+0000 7f3494961640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349015cf60 0x7f349014a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35000/0 (socket says 172.21.15.122:35000) 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.435+0000 7f3494961640 1 -- 172.21.15.122:0/3969426834 learned_addr learned my addr 172.21.15.122:0/3969426834 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3495162640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f347c003a60 0x7f349014ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3495963640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f349014a5d0 0x7f3490150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3494961640 1 -- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f349014a5d0 msgr2=0x7f3490150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3494961640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f349014a5d0 0x7f3490150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3494961640 1 -- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f347c003a60 msgr2=0x7f349014ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3494961640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f347c003a60 0x7f349014ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3494961640 1 -- 172.21.15.122:0/3969426834 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349014f200 con 0x7f349015cf60 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3494961640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349015cf60 0x7f349014a090 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f348000e9a0 tx=0x7f348000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3485ffb640 1 -- 172.21.15.122:0/3969426834 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348000cc60 con 0x7f349015cf60 2024-09-17T06:04:46.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3485ffb640 1 -- 172.21.15.122:0/3969426834 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f348000ce00 con 0x7f349015cf60 2024-09-17T06:04:46.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f34973c6640 1 -- 172.21.15.122:0/3969426834 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34901f4a30 con 0x7f349015cf60 2024-09-17T06:04:46.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3485ffb640 1 -- 172.21.15.122:0/3969426834 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480005280 con 0x7f349015cf60 2024-09-17T06:04:46.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f34973c6640 1 -- 172.21.15.122:0/3969426834 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34901549a0 con 0x7f349015cf60 2024-09-17T06:04:46.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f34973c6640 1 -- 172.21.15.122:0/3969426834 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34900c5a60 con 0x7f349015cf60 2024-09-17T06:04:46.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3485ffb640 1 -- 172.21.15.122:0/3969426834 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3480005420 con 0x7f349015cf60 2024-09-17T06:04:46.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3485ffb640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3474073230 0x7f3474075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:46.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3485ffb640 1 -- 172.21.15.122:0/3969426834 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3480094d90 con 0x7f349015cf60 2024-09-17T06:04:46.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.439+0000 7f3495162640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3474073230 0x7f3474075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:46.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.443+0000 7f3495162640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3474073230 0x7f3474075740 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f348c0aa000 tx=0x7f348c019900 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:46.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.443+0000 7f3485ffb640 1 -- 172.21.15.122:0/3969426834 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f349014f200 con 0x7f349015cf60 2024-09-17T06:04:46.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.611+0000 7f34973c6640 1 -- 172.21.15.122:0/3969426834 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f349015aa00 con 0x7f3474073230 2024-09-17T06:04:46.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.627+0000 7f3485ffb640 1 -- 172.21.15.122:0/3969426834 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7f349015aa00 con 0x7f3474073230 2024-09-17T06:04:46.633 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:46.635 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:04:46.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.631+0000 7f34973c6640 1 -- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3474073230 msgr2=0x7f3474075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.631+0000 7f34973c6640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3474073230 0x7f3474075740 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f348c0aa000 tx=0x7f348c019900 comp rx=0 tx=0).stop 2024-09-17T06:04:46.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.631+0000 7f34973c6640 1 -- 172.21.15.122:0/3969426834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349015cf60 msgr2=0x7f349014a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.631+0000 7f34973c6640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349015cf60 0x7f349014a090 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f348000e9a0 tx=0x7f348000ee60 comp rx=0 tx=0).stop 2024-09-17T06:04:46.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.631+0000 7f34973c6640 1 -- 172.21.15.122:0/3969426834 shutdown_connections 2024-09-17T06:04:46.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.631+0000 7f34973c6640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f349014a5d0 0x7f3490150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.631+0000 7f34973c6640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349015cf60 0x7f349014a090 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.631+0000 7f34973c6640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3474073230 0x7f3474075740 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.631+0000 7f34973c6640 1 --2- 172.21.15.122:0/3969426834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f347c003a60 0x7f349014ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.631+0000 7f34973c6640 1 -- 172.21.15.122:0/3969426834 >> 172.21.15.122:0/3969426834 conn(0x7f349008ccd0 msgr2=0x7f34900b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:46.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.631+0000 7f34973c6640 1 -- 172.21.15.122:0/3969426834 shutdown_connections 2024-09-17T06:04:46.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.631+0000 7f34973c6640 1 -- 172.21.15.122:0/3969426834 wait complete. 2024-09-17T06:04:46.653 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-17T06:04:45.526849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219568,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755152,"statfs":{"total":773094113280,"available":772869275648,"internally_reserved":0,"allocated":3416064,"data_stored":2037216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005778"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827969+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:04:14.827969+0000","last_peered":"2024-09-17T06:04:14.827969+0000","last_clean":"2024-09-17T06:04:14.827969+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:04:14.827969+0000","last_undegraded":"2024-09-17T06:04:14.827969+0000","last_fullsized":"2024-09-17T06:04:14.827969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914314+0000","last_change":"2024-09-17T06:04:08.851488+0000","last_active":"2024-09-17T06:04:13.914314+0000","last_peered":"2024-09-17T06:04:13.914314+0000","last_clean":"2024-09-17T06:04:13.914314+0000","last_became_active":"2024-09-17T06:04:08.847345+0000","last_became_peered":"2024-09-17T06:04:08.847345+0000","last_unstale":"2024-09-17T06:04:13.914314+0000","last_undegraded":"2024-09-17T06:04:13.914314+0000","last_fullsized":"2024-09-17T06:04:13.914314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912954+0000","last_change":"2024-09-17T06:04:13.045049+0000","last_active":"2024-09-17T06:04:13.912954+0000","last_peered":"2024-09-17T06:04:13.912954+0000","last_clean":"2024-09-17T06:04:13.912954+0000","last_became_active":"2024-09-17T06:04:13.041321+0000","last_became_peered":"2024-09-17T06:04:13.041321+0000","last_unstale":"2024-09-17T06:04:13.912954+0000","last_undegraded":"2024-09-17T06:04:13.912954+0000","last_fullsized":"2024-09-17T06:04:13.912954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.500551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914545+0000","last_change":"2024-09-17T06:04:07.834691+0000","last_active":"2024-09-17T06:04:13.914545+0000","last_peered":"2024-09-17T06:04:13.914545+0000","last_clean":"2024-09-17T06:04:13.914545+0000","last_became_active":"2024-09-17T06:04:07.834110+0000","last_became_peered":"2024-09-17T06:04:07.834110+0000","last_unstale":"2024-09-17T06:04:13.914545+0000","last_undegraded":"2024-09-17T06:04:13.914545+0000","last_fullsized":"2024-09-17T06:04:13.914545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827140+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:04:14.827140+0000","last_peered":"2024-09-17T06:04:14.827140+0000","last_clean":"2024-09-17T06:04:14.827140+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:04:14.827140+0000","last_undegraded":"2024-09-17T06:04:14.827140+0000","last_fullsized":"2024-09-17T06:04:14.827140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915612+0000","last_change":"2024-09-17T06:04:12.954966+0000","last_active":"2024-09-17T06:04:13.915612+0000","last_peered":"2024-09-17T06:04:13.915612+0000","last_clean":"2024-09-17T06:04:13.915612+0000","last_became_active":"2024-09-17T06:04:12.953915+0000","last_became_peered":"2024-09-17T06:04:12.953915+0000","last_unstale":"2024-09-17T06:04:13.915612+0000","last_undegraded":"2024-09-17T06:04:13.915612+0000","last_fullsized":"2024-09-17T06:04:13.915612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:54.009189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826543+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:04:14.826543+0000","last_peered":"2024-09-17T06:04:14.826543+0000","last_clean":"2024-09-17T06:04:14.826543+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:04:14.826543+0000","last_undegraded":"2024-09-17T06:04:14.826543+0000","last_fullsized":"2024-09-17T06:04:14.826543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922620+0000","last_change":"2024-09-17T06:04:08.847869+0000","last_active":"2024-09-17T06:04:13.922620+0000","last_peered":"2024-09-17T06:04:13.922620+0000","last_clean":"2024-09-17T06:04:13.922620+0000","last_became_active":"2024-09-17T06:04:08.847475+0000","last_became_peered":"2024-09-17T06:04:08.847475+0000","last_unstale":"2024-09-17T06:04:13.922620+0000","last_undegraded":"2024-09-17T06:04:13.922620+0000","last_fullsized":"2024-09-17T06:04:13.922620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:54.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.917090+0000","last_change":"2024-09-17T06:04:12.948833+0000","last_active":"2024-09-17T06:04:13.917090+0000","last_peered":"2024-09-17T06:04:13.917090+0000","last_clean":"2024-09-17T06:04:13.917090+0000","last_became_active":"2024-09-17T06:04:12.947705+0000","last_became_peered":"2024-09-17T06:04:12.947705+0000","last_unstale":"2024-09-17T06:04:13.917090+0000","last_undegraded":"2024-09-17T06:04:13.917090+0000","last_fullsized":"2024-09-17T06:04:13.917090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:46.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826033+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:04:14.826033+0000","last_peered":"2024-09-17T06:04:14.826033+0000","last_clean":"2024-09-17T06:04:14.826033+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:04:14.826033+0000","last_undegraded":"2024-09-17T06:04:14.826033+0000","last_fullsized":"2024-09-17T06:04:14.826033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923681+0000","last_change":"2024-09-17T06:04:08.850056+0000","last_active":"2024-09-17T06:04:13.923681+0000","last_peered":"2024-09-17T06:04:13.923681+0000","last_clean":"2024-09-17T06:04:13.923681+0000","last_became_active":"2024-09-17T06:04:08.847436+0000","last_became_peered":"2024-09-17T06:04:08.847436+0000","last_unstale":"2024-09-17T06:04:13.923681+0000","last_undegraded":"2024-09-17T06:04:13.923681+0000","last_fullsized":"2024-09-17T06:04:13.923681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:29.069085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916255+0000","last_change":"2024-09-17T06:04:12.951144+0000","last_active":"2024-09-17T06:04:13.916255+0000","last_peered":"2024-09-17T06:04:13.916255+0000","last_clean":"2024-09-17T06:04:13.916255+0000","last_became_active":"2024-09-17T06:04:12.950127+0000","last_became_peered":"2024-09-17T06:04:12.950127+0000","last_unstale":"2024-09-17T06:04:13.916255+0000","last_undegraded":"2024-09-17T06:04:13.916255+0000","last_fullsized":"2024-09-17T06:04:13.916255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:52.901835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.753568+0000","last_change":"2024-09-17T06:04:08.847906+0000","last_active":"2024-09-17T06:04:14.753568+0000","last_peered":"2024-09-17T06:04:14.753568+0000","last_clean":"2024-09-17T06:04:14.753568+0000","last_became_active":"2024-09-17T06:04:08.847601+0000","last_became_peered":"2024-09-17T06:04:08.847601+0000","last_unstale":"2024-09-17T06:04:14.753568+0000","last_undegraded":"2024-09-17T06:04:14.753568+0000","last_fullsized":"2024-09-17T06:04:14.753568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826490+0000","last_change":"2024-09-17T06:04:07.851351+0000","last_active":"2024-09-17T06:04:14.826490+0000","last_peered":"2024-09-17T06:04:14.826490+0000","last_clean":"2024-09-17T06:04:14.826490+0000","last_became_active":"2024-09-17T06:04:07.850947+0000","last_became_peered":"2024-09-17T06:04:07.850947+0000","last_unstale":"2024-09-17T06:04:14.826490+0000","last_undegraded":"2024-09-17T06:04:14.826490+0000","last_fullsized":"2024-09-17T06:04:14.826490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:43.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919163+0000","last_change":"2024-09-17T06:04:12.936732+0000","last_active":"2024-09-17T06:04:13.919163+0000","last_peered":"2024-09-17T06:04:13.919163+0000","last_clean":"2024-09-17T06:04:13.919163+0000","last_became_active":"2024-09-17T06:04:12.935512+0000","last_became_peered":"2024-09-17T06:04:12.935512+0000","last_unstale":"2024-09-17T06:04:13.919163+0000","last_undegraded":"2024-09-17T06:04:13.919163+0000","last_fullsized":"2024-09-17T06:04:13.919163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915113+0000","last_change":"2024-09-17T06:04:08.847093+0000","last_active":"2024-09-17T06:04:13.915113+0000","last_peered":"2024-09-17T06:04:13.915113+0000","last_clean":"2024-09-17T06:04:13.915113+0000","last_became_active":"2024-09-17T06:04:08.846716+0000","last_became_peered":"2024-09-17T06:04:08.846716+0000","last_unstale":"2024-09-17T06:04:13.915113+0000","last_undegraded":"2024-09-17T06:04:13.915113+0000","last_fullsized":"2024-09-17T06:04:13.915113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557626+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:04:14.557626+0000","last_peered":"2024-09-17T06:04:14.557626+0000","last_clean":"2024-09-17T06:04:14.557626+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:04:14.557626+0000","last_undegraded":"2024-09-17T06:04:14.557626+0000","last_fullsized":"2024-09-17T06:04:14.557626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918420+0000","last_change":"2024-09-17T06:04:12.951796+0000","last_active":"2024-09-17T06:04:13.918420+0000","last_peered":"2024-09-17T06:04:13.918420+0000","last_clean":"2024-09-17T06:04:13.918420+0000","last_became_active":"2024-09-17T06:04:12.948211+0000","last_became_peered":"2024-09-17T06:04:12.948211+0000","last_unstale":"2024-09-17T06:04:13.918420+0000","last_undegraded":"2024-09-17T06:04:13.918420+0000","last_fullsized":"2024-09-17T06:04:13.918420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:43.869350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913781+0000","last_change":"2024-09-17T06:04:08.850212+0000","last_active":"2024-09-17T06:04:13.913781+0000","last_peered":"2024-09-17T06:04:13.913781+0000","last_clean":"2024-09-17T06:04:13.913781+0000","last_became_active":"2024-09-17T06:04:08.835906+0000","last_became_peered":"2024-09-17T06:04:08.835906+0000","last_unstale":"2024-09-17T06:04:13.913781+0000","last_undegraded":"2024-09-17T06:04:13.913781+0000","last_fullsized":"2024-09-17T06:04:13.913781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556835+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:04:14.556835+0000","last_peered":"2024-09-17T06:04:14.556835+0000","last_clean":"2024-09-17T06:04:14.556835+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:04:14.556835+0000","last_undegraded":"2024-09-17T06:04:14.556835+0000","last_fullsized":"2024-09-17T06:04:14.556835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558516+0000","last_change":"2024-09-17T06:04:13.048882+0000","last_active":"2024-09-17T06:04:14.558516+0000","last_peered":"2024-09-17T06:04:14.558516+0000","last_clean":"2024-09-17T06:04:14.558516+0000","last_became_active":"2024-09-17T06:04:13.047684+0000","last_became_peered":"2024-09-17T06:04:13.047684+0000","last_unstale":"2024-09-17T06:04:14.558516+0000","last_undegraded":"2024-09-17T06:04:14.558516+0000","last_fullsized":"2024-09-17T06:04:14.558516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:21.270772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916697+0000","last_change":"2024-09-17T06:04:08.838033+0000","last_active":"2024-09-17T06:04:13.916697+0000","last_peered":"2024-09-17T06:04:13.916697+0000","last_clean":"2024-09-17T06:04:13.916697+0000","last_became_active":"2024-09-17T06:04:08.836402+0000","last_became_peered":"2024-09-17T06:04:08.836402+0000","last_unstale":"2024-09-17T06:04:13.916697+0000","last_undegraded":"2024-09-17T06:04:13.916697+0000","last_fullsized":"2024-09-17T06:04:13.916697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:12.374198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825530+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:04:14.825530+0000","last_peered":"2024-09-17T06:04:14.825530+0000","last_clean":"2024-09-17T06:04:14.825530+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:04:14.825530+0000","last_undegraded":"2024-09-17T06:04:14.825530+0000","last_fullsized":"2024-09-17T06:04:14.825530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919390+0000","last_change":"2024-09-17T06:04:12.949288+0000","last_active":"2024-09-17T06:04:13.919390+0000","last_peered":"2024-09-17T06:04:13.919390+0000","last_clean":"2024-09-17T06:04:13.919390+0000","last_became_active":"2024-09-17T06:04:12.947997+0000","last_became_peered":"2024-09-17T06:04:12.947997+0000","last_unstale":"2024-09-17T06:04:13.919390+0000","last_undegraded":"2024-09-17T06:04:13.919390+0000","last_fullsized":"2024-09-17T06:04:13.919390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827729+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:04:14.827729+0000","last_peered":"2024-09-17T06:04:14.827729+0000","last_clean":"2024-09-17T06:04:14.827729+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:04:14.827729+0000","last_undegraded":"2024-09-17T06:04:14.827729+0000","last_fullsized":"2024-09-17T06:04:14.827729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755401+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:04:14.755401+0000","last_peered":"2024-09-17T06:04:14.755401+0000","last_clean":"2024-09-17T06:04:14.755401+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:04:14.755401+0000","last_undegraded":"2024-09-17T06:04:14.755401+0000","last_fullsized":"2024-09-17T06:04:14.755401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915706+0000","last_change":"2024-09-17T06:04:13.039804+0000","last_active":"2024-09-17T06:04:13.915706+0000","last_peered":"2024-09-17T06:04:13.915706+0000","last_clean":"2024-09-17T06:04:13.915706+0000","last_became_active":"2024-09-17T06:04:13.038212+0000","last_became_peered":"2024-09-17T06:04:13.038212+0000","last_unstale":"2024-09-17T06:04:13.915706+0000","last_undegraded":"2024-09-17T06:04:13.915706+0000","last_fullsized":"2024-09-17T06:04:13.915706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:35.798927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915606+0000","last_change":"2024-09-17T06:04:08.853353+0000","last_active":"2024-09-17T06:04:13.915606+0000","last_peered":"2024-09-17T06:04:13.915606+0000","last_clean":"2024-09-17T06:04:13.915606+0000","last_became_active":"2024-09-17T06:04:08.852015+0000","last_became_peered":"2024-09-17T06:04:08.852015+0000","last_unstale":"2024-09-17T06:04:13.915606+0000","last_undegraded":"2024-09-17T06:04:13.915606+0000","last_fullsized":"2024-09-17T06:04:13.915606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558240+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:04:14.558240+0000","last_peered":"2024-09-17T06:04:14.558240+0000","last_clean":"2024-09-17T06:04:14.558240+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:04:14.558240+0000","last_undegraded":"2024-09-17T06:04:14.558240+0000","last_fullsized":"2024-09-17T06:04:14.558240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912658+0000","last_change":"2024-09-17T06:04:13.034589+0000","last_active":"2024-09-17T06:04:13.912658+0000","last_peered":"2024-09-17T06:04:13.912658+0000","last_clean":"2024-09-17T06:04:13.912658+0000","last_became_active":"2024-09-17T06:04:13.034080+0000","last_became_peered":"2024-09-17T06:04:13.034080+0000","last_unstale":"2024-09-17T06:04:13.912658+0000","last_undegraded":"2024-09-17T06:04:13.912658+0000","last_fullsized":"2024-09-17T06:04:13.912658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:16.669822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557861+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:04:14.557861+0000","last_peered":"2024-09-17T06:04:14.557861+0000","last_clean":"2024-09-17T06:04:14.557861+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:04:14.557861+0000","last_undegraded":"2024-09-17T06:04:14.557861+0000","last_fullsized":"2024-09-17T06:04:14.557861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826908+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:04:14.826908+0000","last_peered":"2024-09-17T06:04:14.826908+0000","last_clean":"2024-09-17T06:04:14.826908+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:04:14.826908+0000","last_undegraded":"2024-09-17T06:04:14.826908+0000","last_fullsized":"2024-09-17T06:04:14.826908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826528+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:04:14.826528+0000","last_peered":"2024-09-17T06:04:14.826528+0000","last_clean":"2024-09-17T06:04:14.826528+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:04:14.826528+0000","last_undegraded":"2024-09-17T06:04:14.826528+0000","last_fullsized":"2024-09-17T06:04:14.826528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923885+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:04:13.923885+0000","last_peered":"2024-09-17T06:04:13.923885+0000","last_clean":"2024-09-17T06:04:13.923885+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:04:13.923885+0000","last_undegraded":"2024-09-17T06:04:13.923885+0000","last_fullsized":"2024-09-17T06:04:13.923885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558155+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:04:14.558155+0000","last_peered":"2024-09-17T06:04:14.558155+0000","last_clean":"2024-09-17T06:04:14.558155+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:04:14.558155+0000","last_undegraded":"2024-09-17T06:04:14.558155+0000","last_fullsized":"2024-09-17T06:04:14.558155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556865+0000","last_change":"2024-09-17T06:04:12.942301+0000","last_active":"2024-09-17T06:04:14.556865+0000","last_peered":"2024-09-17T06:04:14.556865+0000","last_clean":"2024-09-17T06:04:14.556865+0000","last_became_active":"2024-09-17T06:04:12.941640+0000","last_became_peered":"2024-09-17T06:04:12.941640+0000","last_unstale":"2024-09-17T06:04:14.556865+0000","last_undegraded":"2024-09-17T06:04:14.556865+0000","last_fullsized":"2024-09-17T06:04:14.556865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:31.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918736+0000","last_change":"2024-09-17T06:04:08.838642+0000","last_active":"2024-09-17T06:04:13.918736+0000","last_peered":"2024-09-17T06:04:13.918736+0000","last_clean":"2024-09-17T06:04:13.918736+0000","last_became_active":"2024-09-17T06:04:08.835562+0000","last_became_peered":"2024-09-17T06:04:08.835562+0000","last_unstale":"2024-09-17T06:04:13.918736+0000","last_undegraded":"2024-09-17T06:04:13.918736+0000","last_fullsized":"2024-09-17T06:04:13.918736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:16.900376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922711+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:04:13.922711+0000","last_peered":"2024-09-17T06:04:13.922711+0000","last_clean":"2024-09-17T06:04:13.922711+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:04:13.922711+0000","last_undegraded":"2024-09-17T06:04:13.922711+0000","last_fullsized":"2024-09-17T06:04:13.922711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557663+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:04:14.557663+0000","last_peered":"2024-09-17T06:04:14.557663+0000","last_clean":"2024-09-17T06:04:14.557663+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:04:14.557663+0000","last_undegraded":"2024-09-17T06:04:14.557663+0000","last_fullsized":"2024-09-17T06:04:14.557663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556896+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:04:14.556896+0000","last_peered":"2024-09-17T06:04:14.556896+0000","last_clean":"2024-09-17T06:04:14.556896+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:04:14.556896+0000","last_undegraded":"2024-09-17T06:04:14.556896+0000","last_fullsized":"2024-09-17T06:04:14.556896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824198+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:04:14.824198+0000","last_peered":"2024-09-17T06:04:14.824198+0000","last_clean":"2024-09-17T06:04:14.824198+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:04:14.824198+0000","last_undegraded":"2024-09-17T06:04:14.824198+0000","last_fullsized":"2024-09-17T06:04:14.824198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558517+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:04:14.558517+0000","last_peered":"2024-09-17T06:04:14.558517+0000","last_clean":"2024-09-17T06:04:14.558517+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:04:14.558517+0000","last_undegraded":"2024-09-17T06:04:14.558517+0000","last_fullsized":"2024-09-17T06:04:14.558517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826003+0000","last_change":"2024-09-17T06:04:08.840359+0000","last_active":"2024-09-17T06:04:14.826003+0000","last_peered":"2024-09-17T06:04:14.826003+0000","last_clean":"2024-09-17T06:04:14.826003+0000","last_became_active":"2024-09-17T06:04:08.839822+0000","last_became_peered":"2024-09-17T06:04:08.839822+0000","last_unstale":"2024-09-17T06:04:14.826003+0000","last_undegraded":"2024-09-17T06:04:14.826003+0000","last_fullsized":"2024-09-17T06:04:14.826003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825413+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:04:14.825413+0000","last_peered":"2024-09-17T06:04:14.825413+0000","last_clean":"2024-09-17T06:04:14.825413+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:04:14.825413+0000","last_undegraded":"2024-09-17T06:04:14.825413+0000","last_fullsized":"2024-09-17T06:04:14.825413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827476+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:04:14.827476+0000","last_peered":"2024-09-17T06:04:14.827476+0000","last_clean":"2024-09-17T06:04:14.827476+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:04:14.827476+0000","last_undegraded":"2024-09-17T06:04:14.827476+0000","last_fullsized":"2024-09-17T06:04:14.827476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913432+0000","last_change":"2024-09-17T06:04:08.846617+0000","last_active":"2024-09-17T06:04:13.913432+0000","last_peered":"2024-09-17T06:04:13.913432+0000","last_clean":"2024-09-17T06:04:13.913432+0000","last_became_active":"2024-09-17T06:04:08.837049+0000","last_became_peered":"2024-09-17T06:04:08.837049+0000","last_unstale":"2024-09-17T06:04:13.913432+0000","last_undegraded":"2024-09-17T06:04:13.913432+0000","last_fullsized":"2024-09-17T06:04:13.913432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923114+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:04:13.923114+0000","last_peered":"2024-09-17T06:04:13.923114+0000","last_clean":"2024-09-17T06:04:13.923114+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:04:13.923114+0000","last_undegraded":"2024-09-17T06:04:13.923114+0000","last_fullsized":"2024-09-17T06:04:13.923114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825786+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:04:14.825786+0000","last_peered":"2024-09-17T06:04:14.825786+0000","last_clean":"2024-09-17T06:04:14.825786+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:04:14.825786+0000","last_undegraded":"2024-09-17T06:04:14.825786+0000","last_fullsized":"2024-09-17T06:04:14.825786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754281+0000","last_change":"2024-09-17T06:04:13.042118+0000","last_active":"2024-09-17T06:04:14.754281+0000","last_peered":"2024-09-17T06:04:14.754281+0000","last_clean":"2024-09-17T06:04:14.754281+0000","last_became_active":"2024-09-17T06:04:13.040403+0000","last_became_peered":"2024-09-17T06:04:13.040403+0000","last_unstale":"2024-09-17T06:04:14.754281+0000","last_undegraded":"2024-09-17T06:04:14.754281+0000","last_fullsized":"2024-09-17T06:04:14.754281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826117+0000","last_change":"2024-09-17T06:04:08.838758+0000","last_active":"2024-09-17T06:04:14.826117+0000","last_peered":"2024-09-17T06:04:14.826117+0000","last_clean":"2024-09-17T06:04:14.826117+0000","last_became_active":"2024-09-17T06:04:08.838386+0000","last_became_peered":"2024-09-17T06:04:08.838386+0000","last_unstale":"2024-09-17T06:04:14.826117+0000","last_undegraded":"2024-09-17T06:04:14.826117+0000","last_fullsized":"2024-09-17T06:04:14.826117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:03.255963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824908+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:04:14.824908+0000","last_peered":"2024-09-17T06:04:14.824908+0000","last_clean":"2024-09-17T06:04:14.824908+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:04:14.824908+0000","last_undegraded":"2024-09-17T06:04:14.824908+0000","last_fullsized":"2024-09-17T06:04:14.824908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.753747+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:04:14.753747+0000","last_peered":"2024-09-17T06:04:14.753747+0000","last_clean":"2024-09-17T06:04:14.753747+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:04:14.753747+0000","last_undegraded":"2024-09-17T06:04:14.753747+0000","last_fullsized":"2024-09-17T06:04:14.753747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922776+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:04:13.922776+0000","last_peered":"2024-09-17T06:04:13.922776+0000","last_clean":"2024-09-17T06:04:13.922776+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:04:13.922776+0000","last_undegraded":"2024-09-17T06:04:13.922776+0000","last_fullsized":"2024-09-17T06:04:13.922776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558194+0000","last_change":"2024-09-17T06:04:07.833230+0000","last_active":"2024-09-17T06:04:14.558194+0000","last_peered":"2024-09-17T06:04:14.558194+0000","last_clean":"2024-09-17T06:04:14.558194+0000","last_became_active":"2024-09-17T06:04:07.832307+0000","last_became_peered":"2024-09-17T06:04:07.832307+0000","last_unstale":"2024-09-17T06:04:14.558194+0000","last_undegraded":"2024-09-17T06:04:14.558194+0000","last_fullsized":"2024-09-17T06:04:14.558194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:15.843465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826765+0000","last_change":"2024-09-17T06:04:12.934060+0000","last_active":"2024-09-17T06:04:14.826765+0000","last_peered":"2024-09-17T06:04:14.826765+0000","last_clean":"2024-09-17T06:04:14.826765+0000","last_became_active":"2024-09-17T06:04:12.933545+0000","last_became_peered":"2024-09-17T06:04:12.933545+0000","last_unstale":"2024-09-17T06:04:14.826765+0000","last_undegraded":"2024-09-17T06:04:14.826765+0000","last_fullsized":"2024-09-17T06:04:14.826765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:29.393815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827267+0000","last_change":"2024-09-17T06:04:08.851525+0000","last_active":"2024-09-17T06:04:14.827267+0000","last_peered":"2024-09-17T06:04:14.827267+0000","last_clean":"2024-09-17T06:04:14.827267+0000","last_became_active":"2024-09-17T06:04:08.851117+0000","last_became_peered":"2024-09-17T06:04:08.851117+0000","last_unstale":"2024-09-17T06:04:14.827267+0000","last_undegraded":"2024-09-17T06:04:14.827267+0000","last_fullsized":"2024-09-17T06:04:14.827267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:53.071703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825390+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:04:14.825390+0000","last_peered":"2024-09-17T06:04:14.825390+0000","last_clean":"2024-09-17T06:04:14.825390+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:04:14.825390+0000","last_undegraded":"2024-09-17T06:04:14.825390+0000","last_fullsized":"2024-09-17T06:04:14.825390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921808+0000","last_change":"2024-09-17T06:04:13.042590+0000","last_active":"2024-09-17T06:04:13.921808+0000","last_peered":"2024-09-17T06:04:13.921808+0000","last_clean":"2024-09-17T06:04:13.921808+0000","last_became_active":"2024-09-17T06:04:13.041078+0000","last_became_peered":"2024-09-17T06:04:13.041078+0000","last_unstale":"2024-09-17T06:04:13.921808+0000","last_undegraded":"2024-09-17T06:04:13.921808+0000","last_fullsized":"2024-09-17T06:04:13.921808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:59.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826490+0000","last_change":"2024-09-17T06:04:08.848046+0000","last_active":"2024-09-17T06:04:14.826490+0000","last_peered":"2024-09-17T06:04:14.826490+0000","last_clean":"2024-09-17T06:04:14.826490+0000","last_became_active":"2024-09-17T06:04:08.847664+0000","last_became_peered":"2024-09-17T06:04:08.847664+0000","last_unstale":"2024-09-17T06:04:14.826490+0000","last_undegraded":"2024-09-17T06:04:14.826490+0000","last_fullsized":"2024-09-17T06:04:14.826490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:12.579790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919451+0000","last_change":"2024-09-17T06:04:07.841655+0000","last_active":"2024-09-17T06:04:13.919451+0000","last_peered":"2024-09-17T06:04:13.919451+0000","last_clean":"2024-09-17T06:04:13.919451+0000","last_became_active":"2024-09-17T06:04:07.840432+0000","last_became_peered":"2024-09-17T06:04:07.840432+0000","last_unstale":"2024-09-17T06:04:13.919451+0000","last_undegraded":"2024-09-17T06:04:13.919451+0000","last_fullsized":"2024-09-17T06:04:13.919451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:04.523110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915435+0000","last_change":"2024-09-17T06:04:12.955760+0000","last_active":"2024-09-17T06:04:13.915435+0000","last_peered":"2024-09-17T06:04:13.915435+0000","last_clean":"2024-09-17T06:04:13.915435+0000","last_became_active":"2024-09-17T06:04:12.954977+0000","last_became_peered":"2024-09-17T06:04:12.954977+0000","last_unstale":"2024-09-17T06:04:13.915435+0000","last_undegraded":"2024-09-17T06:04:13.915435+0000","last_fullsized":"2024-09-17T06:04:13.915435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:19.737903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825704+0000","last_change":"2024-09-17T06:04:08.849143+0000","last_active":"2024-09-17T06:04:14.825704+0000","last_peered":"2024-09-17T06:04:14.825704+0000","last_clean":"2024-09-17T06:04:14.825704+0000","last_became_active":"2024-09-17T06:04:08.848740+0000","last_became_peered":"2024-09-17T06:04:08.848740+0000","last_unstale":"2024-09-17T06:04:14.825704+0000","last_undegraded":"2024-09-17T06:04:14.825704+0000","last_fullsized":"2024-09-17T06:04:14.825704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.823997+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:04:14.823997+0000","last_peered":"2024-09-17T06:04:14.823997+0000","last_clean":"2024-09-17T06:04:14.823997+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:04:14.823997+0000","last_undegraded":"2024-09-17T06:04:14.823997+0000","last_fullsized":"2024-09-17T06:04:14.823997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827071+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:04:14.827071+0000","last_peered":"2024-09-17T06:04:14.827071+0000","last_clean":"2024-09-17T06:04:14.827071+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:04:14.827071+0000","last_undegraded":"2024-09-17T06:04:14.827071+0000","last_fullsized":"2024-09-17T06:04:14.827071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754000+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:04:14.754000+0000","last_peered":"2024-09-17T06:04:14.754000+0000","last_clean":"2024-09-17T06:04:14.754000+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:04:14.754000+0000","last_undegraded":"2024-09-17T06:04:14.754000+0000","last_fullsized":"2024-09-17T06:04:14.754000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754133+0000","last_change":"2024-09-17T06:04:07.849633+0000","last_active":"2024-09-17T06:04:14.754133+0000","last_peered":"2024-09-17T06:04:14.754133+0000","last_clean":"2024-09-17T06:04:14.754133+0000","last_became_active":"2024-09-17T06:04:07.848323+0000","last_became_peered":"2024-09-17T06:04:07.848323+0000","last_unstale":"2024-09-17T06:04:14.754133+0000","last_undegraded":"2024-09-17T06:04:14.754133+0000","last_fullsized":"2024-09-17T06:04:14.754133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915247+0000","last_change":"2024-09-17T06:04:13.036889+0000","last_active":"2024-09-17T06:04:13.915247+0000","last_peered":"2024-09-17T06:04:13.915247+0000","last_clean":"2024-09-17T06:04:13.915247+0000","last_became_active":"2024-09-17T06:04:13.035428+0000","last_became_peered":"2024-09-17T06:04:13.035428+0000","last_unstale":"2024-09-17T06:04:13.915247+0000","last_undegraded":"2024-09-17T06:04:13.915247+0000","last_fullsized":"2024-09-17T06:04:13.915247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:00.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826148+0000","last_change":"2024-09-17T06:04:08.848113+0000","last_active":"2024-09-17T06:04:14.826148+0000","last_peered":"2024-09-17T06:04:14.826148+0000","last_clean":"2024-09-17T06:04:14.826148+0000","last_became_active":"2024-09-17T06:04:08.847695+0000","last_became_peered":"2024-09-17T06:04:08.847695+0000","last_unstale":"2024-09-17T06:04:14.826148+0000","last_undegraded":"2024-09-17T06:04:14.826148+0000","last_fullsized":"2024-09-17T06:04:14.826148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:21.258775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922496+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:04:13.922496+0000","last_peered":"2024-09-17T06:04:13.922496+0000","last_clean":"2024-09-17T06:04:13.922496+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:04:13.922496+0000","last_undegraded":"2024-09-17T06:04:13.922496+0000","last_fullsized":"2024-09-17T06:04:13.922496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914403+0000","last_change":"2024-09-17T06:04:13.034560+0000","last_active":"2024-09-17T06:04:13.914403+0000","last_peered":"2024-09-17T06:04:13.914403+0000","last_clean":"2024-09-17T06:04:13.914403+0000","last_became_active":"2024-09-17T06:04:13.034023+0000","last_became_peered":"2024-09-17T06:04:13.034023+0000","last_unstale":"2024-09-17T06:04:13.914403+0000","last_undegraded":"2024-09-17T06:04:13.914403+0000","last_fullsized":"2024-09-17T06:04:13.914403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:04.549375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826605+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:04:14.826605+0000","last_peered":"2024-09-17T06:04:14.826605+0000","last_clean":"2024-09-17T06:04:14.826605+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:04:14.826605+0000","last_undegraded":"2024-09-17T06:04:14.826605+0000","last_fullsized":"2024-09-17T06:04:14.826605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827133+0000","last_change":"2024-09-17T06:04:07.837797+0000","last_active":"2024-09-17T06:04:14.827133+0000","last_peered":"2024-09-17T06:04:14.827133+0000","last_clean":"2024-09-17T06:04:14.827133+0000","last_became_active":"2024-09-17T06:04:07.837347+0000","last_became_peered":"2024-09-17T06:04:07.837347+0000","last_unstale":"2024-09-17T06:04:14.827133+0000","last_undegraded":"2024-09-17T06:04:14.827133+0000","last_fullsized":"2024-09-17T06:04:14.827133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.924037+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:04:13.924037+0000","last_peered":"2024-09-17T06:04:13.924037+0000","last_clean":"2024-09-17T06:04:13.924037+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:04:13.924037+0000","last_undegraded":"2024-09-17T06:04:13.924037+0000","last_fullsized":"2024-09-17T06:04:13.924037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826129+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:04:14.826129+0000","last_peered":"2024-09-17T06:04:14.826129+0000","last_clean":"2024-09-17T06:04:14.826129+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:04:14.826129+0000","last_undegraded":"2024-09-17T06:04:14.826129+0000","last_fullsized":"2024-09-17T06:04:14.826129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:22.322334+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:04:22.322334+0000","last_peered":"2024-09-17T06:04:22.322334+0000","last_clean":"2024-09-17T06:04:22.322334+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:04:22.322334+0000","last_undegraded":"2024-09-17T06:04:22.322334+0000","last_fullsized":"2024-09-17T06:04:22.322334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557256+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:04:14.557256+0000","last_peered":"2024-09-17T06:04:14.557256+0000","last_clean":"2024-09-17T06:04:14.557256+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:04:14.557256+0000","last_undegraded":"2024-09-17T06:04:14.557256+0000","last_fullsized":"2024-09-17T06:04:14.557256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919279+0000","last_change":"2024-09-17T06:04:08.842243+0000","last_active":"2024-09-17T06:04:13.919279+0000","last_peered":"2024-09-17T06:04:13.919279+0000","last_clean":"2024-09-17T06:04:13.919279+0000","last_became_active":"2024-09-17T06:04:08.841831+0000","last_became_peered":"2024-09-17T06:04:08.841831+0000","last_unstale":"2024-09-17T06:04:13.919279+0000","last_undegraded":"2024-09-17T06:04:13.919279+0000","last_fullsized":"2024-09-17T06:04:13.919279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:47.589819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557915+0000","last_change":"2024-09-17T06:04:07.852382+0000","last_active":"2024-09-17T06:04:14.557915+0000","last_peered":"2024-09-17T06:04:14.557915+0000","last_clean":"2024-09-17T06:04:14.557915+0000","last_became_active":"2024-09-17T06:04:07.851954+0000","last_became_peered":"2024-09-17T06:04:07.851954+0000","last_unstale":"2024-09-17T06:04:14.557915+0000","last_undegraded":"2024-09-17T06:04:14.557915+0000","last_fullsized":"2024-09-17T06:04:14.557915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.918024+0000","last_change":"2024-09-17T06:04:12.942425+0000","last_active":"2024-09-17T06:04:13.918024+0000","last_peered":"2024-09-17T06:04:13.918024+0000","last_clean":"2024-09-17T06:04:13.918024+0000","last_became_active":"2024-09-17T06:04:12.937463+0000","last_became_peered":"2024-09-17T06:04:12.937463+0000","last_unstale":"2024-09-17T06:04:13.918024+0000","last_undegraded":"2024-09-17T06:04:13.918024+0000","last_fullsized":"2024-09-17T06:04:13.918024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:21.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827689+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:04:14.827689+0000","last_peered":"2024-09-17T06:04:14.827689+0000","last_clean":"2024-09-17T06:04:14.827689+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:04:14.827689+0000","last_undegraded":"2024-09-17T06:04:14.827689+0000","last_fullsized":"2024-09-17T06:04:14.827689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922956+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:04:13.922956+0000","last_peered":"2024-09-17T06:04:13.922956+0000","last_clean":"2024-09-17T06:04:13.922956+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:04:13.922956+0000","last_undegraded":"2024-09-17T06:04:13.922956+0000","last_fullsized":"2024-09-17T06:04:13.922956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913193+0000","last_change":"2024-09-17T06:04:12.956822+0000","last_active":"2024-09-17T06:04:13.913193+0000","last_peered":"2024-09-17T06:04:13.913193+0000","last_clean":"2024-09-17T06:04:13.913193+0000","last_became_active":"2024-09-17T06:04:12.956349+0000","last_became_peered":"2024-09-17T06:04:12.956349+0000","last_unstale":"2024-09-17T06:04:13.913193+0000","last_undegraded":"2024-09-17T06:04:13.913193+0000","last_fullsized":"2024-09-17T06:04:13.913193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:56.435215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922611+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:04:13.922611+0000","last_peered":"2024-09-17T06:04:13.922611+0000","last_clean":"2024-09-17T06:04:13.922611+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:04:13.922611+0000","last_undegraded":"2024-09-17T06:04:13.922611+0000","last_fullsized":"2024-09-17T06:04:13.922611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755152+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:04:14.755152+0000","last_peered":"2024-09-17T06:04:14.755152+0000","last_clean":"2024-09-17T06:04:14.755152+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:04:14.755152+0000","last_undegraded":"2024-09-17T06:04:14.755152+0000","last_fullsized":"2024-09-17T06:04:14.755152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913592+0000","last_change":"2024-09-17T06:04:13.043905+0000","last_active":"2024-09-17T06:04:13.913592+0000","last_peered":"2024-09-17T06:04:13.913592+0000","last_clean":"2024-09-17T06:04:13.913592+0000","last_became_active":"2024-09-17T06:04:13.041929+0000","last_became_peered":"2024-09-17T06:04:13.041929+0000","last_unstale":"2024-09-17T06:04:13.913592+0000","last_undegraded":"2024-09-17T06:04:13.913592+0000","last_fullsized":"2024-09-17T06:04:13.913592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:07.693245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827124+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:04:14.827124+0000","last_peered":"2024-09-17T06:04:14.827124+0000","last_clean":"2024-09-17T06:04:14.827124+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:04:14.827124+0000","last_undegraded":"2024-09-17T06:04:14.827124+0000","last_fullsized":"2024-09-17T06:04:14.827124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556560+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:04:14.556560+0000","last_peered":"2024-09-17T06:04:14.556560+0000","last_clean":"2024-09-17T06:04:14.556560+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:04:14.556560+0000","last_undegraded":"2024-09-17T06:04:14.556560+0000","last_fullsized":"2024-09-17T06:04:14.556560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921998+0000","last_change":"2024-09-17T06:04:07.857398+0000","last_active":"2024-09-17T06:04:13.921998+0000","last_peered":"2024-09-17T06:04:13.921998+0000","last_clean":"2024-09-17T06:04:13.921998+0000","last_became_active":"2024-09-17T06:04:07.856866+0000","last_became_peered":"2024-09-17T06:04:07.856866+0000","last_unstale":"2024-09-17T06:04:13.921998+0000","last_undegraded":"2024-09-17T06:04:13.921998+0000","last_fullsized":"2024-09-17T06:04:13.921998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754760+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:04:14.754760+0000","last_peered":"2024-09-17T06:04:14.754760+0000","last_clean":"2024-09-17T06:04:14.754760+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:04:14.754760+0000","last_undegraded":"2024-09-17T06:04:14.754760+0000","last_fullsized":"2024-09-17T06:04:14.754760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913448+0000","last_change":"2024-09-17T06:04:08.850811+0000","last_active":"2024-09-17T06:04:13.913448+0000","last_peered":"2024-09-17T06:04:13.913448+0000","last_clean":"2024-09-17T06:04:13.913448+0000","last_became_active":"2024-09-17T06:04:08.847235+0000","last_became_peered":"2024-09-17T06:04:08.847235+0000","last_unstale":"2024-09-17T06:04:13.913448+0000","last_undegraded":"2024-09-17T06:04:13.913448+0000","last_fullsized":"2024-09-17T06:04:13.913448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:21.794733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913694+0000","last_change":"2024-09-17T06:04:07.840224+0000","last_active":"2024-09-17T06:04:13.913694+0000","last_peered":"2024-09-17T06:04:13.913694+0000","last_clean":"2024-09-17T06:04:13.913694+0000","last_became_active":"2024-09-17T06:04:07.839703+0000","last_became_peered":"2024-09-17T06:04:07.839703+0000","last_unstale":"2024-09-17T06:04:13.913694+0000","last_undegraded":"2024-09-17T06:04:13.913694+0000","last_fullsized":"2024-09-17T06:04:13.913694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:01.141166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755032+0000","last_change":"2024-09-17T06:04:07.844255+0000","last_active":"2024-09-17T06:04:14.755032+0000","last_peered":"2024-09-17T06:04:14.755032+0000","last_clean":"2024-09-17T06:04:14.755032+0000","last_became_active":"2024-09-17T06:04:07.843380+0000","last_became_peered":"2024-09-17T06:04:07.843380+0000","last_unstale":"2024-09-17T06:04:14.755032+0000","last_undegraded":"2024-09-17T06:04:14.755032+0000","last_fullsized":"2024-09-17T06:04:14.755032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:28.720792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827019+0000","last_change":"2024-09-17T06:04:08.837656+0000","last_active":"2024-09-17T06:04:14.827019+0000","last_peered":"2024-09-17T06:04:14.827019+0000","last_clean":"2024-09-17T06:04:14.827019+0000","last_became_active":"2024-09-17T06:04:08.837157+0000","last_became_peered":"2024-09-17T06:04:08.837157+0000","last_unstale":"2024-09-17T06:04:14.827019+0000","last_undegraded":"2024-09-17T06:04:14.827019+0000","last_fullsized":"2024-09-17T06:04:14.827019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824605+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:04:14.824605+0000","last_peered":"2024-09-17T06:04:14.824605+0000","last_clean":"2024-09-17T06:04:14.824605+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:04:14.824605+0000","last_undegraded":"2024-09-17T06:04:14.824605+0000","last_fullsized":"2024-09-17T06:04:14.824605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915126+0000","last_change":"2024-09-17T06:04:07.848422+0000","last_active":"2024-09-17T06:04:13.915126+0000","last_peered":"2024-09-17T06:04:13.915126+0000","last_clean":"2024-09-17T06:04:13.915126+0000","last_became_active":"2024-09-17T06:04:07.847917+0000","last_became_peered":"2024-09-17T06:04:07.847917+0000","last_unstale":"2024-09-17T06:04:13.915126+0000","last_undegraded":"2024-09-17T06:04:13.915126+0000","last_fullsized":"2024-09-17T06:04:13.915126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:04.960985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.916415+0000","last_change":"2024-09-17T06:04:08.831009+0000","last_active":"2024-09-17T06:04:13.916415+0000","last_peered":"2024-09-17T06:04:13.916415+0000","last_clean":"2024-09-17T06:04:13.916415+0000","last_became_active":"2024-09-17T06:04:08.830578+0000","last_became_peered":"2024-09-17T06:04:08.830578+0000","last_unstale":"2024-09-17T06:04:13.916415+0000","last_undegraded":"2024-09-17T06:04:13.916415+0000","last_fullsized":"2024-09-17T06:04:13.916415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:21.761554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914674+0000","last_change":"2024-09-17T06:04:12.953383+0000","last_active":"2024-09-17T06:04:13.914674+0000","last_peered":"2024-09-17T06:04:13.914674+0000","last_clean":"2024-09-17T06:04:13.914674+0000","last_became_active":"2024-09-17T06:04:12.952849+0000","last_became_peered":"2024-09-17T06:04:12.952849+0000","last_unstale":"2024-09-17T06:04:13.914674+0000","last_undegraded":"2024-09-17T06:04:13.914674+0000","last_fullsized":"2024-09-17T06:04:13.914674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:01.588798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754494+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:04:14.754494+0000","last_peered":"2024-09-17T06:04:14.754494+0000","last_clean":"2024-09-17T06:04:14.754494+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:04:14.754494+0000","last_undegraded":"2024-09-17T06:04:14.754494+0000","last_fullsized":"2024-09-17T06:04:14.754494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.824042+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:04:14.824042+0000","last_peered":"2024-09-17T06:04:14.824042+0000","last_clean":"2024-09-17T06:04:14.824042+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:04:14.824042+0000","last_undegraded":"2024-09-17T06:04:14.824042+0000","last_fullsized":"2024-09-17T06:04:14.824042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922377+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:04:13.922377+0000","last_peered":"2024-09-17T06:04:13.922377+0000","last_clean":"2024-09-17T06:04:13.922377+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:04:13.922377+0000","last_undegraded":"2024-09-17T06:04:13.922377+0000","last_fullsized":"2024-09-17T06:04:13.922377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826836+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:04:14.826836+0000","last_peered":"2024-09-17T06:04:14.826836+0000","last_clean":"2024-09-17T06:04:14.826836+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:04:14.826836+0000","last_undegraded":"2024-09-17T06:04:14.826836+0000","last_fullsized":"2024-09-17T06:04:14.826836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914912+0000","last_change":"2024-09-17T06:04:08.853837+0000","last_active":"2024-09-17T06:04:13.914912+0000","last_peered":"2024-09-17T06:04:13.914912+0000","last_clean":"2024-09-17T06:04:13.914912+0000","last_became_active":"2024-09-17T06:04:08.847311+0000","last_became_peered":"2024-09-17T06:04:08.847311+0000","last_unstale":"2024-09-17T06:04:13.914912+0000","last_undegraded":"2024-09-17T06:04:13.914912+0000","last_fullsized":"2024-09-17T06:04:13.914912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:39.705332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.557384+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:04:14.557384+0000","last_peered":"2024-09-17T06:04:14.557384+0000","last_clean":"2024-09-17T06:04:14.557384+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:04:14.557384+0000","last_undegraded":"2024-09-17T06:04:14.557384+0000","last_fullsized":"2024-09-17T06:04:14.557384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755114+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:04:14.755114+0000","last_peered":"2024-09-17T06:04:14.755114+0000","last_clean":"2024-09-17T06:04:14.755114+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:04:14.755114+0000","last_undegraded":"2024-09-17T06:04:14.755114+0000","last_fullsized":"2024-09-17T06:04:14.755114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.915505+0000","last_change":"2024-09-17T06:04:08.847264+0000","last_active":"2024-09-17T06:04:13.915505+0000","last_peered":"2024-09-17T06:04:13.915505+0000","last_clean":"2024-09-17T06:04:13.915505+0000","last_became_active":"2024-09-17T06:04:08.846741+0000","last_became_peered":"2024-09-17T06:04:08.846741+0000","last_unstale":"2024-09-17T06:04:13.915505+0000","last_undegraded":"2024-09-17T06:04:13.915505+0000","last_fullsized":"2024-09-17T06:04:13.915505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921907+0000","last_change":"2024-09-17T06:04:08.856656+0000","last_active":"2024-09-17T06:04:13.921907+0000","last_peered":"2024-09-17T06:04:13.921907+0000","last_clean":"2024-09-17T06:04:13.921907+0000","last_became_active":"2024-09-17T06:04:08.855496+0000","last_became_peered":"2024-09-17T06:04:08.855496+0000","last_unstale":"2024-09-17T06:04:13.921907+0000","last_undegraded":"2024-09-17T06:04:13.921907+0000","last_fullsized":"2024-09-17T06:04:13.921907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.913105+0000","last_change":"2024-09-17T06:04:08.851245+0000","last_active":"2024-09-17T06:04:13.913105+0000","last_peered":"2024-09-17T06:04:13.913105+0000","last_clean":"2024-09-17T06:04:13.913105+0000","last_became_active":"2024-09-17T06:04:08.847488+0000","last_became_peered":"2024-09-17T06:04:08.847488+0000","last_unstale":"2024-09-17T06:04:13.913105+0000","last_undegraded":"2024-09-17T06:04:13.913105+0000","last_fullsized":"2024-09-17T06:04:13.913105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922140+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:04:13.922140+0000","last_peered":"2024-09-17T06:04:13.922140+0000","last_clean":"2024-09-17T06:04:13.922140+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:04:13.922140+0000","last_undegraded":"2024-09-17T06:04:13.922140+0000","last_fullsized":"2024-09-17T06:04:13.922140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826398+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:04:14.826398+0000","last_peered":"2024-09-17T06:04:14.826398+0000","last_clean":"2024-09-17T06:04:14.826398+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:04:14.826398+0000","last_undegraded":"2024-09-17T06:04:14.826398+0000","last_fullsized":"2024-09-17T06:04:14.826398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754421+0000","last_change":"2024-09-17T06:04:08.847877+0000","last_active":"2024-09-17T06:04:14.754421+0000","last_peered":"2024-09-17T06:04:14.754421+0000","last_clean":"2024-09-17T06:04:14.754421+0000","last_became_active":"2024-09-17T06:04:08.847538+0000","last_became_peered":"2024-09-17T06:04:08.847538+0000","last_unstale":"2024-09-17T06:04:14.754421+0000","last_undegraded":"2024-09-17T06:04:14.754421+0000","last_fullsized":"2024-09-17T06:04:14.754421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826750+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:04:14.826750+0000","last_peered":"2024-09-17T06:04:14.826750+0000","last_clean":"2024-09-17T06:04:14.826750+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:04:14.826750+0000","last_undegraded":"2024-09-17T06:04:14.826750+0000","last_fullsized":"2024-09-17T06:04:14.826750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825216+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:04:14.825216+0000","last_peered":"2024-09-17T06:04:14.825216+0000","last_clean":"2024-09-17T06:04:14.825216+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:04:14.825216+0000","last_undegraded":"2024-09-17T06:04:14.825216+0000","last_fullsized":"2024-09-17T06:04:14.825216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.923600+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:04:13.923600+0000","last_peered":"2024-09-17T06:04:13.923600+0000","last_clean":"2024-09-17T06:04:13.923600+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:04:13.923600+0000","last_undegraded":"2024-09-17T06:04:13.923600+0000","last_fullsized":"2024-09-17T06:04:13.923600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921566+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:04:13.921566+0000","last_peered":"2024-09-17T06:04:13.921566+0000","last_clean":"2024-09-17T06:04:13.921566+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:04:13.921566+0000","last_undegraded":"2024-09-17T06:04:13.921566+0000","last_fullsized":"2024-09-17T06:04:13.921566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.556805+0000","last_change":"2024-09-17T06:04:08.824718+0000","last_active":"2024-09-17T06:04:14.556805+0000","last_peered":"2024-09-17T06:04:14.556805+0000","last_clean":"2024-09-17T06:04:14.556805+0000","last_became_active":"2024-09-17T06:04:08.823771+0000","last_became_peered":"2024-09-17T06:04:08.823771+0000","last_unstale":"2024-09-17T06:04:14.556805+0000","last_undegraded":"2024-09-17T06:04:14.556805+0000","last_fullsized":"2024-09-17T06:04:14.556805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:53.735092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826605+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:04:14.826605+0000","last_peered":"2024-09-17T06:04:14.826605+0000","last_clean":"2024-09-17T06:04:14.826605+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:04:14.826605+0000","last_undegraded":"2024-09-17T06:04:14.826605+0000","last_fullsized":"2024-09-17T06:04:14.826605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.914823+0000","last_change":"2024-09-17T06:04:08.850255+0000","last_active":"2024-09-17T06:04:13.914823+0000","last_peered":"2024-09-17T06:04:13.914823+0000","last_clean":"2024-09-17T06:04:13.914823+0000","last_became_active":"2024-09-17T06:04:08.847637+0000","last_became_peered":"2024-09-17T06:04:08.847637+0000","last_unstale":"2024-09-17T06:04:13.914823+0000","last_undegraded":"2024-09-17T06:04:13.914823+0000","last_fullsized":"2024-09-17T06:04:13.914823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.919159+0000","last_change":"2024-09-17T06:04:08.845829+0000","last_active":"2024-09-17T06:04:13.919159+0000","last_peered":"2024-09-17T06:04:13.919159+0000","last_clean":"2024-09-17T06:04:13.919159+0000","last_became_active":"2024-09-17T06:04:08.845441+0000","last_became_peered":"2024-09-17T06:04:08.845441+0000","last_unstale":"2024-09-17T06:04:13.919159+0000","last_undegraded":"2024-09-17T06:04:13.919159+0000","last_fullsized":"2024-09-17T06:04:13.919159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:38.878124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.754889+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:04:14.754889+0000","last_peered":"2024-09-17T06:04:14.754889+0000","last_clean":"2024-09-17T06:04:14.754889+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:04:14.754889+0000","last_undegraded":"2024-09-17T06:04:14.754889+0000","last_fullsized":"2024-09-17T06:04:14.754889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.755103+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:04:14.755103+0000","last_peered":"2024-09-17T06:04:14.755103+0000","last_clean":"2024-09-17T06:04:14.755103+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:04:14.755103+0000","last_undegraded":"2024-09-17T06:04:14.755103+0000","last_fullsized":"2024-09-17T06:04:14.755103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.827068+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:04:14.827068+0000","last_peered":"2024-09-17T06:04:14.827068+0000","last_clean":"2024-09-17T06:04:14.827068+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:04:14.827068+0000","last_undegraded":"2024-09-17T06:04:14.827068+0000","last_fullsized":"2024-09-17T06:04:14.827068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.912650+0000","last_change":"2024-09-17T06:04:08.853473+0000","last_active":"2024-09-17T06:04:13.912650+0000","last_peered":"2024-09-17T06:04:13.912650+0000","last_clean":"2024-09-17T06:04:13.912650+0000","last_became_active":"2024-09-17T06:04:08.851946+0000","last_became_peered":"2024-09-17T06:04:08.851946+0000","last_unstale":"2024-09-17T06:04:13.912650+0000","last_undegraded":"2024-09-17T06:04:13.912650+0000","last_fullsized":"2024-09-17T06:04:13.912650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825436+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:04:14.825436+0000","last_peered":"2024-09-17T06:04:14.825436+0000","last_clean":"2024-09-17T06:04:14.825436+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:04:14.825436+0000","last_undegraded":"2024-09-17T06:04:14.825436+0000","last_fullsized":"2024-09-17T06:04:14.825436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.921983+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:04:13.921983+0000","last_peered":"2024-09-17T06:04:13.921983+0000","last_clean":"2024-09-17T06:04:13.921983+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:04:13.921983+0000","last_undegraded":"2024-09-17T06:04:13.921983+0000","last_fullsized":"2024-09-17T06:04:13.921983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825723+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:04:14.825723+0000","last_peered":"2024-09-17T06:04:14.825723+0000","last_clean":"2024-09-17T06:04:14.825723+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:04:14.825723+0000","last_undegraded":"2024-09-17T06:04:14.825723+0000","last_fullsized":"2024-09-17T06:04:14.825723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:13.922399+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:04:13.922399+0000","last_peered":"2024-09-17T06:04:13.922399+0000","last_clean":"2024-09-17T06:04:13.922399+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:04:13.922399+0000","last_undegraded":"2024-09-17T06:04:13.922399+0000","last_fullsized":"2024-09-17T06:04:13.922399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.825947+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:04:14.825947+0000","last_peered":"2024-09-17T06:04:14.825947+0000","last_clean":"2024-09-17T06:04:14.825947+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:04:14.825947+0000","last_undegraded":"2024-09-17T06:04:14.825947+0000","last_fullsized":"2024-09-17T06:04:14.825947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.558186+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:04:14.558186+0000","last_peered":"2024-09-17T06:04:14.558186+0000","last_clean":"2024-09-17T06:04:14.558186+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:04:14.558186+0000","last_undegraded":"2024-09-17T06:04:14.558186+0000","last_fullsized":"2024-09-17T06:04:14.558186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T06:04:14.826777+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:04:14.826777+0000","last_peered":"2024-09-17T06:04:14.826777+0000","last_clean":"2024-09-17T06:04:14.826777+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:04:14.826777+0000","last_undegraded":"2024-09-17T06:04:14.826777+0000","last_fullsized":"2024-09-17T06:04:14.826777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":876544,"data_stored":696906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":106060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":105990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:04:46.658 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T06:04:46.658 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-17T06:04:46.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.831+0000 7fc935c94640 1 -- 172.21.15.122:0/4293455566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9300c68d0 msgr2=0x7fc93015b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.831+0000 7fc935c94640 1 --2- 172.21.15.122:0/4293455566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9300c68d0 0x7fc93015b810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc920009840 tx=0x7fc92001c820 comp rx=0 tx=0).stop 2024-09-17T06:04:46.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.831+0000 7fc935c94640 1 -- 172.21.15.122:0/4293455566 shutdown_connections 2024-09-17T06:04:46.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.831+0000 7fc935c94640 1 --2- 172.21.15.122:0/4293455566 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc93014eae0 0x7fc93015bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.831+0000 7fc935c94640 1 --2- 172.21.15.122:0/4293455566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9300c68d0 0x7fc93015b810 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.831+0000 7fc935c94640 1 -- 172.21.15.122:0/4293455566 >> 172.21.15.122:0/4293455566 conn(0x7fc9300746d0 msgr2=0x7fc930074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:46.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.831+0000 7fc935c94640 1 -- 172.21.15.122:0/4293455566 shutdown_connections 2024-09-17T06:04:46.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.831+0000 7fc935c94640 1 -- 172.21.15.122:0/4293455566 wait complete. 2024-09-17T06:04:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc935c94640 1 Processor -- start 2024-09-17T06:04:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc935c94640 1 -- start start 2024-09-17T06:04:46.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc935c94640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9300c68d0 0x7fc930148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:46.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc935c94640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9300c8df0 0x7fc930145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:46.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc935c94640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc93014eae0 0x7fc9301f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:46.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc935c94640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc930152540 con 0x7fc9300c68d0 2024-09-17T06:04:46.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc935c94640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc9300c9f70 con 0x7fc9300c8df0 2024-09-17T06:04:46.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc935c94640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc9301526c0 con 0x7fc93014eae0 2024-09-17T06:04:46.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9300c68d0 0x7fc930148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:46.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9300c68d0 0x7fc930148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35016/0 (socket says 172.21.15.122:35016) 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92f7fe640 1 -- 172.21.15.122:0/2170403278 learned_addr learned my addr 172.21.15.122:0/2170403278 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92effd640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9300c8df0 0x7fc930145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92ffff640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc93014eae0 0x7fc9301f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92f7fe640 1 -- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc93014eae0 msgr2=0x7fc9301f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92f7fe640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc93014eae0 0x7fc9301f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92f7fe640 1 -- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9300c8df0 msgr2=0x7fc930145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92f7fe640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9300c8df0 0x7fc930145080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92f7fe640 1 -- 172.21.15.122:0/2170403278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9301522e0 con 0x7fc9300c68d0 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92ffff640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc93014eae0 0x7fc9301f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92effd640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9300c8df0 0x7fc930145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc92f7fe640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9300c68d0 0x7fc930148fb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc92800cb70 tx=0x7fc92800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc927fff640 1 -- 172.21.15.122:0/2170403278 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928016020 con 0x7fc9300c68d0 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc927fff640 1 -- 172.21.15.122:0/2170403278 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc92800ab60 con 0x7fc9300c68d0 2024-09-17T06:04:46.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc935c94640 1 -- 172.21.15.122:0/2170403278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc930144210 con 0x7fc9300c68d0 2024-09-17T06:04:46.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc927fff640 1 -- 172.21.15.122:0/2170403278 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928012420 con 0x7fc9300c68d0 2024-09-17T06:04:46.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc935c94640 1 -- 172.21.15.122:0/2170403278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9301f66f0 con 0x7fc9300c68d0 2024-09-17T06:04:46.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.835+0000 7fc935c94640 1 -- 172.21.15.122:0/2170403278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc930072b20 con 0x7fc9300c68d0 2024-09-17T06:04:46.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.839+0000 7fc927fff640 1 -- 172.21.15.122:0/2170403278 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc928019020 con 0x7fc9300c68d0 2024-09-17T06:04:46.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.839+0000 7fc927fff640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc910073230 0x7fc910075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:46.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.839+0000 7fc927fff640 1 -- 172.21.15.122:0/2170403278 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc928094bb0 con 0x7fc9300c68d0 2024-09-17T06:04:46.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.839+0000 7fc92effd640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc910073230 0x7fc910075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:46.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.839+0000 7fc92effd640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc910073230 0x7fc910075740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc9200af000 tx=0x7fc92001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:46.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:46.843+0000 7fc927fff640 1 -- 172.21.15.122:0/2170403278 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc928020020 con 0x7fc9300c68d0 2024-09-17T06:04:47.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.003+0000 7fc935c94640 1 -- 172.21.15.122:0/2170403278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fc930156610 con 0x7fc9300c68d0 2024-09-17T06:04:47.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.003+0000 7fc927fff640 1 -- 172.21.15.122:0/2170403278 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v26) ==== 56+0+3526 (secure 0 0 0) 0x7fc92805fa00 con 0x7fc9300c68d0 2024-09-17T06:04:47.006 INFO:teuthology.orchestra.run.smithi122.stdout:epoch 26 2024-09-17T06:04:47.006 INFO:teuthology.orchestra.run.smithi122.stdout:fsid 5aff0fc3-254a-48aa-be08-0081a34bd09c 2024-09-17T06:04:47.006 INFO:teuthology.orchestra.run.smithi122.stdout:created 2024-09-17T06:03:42.642598+0000 2024-09-17T06:04:47.006 INFO:teuthology.orchestra.run.smithi122.stdout:modified 2024-09-17T06:04:13.331438+0000 2024-09-17T06:04:47.006 INFO:teuthology.orchestra.run.smithi122.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-17T06:04:47.006 INFO:teuthology.orchestra.run.smithi122.stdout:crush_version 6 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:full_ratio 0.95 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:backfillfull_ratio 0.9 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:nearfull_ratio 0.85 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:require_min_compat_client luminous 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:min_compat_client jewel 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:require_osd_release squid 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:stretch_mode_enabled false 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:pool 2 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.50 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:pool 3 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 26 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:max_osd 8 2024-09-17T06:04:47.007 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] [v2:172.21.15.122:6826/776463314,v1:172.21.15.122:6827/776463314] exists,up b8a621d5-9187-4034-ac89-5adb5b22ca7a 2024-09-17T06:04:47.008 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] [v2:172.21.15.122:6802/2272556556,v1:172.21.15.122:6803/2272556556] exists,up 992e1af1-06d0-4849-93bf-4be8fc437183 2024-09-17T06:04:47.008 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] [v2:172.21.15.122:6818/1205784459,v1:172.21.15.122:6819/1205784459] exists,up e3a31b77-d4db-4ee6-af7c-60af7df4bd69 2024-09-17T06:04:47.008 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] [v2:172.21.15.122:6810/3198016774,v1:172.21.15.122:6811/3198016774] exists,up 9f473452-18cd-44a4-803a-e908e21ab405 2024-09-17T06:04:47.008 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] [v2:172.21.15.173:6812/920798795,v1:172.21.15.173:6813/920798795] exists,up f11201b3-22f8-4b9e-873c-0ed12835e2d3 2024-09-17T06:04:47.008 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] [v2:172.21.15.173:6804/2576144160,v1:172.21.15.173:6805/2576144160] exists,up 3f853011-9aea-4f7c-bb97-2c74fba1e33e 2024-09-17T06:04:47.008 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] [v2:172.21.15.173:6820/1877869793,v1:172.21.15.173:6821/1877869793] exists,up 445606c9-7e18-44b2-997d-68d280a3a37c 2024-09-17T06:04:47.008 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7 up in weight 1 up_from 15 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] [v2:172.21.15.173:6828/1719466778,v1:172.21.15.173:6829/1719466778] exists,up ce0b67c6-0618-41b7-87e3-bf2d4c708907 2024-09-17T06:04:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.007+0000 7fc935c94640 1 -- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc910073230 msgr2=0x7fc910075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.007+0000 7fc935c94640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc910073230 0x7fc910075740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc9200af000 tx=0x7fc92001b060 comp rx=0 tx=0).stop 2024-09-17T06:04:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.007+0000 7fc935c94640 1 -- 172.21.15.122:0/2170403278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9300c68d0 msgr2=0x7fc930148fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.007+0000 7fc935c94640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9300c68d0 0x7fc930148fb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc92800cb70 tx=0x7fc92800cc60 comp rx=0 tx=0).stop 2024-09-17T06:04:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.007+0000 7fc935c94640 1 -- 172.21.15.122:0/2170403278 shutdown_connections 2024-09-17T06:04:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.007+0000 7fc935c94640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc93014eae0 0x7fc9301f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.007+0000 7fc935c94640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc910073230 0x7fc910075740 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.007+0000 7fc935c94640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9300c8df0 0x7fc930145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.007+0000 7fc935c94640 1 --2- 172.21.15.122:0/2170403278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9300c68d0 0x7fc930148fb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.007+0000 7fc935c94640 1 -- 172.21.15.122:0/2170403278 >> 172.21.15.122:0/2170403278 conn(0x7fc9300746d0 msgr2=0x7fc93015b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:47.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.007+0000 7fc935c94640 1 -- 172.21.15.122:0/2170403278 shutdown_connections 2024-09-17T06:04:47.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.007+0000 7fc935c94640 1 -- 172.21.15.122:0/2170403278 wait complete. 2024-09-17T06:04:47.026 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] [v2:172.21.15.122:6826/776463314,v1:172.21.15.122:6827/776463314] exists,up b8a621d5-9187-4034-ac89-5adb5b22ca7a', 'osd.1 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] [v2:172.21.15.122:6802/2272556556,v1:172.21.15.122:6803/2272556556] exists,up 992e1af1-06d0-4849-93bf-4be8fc437183', 'osd.2 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] [v2:172.21.15.122:6818/1205784459,v1:172.21.15.122:6819/1205784459] exists,up e3a31b77-d4db-4ee6-af7c-60af7df4bd69', 'osd.3 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] [v2:172.21.15.122:6810/3198016774,v1:172.21.15.122:6811/3198016774] exists,up 9f473452-18cd-44a4-803a-e908e21ab405', 'osd.4 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] [v2:172.21.15.173:6812/920798795,v1:172.21.15.173:6813/920798795] exists,up f11201b3-22f8-4b9e-873c-0ed12835e2d3', 'osd.5 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] [v2:172.21.15.173:6804/2576144160,v1:172.21.15.173:6805/2576144160] exists,up 3f853011-9aea-4f7c-bb97-2c74fba1e33e', 'osd.6 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] [v2:172.21.15.173:6820/1877869793,v1:172.21.15.173:6821/1877869793] exists,up 445606c9-7e18-44b2-997d-68d280a3a37c', 'osd.7 up in weight 1 up_from 15 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] [v2:172.21.15.173:6828/1719466778,v1:172.21.15.173:6829/1719466778] exists,up ce0b67c6-0618-41b7-87e3-bf2d4c708907'] 2024-09-17T06:04:47.026 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-17T06:04:47.155 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:04:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "name": "mon.a", 2024-09-17T06:04:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster": "ceph", 2024-09-17T06:04:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-17T06:04:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "admin_socket_mode": "", 2024-09-17T06:04:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-17T06:04:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "auth_client_required": "cephx, none", 2024-09-17T06:04:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "auth_cluster_required": "cephx", 2024-09-17T06:04:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "auth_debug": "true", 2024-09-17T06:04:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-17T06:04:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-17T06:04:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "auth_service_required": "cephx", 2024-09-17T06:04:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-17T06:04:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "auth_supported": "cephx", 2024-09-17T06:04:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_aio": "true", 2024-09-17T06:04:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-17T06:04:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_aio_poll_ms": "250", 2024-09-17T06:04:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_aio_reap_max": "16", 2024-09-17T06:04:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_async_discard_threads": "0", 2024-09-17T06:04:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_block_size": "4096", 2024-09-17T06:04:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_debug_aio": "false", 2024-09-17T06:04:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-17T06:04:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-17T06:04:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_debug_inflight_ios": "false", 2024-09-17T06:04:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_enable_discard": "false", 2024-09-17T06:04:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_flock_retry": "3", 2024-09-17T06:04:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-17T06:04:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_inject_crash": "0", 2024-09-17T06:04:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-17T06:04:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_ioring": "false", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_ioring_hipri": "false", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bdev_type": "", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_alloc_size": "1048576", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_allocator": "hybrid", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_buffered_io": "true", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_check_for_zeros": "false", 2024-09-17T06:04:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-17T06:04:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-17T06:04:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_compact_log_sync": "false", 2024-09-17T06:04:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-17T06:04:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-17T06:04:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-17T06:04:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-17T06:04:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_max_log_runway": "4194304", 2024-09-17T06:04:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_max_prefetch": "1048576", 2024-09-17T06:04:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_min_flush_size": "524288", 2024-09-17T06:04:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_min_log_runway": "1048576", 2024-09-17T06:04:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_replay_recovery": "false", 2024-09-17T06:04:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_sync_write": "false", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_allocation_from_file": "true", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_allocator": "hybrid", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_async_db_compaction": "true", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-17T06:04:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_bdev_label_multi": "true", 2024-09-17T06:04:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-17T06:04:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-17T06:04:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-17T06:04:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-17T06:04:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-17T06:04:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_block_create": "true", 2024-09-17T06:04:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_block_db_create": "false", 2024-09-17T06:04:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_block_db_path": "", 2024-09-17T06:04:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_block_db_size": "0", 2024-09-17T06:04:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_block_path": "", 2024-09-17T06:04:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_block_preallocate_file": "false", 2024-09-17T06:04:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_block_size": "107374182400", 2024-09-17T06:04:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_block_wal_create": "false", 2024-09-17T06:04:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_block_wal_path": "", 2024-09-17T06:04:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_block_wal_size": "100663296", 2024-09-17T06:04:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_bluefs": "true", 2024-09-17T06:04:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-17T06:04:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-17T06:04:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-17T06:04:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-17T06:04:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-17T06:04:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T06:04:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T06:04:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-17T06:04:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T06:04:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_autotune": "true", 2024-09-17T06:04:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-17T06:04:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-17T06:04:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-17T06:04:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-17T06:04:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_size": "0", 2024-09-17T06:04:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-17T06:04:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-17T06:04:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-17T06:04:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-17T06:04:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_type": "2q", 2024-09-17T06:04:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-17T06:04:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_clone_cow": "true", 2024-09-17T06:04:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-17T06:04:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-17T06:04:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-17T06:04:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-17T06:04:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-17T06:04:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-17T06:04:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-17T06:04:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_compression_mode": "none", 2024-09-17T06:04:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_csum_type": "crc32c", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_freelist": "false", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-17T06:04:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_small_allocations": "0", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_default_buffered_read": "true", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_default_buffered_write": "false", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-17T06:04:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fail_eio": "false", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_on_mount": "false", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-17T06:04:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_on_umount": "false", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_ignore_data_csum": "false", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-17T06:04:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_log_op_age": "5.000000", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_max_alloc_size": "0", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_max_blob_size": "0", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_max_deferred_txc": "32", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_min_alloc_size": "0", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_nid_prealloc": "1024", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-17T06:04:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-17T06:04:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-17T06:04:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-17T06:04:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_retry_disk_reads": "3", 2024-09-17T06:04:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_rocksdb_cf": "true", 2024-09-17T06:04:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-17T06:04:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-17T06:04:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-17T06:04:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-17T06:04:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-17T06:04:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-17T06:04:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-17T06:04:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-17T06:04:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_spdk_mem": "512", 2024-09-17T06:04:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-17T06:04:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-17T06:04:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-17T06:04:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-17T06:04:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-17T06:04:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-17T06:04:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-17T06:04:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_tracing": "false", 2024-09-17T06:04:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-17T06:04:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-17T06:04:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_write_v2": "false", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_write_v2_random": "false", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_zero_block_detection": "false", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-17T06:04:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephx_cluster_require_signatures": "false", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephx_cluster_require_version": "2", 2024-09-17T06:04:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "cephx_require_signatures": "false", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "cephx_require_version": "2", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "cephx_service_require_signatures": "false", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "cephx_service_require_version": "2", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "cephx_sign_messages": "true", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "chdir": "", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "client_acl_type": "", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "client_asio_thread_count": "2", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "client_cache_mid": "0.750000", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "client_cache_size": "16384", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "client_caps_release_delay": "5", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "client_check_pool_perm": "true", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "client_debug_force_sync_read": "false", 2024-09-17T06:04:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "client_debug_getattr_caps": "false", 2024-09-17T06:04:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_debug_inject_features": "", 2024-09-17T06:04:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_debug_inject_tick_delay": "0", 2024-09-17T06:04:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-17T06:04:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_die_on_failed_remount": "false", 2024-09-17T06:04:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_dirsize_rbytes": "true", 2024-09-17T06:04:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_force_lazyio": "false", 2024-09-17T06:04:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_fs": "", 2024-09-17T06:04:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-17T06:04:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_inject_release_failure": "false", 2024-09-17T06:04:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_max_inline_size": "4096", 2024-09-17T06:04:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-17T06:04:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_mds_namespace": "", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_metadata": "", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_mount_gid": "-1", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_mount_timeout": "300", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_mount_uid": "-1", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_mountpoint": "/", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_notify_timeout": "10", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_oc": "true", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_oc_max_dirty": "104857600", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_oc_max_objects": "1000", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_oc_size": "209715200", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_oc_target_dirty": "8388608", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_permissions": "true", 2024-09-17T06:04:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "client_quota": "true", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_quota_df": "true", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_readahead_max_bytes": "0", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_readahead_max_periods": "4", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_readahead_min": "131072", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_reconnect_stale": "false", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_shutdown_timeout": "30", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_snapdir": ".snap", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_tick_interval": "1", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_trace": "", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_try_dentry_invalidate": "false", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_use_faked_inos": "false", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_use_random_mds": "false", 2024-09-17T06:04:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "clog_to_graylog": "false", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "clog_to_graylog_port": "12201", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "clog_to_monitors": "default=true", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "clog_to_syslog": "false", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "clog_to_syslog_level": "info", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "-", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_network": "", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_network_interface": "", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "compressor_zlib_isal": "false", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "compressor_zlib_level": "5", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "compressor_zlib_winsize": "-15", 2024-09-17T06:04:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "compressor_zstd_level": "1", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "crimson_alien_op_num_threads": "6", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "crimson_osd_stat_interval": "0", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "crimson_seastar_cpu_cores": "", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "crimson_seastar_num_threads": "0", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_location": "", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_location_hook": "", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_location_hook_timeout": "10", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "daemonize": "false", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "daos_pool": "tank", 2024-09-17T06:04:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-17T06:04:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-17T06:04:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-17T06:04:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_alienstore": "0/5", 2024-09-17T06:04:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_allow_any_pool_priority": "false", 2024-09-17T06:04:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_asok": "1/5", 2024-09-17T06:04:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_asok_assert_abort": "false", 2024-09-17T06:04:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_asserts_on_shutdown": "true", 2024-09-17T06:04:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_auth": "20/20", 2024-09-17T06:04:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_bdev": "1/3", 2024-09-17T06:04:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_bluefs": "1/5", 2024-09-17T06:04:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_bluestore": "1/5", 2024-09-17T06:04:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_buffer": "0/1", 2024-09-17T06:04:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_ceph_dedup": "0/5", 2024-09-17T06:04:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_ceph_exporter": "1/5", 2024-09-17T06:04:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_cephfs_mirror": "0/5", 2024-09-17T06:04:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_cephsqlite": "0/5", 2024-09-17T06:04:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_client": "0/5", 2024-09-17T06:04:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_compressor": "1/5", 2024-09-17T06:04:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_context": "0/1", 2024-09-17T06:04:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_crimson_interrupt": "0/5", 2024-09-17T06:04:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_crush": "1/1", 2024-09-17T06:04:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_crypto": "1/5", 2024-09-17T06:04:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_cyanstore": "0/5", 2024-09-17T06:04:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_deliberately_leak_memory": "false", 2024-09-17T06:04:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_disable_randomized_ping": "false", 2024-09-17T06:04:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_dpdk": "1/5", 2024-09-17T06:04:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_eventtrace": "1/5", 2024-09-17T06:04:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_filer": "0/1", 2024-09-17T06:04:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_filestore": "1/3", 2024-09-17T06:04:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_finisher": "1/1", 2024-09-17T06:04:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_fuse": "1/5", 2024-09-17T06:04:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_heartbeat_testing_span": "0", 2024-09-17T06:04:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_heartbeatmap": "1/5", 2024-09-17T06:04:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-17T06:04:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_javaclient": "1/5", 2024-09-17T06:04:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_journal": "1/3", 2024-09-17T06:04:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_journaler": "0/5", 2024-09-17T06:04:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_kstore": "1/5", 2024-09-17T06:04:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_lockdep": "0/1", 2024-09-17T06:04:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_mclock": "1/5", 2024-09-17T06:04:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_mds": "1/5", 2024-09-17T06:04:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_mds_balancer": "1/5", 2024-09-17T06:04:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_mds_locker": "1/5", 2024-09-17T06:04:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_mds_log": "1/5", 2024-09-17T06:04:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_mds_log_expire": "1/5", 2024-09-17T06:04:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_mds_migrator": "1/5", 2024-09-17T06:04:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_mds_quiesce": "3/5", 2024-09-17T06:04:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_memstore": "1/5", 2024-09-17T06:04:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_mgr": "2/5", 2024-09-17T06:04:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_mgrc": "1/5", 2024-09-17T06:04:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_mon": "20/20", 2024-09-17T06:04:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_monc": "0/10", 2024-09-17T06:04:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_ms": "1/1", 2024-09-17T06:04:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_none": "0/5", 2024-09-17T06:04:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_objclass": "0/5", 2024-09-17T06:04:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_objectcacher": "0/5", 2024-09-17T06:04:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_objecter": "0/1", 2024-09-17T06:04:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_optracker": "0/5", 2024-09-17T06:04:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_osd": "1/5", 2024-09-17T06:04:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_paxos": "20/20", 2024-09-17T06:04:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_perfcounter": "1/5", 2024-09-17T06:04:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_prioritycache": "1/5", 2024-09-17T06:04:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rados": "0/5", 2024-09-17T06:04:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rbd": "0/5", 2024-09-17T06:04:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rbd_mirror": "0/5", 2024-09-17T06:04:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rbd_pwl": "0/5", 2024-09-17T06:04:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rbd_replay": "0/5", 2024-09-17T06:04:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_refs": "0/0", 2024-09-17T06:04:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_reserver": "1/1", 2024-09-17T06:04:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rgw": "1/5", 2024-09-17T06:04:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rgw_access": "1/5", 2024-09-17T06:04:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rgw_datacache": "1/5", 2024-09-17T06:04:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rgw_dbstore": "1/5", 2024-09-17T06:04:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rgw_flight": "1/5", 2024-09-17T06:04:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-17T06:04:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rgw_notification": "1/5", 2024-09-17T06:04:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rgw_sync": "1/5", 2024-09-17T06:04:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_rocksdb": "4/5", 2024-09-17T06:04:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore": "0/5", 2024-09-17T06:04:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_backref": "0/5", 2024-09-17T06:04:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_cache": "0/5", 2024-09-17T06:04:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_cleaner": "0/5", 2024-09-17T06:04:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_device": "0/5", 2024-09-17T06:04:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_epm": "0/5", 2024-09-17T06:04:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-17T06:04:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_journal": "0/5", 2024-09-17T06:04:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_lba": "0/5", 2024-09-17T06:04:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_odata": "0/5", 2024-09-17T06:04:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_omap": "0/5", 2024-09-17T06:04:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_onode": "0/5", 2024-09-17T06:04:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_t": "0/5", 2024-09-17T06:04:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_seastore_tm": "0/5", 2024-09-17T06:04:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_striper": "0/1", 2024-09-17T06:04:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_test": "0/5", 2024-09-17T06:04:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_throttle": "1/1", 2024-09-17T06:04:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_timer": "0/1", 2024-09-17T06:04:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_tp": "0/5", 2024-09-17T06:04:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "debug_trace": "1/5", 2024-09-17T06:04:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-17T06:04:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "device_failure_prediction_mode": "none", 2024-09-17T06:04:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-17T06:04:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-17T06:04:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "err_to_graylog": "false", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "err_to_journald": "false", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "err_to_stderr": "true", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "err_to_syslog": "false", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event_tracing": "false", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "exporter_addr": "0.0.0.0", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "exporter_cert_file": "", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "exporter_http_port": "9926", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "exporter_key_file": "", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "exporter_prio_limit": "5", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "exporter_sort_metrics": "true", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "exporter_stats_period": "5", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "fake_statfs_for_testing": "0", 2024-09-17T06:04:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "fatal_signal_handlers": "true", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filer_max_purge_ops": "10", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filer_max_truncate_ops": "128", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_apply_finisher_threads": "1", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_blackhole": "false", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_btrfs_clone_range": "true", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_btrfs_snap": "true", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_caller_concurrency": "10", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_collect_device_partition_information": "true", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_commit_timeout": "600.000000", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_debug_inject_read_err": "false", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_debug_omap_check": "false", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_debug_verify_split": "false", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_dump_file": "", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-17T06:04:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_fadvise": "true", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_fail_eio": "true", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_fd_cache_shards": "16", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_fd_cache_size": "128", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_fiemap": "false", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_fiemap_threshold": "4096", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_inject_stall": "0", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_journal_parallel": "false", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_journal_trailing": "false", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_journal_writeahead": "false", 2024-09-17T06:04:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_kill_at": "0", 2024-09-17T06:04:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-17T06:04:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-17T06:04:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-17T06:04:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-17T06:04:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-17T06:04:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_inline_xattrs": "0", 2024-09-17T06:04:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-17T06:04:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_xattr_value_size": "0", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_merge_threshold": "-10", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_odsync_write": "false", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_omap_backend": "rocksdb", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_omap_backend_path": "", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-17T06:04:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_op_thread_timeout": "60", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_op_threads": "2", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_punch_hole": "false", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_queue_max_ops": "50", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_seek_data_hole": "false", 2024-09-17T06:04:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_sloppy_crc": "false", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_splice": "false", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_split_multiple": "2", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_split_rand_factor": "20", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_update_to": "1000", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_enable": "true", 2024-09-17T06:04:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_xfs_extsize": "false", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "filestore_zfs_snap": "false", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "fio_dir": "/tmp/fio", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "5aff0fc3-254a-48aa-be08-0081a34bd09c", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_allow_other": "true", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_atomic_o_trunc": "true", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_big_writes": "true", 2024-09-17T06:04:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_debug": "false", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_default_permissions": "false", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_disable_pagecache": "false", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_max_write": "0", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_multithreaded": "true", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_require_active_mds": "true", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_set_user_groups": "true", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_splice_move": "true", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_splice_read": "true", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_splice_write": "true", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "fuse_use_invalidate_cb": "true", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "gss_target_name": "ceph", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_file": "", 2024-09-17T06:04:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_inject_failure": "0", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_interval": "5", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "host": "smithi122", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-17T06:04:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "inject_early_sigterm": "false", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "jaeger_agent_port": "6799", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "jaeger_tracing_enable": "false", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_aio": "true", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_align_min_size": "65536", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_block_align": "true", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_block_size": "4096", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_dio": "true", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_discard": "false", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_force_aio": "false", 2024-09-17T06:04:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_ignore_corruption": "false", 2024-09-17T06:04:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_max_write_bytes": "10485760", 2024-09-17T06:04:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_max_write_entries": "100", 2024-09-17T06:04:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_replay_from": "0", 2024-09-17T06:04:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-17T06:04:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-17T06:04:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-17T06:04:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-17T06:04:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_write_header_frequency": "0", 2024-09-17T06:04:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "journal_zero_on_create": "false", 2024-09-17T06:04:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "journaler_prefetch_periods": "10", 2024-09-17T06:04:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "journaler_prezero_periods": "5", 2024-09-17T06:04:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "journaler_write_head_interval": "15", 2024-09-17T06:04:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "key": "", 2024-09-17T06:04:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "keyfile": "", 2024-09-17T06:04:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-17T06:04:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "kstore_backend": "rocksdb", 2024-09-17T06:04:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "kstore_default_stripe_size": "65536", 2024-09-17T06:04:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "kstore_fsck_on_mount": "false", 2024-09-17T06:04:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-17T06:04:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "kstore_max_bytes": "67108864", 2024-09-17T06:04:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "kstore_max_ops": "512", 2024-09-17T06:04:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "kstore_nid_prealloc": "1024", 2024-09-17T06:04:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "kstore_onode_map_size": "1024", 2024-09-17T06:04:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-17T06:04:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "kstore_sync_submit_transaction": "false", 2024-09-17T06:04:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "kstore_sync_transaction": "false", 2024-09-17T06:04:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "librados_thread_count": "2", 2024-09-17T06:04:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "lockdep": "false", 2024-09-17T06:04:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "lockdep_force_backtrace": "false", 2024-09-17T06:04:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "log_coarse_timestamps": "true", 2024-09-17T06:04:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-17T06:04:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "log_flush_on_exit": "false", 2024-09-17T06:04:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "log_graylog_host": "127.0.0.1", 2024-09-17T06:04:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "log_graylog_port": "12201", 2024-09-17T06:04:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "log_max_new": "1000", 2024-09-17T06:04:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "log_max_recent": "10000", 2024-09-17T06:04:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "log_stderr_prefix": "", 2024-09-17T06:04:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "log_stop_at_utilization": "0.970000", 2024-09-17T06:04:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "log_to_file": "true", 2024-09-17T06:04:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "log_to_graylog": "false", 2024-09-17T06:04:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "log_to_journald": "false", 2024-09-17T06:04:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "log_to_stderr": "false", 2024-09-17T06:04:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "log_to_syslog": "false", 2024-09-17T06:04:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "max_rotating_auth_attempts": "10", 2024-09-17T06:04:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-17T06:04:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_action_on_write_error": "1", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_alternate_name_max": "8192", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_asio_thread_count": "2", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_export_pin": "true", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_fragment_dirs": "true", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_fragment_interval": "5", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_interval": "10", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_max": "-1", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_max_until": "-1", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_merge_size": "50", 2024-09-17T06:04:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_midchunk": "0.300000", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_min_start": "0.200000", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_minchunk": "0.001000", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_mode": "0", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_need_max": "1.200000", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_need_min": "0.800000", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_overload_epochs": "2", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_split_bits": "3", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_split_size": "10000", 2024-09-17T06:04:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_target_decay": "10.000000", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_beacon_grace": "15.000000", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_beacon_interval": "4.000000", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache_mid": "0.700000", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache_quiesce_delay": "0", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache_release_free_interval": "10", 2024-09-17T06:04:47.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache_reservation": "0.050000", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache_trim_interval": "1", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache_trim_threshold": "262144", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_client_prealloc_inos": "1000", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_connect_bootstrapping": "false", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_damage_table_max_entries": "10000", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_debug_auth_pins": "false", 2024-09-17T06:04:47.207 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_debug_frag": "false", 2024-09-17T06:04:47.208 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_debug_scatterstat": "false", 2024-09-17T06:04:47.208 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_debug_subtrees": "false", 2024-09-17T06:04:47.208 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_decay_halflife": "5.000000", 2024-09-17T06:04:47.208 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_default_dir_hash": "2", 2024-09-17T06:04:47.208 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_defer_session_stale": "true", 2024-09-17T06:04:47.208 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_deny_all_reconnect": "false", 2024-09-17T06:04:47.208 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_dir_keys_per_op": "16384", 2024-09-17T06:04:47.208 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_dir_max_commit_size": "10", 2024-09-17T06:04:47.208 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_dir_max_entries": "0", 2024-09-17T06:04:47.208 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_dir_prefetch": "true", 2024-09-17T06:04:47.208 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-17T06:04:47.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-17T06:04:47.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_dump_cache_on_map": "false", 2024-09-17T06:04:47.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-17T06:04:47.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-17T06:04:47.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_early_reply": "true", 2024-09-17T06:04:47.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_enable_op_tracker": "true", 2024-09-17T06:04:47.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_enforce_unique_name": "true", 2024-09-17T06:04:47.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-17T06:04:47.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-17T06:04:47.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_export_ephemeral_random": "true", 2024-09-17T06:04:47.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_health_summarize_threshold": "10", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_inject_health_dummy": "false", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_inject_migrator_session_race": "false", 2024-09-17T06:04:47.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-17T06:04:47.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-17T06:04:47.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-17T06:04:47.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_join_fs": "", 2024-09-17T06:04:47.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_journal_format": "1", 2024-09-17T06:04:47.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-17T06:04:47.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_create_at": "0", 2024-09-17T06:04:47.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_dirfrag_at": "0", 2024-09-17T06:04:47.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_export_at": "0", 2024-09-17T06:04:47.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_import_at": "0", 2024-09-17T06:04:47.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_journal_at": "0", 2024-09-17T06:04:47.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_journal_expire_at": "0", 2024-09-17T06:04:47.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_journal_replay_at": "0", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_link_at": "0", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_mdstable_at": "0", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_openc_at": "0", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_rename_at": "0", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_kill_shutdown_at": "0", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_event_large_threshold": "524288", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_events_per_segment": "1024", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_max_events": "-1", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_max_segments": "128", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_pause": "false", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_segment_size": "0", 2024-09-17T06:04:47.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_trim_threshold": "128", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log_warn_factor": "2.000000", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_max_caps_per_client": "1048576", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_max_completed_flushes": "100000", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_max_completed_requests": "100000", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_max_export_size": "20971520", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_max_file_recover": "32", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_max_purge_files": "64", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_max_purge_ops": "8192", 2024-09-17T06:04:47.213 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_max_snaps_per_dir": "100", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_metrics_update_interval": "2", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_min_caps_per_client": "100", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_min_caps_working_set": "10000", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_numa_node": "-1", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_op_complaint_time": "30.000000", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_op_history_duration": "600", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_op_history_size": "20", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_op_history_slow_op_size": "20", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-17T06:04:47.214 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_op_log_threshold": "5", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_ping_grace": "15", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_ping_interval": "5", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_recall_max_caps": "30000", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_recall_warning_threshold": "262144", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_replay_interval": "1.000000", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-17T06:04:47.215 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_root_ino_gid": "0", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_root_ino_uid": "0", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_scrub_stats_review_period": "1", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-17T06:04:47.216 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-17T06:04:47.217 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_shutdown_check": "0", 2024-09-17T06:04:47.217 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_skip_ino": "0", 2024-09-17T06:04:47.217 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-17T06:04:47.217 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_snap_max_uid": "4294967294", 2024-09-17T06:04:47.217 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_snap_min_uid": "0", 2024-09-17T06:04:47.217 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_snap_rstat": "false", 2024-09-17T06:04:47.217 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_standby_replay_damaged": "false", 2024-09-17T06:04:47.217 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_symlink_recovery": "true", 2024-09-17T06:04:47.217 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-17T06:04:47.217 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_thrash_exports": "0", 2024-09-17T06:04:47.217 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_thrash_fragments": "0", 2024-09-17T06:04:47.217 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_tick_interval": "5.000000", 2024-09-17T06:04:47.218 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_valgrind_exit": "false", 2024-09-17T06:04:47.218 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_verify_backtrace": "1", 2024-09-17T06:04:47.218 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_verify_scatter": "false", 2024-09-17T06:04:47.218 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-17T06:04:47.218 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_wipe_sessions": "false", 2024-09-17T06:04:47.218 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool_debug": "false", 2024-09-17T06:04:47.218 INFO:teuthology.orchestra.run.smithi122.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-17T06:04:47.218 INFO:teuthology.orchestra.run.smithi122.stdout: "memstore_device_bytes": "1073741824", 2024-09-17T06:04:47.218 INFO:teuthology.orchestra.run.smithi122.stdout: "memstore_page_set": "false", 2024-09-17T06:04:47.218 INFO:teuthology.orchestra.run.smithi122.stdout: "memstore_page_size": "65536", 2024-09-17T06:04:47.218 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_client_bytes": "134217728", 2024-09-17T06:04:47.218 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_client_messages": "512", 2024-09-17T06:04:47.219 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-17T06:04:47.219 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-17T06:04:47.219 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-17T06:04:47.219 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-17T06:04:47.219 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_disabled_modules": "", 2024-09-17T06:04:47.219 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_enable_op_tracker": "true", 2024-09-17T06:04:47.219 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-17T06:04:47.219 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_max_pg_creating": "1024", 2024-09-17T06:04:47.219 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_max_pg_num_change": "128", 2024-09-17T06:04:47.219 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_mds_bytes": "134217728", 2024-09-17T06:04:47.219 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_mds_messages": "128", 2024-09-17T06:04:47.219 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_mon_bytes": "134217728", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_mon_messages": "128", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_op_history_duration": "600", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_op_history_size": "20", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_op_log_threshold": "5", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_osd_bytes": "536870912", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_osd_messages": "8192", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_pool": "true", 2024-09-17T06:04:47.220 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_standby_modules": "true", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_stats_period": "5", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_stats_threshold": "5", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_tick_period": "2", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_allow_pool_delete": "true", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_allow_pool_size_one": "true", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_auth_validate_all_caps": "true", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_client_bytes": "104857600", 2024-09-17T06:04:47.221 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_client_directed_command_retry": "2", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_client_hunt_parallel": "3", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_client_log_interval": "1.000000", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_client_ping_interval": "10.000000", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_client_target_rank": "-1", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-17T06:04:47.222 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_cluster_log_level": "debug", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_cluster_log_to_file": "true", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_cluster_log_to_journald": "false", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_compact_on_bootstrap": "false", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_compact_on_start": "false", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_compact_on_trim": "true", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-17T06:04:47.223 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_cpu_threads": "4", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_crush_min_required_version": "hammer", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_daemon_bytes": "419430400", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_data_avail_crit": "5", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_data_avail_warn": "5", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_data_size_warn": "16106127360", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_debug_dump_json": "false", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-17T06:04:47.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_debug_dump_transactions": "false", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_debug_extra_checks": "false", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_debug_no_require_reef": "false", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_debug_no_require_squid": "false", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_down_mkfs_grace": "300", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_down_uptime_grace": "60", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_election_default_strategy": "1", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_election_timeout": "5.000000", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_elector_ping_divisor": "2", 2024-09-17T06:04:47.225 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-17T06:04:47.226 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_enable_op_tracker": "true", 2024-09-17T06:04:47.226 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_fake_pool_delete": "false", 2024-09-17T06:04:47.226 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_force_quorum_join": "false", 2024-09-17T06:04:47.226 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-17T06:04:47.226 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_globalid_prealloc": "10000", 2024-09-17T06:04:47.226 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_health_detail_to_clog": "false", 2024-09-17T06:04:47.226 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_health_log_update_period": "5", 2024-09-17T06:04:47.226 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_health_max_detail": "50", 2024-09-17T06:04:47.226 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_health_to_clog": "true", 2024-09-17T06:04:47.226 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_health_to_clog_interval": "600", 2024-09-17T06:04:47.226 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-17T06:04:47.226 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_host": "172.21.15.122,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]", 2024-09-17T06:04:47.227 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_host_override": "", 2024-09-17T06:04:47.227 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_initial_members": "", 2024-09-17T06:04:47.227 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-17T06:04:47.227 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-17T06:04:47.227 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-17T06:04:47.227 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-17T06:04:47.227 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-17T06:04:47.227 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_lease": "5.000000", 2024-09-17T06:04:47.227 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-17T06:04:47.227 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-17T06:04:47.227 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_log_full_interval": "50", 2024-09-17T06:04:47.227 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_log_max": "10000", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_log_max_summary": "50", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_max_log_epochs": "500", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_max_osd": "10000", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_max_pg_per_osd": "10000", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_max_pool_pg_num": "65536", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_mds_force_trim_to": "0", 2024-09-17T06:04:47.228 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_mds_skip_sanity": "false", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_memory_autotune": "true", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_memory_target": "2147483648", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_mgr_beacon_grace": "30", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_mgr_digest_period": "5", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_mgr_inactive_grace": "60", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_min_osdmap_epochs": "500", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_op_complaint_time": "120", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_op_history_duration": "600", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_op_history_size": "20", 2024-09-17T06:04:47.229 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_op_history_slow_op_size": "20", 2024-09-17T06:04:47.230 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-17T06:04:47.230 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_op_log_threshold": "5", 2024-09-17T06:04:47.230 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-17T06:04:47.230 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-17T06:04:47.230 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-17T06:04:47.230 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_auto_mark_in": "false", 2024-09-17T06:04:47.230 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-17T06:04:47.230 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-17T06:04:47.230 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_cache_size": "500", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_down_out_interval": "600", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_force_trim_to": "0", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-17T06:04:47.231 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_min_down_reporters": "2", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_report_timeout": "900", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-17T06:04:47.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_pg_stuck_threshold": "60", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_probe_timeout": "2.000000", 2024-09-17T06:04:47.233 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_reweight_max_change": "0.050000", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_reweight_max_osds": "4", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_scrub_interval": "86400", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_scrub_max_keys": "100", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_scrub_timeout": "300", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_session_timeout": "300", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_smart_report_timeout": "5", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_stat_smooth_intervals": "6", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-17T06:04:47.234 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_stretch_pool_min_size": "2", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_stretch_pool_size": "4", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_sync_debug": "false", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_sync_provider_kill_at": "0", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_sync_requester_kill_at": "0", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_sync_timeout": "60.000000", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_target_pg_per_osd": "100", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_tick_interval": "5", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_timecheck_interval": "300.000000", 2024-09-17T06:04:47.235 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_use_min_delay_socket": "false", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_older_version_delay": "604800", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_misplaced": "false", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_older_version": "true", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-17T06:04:47.236 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "monmap": "", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-17T06:04:47.237 INFO:teuthology.orchestra.run.smithi122.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "motr_tracing_enabled": "false", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_op_threads": "3", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_cm": "false", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_device_name": "", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_dscp": "96", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_local_gid": "", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_port_num": "1", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-17T06:04:47.238 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_sl": "3", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_support_srq": "true", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_rdma_type": "ib", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_async_reap_threshold": "5", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_bind_before_connect": "false", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_bind_ipv4": "true", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_bind_ipv6": "false", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_bind_msgr1": "true", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_bind_msgr2": "true", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_bind_port_max": "7568", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_bind_port_min": "6800", 2024-09-17T06:04:47.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-17T06:04:47.240 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_bind_retry_count": "3", 2024-09-17T06:04:47.240 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_bind_retry_delay": "5", 2024-09-17T06:04:47.240 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_blackhole_client": "false", 2024-09-17T06:04:47.240 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_blackhole_mds": "false", 2024-09-17T06:04:47.240 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_blackhole_mgr": "false", 2024-09-17T06:04:47.240 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_blackhole_mon": "false", 2024-09-17T06:04:47.240 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_blackhole_osd": "false", 2024-09-17T06:04:47.240 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_client_mode": "crc secure", 2024-09-17T06:04:47.240 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-17T06:04:47.240 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_cluster_mode": "crc secure", 2024-09-17T06:04:47.240 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_cluster_type": "", 2024-09-17T06:04:47.240 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_compress_secure": "false", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_connection_idle_timeout": "900", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_connection_ready_timeout": "10", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_crc_data": "true", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_crc_header": "true", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_die_on_bad_msg": "false", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_die_on_bug": "true", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_die_on_old_message": "true", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_die_on_skipped_message": "false", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_coremask": "0xF", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-17T06:04:47.241 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_enable_tso": "true", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_hugepages": "", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_lro": "true", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_memory_channel": "4", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_pmd": "", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_port_id": "0", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-17T06:04:47.242 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-17T06:04:47.243 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_dump_on_send": "false", 2024-09-17T06:04:47.243 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_initial_backoff": "0.200000", 2024-09-17T06:04:47.243 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_inject_delay_max": "1.000000", 2024-09-17T06:04:47.243 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-17T06:04:47.243 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_inject_delay_type": "", 2024-09-17T06:04:47.243 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-17T06:04:47.243 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_inject_network_congestion": "0", 2024-09-17T06:04:47.243 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_inject_socket_failures": "0", 2024-09-17T06:04:47.243 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_learn_addr_from_peer": "true", 2024-09-17T06:04:47.243 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_max_accept_failures": "4", 2024-09-17T06:04:47.243 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_max_backoff": "15.000000", 2024-09-17T06:04:47.243 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_mon_client_mode": "secure crc", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_mon_service_mode": "secure crc", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_osd_compress_min_size": "1024", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_osd_compress_mode": "none", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_pq_min_cost": "65536", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_public_type": "", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_service_mode": "crc secure", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_tcp_listen_backlog": "512", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_tcp_nodelay": "true", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-17T06:04:47.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_tcp_rcvbuf": "0", 2024-09-17T06:04:47.245 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-17T06:04:47.245 INFO:teuthology.orchestra.run.smithi122.stdout: "ms_type": "async+posix", 2024-09-17T06:04:47.245 INFO:teuthology.orchestra.run.smithi122.stdout: "no_config_file": "false", 2024-09-17T06:04:47.245 INFO:teuthology.orchestra.run.smithi122.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-17T06:04:47.245 INFO:teuthology.orchestra.run.smithi122.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-17T06:04:47.245 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter_completion_locks_per_session": "32", 2024-09-17T06:04:47.245 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-17T06:04:47.245 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-17T06:04:47.245 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter_inflight_ops": "1024", 2024-09-17T06:04:47.245 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-17T06:04:47.246 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-17T06:04:47.246 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter_tick_interval": "5.000000", 2024-09-17T06:04:47.246 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter_timeout": "10.000000", 2024-09-17T06:04:47.246 INFO:teuthology.orchestra.run.smithi122.stdout: "objectstore_blackhole": "false", 2024-09-17T06:04:47.246 INFO:teuthology.orchestra.run.smithi122.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-17T06:04:47.246 INFO:teuthology.orchestra.run.smithi122.stdout: "openssl_engine_opts": "", 2024-09-17T06:04:47.246 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_agent_delay_time": "5.000000", 2024-09-17T06:04:47.246 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_agent_hist_halflife": "1000", 2024-09-17T06:04:47.246 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_agent_max_low_ops": "2", 2024-09-17T06:04:47.246 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_agent_max_ops": "4", 2024-09-17T06:04:47.246 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-17T06:04:47.246 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-17T06:04:47.247 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_agent_slop": "0.020000", 2024-09-17T06:04:47.247 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-17T06:04:47.247 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-17T06:04:47.247 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_asio_thread_count": "2", 2024-09-17T06:04:47.247 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_async_recovery_min_cost": "100", 2024-09-17T06:04:47.247 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-17T06:04:47.247 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-17T06:04:47.247 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_backfill_scan_max": "512", 2024-09-17T06:04:47.247 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_backfill_scan_min": "64", 2024-09-17T06:04:47.247 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_backoff_on_degraded": "false", 2024-09-17T06:04:47.247 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_backoff_on_peering": "false", 2024-09-17T06:04:47.247 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_backoff_on_unfound": "true", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_beacon_report_interval": "300", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bench_duration": "30", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bench_max_block_size": "67108864", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_blkin_trace_all": "false", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_check_for_log_corruption": "false", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-17T06:04:47.248 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-17T06:04:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-17T06:04:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-17T06:04:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_class_update_on_start": "true", 2024-09-17T06:04:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_client_message_cap": "256", 2024-09-17T06:04:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_client_message_size_cap": "524288000", 2024-09-17T06:04:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_client_op_priority": "63", 2024-09-17T06:04:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_client_watch_timeout": "30", 2024-09-17T06:04:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_command_max_records": "256", 2024-09-17T06:04:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_compact_on_start": "false", 2024-09-17T06:04:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-17T06:04:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-17T06:04:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_crush_update_on_start": "true", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_crush_update_weight_set": "true", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_feed_pullee": "-1", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_misdirected_ops": "false", 2024-09-17T06:04:47.250 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_no_acting_change": "false", 2024-09-17T06:04:47.251 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_no_purge_strays": "false", 2024-09-17T06:04:47.251 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_op_order": "false", 2024-09-17T06:04:47.251 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-17T06:04:47.251 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-17T06:04:47.251 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-17T06:04:47.251 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-17T06:04:47.251 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_shutdown": "false", 2024-09-17T06:04:47.251 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-17T06:04:47.251 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-17T06:04:47.251 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_trim_objects": "false", 2024-09-17T06:04:47.251 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-17T06:04:47.251 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_verify_snaps": "false", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_deep_scrub_keys": "1024", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_deep_scrub_stride": "524288", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_default_notify_timeout": "30", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_delete_sleep": "0.000000", 2024-09-17T06:04:47.252 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-17T06:04:47.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-17T06:04:47.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-17T06:04:47.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_discard_disconnected_ops": "true", 2024-09-17T06:04:47.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_ec_partial_reads": "true", 2024-09-17T06:04:47.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_enable_op_tracker": "true", 2024-09-17T06:04:47.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-17T06:04:47.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-17T06:04:47.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-17T06:04:47.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-17T06:04:47.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_fast_info": "true", 2024-09-17T06:04:47.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_fast_shutdown": "true", 2024-09-17T06:04:47.253 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-17T06:04:47.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-17T06:04:47.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-17T06:04:47.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-17T06:04:47.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-17T06:04:47.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_function_tracing": "false", 2024-09-17T06:04:47.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_heartbeat_grace": "20", 2024-09-17T06:04:47.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_heartbeat_interval": "6", 2024-09-17T06:04:47.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-17T06:04:47.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_heartbeat_min_peers": "10", 2024-09-17T06:04:47.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_heartbeat_min_size": "2000", 2024-09-17T06:04:47.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_heartbeat_stale": "600", 2024-09-17T06:04:47.254 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_hit_set_max_size": "100000", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_hit_set_min_size": "1000", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_journal_size": "5120", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_kill_backfill_at": "0", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_map_cache_size": "50", 2024-09-17T06:04:47.255 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_map_dedup": "true", 2024-09-17T06:04:47.256 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_map_message_max": "40", 2024-09-17T06:04:47.256 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-17T06:04:47.256 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_map_share_max_epochs": "40", 2024-09-17T06:04:47.256 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_attr_name_len": "100", 2024-09-17T06:04:47.256 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_attr_size": "0", 2024-09-17T06:04:47.256 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_backfills": "1", 2024-09-17T06:04:47.256 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_markdown_count": "5", 2024-09-17T06:04:47.256 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_markdown_period": "600", 2024-09-17T06:04:47.256 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_object_name_len": "2048", 2024-09-17T06:04:47.256 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_object_namespace_len": "256", 2024-09-17T06:04:47.256 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_object_size": "134217728", 2024-09-17T06:04:47.256 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_pg_blocked_by": "16", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_pg_log_entries": "10000", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_pgls": "1024", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_push_cost": "8388608", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_push_objects": "10", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_scrubs": "3", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_trimming_pgs": "2", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_write_op_reply_len": "64", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_max_write_size": "90", 2024-09-17T06:04:47.257 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_profile": "balanced", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-17T06:04:47.258 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_memory_base": "805306368", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_memory_cache_min": "134217728", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_memory_target": "4294967296", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_memory_target_autotune": "false", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-17T06:04:47.259 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_min_pg_log_entries": "250", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_min_recovery_priority": "0", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mon_report_interval": "5", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_num_cache_shards": "32", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_num_op_tracker_shard": "32", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_numa_auto_affinity": "true", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_numa_node": "-1", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_numa_prefer_iface": "true", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_objecter_finishers": "1", 2024-09-17T06:04:47.260 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_objectstore": "bluestore", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_objectstore_fuse": "false", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_objectstore_tracing": "false", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_complaint_time": "30.000000", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_history_duration": "600", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_history_size": "20", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_history_slow_op_size": "20", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_log_threshold": "5", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_num_shards": "0", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_num_shards_hdd": "5", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_num_shards_ssd": "8", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-17T06:04:47.261 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_pq_min_cost": "65536", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_queue_cut_off": "high", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_op_thread_timeout": "15", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_open_classes_on_start": "true", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_os_flags": "0", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_peering_op_priority": "255", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pg_delete_cost": "1048576", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pg_delete_priority": "5", 2024-09-17T06:04:47.262 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pg_log_trim_max": "10000", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pg_log_trim_min": "100", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-17T06:04:47.263 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_crimson": "false", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_flags": "0", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_min_size": "0", 2024-09-17T06:04:47.264 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_pg_num": "32", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_pgp_num": "0", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_read_ratio": "70", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_size": "2", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_default_type": "replicated", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_push_per_object_cost": "1000", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recover_clone_overlap": "true", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-17T06:04:47.265 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_cost": "20971520", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_max_active": "0", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_max_single_start": "1", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_op_priority": "3", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_priority": "5", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_sleep": "0.000000", 2024-09-17T06:04:47.266 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_repair_during_recovery": "false", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_requested_scrub_priority": "120", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_auto_repair": "false", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_begin_hour": "0", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_begin_week_day": "0", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_chunk_max": "15", 2024-09-17T06:04:47.267 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_chunk_min": "5", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_cost": "52428800", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_during_recovery": "false", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_end_hour": "0", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_end_week_day": "0", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_event_cost": "4096", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_invalid_stats": "true", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_max_preemptions": "5", 2024-09-17T06:04:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_priority": "5", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_retry_delay": "30", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_retry_trimming": "10", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_scrub_sleep": "0.000000", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_skip_data_digest": "false", 2024-09-17T06:04:47.269 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_smart_report_timeout": "5", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_snap_trim_cost": "1048576", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_snap_trim_priority": "5", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_target_transaction_size": "30", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-17T06:04:47.270 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_tracing": "false", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_use_stale_snap": "false", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "osdc_blkin_trace_all": "false", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "paxos_kill_at": "0", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "paxos_max_join_drift": "10", 2024-09-17T06:04:47.271 INFO:teuthology.orchestra.run.smithi122.stdout: "paxos_min": "500", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "paxos_min_wait": "0.050000", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "paxos_propose_interval": "1.000000", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "paxos_service_trim_max": "500", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "paxos_service_trim_min": "250", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "paxos_stash_full_interval": "25", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "paxos_trim_max": "500", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "paxos_trim_min": "250", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "perf": "true", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-17T06:04:47.272 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "-", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrv": "", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "public_bind_addr": "-", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "public_network": "", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "public_network_interface": "", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "qat_compressor_busy_polling": "false", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "qat_compressor_enabled": "false", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "qat_compressor_session_max_number": "256", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "rados_mon_op_timeout": "0", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "rados_osd_op_timeout": "0", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "rados_tracing": "false", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_atime_update_interval": "60", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-17T06:04:47.273 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_balance_parent_reads": "false", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_balance_snap_reads": "false", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_blkin_trace_all": "false", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_cache": "true", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_cache_policy": "writearound", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_cache_size": "33554432", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-17T06:04:47.274 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_clone_copy_on_read": "false", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_compression_hint": "none", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_concurrent_management_ops": "10", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_default_clone_format": "auto", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_default_data_pool": "", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_default_features": "61", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_default_format": "2", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_default_map_options": "", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_default_order": "22", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_default_pool": "rbd", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-17T06:04:47.275 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_default_stripe_count": "0", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_default_stripe_unit": "0", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_enable_alloc_hint": "true", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_io_scheduler": "simple", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-17T06:04:47.276 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-17T06:04:47.277 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-17T06:04:47.277 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-17T06:04:47.277 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-17T06:04:47.277 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_journal_order": "24", 2024-09-17T06:04:47.277 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_journal_pool": "", 2024-09-17T06:04:47.277 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_journal_splay_width": "4", 2024-09-17T06:04:47.277 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_localize_parent_reads": "false", 2024-09-17T06:04:47.277 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_localize_snap_reads": "false", 2024-09-17T06:04:47.277 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-17T06:04:47.277 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-17T06:04:47.277 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-17T06:04:47.278 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-17T06:04:47.278 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-17T06:04:47.278 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-17T06:04:47.278 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-17T06:04:47.278 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-17T06:04:47.278 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-17T06:04:47.278 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-17T06:04:47.278 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-17T06:04:47.278 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-17T06:04:47.278 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-17T06:04:47.278 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-17T06:04:47.278 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-17T06:04:47.279 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_mtime_update_interval": "60", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_non_blocking_aio": "true", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_op_thread_timeout": "60", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_op_threads": "1", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_parent_cache_enabled": "false", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_plugins": "", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_bps_burst": "0", 2024-09-17T06:04:47.280 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_bps_limit": "0", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_exclude_ops": "0", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_iops_burst": "0", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_iops_limit": "0", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-17T06:04:47.281 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_read_from_replica_policy": "default", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_skip_partial_discard": "true", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-17T06:04:47.282 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_tracing": "false", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_validate_names": "true", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "rbd_validate_pool": "true", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "restapi_base_url": "", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "restapi_log_level": "", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_acl_grants_max_num": "100", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_admin_entry": "admin", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_asio_assert_yielding": "false", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_backend_store": "rados", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_barbican_url": "", 2024-09-17T06:04:47.283 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_beast_enable_async": "true", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_bucket_counters_cache": "false", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_cache_enabled": "true", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_cache_expiry_interval": "900", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_cache_lru_size": "25000", 2024-09-17T06:04:47.284 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_config_store": "rados", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_content_length_compat": "false", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_copy_obj_progress": "true", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_cors_rules_max_num": "100", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_cross_domain_policy": "", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_kmip_addr": "", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_kmip_password": "", 2024-09-17T06:04:47.285 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-17T06:04:47.286 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_kmip_username": "", 2024-09-17T06:04:47.286 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_require_ssl": "true", 2024-09-17T06:04:47.286 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-17T06:04:47.286 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-17T06:04:47.286 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-17T06:04:47.286 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-17T06:04:47.286 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-17T06:04:47.286 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-17T06:04:47.286 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-17T06:04:47.286 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-17T06:04:47.286 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-17T06:04:47.286 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_vault_addr": "", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_vault_auth": "token", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_vault_namespace": "", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_vault_prefix": "", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-17T06:04:47.287 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-17T06:04:47.288 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_vault_token_file": "", 2024-09-17T06:04:47.288 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-17T06:04:47.288 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_curl_buffersize": "524288", 2024-09-17T06:04:47.288 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-17T06:04:47.288 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_curl_low_speed_time": "300", 2024-09-17T06:04:47.288 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-17T06:04:47.288 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-17T06:04:47.288 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-17T06:04:47.288 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-17T06:04:47.288 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-17T06:04:47.288 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-17T06:04:47.289 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-17T06:04:47.290 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_data_log_changes_size": "1000", 2024-09-17T06:04:47.290 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_data_log_num_shards": "128", 2024-09-17T06:04:47.290 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-17T06:04:47.290 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_data_log_window": "30", 2024-09-17T06:04:47.290 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-17T06:04:47.290 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-17T06:04:47.290 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-17T06:04:47.290 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-17T06:04:47.290 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-17T06:04:47.290 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-17T06:04:47.290 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-17T06:04:47.290 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-17T06:04:47.291 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-17T06:04:47.291 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-17T06:04:47.291 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-17T06:04:47.291 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-17T06:04:47.291 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-17T06:04:47.291 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_disable_s3select": "false", 2024-09-17T06:04:47.291 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-17T06:04:47.291 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-17T06:04:47.291 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-17T06:04:47.291 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-17T06:04:47.291 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-17T06:04:47.291 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-17T06:04:47.292 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-17T06:04:47.292 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-17T06:04:47.292 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-17T06:04:47.292 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-17T06:04:47.292 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-17T06:04:47.292 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-17T06:04:47.292 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dns_name": "", 2024-09-17T06:04:47.292 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dns_s3website_name": "", 2024-09-17T06:04:47.292 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dynamic_resharding": "true", 2024-09-17T06:04:47.292 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-17T06:04:47.292 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-17T06:04:47.293 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-17T06:04:47.293 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_enable_gc_threads": "true", 2024-09-17T06:04:47.293 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_enable_lc_threads": "true", 2024-09-17T06:04:47.293 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_enable_mdsearch": "true", 2024-09-17T06:04:47.293 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_enable_ops_log": "false", 2024-09-17T06:04:47.293 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_enable_quota_threads": "true", 2024-09-17T06:04:47.293 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_enable_static_website": "false", 2024-09-17T06:04:47.293 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_enable_usage_log": "false", 2024-09-17T06:04:47.293 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_enforce_swift_acls": "true", 2024-09-17T06:04:47.293 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_exit_timeout_secs": "120", 2024-09-17T06:04:47.293 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_expose_bucket": "false", 2024-09-17T06:04:47.294 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_extended_http_attrs": "", 2024-09-17T06:04:47.294 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_filter": "none", 2024-09-17T06:04:47.294 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-17T06:04:47.294 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_frontends": "beast port=7480", 2024-09-17T06:04:47.294 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-17T06:04:47.294 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_gc_max_deferred": "50", 2024-09-17T06:04:47.294 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-17T06:04:47.294 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_gc_max_objs": "32", 2024-09-17T06:04:47.294 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-17T06:04:47.294 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-17T06:04:47.294 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_gc_processor_period": "3600", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_init_timeout": "300", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_kafka_connection_idle": "300", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-17T06:04:47.295 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_admin_domain": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_admin_password": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_admin_password_path": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_admin_project": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_admin_tenant": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_admin_token": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_admin_token_path": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_admin_user": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_barbican_domain": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_barbican_password": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_barbican_project": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-17T06:04:47.296 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_barbican_user": "", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_url": "", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_lc_debug_interval": "-1", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_lc_lock_max_time": "90", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_lc_max_objs": "32", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_lc_max_rules": "1000", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_lc_max_worker": "3", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-17T06:04:47.297 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_lc_thread_delay": "0", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_ldap_dnattr": "uid", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_ldap_searchfilter": "", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_ldap_uri": "", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_log_http_headers": "", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-17T06:04:47.298 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_log_object_name_utc": "false", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_attr_name_len": "0", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_attr_size": "0", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_chunk_size": "4194304", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_listing_results": "5000", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_notify_retries": "10", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_put_param_size": "1048576", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_put_size": "5368709120", 2024-09-17T06:04:47.299 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_max_slo_entries": "1000", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_md_log_max_shards": "64", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_mp_lock_max_time": "600", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-17T06:04:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_max_gc": "300", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_num_async_rados_threads": "32", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_num_control_oids": "8", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_numa_node": "-1", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-17T06:04:47.301 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_objexp_chunk_size": "100", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_objexp_gc_interval": "600", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_op_thread_timeout": "600", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_op_tracing": "false", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_opa_token": "", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_opa_url": "", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_opa_verify_ssl": "true", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_ops_log_rados": "false", 2024-09-17T06:04:47.302 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_ops_log_socket_path": "", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_period_push_interval": "2.000000", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_posix_cache_lanes": "3", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_posix_cache_partitions": "3", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_print_continue": "true", 2024-09-17T06:04:47.303 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_rados_tracing": "false", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_realm": "", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_realm_id": "", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_region": "", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-17T06:04:47.304 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_request_uri": "", 2024-09-17T06:04:47.305 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_reshard_batch_size": "64", 2024-09-17T06:04:47.305 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-17T06:04:47.305 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-17T06:04:47.305 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_reshard_max_aio": "128", 2024-09-17T06:04:47.305 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_reshard_num_logs": "16", 2024-09-17T06:04:47.305 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-17T06:04:47.305 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-17T06:04:47.305 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_reshard_thread_interval": "600", 2024-09-17T06:04:47.305 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-17T06:04:47.305 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_resolve_cname": "false", 2024-09-17T06:04:47.305 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-17T06:04:47.305 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_run_sync_thread": "true", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_scheduler_type": "throttler", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_script_uri": "", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_service_provider_name": "", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sts_client_id": "", 2024-09-17T06:04:47.306 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sts_client_secret": "", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sts_entry": "sts", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sts_key": "sts", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sts_min_session_duration": "900", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sts_token_introspection_url": "", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_swift_account_in_url": "false", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_swift_auth_entry": "auth", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_swift_auth_url": "", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_swift_custom_header": "", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_swift_need_stats": "true", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_swift_tenant_name": "", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_swift_token_expiration": "86400", 2024-09-17T06:04:47.307 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_swift_url": "", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_swift_url_prefix": "swift", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sync_lease_period": "120", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-17T06:04:47.308 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_thread_pool_size": "512", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_torrent_comment": "", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_torrent_createby": "", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_torrent_encoding": "", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_torrent_flag": "false", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_torrent_origin": "", 2024-09-17T06:04:47.309 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_torrent_tracker": "", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_trust_forwarded_https": "false", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_usage_max_shards": "32", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_usage_max_user_shards": "1", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_use_opa_authz": "false", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_user_counters_cache": "false", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_user_max_buckets": "1000", 2024-09-17T06:04:47.310 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_user_policies_max_num": "100", 2024-09-17T06:04:47.311 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-17T06:04:47.311 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-17T06:04:47.311 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-17T06:04:47.311 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-17T06:04:47.311 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_user_unique_email": "true", 2024-09-17T06:04:47.311 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_verify_ssl": "true", 2024-09-17T06:04:47.311 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-17T06:04:47.311 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_zone": "", 2024-09-17T06:04:47.311 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_zone_id": "", 2024-09-17T06:04:47.311 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-17T06:04:47.311 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_zonegroup": "", 2024-09-17T06:04:47.311 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_zonegroup_id": "", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rgwlc_auto_session_clear": "true", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_block_size": "4096", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_cache_size": "536870912", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-17T06:04:47.312 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-17T06:04:47.313 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-17T06:04:47.313 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-17T06:04:47.313 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-17T06:04:47.313 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-17T06:04:47.313 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-17T06:04:47.313 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_index_type": "binary_search", 2024-09-17T06:04:47.313 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-17T06:04:47.313 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-17T06:04:47.313 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_partition_filters": "false", 2024-09-17T06:04:47.313 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_perf": "false", 2024-09-17T06:04:47.313 INFO:teuthology.orchestra.run.smithi122.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-17T06:04:47.313 INFO:teuthology.orchestra.run.smithi122.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "run_dir": "/var/run/ceph", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_block_create": "true", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_cache_lru_size": "67108864", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_default_max_object_size": "16777216", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_device_size": "53687091200", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_full_integrity_check": "false", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_journal_batch_capacity": "16", 2024-09-17T06:04:47.314 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-17T06:04:47.315 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-17T06:04:47.315 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-17T06:04:47.315 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_main_device_type": "SSD", 2024-09-17T06:04:47.315 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-17T06:04:47.315 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-17T06:04:47.315 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-17T06:04:47.315 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-17T06:04:47.315 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-17T06:04:47.315 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-17T06:04:47.315 INFO:teuthology.orchestra.run.smithi122.stdout: "seastore_segment_size": "67108864", 2024-09-17T06:04:47.315 INFO:teuthology.orchestra.run.smithi122.stdout: "set_keepcaps": "false", 2024-09-17T06:04:47.315 INFO:teuthology.orchestra.run.smithi122.stdout: "setgroup": "", 2024-09-17T06:04:47.316 INFO:teuthology.orchestra.run.smithi122.stdout: "setuser": "", 2024-09-17T06:04:47.316 INFO:teuthology.orchestra.run.smithi122.stdout: "setuser_match_path": "", 2024-09-17T06:04:47.316 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-17T06:04:47.316 INFO:teuthology.orchestra.run.smithi122.stdout: "thp": "false", 2024-09-17T06:04:47.316 INFO:teuthology.orchestra.run.smithi122.stdout: "threadpool_default_timeout": "60", 2024-09-17T06:04:47.316 INFO:teuthology.orchestra.run.smithi122.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-17T06:04:47.316 INFO:teuthology.orchestra.run.smithi122.stdout: "throttler_perf_counter": "true", 2024-09-17T06:04:47.316 INFO:teuthology.orchestra.run.smithi122.stdout: "tmp_dir": "/tmp", 2024-09-17T06:04:47.316 INFO:teuthology.orchestra.run.smithi122.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-17T06:04:47.316 INFO:teuthology.orchestra.run.smithi122.stdout: "uadk_compressor_enabled": "false", 2024-09-17T06:04:47.316 INFO:teuthology.orchestra.run.smithi122.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-17T06:04:47.316 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:04:47.319 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-17T06:04:47.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.471+0000 7fa58a289640 1 -- 172.21.15.122:0/2231489807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa58406f5c0 msgr2=0x7fa5840c2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.471+0000 7fa58a289640 1 --2- 172.21.15.122:0/2231489807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa58406f5c0 0x7fa5840c2a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa5840b0c70 tx=0x7fa57c01eff0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.471+0000 7fa58a289640 1 -- 172.21.15.122:0/2231489807 shutdown_connections 2024-09-17T06:04:47.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.471+0000 7fa58a289640 1 --2- 172.21.15.122:0/2231489807 >> v2:172.21.15.173:3300/0 conn(0x7fa5840c9fc0 0x7fa58415b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.471+0000 7fa58a289640 1 --2- 172.21.15.122:0/2231489807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa58406f5c0 0x7fa5840c2a20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.471+0000 7fa58a289640 1 -- 172.21.15.122:0/2231489807 >> 172.21.15.122:0/2231489807 conn(0x7fa584073640 msgr2=0x7fa5840cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:47.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.471+0000 7fa58a289640 1 -- 172.21.15.122:0/2231489807 shutdown_connections 2024-09-17T06:04:47.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.471+0000 7fa58a289640 1 -- 172.21.15.122:0/2231489807 wait complete. 2024-09-17T06:04:47.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa58a289640 1 Processor -- start 2024-09-17T06:04:47.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa58a289640 1 -- start start 2024-09-17T06:04:47.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa58a289640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840b3b80 0x7fa5841efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa58a289640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5840c9fc0 0x7fa584148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa58a289640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5840cc960 0x7fa5840ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa58a289640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa58406f0a0 con 0x7fa5840b3b80 2024-09-17T06:04:47.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa58a289640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa58406edc0 con 0x7fa5840cc960 2024-09-17T06:04:47.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa58a289640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa5840c2f60 con 0x7fa5840c9fc0 2024-09-17T06:04:47.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa583fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840b3b80 0x7fa5841efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa583fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840b3b80 0x7fa5841efbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35044/0 (socket says 172.21.15.122:35044) 2024-09-17T06:04:47.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa583fff640 1 -- 172.21.15.122:0/1271742511 learned_addr learned my addr 172.21.15.122:0/1271742511 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:47.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5840cc960 0x7fa5840ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa5837fe640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5840c9fc0 0x7fa584148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa583fff640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5840c9fc0 msgr2=0x7fa584148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa583fff640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5840c9fc0 0x7fa584148650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa583fff640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5840cc960 msgr2=0x7fa5840ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa583fff640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5840cc960 0x7fa5840ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa583fff640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5841e1730 con 0x7fa5840b3b80 2024-09-17T06:04:47.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa583fff640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840b3b80 0x7fa5841efbd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa57c000c10 tx=0x7fa57c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0be070 con 0x7fa5840b3b80 2024-09-17T06:04:47.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa57c0053e0 con 0x7fa5840b3b80 2024-09-17T06:04:47.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0b5040 con 0x7fa5840b3b80 2024-09-17T06:04:47.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5841e55c0 con 0x7fa5840b3b80 2024-09-17T06:04:47.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5841f2840 con 0x7fa5840b3b80 2024-09-17T06:04:47.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.475+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa5841e5800 con 0x7fa5840b3b80 2024-09-17T06:04:47.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa57c0046d0 con 0x7fa5840b3b80 2024-09-17T06:04:47.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa564073200 0x7fa564075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa57c131850 con 0x7fa5840b3b80 2024-09-17T06:04:47.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1289 (secure 0 0 0) 0x7fa5841e5800 con 0x7fa5840b3b80 2024-09-17T06:04:47.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa5837fe640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa564073200 0x7fa564075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa58a289640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5841e6700 0x7fa5840cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa5840c5820 con 0x7fa5841e6700 2024-09-17T06:04:47.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5841e6700 0x7fa5840cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa588826640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- command(tid 2: {"prefix": "get_command_descriptions"}) -- 0x7fa5841f0110 con 0x7fa5841e6700 2024-09-17T06:04:47.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa5837fe640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa564073200 0x7fa564075710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa58415bc40 tx=0x7fa56c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5841e6700 0x7fa5840cd2b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa57400f900 tx=0x7fa57400fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57400dd40 con 0x7fa5841e6700 2024-09-17T06:04:47.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.0 v2:172.21.15.122:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa57400dd40 con 0x7fa5841e6700 2024-09-17T06:04:47.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5841e6700 msgr2=0x7fa5840cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5841e6700 0x7fa5840cd2b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa57400f900 tx=0x7fa57400fdc0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5841e6700 msgr2=0x7fa5840cd2b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T06:04:47.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.479+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5841e6700 0x7fa5840cd2b0 secure :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa57400f900 tx=0x7fa57400fdc0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa58a289640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840c96b0 0x7fa5841e20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa5841f2a70 con 0x7fa5840c96b0 2024-09-17T06:04:47.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840c96b0 0x7fa5841e20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa588826640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- command(tid 3: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=0"]}) -- 0x7fa5841ef1c0 con 0x7fa5840c96b0 2024-09-17T06:04:47.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840c96b0 0x7fa5841e20c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa57401a000 tx=0x7fa574004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa574011c80 con 0x7fa5840c96b0 2024-09-17T06:04:47.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.0 v2:172.21.15.122:3300/0 2 ==== command_reply(tid 3: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) ==== 82+0+3 (secure 0 0 0) 0x7fa574011d40 con 0x7fa5840c96b0 2024-09-17T06:04:47.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840c96b0 msgr2=0x7fa5841e20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840c96b0 0x7fa5841e20c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa57401a000 tx=0x7fa574004a50 comp rx=0 tx=0).stop 2024-09-17T06:04:47.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840c96b0 msgr2=0x7fa5841e20c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T06:04:47.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840c96b0 0x7fa5841e20c0 secure :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa57401a000 tx=0x7fa574004a50 comp rx=0 tx=0).stop 2024-09-17T06:04:47.490 INFO:teuthology.orchestra.run.smithi122.stdout:mon.a: {} 2024-09-17T06:04:47.491 INFO:teuthology.orchestra.run.smithi122.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T06:04:47.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa58a289640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5841e2600 0x7fa5841e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa5841e2f50 con 0x7fa5841e2600 2024-09-17T06:04:47.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5841e2600 0x7fa5841e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.487+0000 7fa588826640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- command(tid 4: {"prefix": "get_command_descriptions"}) -- 0x7fa58415b990 con 0x7fa5841e2600 2024-09-17T06:04:47.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.491+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5841e2600 0x7fa5841e2a10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa57400e010 tx=0x7fa574009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.491+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa574035030 con 0x7fa5841e2600 2024-09-17T06:04:47.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.491+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.1 v2:172.21.15.173:3300/0 2 ==== command_reply(tid 4: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa574031600 con 0x7fa5841e2600 2024-09-17T06:04:47.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.491+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5841e2600 msgr2=0x7fa5841e2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.491+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5841e2600 0x7fa5841e2a10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa57400e010 tx=0x7fa574009560 comp rx=0 tx=0).stop 2024-09-17T06:04:47.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.491+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5841e2600 msgr2=0x7fa5841e2a10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T06:04:47.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.491+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5841e2600 0x7fa5841e2a10 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa57400e010 tx=0x7fa574009560 comp rx=0 tx=0).stop 2024-09-17T06:04:47.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.491+0000 7fa588826640 1 -- 172.21.15.122:0/1271742511 reap_dead start 2024-09-17T06:04:47.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.495+0000 7fa58a289640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5840ccd70 0x7fa584148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.495+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa58415b6b0 con 0x7fa5840ccd70 2024-09-17T06:04:47.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.499+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5840ccd70 0x7fa584148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.499+0000 7fa588826640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- command(tid 5: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=0"]}) -- 0x7fa58414db40 con 0x7fa5840ccd70 2024-09-17T06:04:47.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.499+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5840ccd70 0x7fa584148650 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa5841e30d0 tx=0x7fa57402a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.501 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.499+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa574035070 con 0x7fa5840ccd70 2024-09-17T06:04:47.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.1 v2:172.21.15.173:3300/0 2 ==== command_reply(tid 5: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) ==== 82+0+3 (secure 0 0 0) 0x7fa574043400 con 0x7fa5840ccd70 2024-09-17T06:04:47.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5840ccd70 msgr2=0x7fa584148650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5840ccd70 0x7fa584148650 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa5841e30d0 tx=0x7fa57402a000 comp rx=0 tx=0).stop 2024-09-17T06:04:47.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5840ccd70 msgr2=0x7fa584148650 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T06:04:47.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5840ccd70 0x7fa584148650 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa5841e30d0 tx=0x7fa57402a000 comp rx=0 tx=0).stop 2024-09-17T06:04:47.505 INFO:teuthology.orchestra.run.smithi122.stdout:mon.b: {} 2024-09-17T06:04:47.506 INFO:teuthology.orchestra.run.smithi122.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T06:04:47.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa58a289640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414c9c0 0x7fa58414cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa584148b90 con 0x7fa58414c9c0 2024-09-17T06:04:47.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414c9c0 0x7fa58414cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa588826640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- command(tid 6: {"prefix": "get_command_descriptions"}) -- 0x7fa584070070 con 0x7fa58414c9c0 2024-09-17T06:04:47.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414c9c0 0x7fa58414cdd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa574011fd0 tx=0x7fa574020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57403aa60 con 0x7fa58414c9c0 2024-09-17T06:04:47.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.2 v2:172.21.15.173:3301/0 2 ==== command_reply(tid 6: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa5740435b0 con 0x7fa58414c9c0 2024-09-17T06:04:47.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414c9c0 msgr2=0x7fa58414cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414c9c0 0x7fa58414cdd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa574011fd0 tx=0x7fa574020000 comp rx=0 tx=0).stop 2024-09-17T06:04:47.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414c9c0 msgr2=0x7fa58414cdd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T06:04:47.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.503+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414c9c0 0x7fa58414cdd0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa574011fd0 tx=0x7fa574020000 comp rx=0 tx=0).stop 2024-09-17T06:04:47.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.511+0000 7fa58a289640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414d310 0x7fa584201b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.511+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa5841ef740 con 0x7fa58414d310 2024-09-17T06:04:47.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.511+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414d310 0x7fa584201b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.511+0000 7fa588826640 1 -- 172.21.15.122:0/1271742511 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- command(tid 7: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=0"]}) -- 0x7fa5841ef8f0 con 0x7fa58414d310 2024-09-17T06:04:47.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.511+0000 7fa588826640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414d310 0x7fa584201b80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa574019d80 tx=0x7fa574035000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.515+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa574051070 con 0x7fa58414d310 2024-09-17T06:04:47.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 <== mon.2 v2:172.21.15.173:3301/0 2 ==== command_reply(tid 7: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) ==== 82+0+3 (secure 0 0 0) 0x7fa574043760 con 0x7fa58414d310 2024-09-17T06:04:47.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414d310 msgr2=0x7fa584201b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414d310 0x7fa584201b80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa574019d80 tx=0x7fa574035000 comp rx=0 tx=0).stop 2024-09-17T06:04:47.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa580ff9640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414d310 msgr2=0x7fa584201b80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T06:04:47.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa580ff9640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa58414d310 0x7fa584201b80 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa574019d80 tx=0x7fa574035000 comp rx=0 tx=0).stop 2024-09-17T06:04:47.520 INFO:teuthology.orchestra.run.smithi122.stdout:mon.c: {} 2024-09-17T06:04:47.521 INFO:teuthology.orchestra.run.smithi122.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T06:04:47.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa564073200 msgr2=0x7fa564075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa58a289640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa564073200 0x7fa564075710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa58415bc40 tx=0x7fa56c009040 comp rx=0 tx=0).stop 2024-09-17T06:04:47.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840b3b80 msgr2=0x7fa5841efbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa58a289640 1 --2- 172.21.15.122:0/1271742511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5840b3b80 0x7fa5841efbd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa57c000c10 tx=0x7fa57c005dd0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa588826640 1 -- 172.21.15.122:0/1271742511 reap_dead start 2024-09-17T06:04:47.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 shutdown_connections 2024-09-17T06:04:47.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 >> 172.21.15.122:0/1271742511 conn(0x7fa584073640 msgr2=0x7fa58406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:47.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 shutdown_connections 2024-09-17T06:04:47.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.519+0000 7fa58a289640 1 -- 172.21.15.122:0/1271742511 wait complete. 2024-09-17T06:04:47.539 DEBUG:teuthology.orchestra.run.smithi122:> type ceph-objectstore-tool 2024-09-17T06:04:47.543 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T06:04:47.543 DEBUG:teuthology.orchestra.run.smithi173:> type ceph-objectstore-tool 2024-09-17T06:04:47.549 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T06:04:47.550 INFO:teuthology.run_tasks:Running task workunit... 2024-09-17T06:04:47.565 INFO:tasks.workunit:Pulling workunits from ref ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T06:04:47.565 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T06:04:47.565 INFO:tasks.workunit:timeout=3h 2024-09-17T06:04:47.565 INFO:tasks.workunit:cleanup=True 2024-09-17T06:04:47.565 DEBUG:teuthology.orchestra.run.smithi122:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T06:04:47.566 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-17T06:04:47.566 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-17T06:04:47.566 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T06:04:47.566 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-17T06:04:47.566 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T06:04:47.566 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T06:04:47.566 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-17T06:04:47.567 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-17T06:04:47.567 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-17T06:04:47.567 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:04:47.567 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-17T06:04:47.568 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:04:47.568 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-17T06:04:47.568 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T06:04:47.592 INFO:teuthology.orchestra.run.smithi122.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-17T06:04:47.592 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-17T06:04:47.592 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-09-17T06:04:47.592 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T06:04:47.592 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T06:04:47.592 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-17 06:04:13.816428867 +0000 2024-09-17T06:04:47.592 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-17 06:04:22.316605367 +0000 2024-09-17T06:04:47.592 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-09-17T06:04:47.592 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-17T06:04:47.592 DEBUG:teuthology.orchestra.run.smithi122:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-17T06:04:47.593 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:47.591+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:47.657 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T06:04:47.704 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:04:47.703+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:04:47.708 INFO:tasks.workunit.client.0.smithi122.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T06:04:47.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.731+0000 7f6f2fb47640 1 -- 172.21.15.122:0/328436688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f280c38c0 msgr2=0x7f6f281534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.731+0000 7f6f2fb47640 1 --2- 172.21.15.122:0/328436688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f280c38c0 0x7f6f281534d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009900 tx=0x7f6f2401c8e0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7f6f2fb47640 1 -- 172.21.15.122:0/328436688 shutdown_connections 2024-09-17T06:04:47.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7f6f2fb47640 1 --2- 172.21.15.122:0/328436688 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f280c4330 0x7f6f280cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7f6f2fb47640 1 --2- 172.21.15.122:0/328436688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f280c38c0 0x7f6f281534d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7f6f2fb47640 1 -- 172.21.15.122:0/328436688 >> 172.21.15.122:0/328436688 conn(0x7f6f28070e40 msgr2=0x7f6f28071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:47.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7f6f2fb47640 1 -- 172.21.15.122:0/328436688 shutdown_connections 2024-09-17T06:04:47.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7f6f2fb47640 1 -- 172.21.15.122:0/328436688 wait complete. 2024-09-17T06:04:47.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7ff20ddc1640 1 -- 172.21.15.122:0/562892020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff20806ce90 msgr2=0x7ff2080b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/562892020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff20806ce90 0x7ff2080b2b20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009900 tx=0x7ff1f001c900 comp rx=0 tx=0).stop 2024-09-17T06:04:47.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7ff20ddc1640 1 -- 172.21.15.122:0/562892020 shutdown_connections 2024-09-17T06:04:47.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/562892020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff20806ce90 0x7ff2080b2b20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/562892020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2080b24b0 0x7ff20806f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7ff20ddc1640 1 -- 172.21.15.122:0/562892020 >> 172.21.15.122:0/562892020 conn(0x7ff208073640 msgr2=0x7ff2080cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:47.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7ff20ddc1640 1 -- 172.21.15.122:0/562892020 shutdown_connections 2024-09-17T06:04:47.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7ff20ddc1640 1 -- 172.21.15.122:0/562892020 wait complete. 2024-09-17T06:04:47.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7f6f2fb47640 1 Processor -- start 2024-09-17T06:04:47.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.735+0000 7f6f2fb47640 1 -- start start 2024-09-17T06:04:47.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff20ddc1640 1 Processor -- start 2024-09-17T06:04:47.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff20ddc1640 1 -- start start 2024-09-17T06:04:47.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2fb47640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f280c38c0 0x7f6f281f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2fb47640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f280c4330 0x7f6f280c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2fb47640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f280cb690 0x7f6f28156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2fb47640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280cf500 con 0x7f6f280cb690 2024-09-17T06:04:47.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2fb47640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280ca2a0 con 0x7f6f280c38c0 2024-09-17T06:04:47.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2fb47640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6f280cf680 con 0x7f6f280c4330 2024-09-17T06:04:47.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2e0e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f280cb690 0x7f6f28156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2e0e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f280cb690 0x7f6f28156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35092/0 (socket says 172.21.15.122:35092) 2024-09-17T06:04:47.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2e0e4640 1 -- 172.21.15.122:0/3001742581 learned_addr learned my addr 172.21.15.122:0/3001742581 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:47.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2d0e2640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f280c4330 0x7f6f280c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2e0e4640 1 -- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f280c4330 msgr2=0x7f6f280c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2e0e4640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f280c4330 0x7f6f280c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2e0e4640 1 -- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f280c38c0 msgr2=0x7f6f281f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2e0e4640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f280c38c0 0x7f6f281f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2e0e4640 1 -- 172.21.15.122:0/3001742581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f281f6a10 con 0x7f6f280cb690 2024-09-17T06:04:47.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2d0e2640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f280c4330 0x7f6f280c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:04:47.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff20ddc1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff20806ce90 0x7ff2081f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff20ddc1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2080b24b0 0x7ff2080ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.743 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:04:47.744 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:04:47.744 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-09-17T06:04:47.744 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:04:47.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff20ddc1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff208159cb0 0x7ff2080c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff20ddc1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff2080c2ba0 con 0x7ff2080b24b0 2024-09-17T06:04:47.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff20ddc1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff2080c2a20 con 0x7ff20806ce90 2024-09-17T06:04:47.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff20ddc1640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff2080c2d20 con 0x7ff208159cb0 2024-09-17T06:04:47.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2e0e4640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f280cb690 0x7f6f28156170 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c6e0 tx=0x7f6f2000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff1fffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2080b24b0 0x7ff2080ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff1fffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2080b24b0 0x7ff2080ac570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35102/0 (socket says 172.21.15.122:35102) 2024-09-17T06:04:47.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff1fffff640 1 -- 172.21.15.122:0/1191077280 learned_addr learned my addr 172.21.15.122:0/1191077280 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:47.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f1e7fc640 1 -- 172.21.15.122:0/3001742581 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20003b80 con 0x7f6f280cb690 2024-09-17T06:04:47.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f1e7fc640 1 -- 172.21.15.122:0/3001742581 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f20003d20 con 0x7f6f280cb690 2024-09-17T06:04:47.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f1e7fc640 1 -- 172.21.15.122:0/3001742581 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20005330 con 0x7f6f280cb690 2024-09-17T06:04:47.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff1fffff640 1 -- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff208159cb0 msgr2=0x7ff2080c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff1fffff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff208159cb0 0x7ff2080c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff1fffff640 1 -- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff20806ce90 msgr2=0x7ff2081f9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff1fffff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff20806ce90 0x7ff2081f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff1fffff640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2080c8040 con 0x7ff2080b24b0 2024-09-17T06:04:47.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2fb47640 1 -- 172.21.15.122:0/3001742581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f281526c0 con 0x7f6f280cb690 2024-09-17T06:04:47.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2fb47640 1 -- 172.21.15.122:0/3001742581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f281f5cd0 con 0x7f6f280cb690 2024-09-17T06:04:47.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff1fffff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2080b24b0 0x7ff2080ac570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff1f001afb0 tx=0x7ff1f00a6730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7f6f2fb47640 1 -- 172.21.15.122:0/3001742581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f281f5ac0 con 0x7f6f280cb690 2024-09-17T06:04:47.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.743+0000 7f6f1e7fc640 1 -- 172.21.15.122:0/3001742581 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6f200054d0 con 0x7f6f280cb690 2024-09-17T06:04:47.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.743+0000 7f6f1e7fc640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6f0c073200 0x7f6f0c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.743+0000 7f6f1e7fc640 1 -- 172.21.15.122:0/3001742581 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7f6f200944e0 con 0x7f6f280cb690 2024-09-17T06:04:47.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0004350 con 0x7ff2080b24b0 2024-09-17T06:04:47.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1f0003600 con 0x7ff2080b24b0 2024-09-17T06:04:47.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.739+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0003a50 con 0x7ff2080b24b0 2024-09-17T06:04:47.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.743+0000 7f6f2d8e3640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6f0c073200 0x7f6f0c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.743+0000 7f6f2d8e3640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6f0c073200 0x7f6f0c075710 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6f240af000 tx=0x7f6f24019680 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.743+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2080c8c50 con 0x7ff2080b24b0 2024-09-17T06:04:47.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.743+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2080c7020 con 0x7ff2080b24b0 2024-09-17T06:04:47.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.747+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7ff20806e1b0 con 0x7ff2080b24b0 2024-09-17T06:04:47.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.747+0000 7f6f1e7fc640 1 -- 172.21.15.122:0/3001742581 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6f281f6a10 con 0x7f6f280cb690 2024-09-17T06:04:47.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.751+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff1f00be030 con 0x7ff2080b24b0 2024-09-17T06:04:47.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.751+0000 7ff204ff9640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff1e8073280 0x7ff1e8075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.751+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6743+0+0 (secure 0 0 0) 0x7ff1f012f230 con 0x7ff2080b24b0 2024-09-17T06:04:47.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.751+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v27) ==== 54+0+16 (secure 0 0 0) 0x7ff1f00c5060 con 0x7ff2080b24b0 2024-09-17T06:04:47.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.751+0000 7ff2077fe640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff1e8073280 0x7ff1e8075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.751+0000 7ff2077fe640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff1e8073280 0x7ff1e8075790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80058d0 tx=0x7ff1f8005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.759+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7ff208162dd0 0x7ff208151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.759+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2080c8a00 con 0x7ff208162dd0 2024-09-17T06:04:47.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.759+0000 7ff207fff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7ff208162dd0 0x7ff208151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.759+0000 7ff207fff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7ff208162dd0 0x7ff208151170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.759+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2080c8a00 con 0x7ff208162dd0 2024-09-17T06:04:47.761 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:47.761 INFO:teuthology.orchestra.run.smithi173.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T06:04:47.761 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:47.764 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:04:47.769 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:47.767+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:47.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.775+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7ff2080b1250 con 0x7ff208162dd0 2024-09-17T06:04:47.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.775+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff2080b1250 con 0x7ff208162dd0 2024-09-17T06:04:47.778 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:04:47.779 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:04:47.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.775+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7ff2081516b0 0x7ff2081fc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.775+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7ff2080cd0b0 con 0x7ff2081516b0 2024-09-17T06:04:47.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.775+0000 7ff2077fe640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7ff2081516b0 0x7ff2081fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.775+0000 7ff2077fe640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7ff2081516b0 0x7ff2081fc670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.779+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2080cd0b0 con 0x7ff2081516b0 2024-09-17T06:04:47.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.791+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7ff2080ccdd0 con 0x7ff2081516b0 2024-09-17T06:04:47.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.795+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff2080ccdd0 con 0x7ff2081516b0 2024-09-17T06:04:47.798 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:04:47.799 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:04:47.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.795+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff2081fd0c0 0x7ff2080638b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.795+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7ff2081fd4d0 con 0x7ff2081fd0c0 2024-09-17T06:04:47.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.795+0000 7ff1fffff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff2081fd0c0 0x7ff2080638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.795+0000 7ff1fffff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff2081fd0c0 0x7ff2080638b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.795+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2081fd4d0 con 0x7ff2081fd0c0 2024-09-17T06:04:47.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.811+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7ff208063df0 con 0x7ff2081fd0c0 2024-09-17T06:04:47.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.811+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff208063df0 con 0x7ff2081fd0c0 2024-09-17T06:04:47.815 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:04:47.815 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:04:47.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.811+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7ff2080c4db0 0x7ff2080c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.811+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7ff2080c5700 con 0x7ff2080c4db0 2024-09-17T06:04:47.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.811+0000 7ff207fff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7ff2080c4db0 0x7ff2080c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.811+0000 7ff207fff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7ff2080c4db0 0x7ff2080c51c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.815+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2080c5700 con 0x7ff2080c4db0 2024-09-17T06:04:47.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.827+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7ff2080c59d0 con 0x7ff2080c4db0 2024-09-17T06:04:47.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.831+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff2080c59d0 con 0x7ff2080c4db0 2024-09-17T06:04:47.833 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:04:47.834 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:04:47.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.831+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7ff20802d4d0 0x7ff20802d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.831+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7ff20802de20 con 0x7ff20802d4d0 2024-09-17T06:04:47.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.831+0000 7ff2077fe640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7ff20802d4d0 0x7ff20802d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.831+0000 7ff2077fe640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7ff20802d4d0 0x7ff20802d8e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.831+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff20802de20 con 0x7ff20802d4d0 2024-09-17T06:04:47.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.851+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7ff20802de20 con 0x7ff20802d4d0 2024-09-17T06:04:47.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.851+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff20802de20 con 0x7ff20802d4d0 2024-09-17T06:04:47.854 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:04:47.855 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:04:47.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.851+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7ff20802e540 0x7ff20820fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.851+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7ff20802e950 con 0x7ff20802e540 2024-09-17T06:04:47.855 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.851+0000 7ff1fffff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7ff20802e540 0x7ff20820fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.856 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.851+0000 7ff1fffff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7ff20802e540 0x7ff20820fa20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.855+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff20802e950 con 0x7ff20802e540 2024-09-17T06:04:47.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.867+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7ff20802e950 con 0x7ff20802e540 2024-09-17T06:04:47.870 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:47.867+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:47.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.871+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff20802e950 con 0x7ff20802e540 2024-09-17T06:04:47.875 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:04:47.875 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:04:47.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.871+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7ff208210470 0x7ff208212890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.871+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7ff208215660 con 0x7ff208210470 2024-09-17T06:04:47.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.875+0000 7ff207fff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7ff208210470 0x7ff208212890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.875+0000 7ff207fff640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7ff208210470 0x7ff208212890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.875+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff208215660 con 0x7ff208210470 2024-09-17T06:04:47.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.887+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7ff208212dd0 con 0x7ff208210470 2024-09-17T06:04:47.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.891+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff208212dd0 con 0x7ff208210470 2024-09-17T06:04:47.894 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:04:47.894 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:04:47.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.891+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7ff208213450 0x7ff208215870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:47.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.891+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7ff208218820 con 0x7ff208213450 2024-09-17T06:04:47.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.891+0000 7ff2077fe640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7ff208213450 0x7ff208215870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:47.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.891+0000 7ff2077fe640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7ff208213450 0x7ff208215870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:47.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.895+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff208218820 con 0x7ff208213450 2024-09-17T06:04:47.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.907+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7ff208217540 con 0x7ff208213450 2024-09-17T06:04:47.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff204ff9640 1 -- 172.21.15.122:0/1191077280 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff208217540 con 0x7ff208213450 2024-09-17T06:04:47.913 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:04:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:04:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7ff208162dd0 msgr2=0x7ff208151170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7ff208162dd0 0x7ff208151170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7ff2081516b0 msgr2=0x7ff2081fc670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7ff2081516b0 0x7ff2081fc670 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff2081fd0c0 msgr2=0x7ff2080638b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff2081fd0c0 0x7ff2080638b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7ff2080c4db0 msgr2=0x7ff2080c51c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7ff2080c4db0 0x7ff2080c51c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7ff20802d4d0 msgr2=0x7ff20802d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff207fff640 1 -- 172.21.15.122:0/1191077280 reap_dead start 2024-09-17T06:04:47.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7ff20802d4d0 0x7ff20802d8e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff207fff640 1 -- 172.21.15.122:0/1191077280 reap_dead start 2024-09-17T06:04:47.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7ff20802e540 msgr2=0x7ff20820fa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7ff20802e540 0x7ff20820fa20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7ff208210470 msgr2=0x7ff208212890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7ff208210470 0x7ff208212890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7ff208213450 msgr2=0x7ff208215870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7ff208213450 0x7ff208215870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff1e8073280 msgr2=0x7ff1e8075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff1e8073280 0x7ff1e8075790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80058d0 tx=0x7ff1f8005860 comp rx=0 tx=0).stop 2024-09-17T06:04:47.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2080b24b0 msgr2=0x7ff2080ac570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:47.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2080b24b0 0x7ff2080ac570 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff1f001afb0 tx=0x7ff1f00a6730 comp rx=0 tx=0).stop 2024-09-17T06:04:47.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff207fff640 1 -- 172.21.15.122:0/1191077280 reap_dead start 2024-09-17T06:04:47.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 shutdown_connections 2024-09-17T06:04:47.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 --2- 172.21.15.122:0/1191077280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2080b24b0 0x7ff2080ac570 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:47.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 >> 172.21.15.122:0/1191077280 conn(0x7ff208073640 msgr2=0x7ff2081524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:47.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 shutdown_connections 2024-09-17T06:04:47.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.911+0000 7ff20ddc1640 1 -- 172.21.15.122:0/1191077280 wait complete. 2024-09-17T06:04:47.917 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:47.917 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:47.945 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:04:47.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:47.967+0000 7f6f2fb47640 1 -- 172.21.15.122:0/3001742581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) -- 0x7f6f280c9ed0 con 0x7f6f280cb690 2024-09-17T06:04:47.971 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:47.967+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:48.072 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:48.071+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:48.105 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:48.106 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:48.121 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:04:48.174 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:48.171+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:48.275 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:48.275+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:48.300 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:48.300 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:48.317 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:04:48.375 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:48.371+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:48.455 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:48.455 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:48.470 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:04:48.476 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:48.475+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:48.578 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:48.575+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:48.649 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:48.650 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:48.666 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:04:48.711 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:48.711+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:48.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.723+0000 7f6f1e7fc640 1 -- 172.21.15.122:0/3001742581 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v28) ==== 87+0+0 (secure 0 0 0) 0x7f6f2005efd0 con 0x7f6f280cb690 2024-09-17T06:04:48.725 INFO:teuthology.orchestra.run.smithi122.stderr:noscrub is set 2024-09-17T06:04:48.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.727+0000 7f6f2fb47640 1 -- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6f0c073200 msgr2=0x7f6f0c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:48.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.727+0000 7f6f2fb47640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6f0c073200 0x7f6f0c075710 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6f240af000 tx=0x7f6f24019680 comp rx=0 tx=0).stop 2024-09-17T06:04:48.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.727+0000 7f6f2fb47640 1 -- 172.21.15.122:0/3001742581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f280cb690 msgr2=0x7f6f28156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:48.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.727+0000 7f6f2fb47640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f280cb690 0x7f6f28156170 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c6e0 tx=0x7f6f2000cba0 comp rx=0 tx=0).stop 2024-09-17T06:04:48.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.727+0000 7f6f2fb47640 1 -- 172.21.15.122:0/3001742581 shutdown_connections 2024-09-17T06:04:48.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.727+0000 7f6f2fb47640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f280cb690 0x7f6f28156170 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:48.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.727+0000 7f6f2fb47640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f280c4330 0x7f6f280c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:48.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.727+0000 7f6f2fb47640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6f0c073200 0x7f6f0c075710 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:48.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.727+0000 7f6f2fb47640 1 --2- 172.21.15.122:0/3001742581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f280c38c0 0x7f6f281f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:48.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.727+0000 7f6f2fb47640 1 -- 172.21.15.122:0/3001742581 >> 172.21.15.122:0/3001742581 conn(0x7f6f28070e40 msgr2=0x7f6f280c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:48.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.727+0000 7f6f2fb47640 1 -- 172.21.15.122:0/3001742581 shutdown_connections 2024-09-17T06:04:48.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:48.727+0000 7f6f2fb47640 1 -- 172.21.15.122:0/3001742581 wait complete. 2024-09-17T06:04:48.779 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:48.775+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:48.811 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:48.811 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:48.827 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:04:48.880 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:48.879+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:48.960 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:48.961 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:48.976 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:04:48.981 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:48.979+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:49.082 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:49.079+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:49.116 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:49.116 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:49.131 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:04:49.182 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:49.179+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:49.283 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:49.283+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:49.327 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:49.327 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:49.344 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:04:49.384 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:49.379+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:49.485 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:49.483+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:49.535 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:49.535 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:49.553 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:04:49.600 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:49.599+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:49.686 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:49.683+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:49.702 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:49.702 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:49.720 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T06:04:49.788 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:04:49.787+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:04:49.876 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:49.876 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:49.889 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:49.887+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:49.892 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T06:04:49.933 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:04:49.989 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:49.987+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:50.086 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:50.087 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:50.090 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:50.087+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:50.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 -- 172.21.15.122:0/2086854020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c780c6810 msgr2=0x7f4c78159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/2086854020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c780c6810 0x7f4c78159ac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009840 tx=0x7f4c6001f010 comp rx=0 tx=0).stop 2024-09-17T06:04:50.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 -- 172.21.15.122:0/2086854020 shutdown_connections 2024-09-17T06:04:50.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/2086854020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c780c6810 0x7f4c78159ac0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/2086854020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c780b8b60 0x7f4c78153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 -- 172.21.15.122:0/2086854020 >> 172.21.15.122:0/2086854020 conn(0x7f4c78074b20 msgr2=0x7f4c78074f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:50.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 -- 172.21.15.122:0/2086854020 shutdown_connections 2024-09-17T06:04:50.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 -- 172.21.15.122:0/2086854020 wait complete. 2024-09-17T06:04:50.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 Processor -- start 2024-09-17T06:04:50.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 -- start start 2024-09-17T06:04:50.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c78072300 0x7f4c78151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c780b8b60 0x7f4c7814e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c780c6810 0x7f4c78157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7815af20 con 0x7f4c78072300 2024-09-17T06:04:50.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7815d250 con 0x7f4c780c6810 2024-09-17T06:04:50.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.095+0000 7f4c7cc87640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7815b0a0 con 0x7f4c780b8b60 2024-09-17T06:04:50.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c78072300 0x7f4c78151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c78072300 0x7f4c78151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35124/0 (socket says 172.21.15.122:35124) 2024-09-17T06:04:50.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7659c640 1 -- 172.21.15.122:0/1696957399 learned_addr learned my addr 172.21.15.122:0/1696957399 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:50.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c76d9d640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c780c6810 0x7f4c78157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c6ffff640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c780b8b60 0x7f4c7814e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7659c640 1 -- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c780b8b60 msgr2=0x7f4c7814e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7659c640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4c780b8b60 0x7f4c7814e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7659c640 1 -- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c780c6810 msgr2=0x7f4c78157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7659c640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c780c6810 0x7f4c78157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7659c640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7814e9e0 con 0x7f4c78072300 2024-09-17T06:04:50.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7659c640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c78072300 0x7f4c78151110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800e7f0 tx=0x7f4c6800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:50.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800ccc0 con 0x7f4c78072300 2024-09-17T06:04:50.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c6800ce80 con 0x7f4c78072300 2024-09-17T06:04:50.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c780ca870 con 0x7f4c78072300 2024-09-17T06:04:50.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68005280 con 0x7f4c78072300 2024-09-17T06:04:50.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c780cae30 con 0x7f4c78072300 2024-09-17T06:04:50.104 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T06:04:50.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f4c78153090 con 0x7f4c78072300 2024-09-17T06:04:50.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4c68005420 con 0x7f4c78072300 2024-09-17T06:04:50.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c6effd640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4c58073200 0x7f4c58075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6743+0+0 (secure 0 0 0) 0x7f4c68095550 con 0x7f4c78072300 2024-09-17T06:04:50.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c6ffff640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4c58073200 0x7f4c58075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v28) ==== 54+0+16 (secure 0 0 0) 0x7f4c68026020 con 0x7f4c78072300 2024-09-17T06:04:50.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4c7814f100 0x7f4c781480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c780c9ee0 con 0x7f4c7814f100 2024-09-17T06:04:50.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.099+0000 7f4c76d9d640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4c7814f100 0x7f4c781480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.103+0000 7f4c6ffff640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4c58073200 0x7f4c58075710 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4c600b2000 tx=0x7f4c6001d850 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:50.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.103+0000 7f4c76d9d640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4c7814f100 0x7f4c781480f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:50.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.103+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c780c9ee0 con 0x7f4c7814f100 2024-09-17T06:04:50.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.115+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f4c78074500 con 0x7f4c7814f100 2024-09-17T06:04:50.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.119+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4c78074500 con 0x7f4c7814f100 2024-09-17T06:04:50.121 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:04:50.122 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:04:50.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.119+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f4c7814ebb0 0x7f4c781f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.119+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f4c78072a90 con 0x7f4c7814ebb0 2024-09-17T06:04:50.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.119+0000 7f4c7659c640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f4c7814ebb0 0x7f4c781f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.119+0000 7f4c7659c640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f4c7814ebb0 0x7f4c781f2c60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:50.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.119+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c78072a90 con 0x7f4c7814ebb0 2024-09-17T06:04:50.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.135+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f4c780727b0 con 0x7f4c7814ebb0 2024-09-17T06:04:50.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.135+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4c780727b0 con 0x7f4c7814ebb0 2024-09-17T06:04:50.138 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:04:50.139 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:04:50.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.135+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4c781f36b0 0x7f4c780638b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.135+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f4c781f3ac0 con 0x7f4c781f36b0 2024-09-17T06:04:50.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.135+0000 7f4c6ffff640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4c781f36b0 0x7f4c780638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.135+0000 7f4c6ffff640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4c781f36b0 0x7f4c780638b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:50.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.139+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c781f3ac0 con 0x7f4c781f36b0 2024-09-17T06:04:50.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.151+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f4c781581d0 con 0x7f4c781f36b0 2024-09-17T06:04:50.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.151+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4c781581d0 con 0x7f4c781f36b0 2024-09-17T06:04:50.155 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:04:50.156 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:04:50.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.151+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f4c7814f8b0 0x7f4c7814fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.151+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f4c780646c0 con 0x7f4c7814f8b0 2024-09-17T06:04:50.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.155+0000 7f4c76d9d640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f4c7814f8b0 0x7f4c7814fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.155+0000 7f4c76d9d640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f4c7814f8b0 0x7f4c7814fcc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:50.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.155+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c780646c0 con 0x7f4c7814f8b0 2024-09-17T06:04:50.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.167+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f4c781504d0 con 0x7f4c7814f8b0 2024-09-17T06:04:50.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.171+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4c781504d0 con 0x7f4c7814f8b0 2024-09-17T06:04:50.172 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:04:50.173 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:04:50.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.171+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f4c7802d9e0 0x7f4c7802ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.171+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f4c78150450 con 0x7f4c7802d9e0 2024-09-17T06:04:50.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.171+0000 7f4c7659c640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f4c7802d9e0 0x7f4c7802ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.171+0000 7f4c7659c640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f4c7802d9e0 0x7f4c7802ddf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:50.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.171+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c78150450 con 0x7f4c7802d9e0 2024-09-17T06:04:50.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.187+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f4c78150200 con 0x7f4c7802d9e0 2024-09-17T06:04:50.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.187+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4c78150200 con 0x7f4c7802d9e0 2024-09-17T06:04:50.191 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:04:50.191 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:04:50.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.187+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f4c78204040 0x7f4c78206460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.187+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f4c78150410 con 0x7f4c78204040 2024-09-17T06:04:50.191 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:50.187+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:50.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.187+0000 7f4c6ffff640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f4c78204040 0x7f4c78206460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.191+0000 7f4c6ffff640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f4c78204040 0x7f4c78206460 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:50.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.191+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c78150410 con 0x7f4c78204040 2024-09-17T06:04:50.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.203+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f4c7802e870 con 0x7f4c78204040 2024-09-17T06:04:50.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.207+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4c7802e870 con 0x7f4c78204040 2024-09-17T06:04:50.210 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:04:50.210 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:04:50.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.207+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f4c78206eb0 0x7f4c782092d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.207+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f4c7802ea20 con 0x7f4c78206eb0 2024-09-17T06:04:50.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.207+0000 7f4c76d9d640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f4c78206eb0 0x7f4c782092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.207+0000 7f4c76d9d640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f4c78206eb0 0x7f4c782092d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:50.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.211+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c7001a5f0 con 0x7f4c78206eb0 2024-09-17T06:04:50.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.223+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f4c78209ae0 con 0x7f4c78206eb0 2024-09-17T06:04:50.231 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.227+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4c78209ae0 con 0x7f4c78206eb0 2024-09-17T06:04:50.231 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:04:50.232 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:04:50.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.227+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f4c7820a200 0x7f4c7820a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.227+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f4c7820bd50 con 0x7f4c7820a200 2024-09-17T06:04:50.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.231+0000 7f4c7659c640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f4c7820a200 0x7f4c7820a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.231+0000 7f4c7659c640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f4c7820a200 0x7f4c7820a610 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:50.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.231+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c7820bd50 con 0x7f4c7820a200 2024-09-17T06:04:50.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.247+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f4c7820ab50 con 0x7f4c7820a200 2024-09-17T06:04:50.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c6effd640 1 -- 172.21.15.122:0/1696957399 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4c7820ab50 con 0x7f4c7820a200 2024-09-17T06:04:50.252 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:04:50.254 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:04:50.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4c7814f100 msgr2=0x7f4c781480f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4c7814f100 0x7f4c781480f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f4c7814ebb0 msgr2=0x7f4c781f2c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f4c7814ebb0 0x7f4c781f2c60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4c781f36b0 msgr2=0x7f4c780638b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4c781f36b0 0x7f4c780638b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f4c7814f8b0 msgr2=0x7f4c7814fcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f4c7814f8b0 0x7f4c7814fcc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f4c7802d9e0 msgr2=0x7f4c7802ddf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f4c7802d9e0 0x7f4c7802ddf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f4c78204040 msgr2=0x7f4c78206460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f4c78204040 0x7f4c78206460 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c76d9d640 1 -- 172.21.15.122:0/1696957399 reap_dead start 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f4c78206eb0 msgr2=0x7f4c782092d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f4c78206eb0 0x7f4c782092d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f4c7820a200 msgr2=0x7f4c7820a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f4c7820a200 0x7f4c7820a610 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c76d9d640 1 -- 172.21.15.122:0/1696957399 reap_dead start 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c76d9d640 1 -- 172.21.15.122:0/1696957399 reap_dead start 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4c58073200 msgr2=0x7f4c58075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4c58073200 0x7f4c58075710 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4c600b2000 tx=0x7f4c6001d850 comp rx=0 tx=0).stop 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c78072300 msgr2=0x7f4c78151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c78072300 0x7f4c78151110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800e7f0 tx=0x7f4c6800ecb0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 shutdown_connections 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4c58073200 0x7f4c58075710 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 --2- 172.21.15.122:0/1696957399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c78072300 0x7f4c78151110 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 >> 172.21.15.122:0/1696957399 conn(0x7f4c78074b20 msgr2=0x7f4c781590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 shutdown_connections 2024-09-17T06:04:50.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.251+0000 7f4c7cc87640 1 -- 172.21.15.122:0/1696957399 wait complete. 2024-09-17T06:04:50.303 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:50.303 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:04:50.303 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:04:50.303 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:04:50.303 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.303 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:50.303 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:04:50.303 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 36.482435072999998, 2024-09-17T06:04:50.303 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.013495551, 2024-09-17T06:04:50.304 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.304 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.304 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:50.304 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.304 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.304 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.304 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:04:50.304 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.304 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.304 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.305 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.305 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:04:50.305 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.305 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.305 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.305 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820818+0000", 2024-09-17T06:04:50.305 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.858e-06 2024-09-17T06:04:50.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.305 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.305 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.305 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820836+0000", 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7955e-05 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820863+0000", 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7013999999999999e-05 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820885+0000", 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1695000000000002e-05 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.306 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.307 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.307 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821084+0000", 2024-09-17T06:04:50.307 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019876400000000001 2024-09-17T06:04:50.307 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.307 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.307 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:50.307 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821305+0000", 2024-09-17T06:04:50.307 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022121099999999999 2024-09-17T06:04:50.307 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.307 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.308 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:50.308 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821563+0000", 2024-09-17T06:04:50.308 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025797100000000001 2024-09-17T06:04:50.308 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.308 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.308 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:50.308 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825504+0000", 2024-09-17T06:04:50.308 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039410119999999998 2024-09-17T06:04:50.309 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.309 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.309 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:50.309 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834165+0000", 2024-09-17T06:04:50.309 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086608810000000005 2024-09-17T06:04:50.309 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.309 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.309 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:50.309 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834252+0000", 2024-09-17T06:04:50.309 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7276999999999998e-05 2024-09-17T06:04:50.309 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.309 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834311+0000", 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8913000000000003e-05 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 36.479211798999998, 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037604380000000001, 2024-09-17T06:04:50.310 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.311 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824040+0000", 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8649999999999999e-06 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824070+0000", 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9162e-05 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824088+0000", 2024-09-17T06:04:50.312 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8529000000000002e-05 2024-09-17T06:04:50.313 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.313 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.313 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.313 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824103+0000", 2024-09-17T06:04:50.313 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5081e-05 2024-09-17T06:04:50.313 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.313 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.313 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.313 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824193+0000", 2024-09-17T06:04:50.313 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9896999999999997e-05 2024-09-17T06:04:50.313 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.313 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.314 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:50.314 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:04:50.314 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1649000000000001e-05 2024-09-17T06:04:50.314 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.314 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.314 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:50.314 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827740+0000", 2024-09-17T06:04:50.314 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035152069999999998 2024-09-17T06:04:50.314 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.314 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827799+0000", 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9048000000000001e-05 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 36.479026247, 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035104340000000002, 2024-09-17T06:04:50.315 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.316 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1909999999999999e-06 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824237+0000", 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1914e-05 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.317 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824252+0000", 2024-09-17T06:04:50.318 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5071e-05 2024-09-17T06:04:50.318 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.318 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.318 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.318 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824265+0000", 2024-09-17T06:04:50.318 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2748000000000001e-05 2024-09-17T06:04:50.318 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.318 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824346+0000", 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0530000000000003e-05 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824375+0000", 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9805e-05 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827659+0000", 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032838569999999998 2024-09-17T06:04:50.319 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.320 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.320 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.320 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827735+0000", 2024-09-17T06:04:50.320 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5318e-05 2024-09-17T06:04:50.320 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.320 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.321 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.321 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.321 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.321 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 75 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:04:50.321 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:04:50.322 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 36.478829447000003, 2024-09-17T06:04:50.322 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003402553, 2024-09-17T06:04:50.322 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.322 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.322 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:04:50.323 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.323 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.323 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.323 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:04:50.323 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.324 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.324 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.324 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.324 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:04:50.324 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.325 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.325 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.325 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.325 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824422+0000", 2024-09-17T06:04:50.325 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3399999999999998e-07 2024-09-17T06:04:50.326 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.326 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.326 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.326 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824434+0000", 2024-09-17T06:04:50.326 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1960000000000001e-05 2024-09-17T06:04:50.326 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.327 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.327 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.327 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824771+0000", 2024-09-17T06:04:50.327 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033676799999999998 2024-09-17T06:04:50.327 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.328 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.328 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.328 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824798+0000", 2024-09-17T06:04:50.328 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7838e-05 2024-09-17T06:04:50.329 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.329 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.329 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.329 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824920+0000", 2024-09-17T06:04:50.329 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012210699999999999 2024-09-17T06:04:50.330 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.330 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.330 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.330 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827824+0000", 2024-09-17T06:04:50.330 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029030459999999998 2024-09-17T06:04:50.330 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.331 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.331 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.331 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.331 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.331 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 4 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:04:50.332 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:04:50.332 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 36.478142939000001, 2024-09-17T06:04:50.332 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003032833, 2024-09-17T06:04:50.332 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.332 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.333 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:04:50.333 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.333 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.333 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.333 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:04:50.334 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.334 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.334 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.334 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.334 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:04:50.334 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.335 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.335 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.335 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.335 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825108+0000", 2024-09-17T06:04:50.335 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6099999999999999e-07 2024-09-17T06:04:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825120+0000", 2024-09-17T06:04:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1780000000000001e-05 2024-09-17T06:04:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825136+0000", 2024-09-17T06:04:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6229999999999999e-05 2024-09-17T06:04:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825152+0000", 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6104e-05 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825297+0000", 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014498399999999999 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828140+0000", 2024-09-17T06:04:50.337 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002842874 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 36.473434159999996, 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032580460000000001, 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:50.338 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.339 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829817+0000", 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.176e-06 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0178e-05 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829847+0000", 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9402000000000002e-05 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.340 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829858+0000", 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1141000000000001e-05 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830004+0000", 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014622699999999999 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830027+0000", 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2826000000000001e-05 2024-09-17T06:04:50.341 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833000+0000", 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029729000000000001 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833074+0000", 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4196000000000006e-05 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.342 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 36.472319378999998, 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0043957220000000003, 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:04:50.343 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830933+0000", 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5090000000000001e-06 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.344 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.345 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830946+0000", 2024-09-17T06:04:50.345 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3018e-05 2024-09-17T06:04:50.345 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.345 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.345 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.345 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830968+0000", 2024-09-17T06:04:50.345 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2558999999999999e-05 2024-09-17T06:04:50.345 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.345 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.345 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.345 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830984+0000", 2024-09-17T06:04:50.345 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5376999999999999e-05 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831072+0000", 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8745000000000005e-05 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831104+0000", 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1265e-05 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.346 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:50.347 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835260+0000", 2024-09-17T06:04:50.347 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0041569559999999998 2024-09-17T06:04:50.347 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.347 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.347 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.347 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835327+0000", 2024-09-17T06:04:50.347 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.6292999999999997e-05 2024-09-17T06:04:50.347 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.347 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.347 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.347 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.348 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.348 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-17T06:04:50.348 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:04:50.348 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 36.469215845999997, 2024-09-17T06:04:50.348 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029529399999999998, 2024-09-17T06:04:50.349 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.349 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.349 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:04:50.349 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.349 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.349 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.349 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:04:50.349 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.350 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.350 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.350 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.350 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:04:50.350 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.351 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.351 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.351 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.351 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834036+0000", 2024-09-17T06:04:50.351 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9999999999999995e-07 2024-09-17T06:04:50.351 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.351 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.351 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.351 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834042+0000", 2024-09-17T06:04:50.352 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.7240000000000003e-06 2024-09-17T06:04:50.352 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.352 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.352 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.352 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834058+0000", 2024-09-17T06:04:50.353 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5648e-05 2024-09-17T06:04:50.353 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.353 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.353 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.353 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834068+0000", 2024-09-17T06:04:50.354 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0383999999999999e-05 2024-09-17T06:04:50.354 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.354 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.354 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.354 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834145+0000", 2024-09-17T06:04:50.355 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.64e-05 2024-09-17T06:04:50.355 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.355 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.355 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:50.355 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834157+0000", 2024-09-17T06:04:50.355 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2414e-05 2024-09-17T06:04:50.356 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.356 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.356 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.356 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834330+0000", 2024-09-17T06:04:50.356 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017272399999999999 2024-09-17T06:04:50.357 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.357 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.357 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.357 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.357 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.357 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:50.358 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:50.315+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:50.359 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:04:50.393 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:50.391+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:50.494 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:50.491+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:50.506 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:50.506 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:50.506 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:04:50.506 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:50.523 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:04:50.595 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:50.590+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:50.696 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:50.691+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:50.715 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:50.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:50.715 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:04:50.715 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:04:50.715 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:50.731 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:04:50.754 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T06:04:50.817 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:50.815+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:50.898 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:50.894+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:50.919 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:50.919 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:04:50.919 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:04:50.919 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:04:50.919 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.919 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:50.919 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:04:50.920 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.096889984999997, 2024-09-17T06:04:50.920 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:04:50.920 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.920 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.920 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:50.920 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.920 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.920 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.920 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:04:50.920 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.920 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.921 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.921 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.921 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:04:50.921 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.921 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.921 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.921 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.921 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:04:50.921 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:04:50.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.922 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.922 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:04:50.922 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:04:50.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.922 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.922 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:04:50.922 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:04:50.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.923 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.923 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:04:50.923 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:04:50.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.923 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.923 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.923 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:04:50.923 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:04:50.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.923 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.923 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:50.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:04:50.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:04:50.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.924 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.924 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:50.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:04:50.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:04:50.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.924 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.924 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:04:50.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:04:50.925 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.925 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.925 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.925 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.925 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:04:50.925 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:04:50.925 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.096777760999998, 2024-09-17T06:04:50.925 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:04:50.925 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.925 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.926 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:50.926 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.926 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.926 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.926 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:04:50.926 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.926 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.926 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.926 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:04:50.926 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.927 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.927 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.927 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:04:50.927 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:04:50.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.927 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.927 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.927 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:04:50.927 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:04:50.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.928 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.928 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.928 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:04:50.928 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:04:50.928 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.928 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.928 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.928 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:04:50.928 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:04:50.928 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.928 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.928 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.929 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:04:50.929 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:04:50.929 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.929 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.929 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:50.929 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:04:50.929 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:04:50.929 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.929 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.929 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:50.930 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:04:50.930 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:04:50.930 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.930 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.930 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.930 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:04:50.930 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:04:50.930 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.930 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.930 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.930 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.931 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.931 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:50.931 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:04:50.931 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.096572410999997, 2024-09-17T06:04:50.931 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:04:50.931 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.931 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.931 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:50.931 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.931 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.931 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.932 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:04:50.932 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.932 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.932 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.932 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.932 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:04:50.932 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.932 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.932 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.932 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.932 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:04:50.933 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:04:50.933 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.933 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.933 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.933 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:04:50.933 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:04:50.933 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.933 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.933 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.933 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:04:50.933 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.934 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:50.935 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:04:50.935 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:04:50.935 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.935 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.935 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:50.935 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:04:50.935 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:04:50.935 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.935 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.935 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.935 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:04:50.935 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:04:50.936 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.936 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.936 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.936 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.936 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.936 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:04:50.936 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:04:50.936 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.090431885000001, 2024-09-17T06:04:50.936 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:04:50.936 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.937 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.937 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:50.937 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.937 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.937 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.937 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:04:50.937 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.937 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.937 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.937 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.938 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:04:50.938 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.938 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.938 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.938 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.938 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:04:50.938 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:04:50.938 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.938 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.938 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.939 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:04:50.939 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:04:50.939 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.939 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.939 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.939 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:04:50.939 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:04:50.939 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.939 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.939 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.939 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:04:50.939 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:04:50.940 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.940 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.940 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.940 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:04:50.940 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:04:50.940 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.940 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.940 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:50.940 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:04:50.940 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:04:50.940 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.940 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.941 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:50.941 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:04:50.941 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:04:50.941 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.941 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.941 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.941 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:04:50.941 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:04:50.941 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.941 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.941 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.942 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.942 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.942 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:04:50.942 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:04:50.942 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.090277159000003, 2024-09-17T06:04:50.942 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:04:50.942 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:50.942 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:50.942 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:50.942 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:50.942 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.943 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:50.943 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:04:50.943 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.943 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.943 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.943 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:50.943 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:04:50.943 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:50.943 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.943 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.943 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:50.943 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:04:50.944 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:04:50.944 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.944 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.944 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:50.944 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:04:50.944 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:04:50.944 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.944 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.944 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:50.944 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:04:50.944 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:04:50.945 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.945 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.945 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:50.945 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:04:50.945 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:04:50.945 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.945 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.945 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:50.945 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:04:50.945 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:04:50.945 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.946 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.946 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:50.946 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:04:50.946 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:04:50.946 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.946 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.946 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:50.946 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:04:50.946 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:04:50.946 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:50.946 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:50.946 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:50.947 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:04:50.947 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:04:50.947 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.947 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.947 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.947 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:50.947 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:50.947 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:50.949 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:04:50.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 -- 172.21.15.122:0/2580032406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00980c67a0 msgr2=0x7f009814e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 --2- 172.21.15.122:0/2580032406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00980c67a0 0x7f009814e9e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0088009900 tx=0x7f008801f0d0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 -- 172.21.15.122:0/2580032406 shutdown_connections 2024-09-17T06:04:50.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 --2- 172.21.15.122:0/2580032406 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0098072270 0x7f0098072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 --2- 172.21.15.122:0/2580032406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00980c67a0 0x7f009814e9e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 -- 172.21.15.122:0/2580032406 >> 172.21.15.122:0/2580032406 conn(0x7f00980746d0 msgr2=0x7f0098074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:50.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 -- 172.21.15.122:0/2580032406 shutdown_connections 2024-09-17T06:04:50.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 -- 172.21.15.122:0/2580032406 wait complete. 2024-09-17T06:04:50.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 Processor -- start 2024-09-17T06:04:50.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 -- start start 2024-09-17T06:04:50.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0098072270 0x7f0098150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00980c67a0 0x7f009814a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f009815b7b0 0x7f0098156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0098158a70 con 0x7f009815b7b0 2024-09-17T06:04:50.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0098158790 con 0x7f0098072270 2024-09-17T06:04:50.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f009c876640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0098158d50 con 0x7f00980c67a0 2024-09-17T06:04:50.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.918+0000 7f0096d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f009815b7b0 0x7f0098156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0096d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f009815b7b0 0x7f0098156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35140/0 (socket says 172.21.15.122:35140) 2024-09-17T06:04:50.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0096d9d640 1 -- 172.21.15.122:0/2405223612 learned_addr learned my addr 172.21.15.122:0/2405223612 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:50.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f009659c640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0098072270 0x7f0098150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0095d9b640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00980c67a0 0x7f009814a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0096d9d640 1 -- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00980c67a0 msgr2=0x7f009814a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0096d9d640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00980c67a0 0x7f009814a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0096d9d640 1 -- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0098072270 msgr2=0x7f0098150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:50.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0096d9d640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0098072270 0x7f0098150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:50.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0096d9d640 1 -- 172.21.15.122:0/2405223612 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009814aba0 con 0x7f009815b7b0 2024-09-17T06:04:50.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0095d9b640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00980c67a0 0x7f009814a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:50.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f009659c640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0098072270 0x7f0098150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:50.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0096d9d640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f009815b7b0 0x7f0098156840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f009000c730 tx=0x7f009000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:50.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0086ffd640 1 -- 172.21.15.122:0/2405223612 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090003b80 con 0x7f009815b7b0 2024-09-17T06:04:50.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0086ffd640 1 -- 172.21.15.122:0/2405223612 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0090003d40 con 0x7f009815b7b0 2024-09-17T06:04:50.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f009c876640 1 -- 172.21.15.122:0/2405223612 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f009815b020 con 0x7f009815b7b0 2024-09-17T06:04:50.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0086ffd640 1 -- 172.21.15.122:0/2405223612 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00900052d0 con 0x7f009815b7b0 2024-09-17T06:04:50.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f009c876640 1 -- 172.21.15.122:0/2405223612 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f009814f2f0 con 0x7f009815b7b0 2024-09-17T06:04:50.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f009c876640 1 -- 172.21.15.122:0/2405223612 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f009815ad70 con 0x7f009815b7b0 2024-09-17T06:04:50.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0086ffd640 1 -- 172.21.15.122:0/2405223612 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0090005680 con 0x7f009815b7b0 2024-09-17T06:04:50.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0086ffd640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0078073230 0x7f0078075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:50.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f0086ffd640 1 -- 172.21.15.122:0/2405223612 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6743+0+0 (secure 0 0 0) 0x7f0090094570 con 0x7f009815b7b0 2024-09-17T06:04:50.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.922+0000 7f009659c640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0078073230 0x7f0078075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:50.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.926+0000 7f009659c640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0078073230 0x7f0078075740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f00880b2000 tx=0x7f008801d910 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:50.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:50.930+0000 7f0086ffd640 1 -- 172.21.15.122:0/2405223612 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f009005f180 con 0x7f009815b7b0 2024-09-17T06:04:50.999 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:50.995+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:51.099 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:51.095+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:51.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.106+0000 7f009c876640 1 -- 172.21.15.122:0/2405223612 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) -- 0x7f00980c9f70 con 0x7f009815b7b0 2024-09-17T06:04:51.141 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:51.142 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:51.142 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:04:51.142 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:51.158 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:04:51.200 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:51.198+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:51.301 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:51.298+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:51.349 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:51.349 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:51.349 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:04:51.349 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:04:51.350 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:51.365 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:04:51.402 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:51.402+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:51.503 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:51.502+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:51.520 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:51.520 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.697200498000001, 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.521 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:04:51.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.523 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.523 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.523 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:04:51.523 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:04:51.523 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.523 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.523 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.523 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:04:51.523 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:04:51.523 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.523 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.523 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:04:51.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.525 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.525 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:51.525 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:04:51.525 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:04:51.525 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.525 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.525 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.525 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:04:51.525 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:04:51.525 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.525 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.525 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.526 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.697080096000001, 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.527 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.528 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:04:51.529 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:04:51.530 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.531 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:04:51.532 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.696952181999997, 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:04:51.533 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.534 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.535 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:04:51.536 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:04:51.537 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.695926219, 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.538 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:04:51.539 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.540 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:04:51.541 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:04:51.542 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:04:51.543 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.543 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.543 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.543 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:04:51.543 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:04:51.543 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.543 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.543 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.543 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.695845276, 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.544 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.545 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.545 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.545 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.545 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:04:51.545 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.545 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.545 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.545 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.545 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:04:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:04:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:04:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:04:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:04:51.546 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.547 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.547 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.547 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:04:51.547 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:04:51.547 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.547 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.547 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.547 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:04:51.547 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:04:51.547 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.547 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.548 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.548 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:04:51.548 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:04:51.548 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.548 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.548 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.548 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:04:51.548 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:04:51.548 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.548 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:04:51.549 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:04:51.550 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.550 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.550 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.550 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:04:51.550 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:04:51.550 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.550 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.550 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.550 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:04:51.551 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:04:51.551 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.551 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.551 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.551 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.551 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.551 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:51.551 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:04:51.551 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.695782874000002, 2024-09-17T06:04:51.551 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:04:51.552 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.552 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.552 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.552 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.552 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.552 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.552 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:04:51.552 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.552 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.552 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.552 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.553 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:04:51.553 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.553 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.553 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.553 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.553 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:04:51.553 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:04:51.553 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.553 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.554 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.554 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:04:51.554 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:04:51.554 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.554 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.554 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.554 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:04:51.554 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:04:51.555 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.555 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.555 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.555 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:04:51.555 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:04:51.555 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.555 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.555 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.555 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:04:51.555 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.556 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:04:51.557 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:04:51.557 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.557 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.557 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.557 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:04:51.557 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:04:51.557 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.557 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.557 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.557 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:04:51.557 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:04:51.558 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.558 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.558 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.558 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:04:51.558 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:04:51.558 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.558 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.558 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.558 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.558 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.558 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.695710783999999, 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.559 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.560 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:04:51.560 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.560 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.560 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.560 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.560 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:04:51.560 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:04:51.560 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.560 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.560 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.560 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:04:51.560 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.561 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.562 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.695668584000003, 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:04:51.563 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.564 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.565 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:04:51.566 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.693076652000002, 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.567 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:04:51.568 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.569 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.569 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.569 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:04:51.569 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:04:51.569 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.569 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.569 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.569 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:04:51.569 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:04:51.569 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.569 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.569 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.570 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.571 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.692980517000002, 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.572 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:04:51.573 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:04:51.575 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.684548231000001, 2024-09-17T06:04:51.576 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:04:51.577 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.577 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.577 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.577 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.577 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.577 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.577 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:04:51.577 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.577 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.578 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.578 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.578 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:04:51.578 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.578 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.578 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.578 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.578 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:04:51.578 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:04:51.578 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.578 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.578 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.579 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:04:51.579 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:04:51.579 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.579 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.579 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.579 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:04:51.579 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:04:51.579 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.579 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.579 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.579 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:04:51.579 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:04:51.580 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.580 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.580 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.580 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:04:51.580 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:04:51.580 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.580 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.580 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.580 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:04:51.580 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.581 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.582 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:04:51.582 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:04:51.582 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.582 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.582 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.582 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:04:51.582 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:04:51.582 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.582 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.582 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.583 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:04:51.583 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:04:51.583 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.583 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.583 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.583 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.583 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.583 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:04:51.583 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:04:51.583 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 32.590959011000002, 2024-09-17T06:04:51.583 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:04:51.583 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.584 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.584 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.584 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.584 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.584 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.584 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:04:51.584 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.584 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.584 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.584 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.585 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:04:51.585 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.585 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.585 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.585 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.585 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:04:51.585 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:04:51.585 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.585 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.585 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.585 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:04:51.586 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:04:51.586 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.586 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.586 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.586 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:04:51.586 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:04:51.586 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.586 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.586 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.586 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:04:51.586 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:04:51.586 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.587 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.587 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.587 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:04:51.587 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:04:51.587 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.587 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.587 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.587 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:04:51.587 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:04:51.588 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.588 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.588 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.588 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:04:51.588 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:04:51.588 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.588 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.588 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.588 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:04:51.589 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:04:51.589 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.589 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.589 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.589 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.589 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.589 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:04:51.589 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:04:51.589 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 30.920328646000002, 2024-09-17T06:04:51.589 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:04:51.590 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.591 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:04:51.592 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.593 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.593 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.593 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:04:51.593 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:04:51.593 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.593 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.593 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:51.593 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:04:51.593 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:04:51.593 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.593 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:04:51.594 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 29.199657689999999, 2024-09-17T06:04:51.595 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.597 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.598 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:04:51.599 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.600 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 29.196973441000001, 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.601 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.602 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.603 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.604 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 28.327770768000001, 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.605 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.607 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:04:51.608 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.610 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.611 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.611 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.611 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:04:51.611 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:04:51.611 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 7.8013298559999997, 2024-09-17T06:04:51.611 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:04:51.611 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.611 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.611 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.612 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.613 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:04:51.613 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:04:51.613 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.613 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.613 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.613 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:04:51.613 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:04:51.613 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.613 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.613 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.614 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:04:51.614 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:04:51.614 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.614 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.614 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.614 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:04:51.614 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:04:51.614 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.614 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.614 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.614 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:04:51.614 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.615 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:04:51.616 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 7.8011003399999996, 2024-09-17T06:04:51.617 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:04:51.618 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.618 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.618 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.618 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.618 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.618 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.618 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:04:51.618 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.618 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.618 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.618 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.618 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.619 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.620 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.620 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:04:51.620 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:04:51.620 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.620 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.620 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.620 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:04:51.620 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:04:51.620 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.620 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.620 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.621 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:04:51.621 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:04:51.621 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.621 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.621 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.621 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:04:51.621 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:04:51.621 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.621 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.622 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:51.622 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:04:51.622 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:04:51.622 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.622 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.622 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.622 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:04:51.622 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:04:51.622 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.622 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.622 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.623 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:04:51.623 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:04:51.623 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.623 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.623 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.623 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:04:51.623 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:04:51.623 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.623 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.623 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.623 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:04:51.623 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:04:51.624 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.624 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.624 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.624 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.624 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.624 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:04:51.624 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:04:51.624 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 7.7991356439999997, 2024-09-17T06:04:51.624 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:04:51.625 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.625 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.625 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:04:51.625 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.625 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.625 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.625 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:04:51.625 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.625 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.625 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.625 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.626 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:04:51.626 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.626 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.626 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.626 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.626 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:04:51.626 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:04:51.626 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.626 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.626 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.627 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:04:51.627 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:04:51.627 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.627 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.627 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.627 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:04:51.627 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:04:51.627 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.628 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:04:51.629 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 3.8655727569999998, 2024-09-17T06:04:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:04:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:04:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.630 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:51.631 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:04:51.631 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:51.631 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.631 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.631 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:51.631 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:04:51.631 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:04:51.631 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.631 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.631 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:51.631 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:04:51.631 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.632 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:04:51.633 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:04:51.634 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:04:51.635 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:51.635 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:51.635 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:51.635 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:04:51.635 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:04:51.635 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.635 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.635 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.635 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:51.635 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:51.635 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:51.637 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:04:51.637 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:51.635+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:51.738 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:51.734+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:51.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.754+0000 7f0086ffd640 1 -- 172.21.15.122:0/2405223612 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v29) ==== 97+0+0 (secure 0 0 0) 0x7f009005ea80 con 0x7f009815b7b0 2024-09-17T06:04:51.758 INFO:teuthology.orchestra.run.smithi122.stderr:nodeep-scrub is set 2024-09-17T06:04:51.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.758+0000 7f009c876640 1 -- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0078073230 msgr2=0x7f0078075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:51.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.758+0000 7f009c876640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0078073230 0x7f0078075740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f00880b2000 tx=0x7f008801d910 comp rx=0 tx=0).stop 2024-09-17T06:04:51.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.758+0000 7f009c876640 1 -- 172.21.15.122:0/2405223612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f009815b7b0 msgr2=0x7f0098156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:51.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.758+0000 7f009c876640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f009815b7b0 0x7f0098156840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f009000c730 tx=0x7f009000cbf0 comp rx=0 tx=0).stop 2024-09-17T06:04:51.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.758+0000 7f009c876640 1 -- 172.21.15.122:0/2405223612 shutdown_connections 2024-09-17T06:04:51.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.758+0000 7f009c876640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f009815b7b0 0x7f0098156840 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:51.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.758+0000 7f009c876640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f00980c67a0 0x7f009814a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:51.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.758+0000 7f009c876640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0078073230 0x7f0078075740 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:51.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.758+0000 7f009c876640 1 --2- 172.21.15.122:0/2405223612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0098072270 0x7f0098150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:51.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.758+0000 7f009c876640 1 -- 172.21.15.122:0/2405223612 >> 172.21.15.122:0/2405223612 conn(0x7f00980746d0 msgr2=0x7f00980c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:51.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.758+0000 7f009c876640 1 -- 172.21.15.122:0/2405223612 shutdown_connections 2024-09-17T06:04:51.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:51.758+0000 7f009c876640 1 -- 172.21.15.122:0/2405223612 wait complete. 2024-09-17T06:04:51.836 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:51.836 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:51.836 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:04:51.837 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:51.839 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:04:51.834+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:04:51.852 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:04:51.940 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:04:51.938+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:04:52.000 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:52.000 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:52.000 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:04:52.000 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:04:52.000 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:52.016 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:04:52.041 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:52.038+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:52.142 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:52.138+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:52.170 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:52.170 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:04:52.170 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:04:52.170 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:04:52.170 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.170 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.170 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:04:52.170 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 53.530411704000002, 2024-09-17T06:04:52.170 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.55819121299999996, 2024-09-17T06:04:52.170 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 1 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.171 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636958+0000", 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4690000000000002e-06 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.172 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636976+0000", 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.802e-05 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637001+0000", 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4552000000000001e-05 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637024+0000", 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3391999999999999e-05 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.173 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637134+0000", 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000109715 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for peered", 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637157+0000", 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3363999999999999e-05 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.191892+0000", 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.55473470899999999 2024-09-17T06:04:52.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.192190+0000", 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029832200000000001 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.192541+0000", 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00035034999999999998 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.175 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.194061+0000", 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0015205959999999999 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.194944+0000", 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00088236399999999996 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.195056+0000", 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011200399999999999 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.176 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.195146+0000", 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0356e-05 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.826118452999999, 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.01182241, 2024-09-17T06:04:52.177 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 42 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.178 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341249+0000", 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0729999999999999e-06 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341257+0000", 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8800000000000008e-06 2024-09-17T06:04:52.179 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341275+0000", 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7842e-05 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341292+0000", 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6829000000000001e-05 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346218+0000", 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049260329999999998 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346372+0000", 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015433299999999999 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346635+0000", 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026296700000000002 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.181 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351575+0000", 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049397959999999998 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352898+0000", 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013230060000000001 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352994+0000", 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6045000000000006e-05 2024-09-17T06:04:52.182 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353070+0000", 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6606000000000005e-05 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.825626104000001, 2024-09-17T06:04:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011645713, 2024-09-17T06:04:52.184 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.184 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.184 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.184 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.184 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.184 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.184 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 43 2024-09-17T06:04:52.184 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.184 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.184 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.184 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.184 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341743+0000", 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.903e-06 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.185 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.186 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.186 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341764+0000", 2024-09-17T06:04:52.186 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0988999999999998e-05 2024-09-17T06:04:52.186 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.188 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.188 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.188 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341808+0000", 2024-09-17T06:04:52.188 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3791000000000001e-05 2024-09-17T06:04:52.188 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.188 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.188 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.188 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341839+0000", 2024-09-17T06:04:52.188 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1216000000000001e-05 2024-09-17T06:04:52.188 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.348686+0000", 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068463589999999998 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.348832+0000", 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014631 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.349079+0000", 2024-09-17T06:04:52.189 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024698800000000001 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353095+0000", 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040160869999999998 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353170+0000", 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4976999999999997e-05 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.190 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353259+0000", 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9305e-05 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353386+0000", 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012678799999999999 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.191 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.825469370999997, 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015057846, 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 44 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.192 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341899+0000", 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9e-06 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.193 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.194 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.194 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342021+0000", 2024-09-17T06:04:52.194 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012252000000000001 2024-09-17T06:04:52.194 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.194 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.194 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.194 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342055+0000", 2024-09-17T06:04:52.194 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3095000000000001e-05 2024-09-17T06:04:52.194 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342078+0000", 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3456e-05 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.349806+0000", 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.007728253 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.195 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.350088+0000", 2024-09-17T06:04:52.196 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00028207900000000002 2024-09-17T06:04:52.196 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.196 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.196 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.196 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.350527+0000", 2024-09-17T06:04:52.196 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00043892200000000001 2024-09-17T06:04:52.196 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.196 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.196 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.196 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353510+0000", 2024-09-17T06:04:52.196 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029825590000000001 2024-09-17T06:04:52.196 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356661+0000", 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0031514099999999999 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356817+0000", 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015552900000000001 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.197 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356955+0000", 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013812300000000001 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.825214477000003, 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015109994, 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.198 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 45 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.199 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342154+0000", 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9999999999999999e-06 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342170+0000", 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6506000000000001e-05 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.200 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342196+0000", 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5412e-05 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342216+0000", 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0191999999999999e-05 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351692+0000", 2024-09-17T06:04:52.201 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0094760650000000005 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351849+0000", 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015737600000000001 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352102+0000", 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025282000000000001 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.202 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356610+0000", 2024-09-17T06:04:52.203 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045081940000000001 2024-09-17T06:04:52.203 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.203 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.203 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.203 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356984+0000", 2024-09-17T06:04:52.203 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037321899999999999 2024-09-17T06:04:52.203 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.203 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.203 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.203 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357126+0000", 2024-09-17T06:04:52.203 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014265999999999999 2024-09-17T06:04:52.203 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357262+0000", 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013554999999999999 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.825113541999997, 2024-09-17T06:04:52.204 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015392114, 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 46 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:04:52.205 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342254+0000", 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4169999999999999e-06 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.206 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.207 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342268+0000", 2024-09-17T06:04:52.207 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4086e-05 2024-09-17T06:04:52.207 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.207 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.207 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.207 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342283+0000", 2024-09-17T06:04:52.207 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4919000000000001e-05 2024-09-17T06:04:52.207 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.207 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.207 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.207 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342297+0000", 2024-09-17T06:04:52.207 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3993e-05 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353648+0000", 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011350783 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353815+0000", 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016706499999999999 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.208 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.354039+0000", 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022362599999999999 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357286+0000", 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003246882 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357422+0000", 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000136093 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.209 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.210 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.210 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357521+0000", 2024-09-17T06:04:52.210 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.8876000000000007e-05 2024-09-17T06:04:52.210 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.210 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.210 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.210 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357645+0000", 2024-09-17T06:04:52.210 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012437400000000001 2024-09-17T06:04:52.210 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.210 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.210 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.210 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.211 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.211 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.211 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:04:52.211 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.825019222999998, 2024-09-17T06:04:52.211 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.018409992999999999, 2024-09-17T06:04:52.211 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.211 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.211 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.211 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.211 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.211 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.212 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 47 2024-09-17T06:04:52.212 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.212 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.212 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.212 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.212 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:04:52.212 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.212 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.212 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.212 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.212 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:04:52.212 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342348+0000", 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.333e-06 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342464+0000", 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011581100000000001 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.213 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342485+0000", 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0222000000000001e-05 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342512+0000", 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7158999999999999e-05 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.354773+0000", 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.012261752000000001 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.214 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.355011+0000", 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000237982 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.355427+0000", 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000415234 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357770+0000", 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023435320000000002 2024-09-17T06:04:52.215 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360464+0000", 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026934820000000001 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360614+0000", 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015075900000000001 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360757+0000", 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014272699999999999 2024-09-17T06:04:52.216 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.217 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.217 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.217 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.217 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.217 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.217 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:04:52.217 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.824803996999997, 2024-09-17T06:04:52.217 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.020363284999999998, 2024-09-17T06:04:52.217 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.217 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.217 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.217 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 48 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.218 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342564+0000", 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5269999999999999e-06 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342593+0000", 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9261e-05 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.219 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342617+0000", 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4258999999999999e-05 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342644+0000", 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6645999999999999e-05 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357867+0000", 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015222591000000001 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.220 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.358013+0000", 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014652299999999999 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.358238+0000", 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000225193 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362590+0000", 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.004351471 2024-09-17T06:04:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362643+0000", 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2957000000000001e-05 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362799+0000", 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015606600000000001 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362926+0000", 2024-09-17T06:04:52.222 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012679100000000001 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.824679099999997, 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.021916326, 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.223 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 49 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.224 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342689+0000", 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.79e-06 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342703+0000", 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3653e-05 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.225 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342740+0000", 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6801000000000002e-05 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342761+0000", 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1713e-05 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359009+0000", 2024-09-17T06:04:52.226 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.016247663999999998 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359291+0000", 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00028178399999999998 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359738+0000", 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00044704500000000003 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.227 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363113+0000", 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033748150000000002 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364339+0000", 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001226067 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364484+0000", 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014500599999999999 2024-09-17T06:04:52.228 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364604+0000", 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000119988 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.824509124999999, 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023299408000000001, 2024-09-17T06:04:52.229 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 50 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.230 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342859+0000", 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.663e-06 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342981+0000", 2024-09-17T06:04:52.231 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012199800000000001 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343001+0000", 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0432e-05 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343020+0000", 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8236e-05 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.232 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360863+0000", 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.017843741 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.361095+0000", 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00023198199999999999 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.361364+0000", 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026886 2024-09-17T06:04:52.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.234 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.234 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.234 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364745+0000", 2024-09-17T06:04:52.234 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033806690000000002 2024-09-17T06:04:52.234 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.234 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.234 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.234 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365860+0000", 2024-09-17T06:04:52.234 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011155679999999999 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366017+0000", 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015673299999999999 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366157+0000", 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013952600000000001 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.824319094000003, 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023463673000000001, 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 51 2024-09-17T06:04:52.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343048+0000", 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0729999999999999e-06 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343057+0000", 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.2959999999999999e-06 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343068+0000", 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1793e-05 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343094+0000", 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5882000000000001e-05 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363287+0000", 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.020192673000000001 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363457+0000", 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017029600000000001 2024-09-17T06:04:52.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.240 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.240 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363687+0000", 2024-09-17T06:04:52.240 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022974099999999999 2024-09-17T06:04:52.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.240 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.240 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366188+0000", 2024-09-17T06:04:52.240 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025014049999999999 2024-09-17T06:04:52.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.240 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366282+0000", 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3992000000000004e-05 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366378+0000", 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5152e-05 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366511+0000", 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013337000000000001 2024-09-17T06:04:52.241 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.824253296999998, 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023823882000000001, 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.242 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 52 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343114+0000", 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5700000000000001e-07 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343122+0000", 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4919999999999993e-06 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.244 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343134+0000", 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1970000000000001e-05 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343144+0000", 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6690000000000001e-06 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364849+0000", 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.021704826 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365104+0000", 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025510700000000002 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365359+0000", 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025527500000000001 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366737+0000", 2024-09-17T06:04:52.246 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001377739 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366772+0000", 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4629000000000003e-05 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366865+0000", 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3220999999999994e-05 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366937+0000", 2024-09-17T06:04:52.247 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.2096999999999998e-05 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.553977502999999, 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010475561, 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.248 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 69 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:04:52.249 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613390+0000", 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.8899999999999998e-07 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613458+0000", 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.8127999999999996e-05 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.250 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613467+0000", 2024-09-17T06:04:52.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0909999999999999e-06 2024-09-17T06:04:52.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.251 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.251 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613474+0000", 2024-09-17T06:04:52.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.2919999999999998e-06 2024-09-17T06:04:52.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.251 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.251 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.615892+0000", 2024-09-17T06:04:52.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002417836 2024-09-17T06:04:52.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.252 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.252 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.615956+0000", 2024-09-17T06:04:52.252 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3380000000000006e-05 2024-09-17T06:04:52.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.252 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.252 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616042+0000", 2024-09-17T06:04:52.252 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6012000000000003e-05 2024-09-17T06:04:52.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619165+0000", 2024-09-17T06:04:52.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00312321 2024-09-17T06:04:52.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.253 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623808+0000", 2024-09-17T06:04:52.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0046427339999999999 2024-09-17T06:04:52.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.253 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623836+0000", 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8839999999999998e-05 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623864+0000", 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8048999999999999e-05 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.254 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.553859750999997, 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010433403000000001, 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 70 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.255 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.256 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.256 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:04:52.256 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.256 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.256 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.256 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.256 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:04:52.256 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.256 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.256 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.256 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.256 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.8800000000000002e-07 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613512+0000", 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.2719999999999999e-06 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613518+0000", 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.4350000000000002e-06 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.257 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613524+0000", 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5110000000000003e-06 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616673+0000", 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003149102 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616764+0000", 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1290000000000002e-05 2024-09-17T06:04:52.258 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616880+0000", 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011597800000000001 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619172+0000", 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0022917670000000001 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623892+0000", 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.004720391 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623918+0000", 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6186999999999998e-05 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623940+0000", 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1781999999999999e-05 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.260 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.553717595000002, 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010700696000000001, 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.261 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 71 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.262 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613650+0000", 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7300000000000005e-07 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613654+0000", 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6920000000000001e-06 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613662+0000", 2024-09-17T06:04:52.263 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8439999999999998e-06 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613668+0000", 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6400000000000002e-06 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617192+0000", 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035246499999999998 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.264 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617294+0000", 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000101259 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617388+0000", 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4228999999999995e-05 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620154+0000", 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0027657459999999999 2024-09-17T06:04:52.265 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624067+0000", 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039132730000000001 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624226+0000", 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015945600000000001 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.266 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624349+0000", 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000123034 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.553687664999998, 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010774550000000001, 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.267 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 72 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.268 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.7399999999999998e-07 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613717+0000", 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7406000000000001e-05 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.269 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613723+0000", 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.652e-06 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613728+0000", 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6789999999999996e-06 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617676+0000", 2024-09-17T06:04:52.270 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039476759999999998 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617728+0000", 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2871999999999998e-05 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617814+0000", 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5463999999999994e-05 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621037+0000", 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032232910000000001 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624400+0000", 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033624240000000001 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624430+0000", 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0552000000000002e-05 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.272 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624453+0000", 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3059999999999999e-05 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.553615121, 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010781999, 2024-09-17T06:04:52.273 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 73 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.274 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613752+0000", 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.61e-07 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613758+0000", 2024-09-17T06:04:52.275 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7209999999999999e-06 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613764+0000", 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3470000000000004e-06 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613769+0000", 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8810000000000004e-06 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.276 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618508+0000", 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047387669999999996 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618559+0000", 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1440999999999998e-05 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618705+0000", 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014593900000000001 2024-09-17T06:04:52.277 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621041+0000", 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023357400000000002 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624482+0000", 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034416999999999998 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624511+0000", 2024-09-17T06:04:52.278 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8070000000000001e-05 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624533+0000", 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2731999999999999e-05 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.553587311999998, 2024-09-17T06:04:52.279 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010828374999999999, 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 74 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:04:52.280 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8599999999999999e-07 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.281 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613782+0000", 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7010000000000001e-06 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613787+0000", 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3980000000000001e-06 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613790+0000", 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.805e-06 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.282 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619344+0000", 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.005553685 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619427+0000", 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.2897000000000003e-05 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619562+0000", 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013549699999999999 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.283 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621581+0000", 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020184719999999999 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624559+0000", 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029778230000000001 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624586+0000", 2024-09-17T06:04:52.284 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7093e-05 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624607+0000", 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1617999999999999e-05 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:04:52.285 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.553515918999999, 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011087911000000001, 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 75 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.286 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613851+0000", 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.1099999999999995e-07 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.287 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.288 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.288 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613923+0000", 2024-09-17T06:04:52.288 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1439999999999994e-05 2024-09-17T06:04:52.288 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.288 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.288 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.288 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613930+0000", 2024-09-17T06:04:52.288 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9629999999999998e-06 2024-09-17T06:04:52.288 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.288 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.288 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.288 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613936+0000", 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5659999999999997e-06 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620210+0000", 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.006273514 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620263+0000", 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2982000000000002e-05 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620363+0000", 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000100802 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621596+0000", 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012330329999999999 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624709+0000", 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003112971 2024-09-17T06:04:52.290 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624838+0000", 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012835099999999999 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624938+0000", 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000100678 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.291 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.553415749999999, 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011079701000000001, 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 76 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.292 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:52.293 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1099999999999996e-07 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613954+0000", 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2009999999999999e-06 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613959+0000", 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0440000000000003e-06 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.294 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613964+0000", 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4329999999999997e-06 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621073+0000", 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0071095209999999997 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621133+0000", 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9740000000000001e-05 2024-09-17T06:04:52.295 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621250+0000", 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000117287 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621908+0000", 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00065739599999999998 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624980+0000", 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0030722039999999998 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.625008+0000", 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8061000000000001e-05 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.625030+0000", 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2303e-05 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.297 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.298 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.298 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:52.298 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:52.298 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:52.298 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:04:52.300 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:52.295+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:52.300 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:04:52.401 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:52.399+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:52.461 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:04:52.461 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:04:52.461 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-09-17T06:04:52.462 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:04:52.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.466+0000 7fd51c1db640 1 -- 172.21.15.122:0/3580430907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5140c9fc0 msgr2=0x7fd51415b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.466+0000 7fd51c1db640 1 --2- 172.21.15.122:0/3580430907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5140c9fc0 0x7fd51415b7c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd504009840 tx=0x7fd50401efd0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.466+0000 7fd51c1db640 1 -- 172.21.15.122:0/3580430907 shutdown_connections 2024-09-17T06:04:52.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.466+0000 7fd51c1db640 1 --2- 172.21.15.122:0/3580430907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5140c9fc0 0x7fd51415b7c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.466+0000 7fd51c1db640 1 --2- 172.21.15.122:0/3580430907 >> v2:172.21.15.173:3300/0 conn(0x7fd5140b3b80 0x7fd514152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.466+0000 7fd51c1db640 1 -- 172.21.15.122:0/3580430907 >> 172.21.15.122:0/3580430907 conn(0x7fd514073640 msgr2=0x7fd5140cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:52.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.466+0000 7fd51c1db640 1 -- 172.21.15.122:0/3580430907 shutdown_connections 2024-09-17T06:04:52.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.466+0000 7fd51c1db640 1 -- 172.21.15.122:0/3580430907 wait complete. 2024-09-17T06:04:52.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.466+0000 7fd51c1db640 1 Processor -- start 2024-09-17T06:04:52.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.466+0000 7fd51c1db640 1 -- start start 2024-09-17T06:04:52.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51c1db640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5140b3b80 0x7fd5141ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51c1db640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5140c9fc0 0x7fd5140c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51c1db640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5140c6320 0x7fd514146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51c1db640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd51406f0a0 con 0x7fd5140c6320 2024-09-17T06:04:52.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51c1db640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd51406edc0 con 0x7fd5140b3b80 2024-09-17T06:04:52.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51c1db640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd5141527c0 con 0x7fd5140c9fc0 2024-09-17T06:04:52.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51a778640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5140c6320 0x7fd514146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51a778640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5140c6320 0x7fd514146250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35158/0 (socket says 172.21.15.122:35158) 2024-09-17T06:04:52.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51a778640 1 -- 172.21.15.122:0/125345962 learned_addr learned my addr 172.21.15.122:0/125345962 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:52.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd519f77640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5140b3b80 0x7fd5141ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd519776640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5140c9fc0 0x7fd5140c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51a778640 1 -- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5140c9fc0 msgr2=0x7fd5140c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51a778640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5140c9fc0 0x7fd5140c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51a778640 1 -- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5140b3b80 msgr2=0x7fd5141ef7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51a778640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5140b3b80 0x7fd5141ef7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51a778640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5141efd00 con 0x7fd5140c6320 2024-09-17T06:04:52.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd519776640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5140c9fc0 0x7fd5140c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:52.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51a778640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5140c6320 0x7fd514146250 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd504009930 tx=0x7fd504005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:52.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5040b5040 con 0x7fd5140c6320 2024-09-17T06:04:52.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5040be070 con 0x7fd5140c6320 2024-09-17T06:04:52.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd514147950 con 0x7fd5140c6320 2024-09-17T06:04:52.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504003b30 con 0x7fd5140c6320 2024-09-17T06:04:52.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5140cd2a0 con 0x7fd5140c6320 2024-09-17T06:04:52.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fd51406f5c0 con 0x7fd5140c6320 2024-09-17T06:04:52.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.470+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd504003cd0 con 0x7fd5140c6320 2024-09-17T06:04:52.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.474+0000 7fd50a7fc640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd4f8073230 0x7fd4f8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.474+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6743+0+0 (secure 0 0 0) 0x7fd504132240 con 0x7fd5140c6320 2024-09-17T06:04:52.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.474+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v29) ==== 54+0+16 (secure 0 0 0) 0x7fd504018b30 con 0x7fd5140c6320 2024-09-17T06:04:52.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.474+0000 7fd519f77640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd4f8073230 0x7fd4f8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.474+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fd5141ef1e0 0x7fd5140cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.474+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5140c96b0 con 0x7fd5141ef1e0 2024-09-17T06:04:52.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.474+0000 7fd519776640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fd5141ef1e0 0x7fd5140cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.474+0000 7fd519776640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fd5141ef1e0 0x7fd5140cd4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:52.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.474+0000 7fd519f77640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd4f8073230 0x7fd4f8075740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd50c001780 tx=0x7fd50c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:52.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.474+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5140c96b0 con 0x7fd5141ef1e0 2024-09-17T06:04:52.479 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:04:52.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.490+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fd514147c20 con 0x7fd5141ef1e0 2024-09-17T06:04:52.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.490+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd514147c20 con 0x7fd5141ef1e0 2024-09-17T06:04:52.495 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:04:52.495 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:04:52.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.490+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fd5140638b0 0x7fd514063cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.490+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fd51414e880 con 0x7fd5140638b0 2024-09-17T06:04:52.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.490+0000 7fd519f77640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fd5140638b0 0x7fd514063cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.490+0000 7fd519f77640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fd5140638b0 0x7fd514063cc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:52.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.494+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd51414e880 con 0x7fd5140638b0 2024-09-17T06:04:52.502 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:52.499+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:52.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.506+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fd5140c3870 con 0x7fd5140638b0 2024-09-17T06:04:52.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.510+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd5140c3870 con 0x7fd5140638b0 2024-09-17T06:04:52.512 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:04:52.513 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:04:52.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.510+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fd5140645c0 0x7fd51414cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.510+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fd5140c3a20 con 0x7fd5140645c0 2024-09-17T06:04:52.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.510+0000 7fd519776640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fd5140645c0 0x7fd51414cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.510+0000 7fd519776640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fd5140645c0 0x7fd51414cad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:52.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.510+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5140c3a20 con 0x7fd5140645c0 2024-09-17T06:04:52.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.522+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fd51414d260 con 0x7fd5140645c0 2024-09-17T06:04:52.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.526+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd51414d260 con 0x7fd5140645c0 2024-09-17T06:04:52.529 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:04:52.530 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:04:52.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.526+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd5140c5420 0x7fd5140c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.526+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fd5140c5d70 con 0x7fd5140c5420 2024-09-17T06:04:52.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.526+0000 7fd51a778640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd5140c5420 0x7fd5140c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.526+0000 7fd51a778640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd5140c5420 0x7fd5140c5830 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:52.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.526+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5140c5d70 con 0x7fd5140c5420 2024-09-17T06:04:52.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.542+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fd5140c5d70 con 0x7fd5140c5420 2024-09-17T06:04:52.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.542+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd5140c5d70 con 0x7fd5140c5420 2024-09-17T06:04:52.547 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:04:52.548 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:04:52.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.542+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fd51402d9e0 0x7fd51402ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.542+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fd51402e330 con 0x7fd51402d9e0 2024-09-17T06:04:52.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.542+0000 7fd519f77640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fd51402d9e0 0x7fd51402ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.546+0000 7fd519f77640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fd51402d9e0 0x7fd51402ddf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:52.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.546+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd51402e330 con 0x7fd51402d9e0 2024-09-17T06:04:52.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.562+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fd51402e330 con 0x7fd51402d9e0 2024-09-17T06:04:52.568 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.566+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd51402e330 con 0x7fd51402d9e0 2024-09-17T06:04:52.569 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:04:52.570 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:04:52.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.566+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fd514203b00 0x7fd514205f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.566+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fd514208cf0 con 0x7fd514203b00 2024-09-17T06:04:52.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.566+0000 7fd519776640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fd514203b00 0x7fd514205f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.566+0000 7fd519776640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fd514203b00 0x7fd514205f20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:52.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.570+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd514208cf0 con 0x7fd514203b00 2024-09-17T06:04:52.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.582+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fd514206460 con 0x7fd514203b00 2024-09-17T06:04:52.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.586+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd514206460 con 0x7fd514203b00 2024-09-17T06:04:52.590 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:04:52.591 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:04:52.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.586+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fd514206ae0 0x7fd514208f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.586+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fd51420bee0 con 0x7fd514206ae0 2024-09-17T06:04:52.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.586+0000 7fd51a778640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fd514206ae0 0x7fd514208f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.586+0000 7fd51a778640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fd514206ae0 0x7fd514208f00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:52.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.590+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd51420bee0 con 0x7fd514206ae0 2024-09-17T06:04:52.602 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:52.598+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:52.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.606+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fd51420beb0 con 0x7fd514206ae0 2024-09-17T06:04:52.613 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.610+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd51420beb0 con 0x7fd514206ae0 2024-09-17T06:04:52.613 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:04:52.614 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:04:52.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.610+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd514209a40 0x7fd514209eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.610+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fd51420f2b0 con 0x7fd514209a40 2024-09-17T06:04:52.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.610+0000 7fd519f77640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd514209a40 0x7fd514209eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.610+0000 7fd519f77640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd514209a40 0x7fd514209eb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:52.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.614+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd51420f2b0 con 0x7fd514209a40 2024-09-17T06:04:52.620 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:52.620 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:52.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.626+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fd51420e130 con 0x7fd514209a40 2024-09-17T06:04:52.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.630+0000 7fd50a7fc640 1 -- 172.21.15.122:0/125345962 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd51420e130 con 0x7fd514209a40 2024-09-17T06:04:52.635 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:04:52.637 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:04:52.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fd5141ef1e0 msgr2=0x7fd5140cd4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fd5141ef1e0 0x7fd5140cd4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fd5140638b0 msgr2=0x7fd514063cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fd5140638b0 0x7fd514063cc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fd5140645c0 msgr2=0x7fd51414cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fd5140645c0 0x7fd51414cad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd5140c5420 msgr2=0x7fd5140c5830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd5140c5420 0x7fd5140c5830 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fd51402d9e0 msgr2=0x7fd51402ddf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51a778640 1 -- 172.21.15.122:0/125345962 reap_dead start 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fd51402d9e0 0x7fd51402ddf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51a778640 1 -- 172.21.15.122:0/125345962 reap_dead start 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fd514203b00 msgr2=0x7fd514205f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fd514203b00 0x7fd514205f20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fd514206ae0 msgr2=0x7fd514208f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fd514206ae0 0x7fd514208f00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd514209a40 msgr2=0x7fd514209eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd514209a40 0x7fd514209eb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd4f8073230 msgr2=0x7fd4f8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd4f8073230 0x7fd4f8075740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd50c001780 tx=0x7fd50c009040 comp rx=0 tx=0).stop 2024-09-17T06:04:52.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5140c6320 msgr2=0x7fd514146250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 --2- 172.21.15.122:0/125345962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5140c6320 0x7fd514146250 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd504009930 tx=0x7fd504005760 comp rx=0 tx=0).stop 2024-09-17T06:04:52.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51a778640 1 -- 172.21.15.122:0/125345962 reap_dead start 2024-09-17T06:04:52.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 shutdown_connections 2024-09-17T06:04:52.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 >> 172.21.15.122:0/125345962 conn(0x7fd514073640 msgr2=0x7fd51414fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:52.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 shutdown_connections 2024-09-17T06:04:52.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.634+0000 7fd51c1db640 1 -- 172.21.15.122:0/125345962 wait complete. 2024-09-17T06:04:52.640 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:04:52.704 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:52.699+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:52.779 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-17T06:04:52.779 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T06:04:52.779 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T06:04:52.780 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T06:04:52.804 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:52.803+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:52.845 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:52.845 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:52.865 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:04:52.916 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:52.914+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:52.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.926+0000 7fd75b800640 1 -- 172.21.15.122:0/1548158426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd75406d7e0 msgr2=0x7fd75406dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.926+0000 7fd75b800640 1 --2- 172.21.15.122:0/1548158426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd75406d7e0 0x7fd75406dbf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd74c009bc0 tx=0x7fd74c01f3b0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.926+0000 7fd75b800640 1 -- 172.21.15.122:0/1548158426 shutdown_connections 2024-09-17T06:04:52.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.926+0000 7fd75b800640 1 --2- 172.21.15.122:0/1548158426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd75406d7e0 0x7fd75406dbf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.926+0000 7fd75b800640 1 --2- 172.21.15.122:0/1548158426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd75406e370 0x7fd7541522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.926+0000 7fd75b800640 1 -- 172.21.15.122:0/1548158426 >> 172.21.15.122:0/1548158426 conn(0x7fd7540cd4f0 msgr2=0x7fd7540cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:52.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.926+0000 7fd75b800640 1 -- 172.21.15.122:0/1548158426 shutdown_connections 2024-09-17T06:04:52.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.926+0000 7fd75b800640 1 -- 172.21.15.122:0/1548158426 wait complete. 2024-09-17T06:04:52.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75b800640 1 Processor -- start 2024-09-17T06:04:52.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75b800640 1 -- start start 2024-09-17T06:04:52.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75b800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75406d7e0 0x7fd754155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75b800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd75406e370 0x7fd754157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75b800640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7540c26f0 0x7fd7540cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75b800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd754158af0 con 0x7fd75406d7e0 2024-09-17T06:04:52.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75b800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd754158810 con 0x7fd75406e370 2024-09-17T06:04:52.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75b800640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd7540c4240 con 0x7fd7540c26f0 2024-09-17T06:04:52.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75959c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75406d7e0 0x7fd754155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75959c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75406d7e0 0x7fd754155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35168/0 (socket says 172.21.15.122:35168) 2024-09-17T06:04:52.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75959c640 1 -- 172.21.15.122:0/210647749 learned_addr learned my addr 172.21.15.122:0/210647749 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd758d9b640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd75406e370 0x7fd754157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd759d9d640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7540c26f0 0x7fd7540cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75959c640 1 -- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7540c26f0 msgr2=0x7fd7540cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75959c640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7540c26f0 0x7fd7540cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75959c640 1 -- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd75406e370 msgr2=0x7fd754157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75959c640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd75406e370 0x7fd754157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.930+0000 7fd75959c640 1 -- 172.21.15.122:0/210647749 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd754156da0 con 0x7fd75406d7e0 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.934+0000 7fd75959c640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75406d7e0 0x7fd754155f80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd75000e7d0 tx=0x7fd75000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.934+0000 7fd749ffb640 1 -- 172.21.15.122:0/210647749 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75000ccc0 con 0x7fd75406d7e0 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.934+0000 7fd749ffb640 1 -- 172.21.15.122:0/210647749 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd750010430 con 0x7fd75406d7e0 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.934+0000 7fd75b800640 1 -- 172.21.15.122:0/210647749 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7541525a0 con 0x7fd75406d7e0 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.934+0000 7fd749ffb640 1 -- 172.21.15.122:0/210647749 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750010880 con 0x7fd75406d7e0 2024-09-17T06:04:52.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.934+0000 7fd75b800640 1 -- 172.21.15.122:0/210647749 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7541efde0 con 0x7fd75406d7e0 2024-09-17T06:04:52.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.934+0000 7fd75b800640 1 -- 172.21.15.122:0/210647749 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75406ed50 con 0x7fd75406d7e0 2024-09-17T06:04:52.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.934+0000 7fd749ffb640 1 -- 172.21.15.122:0/210647749 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd750010a20 con 0x7fd75406d7e0 2024-09-17T06:04:52.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.934+0000 7fd749ffb640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd738073200 0x7fd738075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:52.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.934+0000 7fd749ffb640 1 -- 172.21.15.122:0/210647749 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6743+0+0 (secure 0 0 0) 0x7fd750094f70 con 0x7fd75406d7e0 2024-09-17T06:04:52.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.934+0000 7fd758d9b640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd738073200 0x7fd738075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:52.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.934+0000 7fd758d9b640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd738073200 0x7fd738075710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd7541f37f0 tx=0x7fd744009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:52.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:52.938+0000 7fd749ffb640 1 -- 172.21.15.122:0/210647749 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd75005f6d0 con 0x7fd75406d7e0 2024-09-17T06:04:53.006 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:53.003+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:53.010 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:53.010 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:53.030 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:04:53.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.106+0000 7fd75b800640 1 -- 172.21.15.122:0/210647749 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fd7540cdc10 con 0x7fd75406d7e0 2024-09-17T06:04:53.111 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:53.106+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:53.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd749ffb640 1 -- 172.21.15.122:0/210647749 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v29) ==== 81+0+39004 (secure 0 0 0) 0x7fd750064080 con 0x7fd75406d7e0 2024-09-17T06:04:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:53.113 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:04:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 29, 2024-09-17T06:04:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "5aff0fc3-254a-48aa-be08-0081a34bd09c", 2024-09-17T06:04:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "created": "2024-09-17T06:03:42.642598+0000", 2024-09-17T06:04:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-09-17T06:04:51.747015+0000", 2024-09-17T06:04:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "last_up_change": "2024-09-17T06:03:56.580331+0000", 2024-09-17T06:04:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "last_in_change": "2024-09-17T06:03:46.879949+0000", 2024-09-17T06:04:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T06:04:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_num": 5806080, 2024-09-17T06:04:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_set": [ 2024-09-17T06:04:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "nodeep-scrub", 2024-09-17T06:04:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "noscrub", 2024-09-17T06:04:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "pglog_hardlimit", 2024-09-17T06:04:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "purged_snapdirs", 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_deletes", 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "sortbitwise" 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_version": 6, 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_snapshot": "", 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_max": 4, 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "max_osd": 8, 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "require_min_compat_client": "luminous", 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "min_compat_client": "luminous", 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "require_osd_release": "squid", 2024-09-17T06:04:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "allow_crimson": false, 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "pools": [ 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 1, 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": ".mgr", 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:03:57.560955+0000", 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:04:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 1, 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 1, 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 1, 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 1, 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 1, 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:04:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "18", 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:04:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:04:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:04:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:04:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:04:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:04:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:04:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:04:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_max": 32, 2024-09-17T06:04:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 1 2024-09-17T06:04:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:04:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": {} 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 8, 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 8, 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 0.25, 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 2, 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 2, 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 1, 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 1 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 2, 2024-09-17T06:04:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_metadata", 2024-09-17T06:04:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:06.110710+0000", 2024-09-17T06:04:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:04:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:04:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:04:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:04:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:04:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:04:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:04:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:04:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:04:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:04:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:04:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:04:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:04:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 32, 2024-09-17T06:04:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 32, 2024-09-17T06:04:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 32, 2024-09-17T06:04:53.126 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 32, 2024-09-17T06:04:53.126 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 32, 2024-09-17T06:04:53.126 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:04:53.126 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:04:53.126 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:04:53.126 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:04:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:04:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:04:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:04:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "21", 2024-09-17T06:04:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:04:53.128 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:04:53.128 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:04:53.128 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:04:53.128 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:04:53.128 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:04:53.128 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:04:53.129 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:04:53.129 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:04:53.129 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:04:53.129 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:04:53.129 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:04:53.129 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:04:53.130 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:04:53.130 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:04:53.130 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:04:53.130 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:04:53.130 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:04:53.130 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:04:53.131 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:04:53.131 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:04:53.131 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:04:53.131 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:04:53.131 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:04:53.132 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:04:53.132 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:04:53.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.132 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:04:53.132 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:04:53.132 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:04:53.133 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:04:53.133 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:04:53.133 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:04:53.133 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:04:53.133 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:04:53.133 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:04:53.134 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:04:53.134 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:04:53.134 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:04:53.134 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_bias": 4, 2024-09-17T06:04:53.134 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 16, 2024-09-17T06:04:53.134 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_priority": 5 2024-09-17T06:04:53.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.135 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:04:53.135 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:04:53.135 INFO:teuthology.orchestra.run.smithi122.stdout: "metadata": "cephfs" 2024-09-17T06:04:53.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.136 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:04:53.136 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:04:53.136 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 1.5, 2024-09-17T06:04:53.136 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 1.5, 2024-09-17T06:04:53.136 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 1, 2024-09-17T06:04:53.136 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 1.5, 2024-09-17T06:04:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 1.5, 2024-09-17T06:04:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 1, 2024-09-17T06:04:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:04:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 1 2024-09-17T06:04:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 3, 2024-09-17T06:04:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_data", 2024-09-17T06:04:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:07.186655+0000", 2024-09-17T06:04:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:04:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:04:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:04:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:04:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:04:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:04:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:04:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:04:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:04:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:04:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:04:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:04:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:04:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 64, 2024-09-17T06:04:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 64, 2024-09-17T06:04:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 64, 2024-09-17T06:04:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 64, 2024-09-17T06:04:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 64, 2024-09-17T06:04:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:04:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:04:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:04:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:04:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:04:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "22", 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:04:53.140 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:04:53.141 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:04:53.141 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:04:53.141 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:04:53.141 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:04:53.141 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:04:53.141 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:04:53.141 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:04:53.141 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:04:53.141 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:04:53.141 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:04:53.141 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:04:53.142 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:04:53.142 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:04:53.142 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:04:53.142 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:04:53.142 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:04:53.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.142 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:04:53.142 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:04:53.142 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:04:53.143 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:04:53.143 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:04:53.143 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:04:53.143 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:04:53.143 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:04:53.143 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:04:53.143 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:04:53.143 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:04:53.143 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:04:53.143 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 64, 2024-09-17T06:04:53.143 INFO:teuthology.orchestra.run.smithi122.stdout: "target_size_ratio": 0.05000000074505806 2024-09-17T06:04:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:04:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:04:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: "data": "cephfs" 2024-09-17T06:04:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:04:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:04:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 1.3799999952316284, 2024-09-17T06:04:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 1.3799999952316284, 2024-09-17T06:04:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 1, 2024-09-17T06:04:53.144 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T06:04:53.145 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T06:04:53.145 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 1, 2024-09-17T06:04:53.145 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:04:53.145 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 1 2024-09-17T06:04:53.145 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.145 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 4, 2024-09-17T06:04:53.145 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_data_ec", 2024-09-17T06:04:53.145 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:10.901448+0000", 2024-09-17T06:04:53.145 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 5, 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool,ec_overwrites", 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 3, 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 4, 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 3, 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 1, 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 32, 2024-09-17T06:04:53.146 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 32, 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 32, 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 32, 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 32, 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "26", 2024-09-17T06:04:53.147 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:04:53.148 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "cephfs_data_ec", 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.149 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 8192, 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 64, 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T06:04:53.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: "data": "cephfs" 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osds": [ 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 0, 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "b8a621d5-9187-4034-ac89-5adb5b22ca7a", 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:04:53.151 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:04:53.152 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:04:53.152 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:04:53.152 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:04:53.152 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:04:53.152 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 24, 2024-09-17T06:04:53.152 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:04:53.152 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:04:53.152 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:04:53.152 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6824", 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6825", 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:04:53.153 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6826", 2024-09-17T06:04:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:04:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6827", 2024-09-17T06:04:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:04:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6830", 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6831", 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6828", 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6829", 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:04:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6825/776463314", 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6827/776463314", 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6831/776463314", 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6829/776463314", 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 1, 2024-09-17T06:04:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "992e1af1-06d0-4849-93bf-4be8fc437183", 2024-09-17T06:04:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:04:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:04:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:04:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:04:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:04:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:04:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:04:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 24, 2024-09-17T06:04:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:04:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6800", 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6801", 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:04:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6802", 2024-09-17T06:04:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:04:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6803", 2024-09-17T06:04:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:04:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:04:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6806", 2024-09-17T06:04:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:04:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6807", 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6804", 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:04:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6805", 2024-09-17T06:04:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:04:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6801/2272556556", 2024-09-17T06:04:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6803/2272556556", 2024-09-17T06:04:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6807/2272556556", 2024-09-17T06:04:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6805/2272556556", 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 2, 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "e3a31b77-d4db-4ee6-af7c-60af7df4bd69", 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:04:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 27, 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6816", 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6817", 2024-09-17T06:04:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:04:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:04:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6818", 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6819", 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6822", 2024-09-17T06:04:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:04:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6823", 2024-09-17T06:04:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:04:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6820", 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6821", 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6817/1205784459", 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6819/1205784459", 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6823/1205784459", 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6821/1205784459", 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 3, 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "9f473452-18cd-44a4-803a-e908e21ab405", 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:04:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 27, 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6808", 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6809", 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6810", 2024-09-17T06:04:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:04:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6811", 2024-09-17T06:04:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:04:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6814", 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6815", 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6812", 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6813", 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6809/3198016774", 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6811/3198016774", 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6815/3198016774", 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6813/3198016774", 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 4, 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "f11201b3-22f8-4b9e-873c-0ed12835e2d3", 2024-09-17T06:04:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 27, 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6810", 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6811", 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6812", 2024-09-17T06:04:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:04:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6813", 2024-09-17T06:04:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:04:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6816", 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6817", 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6814", 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6815", 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6811/920798795", 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6813/920798795", 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6817/920798795", 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6815/920798795", 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 5, 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "3f853011-9aea-4f7c-bb97-2c74fba1e33e", 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:04:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:04:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:04:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:04:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:04:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:04:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 14, 2024-09-17T06:04:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 24, 2024-09-17T06:04:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:04:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:04:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:04:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6802", 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6803", 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6804", 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6805", 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6808", 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6809", 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6806", 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6807", 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6803/2576144160", 2024-09-17T06:04:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6805/2576144160", 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6809/2576144160", 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6807/2576144160", 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 6, 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "445606c9-7e18-44b2-997d-68d280a3a37c", 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:04:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 24, 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6818", 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6819", 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6820", 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6821", 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6824", 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6825", 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6822", 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6823", 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6819/1877869793", 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6821/1877869793", 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6825/1877869793", 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6823/1877869793", 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:04:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 7, 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "ce0b67c6-0618-41b7-87e3-bf2d4c708907", 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 20, 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:04:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6826", 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6827", 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6828", 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6829", 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6832", 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6833", 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6830", 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6831", 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6827/1719466778", 2024-09-17T06:04:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6829/1719466778", 2024-09-17T06:04:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6833/1719466778", 2024-09-17T06:04:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6831/1719466778", 2024-09-17T06:04:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:04:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:04:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:04:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:04:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_xinfo": [ 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 0, 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.176942+0000", 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 1, 2024-09-17T06:04:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.431303+0000", 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 2, 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:04:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:04:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:04:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.354201+0000", 2024-09-17T06:04:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:04:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 3, 2024-09-17T06:04:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:04:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:04:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:04:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:04:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:04:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.748604+0000", 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 4, 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.473848+0000", 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 5, 2024-09-17T06:04:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.458683+0000", 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 6, 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:04:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.617928+0000", 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 7, 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.088763+0000", 2024-09-17T06:04:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:04:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:04:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap": [], 2024-09-17T06:04:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap_items": [ 2024-09-17T06:04:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.2", 2024-09-17T06:04:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:04:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 5, 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 1 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.d", 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 7, 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.1d", 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 5, 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.28", 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:04:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 5, 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 3, 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 1 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.c", 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.d", 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 5 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.1d", 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 5 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap_primaries": [], 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_temp": [], 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_temp": [], 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "blocklist": {}, 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "range_blocklist": {}, 2024-09-17T06:04:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profiles": { 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_data_ec": { 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-device-class": "", 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-failure-domain": "osd", 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-num-failure-domains": "0", 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-osds-per-failure-domain": "0", 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-root": "default", 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "jerasure-per-chunk-alignment": "false", 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "k": "2", 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "m": "2", 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "plugin": "jerasure", 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "technique": "reed_sol_van", 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "w": "8" 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "default": { 2024-09-17T06:04:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-failure-domain": "osd", 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "k": "2", 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "m": "1", 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "plugin": "jerasure", 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "technique": "reed_sol_van" 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps_queue": [], 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "new_removed_snaps": [], 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "new_purged_snaps": [], 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_node_flags": {}, 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "device_class_flags": {}, 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode": { 2024-09-17T06:04:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode_enabled": false, 2024-09-17T06:04:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_bucket_count": 0, 2024-09-17T06:04:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "degraded_stretch_mode": 0, 2024-09-17T06:04:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "recovering_stretch_mode": 0, 2024-09-17T06:04:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode_bucket": 0 2024-09-17T06:04:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:04:53.215 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:04:53.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd75b800640 1 -- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd738073200 msgr2=0x7fd738075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd75b800640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd738073200 0x7fd738075710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd7541f37f0 tx=0x7fd744009040 comp rx=0 tx=0).stop 2024-09-17T06:04:53.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd75b800640 1 -- 172.21.15.122:0/210647749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75406d7e0 msgr2=0x7fd754155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd75b800640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75406d7e0 0x7fd754155f80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd75000e7d0 tx=0x7fd75000ec90 comp rx=0 tx=0).stop 2024-09-17T06:04:53.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd75b800640 1 -- 172.21.15.122:0/210647749 shutdown_connections 2024-09-17T06:04:53.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd75b800640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7540c26f0 0x7fd7540cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd75b800640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd738073200 0x7fd738075710 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd75b800640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd75406e370 0x7fd754157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd75b800640 1 --2- 172.21.15.122:0/210647749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd75406d7e0 0x7fd754155f80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd75b800640 1 -- 172.21.15.122:0/210647749 >> 172.21.15.122:0/210647749 conn(0x7fd7540cd4f0 msgr2=0x7fd7540b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:53.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd75b800640 1 -- 172.21.15.122:0/210647749 shutdown_connections 2024-09-17T06:04:53.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.110+0000 7fd75b800640 1 -- 172.21.15.122:0/210647749 wait complete. 2024-09-17T06:04:53.218 INFO:tasks.thrashosds.thrasher:j is {'epoch': 29, 'fsid': '5aff0fc3-254a-48aa-be08-0081a34bd09c', 'created': '2024-09-17T06:03:42.642598+0000', 'modified': '2024-09-17T06:04:51.747015+0000', 'last_up_change': '2024-09-17T06:03:56.580331+0000', 'last_in_change': '2024-09-17T06:03:46.879949+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T06:03:57.560955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T06:04:06.110710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T06:04:07.186655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-17T06:04:10.901448+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}], 'osds': [{'osd': 0, 'uuid': 'b8a621d5-9187-4034-ac89-5adb5b22ca7a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6824', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6825', 'nonce': 776463314}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6826', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6827', 'nonce': 776463314}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6830', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6831', 'nonce': 776463314}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6828', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6829', 'nonce': 776463314}]}, 'public_addr': '172.21.15.122:6825/776463314', 'cluster_addr': '172.21.15.122:6827/776463314', 'heartbeat_back_addr': '172.21.15.122:6831/776463314', 'heartbeat_front_addr': '172.21.15.122:6829/776463314', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '992e1af1-06d0-4849-93bf-4be8fc437183', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6800', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6801', 'nonce': 2272556556}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6802', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6803', 'nonce': 2272556556}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6806', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6807', 'nonce': 2272556556}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6804', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6805', 'nonce': 2272556556}]}, 'public_addr': '172.21.15.122:6801/2272556556', 'cluster_addr': '172.21.15.122:6803/2272556556', 'heartbeat_back_addr': '172.21.15.122:6807/2272556556', 'heartbeat_front_addr': '172.21.15.122:6805/2272556556', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'e3a31b77-d4db-4ee6-af7c-60af7df4bd69', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6816', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6817', 'nonce': 1205784459}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6818', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6819', 'nonce': 1205784459}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6822', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6823', 'nonce': 1205784459}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6820', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6821', 'nonce': 1205784459}]}, 'public_addr': '172.21.15.122:6817/1205784459', 'cluster_addr': '172.21.15.122:6819/1205784459', 'heartbeat_back_addr': '172.21.15.122:6823/1205784459', 'heartbeat_front_addr': '172.21.15.122:6821/1205784459', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '9f473452-18cd-44a4-803a-e908e21ab405', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6808', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6809', 'nonce': 3198016774}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6810', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6811', 'nonce': 3198016774}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6814', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6815', 'nonce': 3198016774}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6812', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6813', 'nonce': 3198016774}]}, 'public_addr': '172.21.15.122:6809/3198016774', 'cluster_addr': '172.21.15.122:6811/3198016774', 'heartbeat_back_addr': '172.21.15.122:6815/3198016774', 'heartbeat_front_addr': '172.21.15.122:6813/3198016774', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'f11201b3-22f8-4b9e-873c-0ed12835e2d3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6810', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6811', 'nonce': 920798795}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6812', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6813', 'nonce': 920798795}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6816', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6817', 'nonce': 920798795}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6814', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6815', 'nonce': 920798795}]}, 'public_addr': '172.21.15.173:6811/920798795', 'cluster_addr': '172.21.15.173:6813/920798795', 'heartbeat_back_addr': '172.21.15.173:6817/920798795', 'heartbeat_front_addr': '172.21.15.173:6815/920798795', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '3f853011-9aea-4f7c-bb97-2c74fba1e33e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6802', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6803', 'nonce': 2576144160}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6804', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6805', 'nonce': 2576144160}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6808', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6809', 'nonce': 2576144160}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6806', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6807', 'nonce': 2576144160}]}, 'public_addr': '172.21.15.173:6803/2576144160', 'cluster_addr': '172.21.15.173:6805/2576144160', 'heartbeat_back_addr': '172.21.15.173:6809/2576144160', 'heartbeat_front_addr': '172.21.15.173:6807/2576144160', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '445606c9-7e18-44b2-997d-68d280a3a37c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6818', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6819', 'nonce': 1877869793}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6820', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6821', 'nonce': 1877869793}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6824', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6825', 'nonce': 1877869793}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6822', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6823', 'nonce': 1877869793}]}, 'public_addr': '172.21.15.173:6819/1877869793', 'cluster_addr': '172.21.15.173:6821/1877869793', 'heartbeat_back_addr': '172.21.15.173:6825/1877869793', 'heartbeat_front_addr': '172.21.15.173:6823/1877869793', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'ce0b67c6-0618-41b7-87e3-bf2d4c708907', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6826', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6827', 'nonce': 1719466778}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6828', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6829', 'nonce': 1719466778}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 1719466778}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6830', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6831', 'nonce': 1719466778}]}, 'public_addr': '172.21.15.173:6827/1719466778', 'cluster_addr': '172.21.15.173:6829/1719466778', 'heartbeat_back_addr': '172.21.15.173:6833/1719466778', 'heartbeat_front_addr': '172.21.15.173:6831/1719466778', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.176942+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.431303+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.354201+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.748604+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.473848+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.458683+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.617928+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.088763+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.2', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '3.d', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '3.1d', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.28', 'mappings': [{'from': 5, 'to': 2}, {'from': 3, 'to': 1}]}, {'pgid': '4.c', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.d', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.1d', 'mappings': [{'from': 1, 'to': 5}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'cephfs_data_ec': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-num-failure-domains': '0', 'crush-osds-per-failure-domain': '0', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '2', 'plugin': 'jerasure', 'technique': 'reed_sol_van', 'w': '8'}, 'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T06:04:53.219 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:04:53.219 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:53.219 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:53.219 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:04:53.214+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:04:53.226 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:04:53.317 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:04:53.314+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:04:53.413 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:53.413 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:53.418 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:53.415+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:53.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.418+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/3647047393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5c0161c20 msgr2=0x7fb5c0164040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.418+0000 7fb5c6ff1640 1 --2- 172.21.15.122:0/3647047393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5c0161c20 0x7fb5c0164040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb5c00c9870 tx=0x7fb5b801cb80 comp rx=0 tx=0).stop 2024-09-17T06:04:53.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.418+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/3647047393 shutdown_connections 2024-09-17T06:04:53.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.418+0000 7fb5c6ff1640 1 --2- 172.21.15.122:0/3647047393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5c0161c20 0x7fb5c0164040 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.418+0000 7fb5c6ff1640 1 --2- 172.21.15.122:0/3647047393 >> v2:172.21.15.173:3300/0 conn(0x7fb5c015d440 0x7fb5c00cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.418+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/3647047393 >> 172.21.15.122:0/3647047393 conn(0x7fb5c0070e40 msgr2=0x7fb5c0071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:53.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.418+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/3647047393 shutdown_connections 2024-09-17T06:04:53.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.418+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/3647047393 wait complete. 2024-09-17T06:04:53.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c6ff1640 1 Processor -- start 2024-09-17T06:04:53.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c6ff1640 1 -- start start 2024-09-17T06:04:53.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c6ff1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5c00cee30 0x7fb5c00c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:53.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c6ff1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5c015d440 0x7fb5c00c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:53.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c6ff1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5c0161c20 0x7fb5c01f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:53.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c6ff1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c0153870 con 0x7fb5c0161c20 2024-09-17T06:04:53.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c6ff1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c00c38c0 con 0x7fb5c00cee30 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c6ff1640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c01539f0 con 0x7fb5c015d440 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c558e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5c0161c20 0x7fb5c01f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c558e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5c0161c20 0x7fb5c01f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35176/0 (socket says 172.21.15.122:35176) 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c558e640 1 -- 172.21.15.122:0/866463254 learned_addr learned my addr 172.21.15.122:0/866463254 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c4d8d640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5c00cee30 0x7fb5c00c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5b7fff640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5c015d440 0x7fb5c00c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c558e640 1 -- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5c015d440 msgr2=0x7fb5c00c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c558e640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5c015d440 0x7fb5c00c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c558e640 1 -- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5c00cee30 msgr2=0x7fb5c00c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c558e640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5c00cee30 0x7fb5c00c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c558e640 1 -- 172.21.15.122:0/866463254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c00c6b40 con 0x7fb5c0161c20 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5b7fff640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5c015d440 0x7fb5c00c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:53.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c558e640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5c0161c20 0x7fb5c01f5b60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb5b801a7b0 tx=0x7fb5b8003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:53.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5b57fa640 1 -- 172.21.15.122:0/866463254 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b80bc070 con 0x7fb5c0161c20 2024-09-17T06:04:53.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5b57fa640 1 -- 172.21.15.122:0/866463254 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5b80042a0 con 0x7fb5c0161c20 2024-09-17T06:04:53.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5b57fa640 1 -- 172.21.15.122:0/866463254 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b80b2040 con 0x7fb5c0161c20 2024-09-17T06:04:53.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/866463254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c01ec660 con 0x7fb5c0161c20 2024-09-17T06:04:53.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.422+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/866463254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c00c5e00 con 0x7fb5c0161c20 2024-09-17T06:04:53.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.426+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/866463254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c00c5bf0 con 0x7fb5c0161c20 2024-09-17T06:04:53.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.426+0000 7fb5b57fa640 1 -- 172.21.15.122:0/866463254 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb5b80046d0 con 0x7fb5c0161c20 2024-09-17T06:04:53.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.426+0000 7fb5b57fa640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb5ac073230 0x7fb5ac075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:53.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.426+0000 7fb5b57fa640 1 -- 172.21.15.122:0/866463254 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6743+0+0 (secure 0 0 0) 0x7fb5b812e240 con 0x7fb5c0161c20 2024-09-17T06:04:53.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.426+0000 7fb5c4d8d640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb5ac073230 0x7fb5ac075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:53.431 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:04:53.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.426+0000 7fb5c4d8d640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb5ac073230 0x7fb5ac075740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc001400 tx=0x7fb5bc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:53.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.430+0000 7fb5b57fa640 1 -- 172.21.15.122:0/866463254 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb5b8016770 con 0x7fb5c0161c20 2024-09-17T06:04:53.519 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:53.519+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:53.572 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:53.573 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:53.588 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:04:53.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.598+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/866463254 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5c00ca720 con 0x7fb5ac073230 2024-09-17T06:04:53.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.614+0000 7fb5b57fa640 1 -- 172.21.15.122:0/866463254 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332640 (secure 0 0 0) 0x7fb5c00ca720 con 0x7fb5ac073230 2024-09-17T06:04:53.620 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:04:53.622 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:04:53.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.618+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb5ac073230 msgr2=0x7fb5ac075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.618+0000 7fb5c6ff1640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb5ac073230 0x7fb5ac075740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc001400 tx=0x7fb5bc009040 comp rx=0 tx=0).stop 2024-09-17T06:04:53.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.618+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/866463254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5c0161c20 msgr2=0x7fb5c01f5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.618+0000 7fb5c6ff1640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5c0161c20 0x7fb5c01f5b60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb5b801a7b0 tx=0x7fb5b8003f40 comp rx=0 tx=0).stop 2024-09-17T06:04:53.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.618+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/866463254 shutdown_connections 2024-09-17T06:04:53.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.618+0000 7fb5c6ff1640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5c0161c20 0x7fb5c01f5b60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.618+0000 7fb5c6ff1640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5c015d440 0x7fb5c00c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.618+0000 7fb5c6ff1640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb5ac073230 0x7fb5ac075740 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.618+0000 7fb5c6ff1640 1 --2- 172.21.15.122:0/866463254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5c00cee30 0x7fb5c00c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.618+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/866463254 >> 172.21.15.122:0/866463254 conn(0x7fb5c0070e40 msgr2=0x7fb5c01625f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:53.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.618+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/866463254 shutdown_connections 2024-09-17T06:04:53.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.618+0000 7fb5c6ff1640 1 -- 172.21.15.122:0/866463254 wait complete. 2024-09-17T06:04:53.625 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:53.623+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:53.639 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-09-17T06:04:53.530314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597465,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":154,"num_write_kb":1651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":323,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219820,"kb_used_data":3584,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754900,"statfs":{"total":773094113280,"available":772869017600,"internally_reserved":0,"allocated":3670016,"data_stored":2182870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2016,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002773"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.765352+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:04:51.765352+0000","last_peered":"2024-09-17T06:04:51.765352+0000","last_clean":"2024-09-17T06:04:51.765352+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:04:51.765352+0000","last_undegraded":"2024-09-17T06:04:51.765352+0000","last_fullsized":"2024-09-17T06:04:51.765352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414096+0000","last_change":"2024-09-17T06:04:08.851488+0000","last_active":"2024-09-17T06:04:52.414096+0000","last_peered":"2024-09-17T06:04:52.414096+0000","last_clean":"2024-09-17T06:04:52.414096+0000","last_became_active":"2024-09-17T06:04:08.847345+0000","last_became_peered":"2024-09-17T06:04:08.847345+0000","last_unstale":"2024-09-17T06:04:52.414096+0000","last_undegraded":"2024-09-17T06:04:52.414096+0000","last_fullsized":"2024-09-17T06:04:52.414096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415732+0000","last_change":"2024-09-17T06:04:13.045049+0000","last_active":"2024-09-17T06:04:52.415732+0000","last_peered":"2024-09-17T06:04:52.415732+0000","last_clean":"2024-09-17T06:04:52.415732+0000","last_became_active":"2024-09-17T06:04:13.041321+0000","last_became_peered":"2024-09-17T06:04:13.041321+0000","last_unstale":"2024-09-17T06:04:52.415732+0000","last_undegraded":"2024-09-17T06:04:52.415732+0000","last_fullsized":"2024-09-17T06:04:52.415732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.500551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414332+0000","last_change":"2024-09-17T06:04:07.834691+0000","last_active":"2024-09-17T06:04:52.414332+0000","last_peered":"2024-09-17T06:04:52.414332+0000","last_clean":"2024-09-17T06:04:52.414332+0000","last_became_active":"2024-09-17T06:04:07.834110+0000","last_became_peered":"2024-09-17T06:04:07.834110+0000","last_unstale":"2024-09-17T06:04:52.414332+0000","last_undegraded":"2024-09-17T06:04:52.414332+0000","last_fullsized":"2024-09-17T06:04:52.414332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.765059+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:04:51.765059+0000","last_peered":"2024-09-17T06:04:51.765059+0000","last_clean":"2024-09-17T06:04:51.765059+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:04:51.765059+0000","last_undegraded":"2024-09-17T06:04:51.765059+0000","last_fullsized":"2024-09-17T06:04:51.765059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764258+0000","last_change":"2024-09-17T06:04:12.954966+0000","last_active":"2024-09-17T06:04:51.764258+0000","last_peered":"2024-09-17T06:04:51.764258+0000","last_clean":"2024-09-17T06:04:51.764258+0000","last_became_active":"2024-09-17T06:04:12.953915+0000","last_became_peered":"2024-09-17T06:04:12.953915+0000","last_unstale":"2024-09-17T06:04:51.764258+0000","last_undegraded":"2024-09-17T06:04:51.764258+0000","last_fullsized":"2024-09-17T06:04:51.764258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:54.009189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.105479+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:04:52.105479+0000","last_peered":"2024-09-17T06:04:52.105479+0000","last_clean":"2024-09-17T06:04:52.105479+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:04:52.105479+0000","last_undegraded":"2024-09-17T06:04:52.105479+0000","last_fullsized":"2024-09-17T06:04:52.105479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.131302+0000","last_change":"2024-09-17T06:04:08.847869+0000","last_active":"2024-09-17T06:04:49.131302+0000","last_peered":"2024-09-17T06:04:49.131302+0000","last_clean":"2024-09-17T06:04:49.131302+0000","last_became_active":"2024-09-17T06:04:08.847475+0000","last_became_peered":"2024-09-17T06:04:08.847475+0000","last_unstale":"2024-09-17T06:04:49.131302+0000","last_undegraded":"2024-09-17T06:04:49.131302+0000","last_fullsized":"2024-09-17T06:04:49.131302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:54.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.765733+0000","last_change":"2024-09-17T06:04:12.948833+0000","last_active":"2024-09-17T06:04:51.765733+0000","last_peered":"2024-09-17T06:04:51.765733+0000","last_clean":"2024-09-17T06:04:51.765733+0000","last_became_active":"2024-09-17T06:04:12.947705+0000","last_became_peered":"2024-09-17T06:04:12.947705+0000","last_unstale":"2024-09-17T06:04:51.765733+0000","last_undegraded":"2024-09-17T06:04:51.765733+0000","last_fullsized":"2024-09-17T06:04:51.765733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:46.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.105364+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:04:52.105364+0000","last_peered":"2024-09-17T06:04:52.105364+0000","last_clean":"2024-09-17T06:04:52.105364+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:04:52.105364+0000","last_undegraded":"2024-09-17T06:04:52.105364+0000","last_fullsized":"2024-09-17T06:04:52.105364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415145+0000","last_change":"2024-09-17T06:04:48.742851+0000","last_active":"2024-09-17T06:04:52.415145+0000","last_peered":"2024-09-17T06:04:52.415145+0000","last_clean":"2024-09-17T06:04:52.415145+0000","last_became_active":"2024-09-17T06:04:48.742473+0000","last_became_peered":"2024-09-17T06:04:48.742473+0000","last_unstale":"2024-09-17T06:04:52.415145+0000","last_undegraded":"2024-09-17T06:04:52.415145+0000","last_fullsized":"2024-09-17T06:04:52.415145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:03.944849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764781+0000","last_change":"2024-09-17T06:04:12.951144+0000","last_active":"2024-09-17T06:04:51.764781+0000","last_peered":"2024-09-17T06:04:51.764781+0000","last_clean":"2024-09-17T06:04:51.764781+0000","last_became_active":"2024-09-17T06:04:12.950127+0000","last_became_peered":"2024-09-17T06:04:12.950127+0000","last_unstale":"2024-09-17T06:04:51.764781+0000","last_undegraded":"2024-09-17T06:04:51.764781+0000","last_fullsized":"2024-09-17T06:04:51.764781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:52.901835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414710+0000","last_change":"2024-09-17T06:04:08.847906+0000","last_active":"2024-09-17T06:04:52.414710+0000","last_peered":"2024-09-17T06:04:52.414710+0000","last_clean":"2024-09-17T06:04:52.414710+0000","last_became_active":"2024-09-17T06:04:08.847601+0000","last_became_peered":"2024-09-17T06:04:08.847601+0000","last_unstale":"2024-09-17T06:04:52.414710+0000","last_undegraded":"2024-09-17T06:04:52.414710+0000","last_fullsized":"2024-09-17T06:04:52.414710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.106040+0000","last_change":"2024-09-17T06:04:07.851351+0000","last_active":"2024-09-17T06:04:52.106040+0000","last_peered":"2024-09-17T06:04:52.106040+0000","last_clean":"2024-09-17T06:04:52.106040+0000","last_became_active":"2024-09-17T06:04:07.850947+0000","last_became_peered":"2024-09-17T06:04:07.850947+0000","last_unstale":"2024-09-17T06:04:52.106040+0000","last_undegraded":"2024-09-17T06:04:52.106040+0000","last_fullsized":"2024-09-17T06:04:52.106040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:43.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.766344+0000","last_change":"2024-09-17T06:04:49.312386+0000","last_active":"2024-09-17T06:04:51.766344+0000","last_peered":"2024-09-17T06:04:51.766344+0000","last_clean":"2024-09-17T06:04:51.766344+0000","last_became_active":"2024-09-17T06:04:49.310510+0000","last_became_peered":"2024-09-17T06:04:49.310510+0000","last_unstale":"2024-09-17T06:04:51.766344+0000","last_undegraded":"2024-09-17T06:04:51.766344+0000","last_fullsized":"2024-09-17T06:04:51.766344+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.500551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413719+0000","last_change":"2024-09-17T06:04:08.847093+0000","last_active":"2024-09-17T06:04:52.413719+0000","last_peered":"2024-09-17T06:04:52.413719+0000","last_clean":"2024-09-17T06:04:52.413719+0000","last_became_active":"2024-09-17T06:04:08.846716+0000","last_became_peered":"2024-09-17T06:04:08.846716+0000","last_unstale":"2024-09-17T06:04:52.413719+0000","last_undegraded":"2024-09-17T06:04:52.413719+0000","last_fullsized":"2024-09-17T06:04:52.413719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413734+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:04:52.413734+0000","last_peered":"2024-09-17T06:04:52.413734+0000","last_clean":"2024-09-17T06:04:52.413734+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:04:52.413734+0000","last_undegraded":"2024-09-17T06:04:52.413734+0000","last_fullsized":"2024-09-17T06:04:52.413734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.766106+0000","last_change":"2024-09-17T06:04:48.746643+0000","last_active":"2024-09-17T06:04:51.766106+0000","last_peered":"2024-09-17T06:04:51.766106+0000","last_clean":"2024-09-17T06:04:51.766106+0000","last_became_active":"2024-09-17T06:04:48.745117+0000","last_became_peered":"2024-09-17T06:04:48.745117+0000","last_unstale":"2024-09-17T06:04:51.766106+0000","last_undegraded":"2024-09-17T06:04:51.766106+0000","last_fullsized":"2024-09-17T06:04:51.766106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:16.669822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415179+0000","last_change":"2024-09-17T06:04:08.850212+0000","last_active":"2024-09-17T06:04:52.415179+0000","last_peered":"2024-09-17T06:04:52.415179+0000","last_clean":"2024-09-17T06:04:52.415179+0000","last_became_active":"2024-09-17T06:04:08.835906+0000","last_became_peered":"2024-09-17T06:04:08.835906+0000","last_unstale":"2024-09-17T06:04:52.415179+0000","last_undegraded":"2024-09-17T06:04:52.415179+0000","last_fullsized":"2024-09-17T06:04:52.415179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413374+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:04:52.413374+0000","last_peered":"2024-09-17T06:04:52.413374+0000","last_clean":"2024-09-17T06:04:52.413374+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:04:52.413374+0000","last_undegraded":"2024-09-17T06:04:52.413374+0000","last_fullsized":"2024-09-17T06:04:52.413374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414383+0000","last_change":"2024-09-17T06:04:13.048882+0000","last_active":"2024-09-17T06:04:52.414383+0000","last_peered":"2024-09-17T06:04:52.414383+0000","last_clean":"2024-09-17T06:04:52.414383+0000","last_became_active":"2024-09-17T06:04:13.047684+0000","last_became_peered":"2024-09-17T06:04:13.047684+0000","last_unstale":"2024-09-17T06:04:52.414383+0000","last_undegraded":"2024-09-17T06:04:52.414383+0000","last_fullsized":"2024-09-17T06:04:52.414383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:21.270772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764816+0000","last_change":"2024-09-17T06:04:08.838033+0000","last_active":"2024-09-17T06:04:51.764816+0000","last_peered":"2024-09-17T06:04:51.764816+0000","last_clean":"2024-09-17T06:04:51.764816+0000","last_became_active":"2024-09-17T06:04:08.836402+0000","last_became_peered":"2024-09-17T06:04:08.836402+0000","last_unstale":"2024-09-17T06:04:51.764816+0000","last_undegraded":"2024-09-17T06:04:51.764816+0000","last_fullsized":"2024-09-17T06:04:51.764816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:12.374198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.104962+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:04:52.104962+0000","last_peered":"2024-09-17T06:04:52.104962+0000","last_clean":"2024-09-17T06:04:52.104962+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:04:52.104962+0000","last_undegraded":"2024-09-17T06:04:52.104962+0000","last_fullsized":"2024-09-17T06:04:52.104962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.766308+0000","last_change":"2024-09-17T06:04:12.949288+0000","last_active":"2024-09-17T06:04:51.766308+0000","last_peered":"2024-09-17T06:04:51.766308+0000","last_clean":"2024-09-17T06:04:51.766308+0000","last_became_active":"2024-09-17T06:04:12.947997+0000","last_became_peered":"2024-09-17T06:04:12.947997+0000","last_unstale":"2024-09-17T06:04:51.766308+0000","last_undegraded":"2024-09-17T06:04:51.766308+0000","last_fullsized":"2024-09-17T06:04:51.766308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.765238+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:04:51.765238+0000","last_peered":"2024-09-17T06:04:51.765238+0000","last_clean":"2024-09-17T06:04:51.765238+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:04:51.765238+0000","last_undegraded":"2024-09-17T06:04:51.765238+0000","last_fullsized":"2024-09-17T06:04:51.765238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.416572+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:04:52.416572+0000","last_peered":"2024-09-17T06:04:52.416572+0000","last_clean":"2024-09-17T06:04:52.416572+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:04:52.416572+0000","last_undegraded":"2024-09-17T06:04:52.416572+0000","last_fullsized":"2024-09-17T06:04:52.416572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764428+0000","last_change":"2024-09-17T06:04:13.039804+0000","last_active":"2024-09-17T06:04:51.764428+0000","last_peered":"2024-09-17T06:04:51.764428+0000","last_clean":"2024-09-17T06:04:51.764428+0000","last_became_active":"2024-09-17T06:04:13.038212+0000","last_became_peered":"2024-09-17T06:04:13.038212+0000","last_unstale":"2024-09-17T06:04:51.764428+0000","last_undegraded":"2024-09-17T06:04:51.764428+0000","last_fullsized":"2024-09-17T06:04:51.764428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:35.798927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415307+0000","last_change":"2024-09-17T06:04:08.853353+0000","last_active":"2024-09-17T06:04:52.415307+0000","last_peered":"2024-09-17T06:04:52.415307+0000","last_clean":"2024-09-17T06:04:52.415307+0000","last_became_active":"2024-09-17T06:04:08.852015+0000","last_became_peered":"2024-09-17T06:04:08.852015+0000","last_unstale":"2024-09-17T06:04:52.415307+0000","last_undegraded":"2024-09-17T06:04:52.415307+0000","last_fullsized":"2024-09-17T06:04:52.415307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414037+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:04:52.414037+0000","last_peered":"2024-09-17T06:04:52.414037+0000","last_clean":"2024-09-17T06:04:52.414037+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:04:52.414037+0000","last_undegraded":"2024-09-17T06:04:52.414037+0000","last_fullsized":"2024-09-17T06:04:52.414037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414064+0000","last_change":"2024-09-17T06:04:13.034589+0000","last_active":"2024-09-17T06:04:52.414064+0000","last_peered":"2024-09-17T06:04:52.414064+0000","last_clean":"2024-09-17T06:04:52.414064+0000","last_became_active":"2024-09-17T06:04:13.034080+0000","last_became_peered":"2024-09-17T06:04:13.034080+0000","last_unstale":"2024-09-17T06:04:52.414064+0000","last_undegraded":"2024-09-17T06:04:52.414064+0000","last_fullsized":"2024-09-17T06:04:52.414064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:16.669822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415200+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:04:52.415200+0000","last_peered":"2024-09-17T06:04:52.415200+0000","last_clean":"2024-09-17T06:04:52.415200+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:04:52.415200+0000","last_undegraded":"2024-09-17T06:04:52.415200+0000","last_fullsized":"2024-09-17T06:04:52.415200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.105808+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:04:52.105808+0000","last_peered":"2024-09-17T06:04:52.105808+0000","last_clean":"2024-09-17T06:04:52.105808+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:04:52.105808+0000","last_undegraded":"2024-09-17T06:04:52.105808+0000","last_fullsized":"2024-09-17T06:04:52.105808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764482+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:04:51.764482+0000","last_peered":"2024-09-17T06:04:51.764482+0000","last_clean":"2024-09-17T06:04:51.764482+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:04:51.764482+0000","last_undegraded":"2024-09-17T06:04:51.764482+0000","last_fullsized":"2024-09-17T06:04:51.764482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.132385+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:04:49.132385+0000","last_peered":"2024-09-17T06:04:49.132385+0000","last_clean":"2024-09-17T06:04:49.132385+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:04:49.132385+0000","last_undegraded":"2024-09-17T06:04:49.132385+0000","last_fullsized":"2024-09-17T06:04:49.132385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415468+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:04:52.415468+0000","last_peered":"2024-09-17T06:04:52.415468+0000","last_clean":"2024-09-17T06:04:52.415468+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:04:52.415468+0000","last_undegraded":"2024-09-17T06:04:52.415468+0000","last_fullsized":"2024-09-17T06:04:52.415468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413263+0000","last_change":"2024-09-17T06:04:12.942301+0000","last_active":"2024-09-17T06:04:52.413263+0000","last_peered":"2024-09-17T06:04:52.413263+0000","last_clean":"2024-09-17T06:04:52.413263+0000","last_became_active":"2024-09-17T06:04:12.941640+0000","last_became_peered":"2024-09-17T06:04:12.941640+0000","last_unstale":"2024-09-17T06:04:52.413263+0000","last_undegraded":"2024-09-17T06:04:52.413263+0000","last_fullsized":"2024-09-17T06:04:52.413263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:31.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.766002+0000","last_change":"2024-09-17T06:04:08.838642+0000","last_active":"2024-09-17T06:04:51.766002+0000","last_peered":"2024-09-17T06:04:51.766002+0000","last_clean":"2024-09-17T06:04:51.766002+0000","last_became_active":"2024-09-17T06:04:08.835562+0000","last_became_peered":"2024-09-17T06:04:08.835562+0000","last_unstale":"2024-09-17T06:04:51.766002+0000","last_undegraded":"2024-09-17T06:04:51.766002+0000","last_fullsized":"2024-09-17T06:04:51.766002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:16.900376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.134391+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:04:49.134391+0000","last_peered":"2024-09-17T06:04:49.134391+0000","last_clean":"2024-09-17T06:04:49.134391+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:04:49.134391+0000","last_undegraded":"2024-09-17T06:04:49.134391+0000","last_fullsized":"2024-09-17T06:04:49.134391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414911+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:04:52.414911+0000","last_peered":"2024-09-17T06:04:52.414911+0000","last_clean":"2024-09-17T06:04:52.414911+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:04:52.414911+0000","last_undegraded":"2024-09-17T06:04:52.414911+0000","last_fullsized":"2024-09-17T06:04:52.414911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.412949+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:04:52.412949+0000","last_peered":"2024-09-17T06:04:52.412949+0000","last_clean":"2024-09-17T06:04:52.412949+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:04:52.412949+0000","last_undegraded":"2024-09-17T06:04:52.412949+0000","last_fullsized":"2024-09-17T06:04:52.412949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414943+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:04:52.414943+0000","last_peered":"2024-09-17T06:04:52.414943+0000","last_clean":"2024-09-17T06:04:52.414943+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:04:52.414943+0000","last_undegraded":"2024-09-17T06:04:52.414943+0000","last_fullsized":"2024-09-17T06:04:52.414943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414535+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:04:52.414535+0000","last_peered":"2024-09-17T06:04:52.414535+0000","last_clean":"2024-09-17T06:04:52.414535+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:04:52.414535+0000","last_undegraded":"2024-09-17T06:04:52.414535+0000","last_fullsized":"2024-09-17T06:04:52.414535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764246+0000","last_change":"2024-09-17T06:04:08.840359+0000","last_active":"2024-09-17T06:04:51.764246+0000","last_peered":"2024-09-17T06:04:51.764246+0000","last_clean":"2024-09-17T06:04:51.764246+0000","last_became_active":"2024-09-17T06:04:08.839822+0000","last_became_peered":"2024-09-17T06:04:08.839822+0000","last_unstale":"2024-09-17T06:04:51.764246+0000","last_undegraded":"2024-09-17T06:04:51.764246+0000","last_fullsized":"2024-09-17T06:04:51.764246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.104962+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:04:52.104962+0000","last_peered":"2024-09-17T06:04:52.104962+0000","last_clean":"2024-09-17T06:04:52.104962+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:04:52.104962+0000","last_undegraded":"2024-09-17T06:04:52.104962+0000","last_fullsized":"2024-09-17T06:04:52.104962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.765069+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:04:51.765069+0000","last_peered":"2024-09-17T06:04:51.765069+0000","last_clean":"2024-09-17T06:04:51.765069+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:04:51.765069+0000","last_undegraded":"2024-09-17T06:04:51.765069+0000","last_fullsized":"2024-09-17T06:04:51.765069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.416416+0000","last_change":"2024-09-17T06:04:49.310218+0000","last_active":"2024-09-17T06:04:52.416416+0000","last_peered":"2024-09-17T06:04:52.416416+0000","last_clean":"2024-09-17T06:04:52.416416+0000","last_became_active":"2024-09-17T06:04:49.309174+0000","last_became_peered":"2024-09-17T06:04:49.309174+0000","last_unstale":"2024-09-17T06:04:52.416416+0000","last_undegraded":"2024-09-17T06:04:52.416416+0000","last_fullsized":"2024-09-17T06:04:52.416416+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:58.701281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.133328+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:04:49.133328+0000","last_peered":"2024-09-17T06:04:49.133328+0000","last_clean":"2024-09-17T06:04:49.133328+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:04:49.133328+0000","last_undegraded":"2024-09-17T06:04:49.133328+0000","last_fullsized":"2024-09-17T06:04:49.133328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.105313+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:04:52.105313+0000","last_peered":"2024-09-17T06:04:52.105313+0000","last_clean":"2024-09-17T06:04:52.105313+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:04:52.105313+0000","last_undegraded":"2024-09-17T06:04:52.105313+0000","last_fullsized":"2024-09-17T06:04:52.105313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.416381+0000","last_change":"2024-09-17T06:04:13.042118+0000","last_active":"2024-09-17T06:04:52.416381+0000","last_peered":"2024-09-17T06:04:52.416381+0000","last_clean":"2024-09-17T06:04:52.416381+0000","last_became_active":"2024-09-17T06:04:13.040403+0000","last_became_peered":"2024-09-17T06:04:13.040403+0000","last_unstale":"2024-09-17T06:04:52.416381+0000","last_undegraded":"2024-09-17T06:04:52.416381+0000","last_fullsized":"2024-09-17T06:04:52.416381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415267+0000","last_change":"2024-09-17T06:04:49.135526+0000","last_active":"2024-09-17T06:04:52.415267+0000","last_peered":"2024-09-17T06:04:52.415267+0000","last_clean":"2024-09-17T06:04:52.415267+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:04:52.415267+0000","last_undegraded":"2024-09-17T06:04:52.415267+0000","last_fullsized":"2024-09-17T06:04:52.415267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:45.338884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415408+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:04:52.415408+0000","last_peered":"2024-09-17T06:04:52.415408+0000","last_clean":"2024-09-17T06:04:52.415408+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:04:52.415408+0000","last_undegraded":"2024-09-17T06:04:52.415408+0000","last_fullsized":"2024-09-17T06:04:52.415408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.417087+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:04:52.417087+0000","last_peered":"2024-09-17T06:04:52.417087+0000","last_clean":"2024-09-17T06:04:52.417087+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:04:52.417087+0000","last_undegraded":"2024-09-17T06:04:52.417087+0000","last_fullsized":"2024-09-17T06:04:52.417087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.131266+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:04:49.131266+0000","last_peered":"2024-09-17T06:04:49.131266+0000","last_clean":"2024-09-17T06:04:49.131266+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:04:49.131266+0000","last_undegraded":"2024-09-17T06:04:49.131266+0000","last_fullsized":"2024-09-17T06:04:49.131266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413409+0000","last_change":"2024-09-17T06:04:07.833230+0000","last_active":"2024-09-17T06:04:52.413409+0000","last_peered":"2024-09-17T06:04:52.413409+0000","last_clean":"2024-09-17T06:04:52.413409+0000","last_became_active":"2024-09-17T06:04:07.832307+0000","last_became_peered":"2024-09-17T06:04:07.832307+0000","last_unstale":"2024-09-17T06:04:52.413409+0000","last_undegraded":"2024-09-17T06:04:52.413409+0000","last_fullsized":"2024-09-17T06:04:52.413409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:15.843465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764677+0000","last_change":"2024-09-17T06:04:12.934060+0000","last_active":"2024-09-17T06:04:51.764677+0000","last_peered":"2024-09-17T06:04:51.764677+0000","last_clean":"2024-09-17T06:04:51.764677+0000","last_became_active":"2024-09-17T06:04:12.933545+0000","last_became_peered":"2024-09-17T06:04:12.933545+0000","last_unstale":"2024-09-17T06:04:51.764677+0000","last_undegraded":"2024-09-17T06:04:51.764677+0000","last_fullsized":"2024-09-17T06:04:51.764677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:29.393815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.106497+0000","last_change":"2024-09-17T06:04:08.851525+0000","last_active":"2024-09-17T06:04:52.106497+0000","last_peered":"2024-09-17T06:04:52.106497+0000","last_clean":"2024-09-17T06:04:52.106497+0000","last_became_active":"2024-09-17T06:04:08.851117+0000","last_became_peered":"2024-09-17T06:04:08.851117+0000","last_unstale":"2024-09-17T06:04:52.106497+0000","last_undegraded":"2024-09-17T06:04:52.106497+0000","last_fullsized":"2024-09-17T06:04:52.106497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:53.071703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.416043+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:04:52.416043+0000","last_peered":"2024-09-17T06:04:52.416043+0000","last_clean":"2024-09-17T06:04:52.416043+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:04:52.416043+0000","last_undegraded":"2024-09-17T06:04:52.416043+0000","last_fullsized":"2024-09-17T06:04:52.416043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.132538+0000","last_change":"2024-09-17T06:04:13.042590+0000","last_active":"2024-09-17T06:04:49.132538+0000","last_peered":"2024-09-17T06:04:49.132538+0000","last_clean":"2024-09-17T06:04:49.132538+0000","last_became_active":"2024-09-17T06:04:13.041078+0000","last_became_peered":"2024-09-17T06:04:13.041078+0000","last_unstale":"2024-09-17T06:04:49.132538+0000","last_undegraded":"2024-09-17T06:04:49.132538+0000","last_fullsized":"2024-09-17T06:04:49.132538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:59.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.106115+0000","last_change":"2024-09-17T06:04:08.848046+0000","last_active":"2024-09-17T06:04:52.106115+0000","last_peered":"2024-09-17T06:04:52.106115+0000","last_clean":"2024-09-17T06:04:52.106115+0000","last_became_active":"2024-09-17T06:04:08.847664+0000","last_became_peered":"2024-09-17T06:04:08.847664+0000","last_unstale":"2024-09-17T06:04:52.106115+0000","last_undegraded":"2024-09-17T06:04:52.106115+0000","last_fullsized":"2024-09-17T06:04:52.106115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:12.579790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.766764+0000","last_change":"2024-09-17T06:04:07.841655+0000","last_active":"2024-09-17T06:04:51.766764+0000","last_peered":"2024-09-17T06:04:51.766764+0000","last_clean":"2024-09-17T06:04:51.766764+0000","last_became_active":"2024-09-17T06:04:07.840432+0000","last_became_peered":"2024-09-17T06:04:07.840432+0000","last_unstale":"2024-09-17T06:04:51.766764+0000","last_undegraded":"2024-09-17T06:04:51.766764+0000","last_fullsized":"2024-09-17T06:04:51.766764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:04.523110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764245+0000","last_change":"2024-09-17T06:04:12.955760+0000","last_active":"2024-09-17T06:04:51.764245+0000","last_peered":"2024-09-17T06:04:51.764245+0000","last_clean":"2024-09-17T06:04:51.764245+0000","last_became_active":"2024-09-17T06:04:12.954977+0000","last_became_peered":"2024-09-17T06:04:12.954977+0000","last_unstale":"2024-09-17T06:04:51.764245+0000","last_undegraded":"2024-09-17T06:04:51.764245+0000","last_fullsized":"2024-09-17T06:04:51.764245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:19.737903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.105665+0000","last_change":"2024-09-17T06:04:08.849143+0000","last_active":"2024-09-17T06:04:52.105665+0000","last_peered":"2024-09-17T06:04:52.105665+0000","last_clean":"2024-09-17T06:04:52.105665+0000","last_became_active":"2024-09-17T06:04:08.848740+0000","last_became_peered":"2024-09-17T06:04:08.848740+0000","last_unstale":"2024-09-17T06:04:52.105665+0000","last_undegraded":"2024-09-17T06:04:52.105665+0000","last_fullsized":"2024-09-17T06:04:52.105665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413212+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:04:52.413212+0000","last_peered":"2024-09-17T06:04:52.413212+0000","last_clean":"2024-09-17T06:04:52.413212+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:04:52.413212+0000","last_undegraded":"2024-09-17T06:04:52.413212+0000","last_fullsized":"2024-09-17T06:04:52.413212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764864+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:04:51.764864+0000","last_peered":"2024-09-17T06:04:51.764864+0000","last_clean":"2024-09-17T06:04:51.764864+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:04:51.764864+0000","last_undegraded":"2024-09-17T06:04:51.764864+0000","last_fullsized":"2024-09-17T06:04:51.764864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414775+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:04:52.414775+0000","last_peered":"2024-09-17T06:04:52.414775+0000","last_clean":"2024-09-17T06:04:52.414775+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:04:52.414775+0000","last_undegraded":"2024-09-17T06:04:52.414775+0000","last_fullsized":"2024-09-17T06:04:52.414775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414858+0000","last_change":"2024-09-17T06:04:07.849633+0000","last_active":"2024-09-17T06:04:52.414858+0000","last_peered":"2024-09-17T06:04:52.414858+0000","last_clean":"2024-09-17T06:04:52.414858+0000","last_became_active":"2024-09-17T06:04:07.848323+0000","last_became_peered":"2024-09-17T06:04:07.848323+0000","last_unstale":"2024-09-17T06:04:52.414858+0000","last_undegraded":"2024-09-17T06:04:52.414858+0000","last_fullsized":"2024-09-17T06:04:52.414858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414997+0000","last_change":"2024-09-17T06:04:13.036889+0000","last_active":"2024-09-17T06:04:52.414997+0000","last_peered":"2024-09-17T06:04:52.414997+0000","last_clean":"2024-09-17T06:04:52.414997+0000","last_became_active":"2024-09-17T06:04:13.035428+0000","last_became_peered":"2024-09-17T06:04:13.035428+0000","last_unstale":"2024-09-17T06:04:52.414997+0000","last_undegraded":"2024-09-17T06:04:52.414997+0000","last_fullsized":"2024-09-17T06:04:52.414997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:00.230691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.105547+0000","last_change":"2024-09-17T06:04:08.848113+0000","last_active":"2024-09-17T06:04:52.105547+0000","last_peered":"2024-09-17T06:04:52.105547+0000","last_clean":"2024-09-17T06:04:52.105547+0000","last_became_active":"2024-09-17T06:04:08.847695+0000","last_became_peered":"2024-09-17T06:04:08.847695+0000","last_unstale":"2024-09-17T06:04:52.105547+0000","last_undegraded":"2024-09-17T06:04:52.105547+0000","last_fullsized":"2024-09-17T06:04:52.105547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:21.258775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.134196+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:04:49.134196+0000","last_peered":"2024-09-17T06:04:49.134196+0000","last_clean":"2024-09-17T06:04:49.134196+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:04:49.134196+0000","last_undegraded":"2024-09-17T06:04:49.134196+0000","last_fullsized":"2024-09-17T06:04:49.134196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414214+0000","last_change":"2024-09-17T06:04:13.034560+0000","last_active":"2024-09-17T06:04:52.414214+0000","last_peered":"2024-09-17T06:04:52.414214+0000","last_clean":"2024-09-17T06:04:52.414214+0000","last_became_active":"2024-09-17T06:04:13.034023+0000","last_became_peered":"2024-09-17T06:04:13.034023+0000","last_unstale":"2024-09-17T06:04:52.414214+0000","last_undegraded":"2024-09-17T06:04:52.414214+0000","last_fullsized":"2024-09-17T06:04:52.414214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:04.549375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.765070+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:04:51.765070+0000","last_peered":"2024-09-17T06:04:51.765070+0000","last_clean":"2024-09-17T06:04:51.765070+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:04:51.765070+0000","last_undegraded":"2024-09-17T06:04:51.765070+0000","last_fullsized":"2024-09-17T06:04:51.765070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.765084+0000","last_change":"2024-09-17T06:04:07.837797+0000","last_active":"2024-09-17T06:04:51.765084+0000","last_peered":"2024-09-17T06:04:51.765084+0000","last_clean":"2024-09-17T06:04:51.765084+0000","last_became_active":"2024-09-17T06:04:07.837347+0000","last_became_peered":"2024-09-17T06:04:07.837347+0000","last_unstale":"2024-09-17T06:04:51.765084+0000","last_undegraded":"2024-09-17T06:04:51.765084+0000","last_fullsized":"2024-09-17T06:04:51.765084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.135183+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:04:49.135183+0000","last_peered":"2024-09-17T06:04:49.135183+0000","last_clean":"2024-09-17T06:04:49.135183+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:04:49.135183+0000","last_undegraded":"2024-09-17T06:04:49.135183+0000","last_fullsized":"2024-09-17T06:04:49.135183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.105433+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:04:52.105433+0000","last_peered":"2024-09-17T06:04:52.105433+0000","last_clean":"2024-09-17T06:04:52.105433+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:04:52.105433+0000","last_undegraded":"2024-09-17T06:04:52.105433+0000","last_fullsized":"2024-09-17T06:04:52.105433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'12","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.416034+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:04:52.416034+0000","last_peered":"2024-09-17T06:04:52.416034+0000","last_clean":"2024-09-17T06:04:52.416034+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:04:52.416034+0000","last_undegraded":"2024-09-17T06:04:52.416034+0000","last_fullsized":"2024-09-17T06:04:52.416034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413418+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:04:52.413418+0000","last_peered":"2024-09-17T06:04:52.413418+0000","last_clean":"2024-09-17T06:04:52.413418+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:04:52.413418+0000","last_undegraded":"2024-09-17T06:04:52.413418+0000","last_fullsized":"2024-09-17T06:04:52.413418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.766308+0000","last_change":"2024-09-17T06:04:08.842243+0000","last_active":"2024-09-17T06:04:51.766308+0000","last_peered":"2024-09-17T06:04:51.766308+0000","last_clean":"2024-09-17T06:04:51.766308+0000","last_became_active":"2024-09-17T06:04:08.841831+0000","last_became_peered":"2024-09-17T06:04:08.841831+0000","last_unstale":"2024-09-17T06:04:51.766308+0000","last_undegraded":"2024-09-17T06:04:51.766308+0000","last_fullsized":"2024-09-17T06:04:51.766308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:47.589819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413284+0000","last_change":"2024-09-17T06:04:07.852382+0000","last_active":"2024-09-17T06:04:52.413284+0000","last_peered":"2024-09-17T06:04:52.413284+0000","last_clean":"2024-09-17T06:04:52.413284+0000","last_became_active":"2024-09-17T06:04:07.851954+0000","last_became_peered":"2024-09-17T06:04:07.851954+0000","last_unstale":"2024-09-17T06:04:52.413284+0000","last_undegraded":"2024-09-17T06:04:52.413284+0000","last_fullsized":"2024-09-17T06:04:52.413284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.765864+0000","last_change":"2024-09-17T06:04:12.942425+0000","last_active":"2024-09-17T06:04:51.765864+0000","last_peered":"2024-09-17T06:04:51.765864+0000","last_clean":"2024-09-17T06:04:51.765864+0000","last_became_active":"2024-09-17T06:04:12.937463+0000","last_became_peered":"2024-09-17T06:04:12.937463+0000","last_unstale":"2024-09-17T06:04:51.765864+0000","last_undegraded":"2024-09-17T06:04:51.765864+0000","last_fullsized":"2024-09-17T06:04:51.765864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:21.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.765271+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:04:51.765271+0000","last_peered":"2024-09-17T06:04:51.765271+0000","last_clean":"2024-09-17T06:04:51.765271+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:04:51.765271+0000","last_undegraded":"2024-09-17T06:04:51.765271+0000","last_fullsized":"2024-09-17T06:04:51.765271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.134884+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:04:49.134884+0000","last_peered":"2024-09-17T06:04:49.134884+0000","last_clean":"2024-09-17T06:04:49.134884+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:04:49.134884+0000","last_undegraded":"2024-09-17T06:04:49.134884+0000","last_fullsized":"2024-09-17T06:04:49.134884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414742+0000","last_change":"2024-09-17T06:04:12.956822+0000","last_active":"2024-09-17T06:04:52.414742+0000","last_peered":"2024-09-17T06:04:52.414742+0000","last_clean":"2024-09-17T06:04:52.414742+0000","last_became_active":"2024-09-17T06:04:12.956349+0000","last_became_peered":"2024-09-17T06:04:12.956349+0000","last_unstale":"2024-09-17T06:04:52.414742+0000","last_undegraded":"2024-09-17T06:04:52.414742+0000","last_fullsized":"2024-09-17T06:04:52.414742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:56.435215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.134728+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:04:49.134728+0000","last_peered":"2024-09-17T06:04:49.134728+0000","last_clean":"2024-09-17T06:04:49.134728+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:04:49.134728+0000","last_undegraded":"2024-09-17T06:04:49.134728+0000","last_fullsized":"2024-09-17T06:04:49.134728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.416078+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:04:52.416078+0000","last_peered":"2024-09-17T06:04:52.416078+0000","last_clean":"2024-09-17T06:04:52.416078+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:04:52.416078+0000","last_undegraded":"2024-09-17T06:04:52.416078+0000","last_fullsized":"2024-09-17T06:04:52.416078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.416573+0000","last_change":"2024-09-17T06:04:13.043905+0000","last_active":"2024-09-17T06:04:52.416573+0000","last_peered":"2024-09-17T06:04:52.416573+0000","last_clean":"2024-09-17T06:04:52.416573+0000","last_became_active":"2024-09-17T06:04:13.041929+0000","last_became_peered":"2024-09-17T06:04:13.041929+0000","last_unstale":"2024-09-17T06:04:52.416573+0000","last_undegraded":"2024-09-17T06:04:52.416573+0000","last_fullsized":"2024-09-17T06:04:52.416573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:07.693245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764645+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:04:51.764645+0000","last_peered":"2024-09-17T06:04:51.764645+0000","last_clean":"2024-09-17T06:04:51.764645+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:04:51.764645+0000","last_undegraded":"2024-09-17T06:04:51.764645+0000","last_fullsized":"2024-09-17T06:04:51.764645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413019+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:04:52.413019+0000","last_peered":"2024-09-17T06:04:52.413019+0000","last_clean":"2024-09-17T06:04:52.413019+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:04:52.413019+0000","last_undegraded":"2024-09-17T06:04:52.413019+0000","last_fullsized":"2024-09-17T06:04:52.413019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.132808+0000","last_change":"2024-09-17T06:04:07.857398+0000","last_active":"2024-09-17T06:04:49.132808+0000","last_peered":"2024-09-17T06:04:49.132808+0000","last_clean":"2024-09-17T06:04:49.132808+0000","last_became_active":"2024-09-17T06:04:07.856866+0000","last_became_peered":"2024-09-17T06:04:07.856866+0000","last_unstale":"2024-09-17T06:04:49.132808+0000","last_undegraded":"2024-09-17T06:04:49.132808+0000","last_fullsized":"2024-09-17T06:04:49.132808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415577+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:04:52.415577+0000","last_peered":"2024-09-17T06:04:52.415577+0000","last_clean":"2024-09-17T06:04:52.415577+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:04:52.415577+0000","last_undegraded":"2024-09-17T06:04:52.415577+0000","last_fullsized":"2024-09-17T06:04:52.415577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415057+0000","last_change":"2024-09-17T06:04:08.850811+0000","last_active":"2024-09-17T06:04:52.415057+0000","last_peered":"2024-09-17T06:04:52.415057+0000","last_clean":"2024-09-17T06:04:52.415057+0000","last_became_active":"2024-09-17T06:04:08.847235+0000","last_became_peered":"2024-09-17T06:04:08.847235+0000","last_unstale":"2024-09-17T06:04:52.415057+0000","last_undegraded":"2024-09-17T06:04:52.415057+0000","last_fullsized":"2024-09-17T06:04:52.415057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:21.794733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.416656+0000","last_change":"2024-09-17T06:04:07.840224+0000","last_active":"2024-09-17T06:04:52.416656+0000","last_peered":"2024-09-17T06:04:52.416656+0000","last_clean":"2024-09-17T06:04:52.416656+0000","last_became_active":"2024-09-17T06:04:07.839703+0000","last_became_peered":"2024-09-17T06:04:07.839703+0000","last_unstale":"2024-09-17T06:04:52.416656+0000","last_undegraded":"2024-09-17T06:04:52.416656+0000","last_fullsized":"2024-09-17T06:04:52.416656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:01.141166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415247+0000","last_change":"2024-09-17T06:04:07.844255+0000","last_active":"2024-09-17T06:04:52.415247+0000","last_peered":"2024-09-17T06:04:52.415247+0000","last_clean":"2024-09-17T06:04:52.415247+0000","last_became_active":"2024-09-17T06:04:07.843380+0000","last_became_peered":"2024-09-17T06:04:07.843380+0000","last_unstale":"2024-09-17T06:04:52.415247+0000","last_undegraded":"2024-09-17T06:04:52.415247+0000","last_fullsized":"2024-09-17T06:04:52.415247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:28.720792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.765069+0000","last_change":"2024-09-17T06:04:08.837656+0000","last_active":"2024-09-17T06:04:51.765069+0000","last_peered":"2024-09-17T06:04:51.765069+0000","last_clean":"2024-09-17T06:04:51.765069+0000","last_became_active":"2024-09-17T06:04:08.837157+0000","last_became_peered":"2024-09-17T06:04:08.837157+0000","last_unstale":"2024-09-17T06:04:51.765069+0000","last_undegraded":"2024-09-17T06:04:51.765069+0000","last_fullsized":"2024-09-17T06:04:51.765069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415095+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:04:52.415095+0000","last_peered":"2024-09-17T06:04:52.415095+0000","last_clean":"2024-09-17T06:04:52.415095+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:04:52.415095+0000","last_undegraded":"2024-09-17T06:04:52.415095+0000","last_fullsized":"2024-09-17T06:04:52.415095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413846+0000","last_change":"2024-09-17T06:04:07.848422+0000","last_active":"2024-09-17T06:04:52.413846+0000","last_peered":"2024-09-17T06:04:52.413846+0000","last_clean":"2024-09-17T06:04:52.413846+0000","last_became_active":"2024-09-17T06:04:07.847917+0000","last_became_peered":"2024-09-17T06:04:07.847917+0000","last_unstale":"2024-09-17T06:04:52.413846+0000","last_undegraded":"2024-09-17T06:04:52.413846+0000","last_fullsized":"2024-09-17T06:04:52.413846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:04.960985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.765426+0000","last_change":"2024-09-17T06:04:08.831009+0000","last_active":"2024-09-17T06:04:51.765426+0000","last_peered":"2024-09-17T06:04:51.765426+0000","last_clean":"2024-09-17T06:04:51.765426+0000","last_became_active":"2024-09-17T06:04:08.830578+0000","last_became_peered":"2024-09-17T06:04:08.830578+0000","last_unstale":"2024-09-17T06:04:51.765426+0000","last_undegraded":"2024-09-17T06:04:51.765426+0000","last_fullsized":"2024-09-17T06:04:51.765426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:21.761554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414771+0000","last_change":"2024-09-17T06:04:49.136091+0000","last_active":"2024-09-17T06:04:52.414771+0000","last_peered":"2024-09-17T06:04:52.414771+0000","last_clean":"2024-09-17T06:04:52.414771+0000","last_became_active":"2024-09-17T06:04:49.135411+0000","last_became_peered":"2024-09-17T06:04:49.135411+0000","last_unstale":"2024-09-17T06:04:52.414771+0000","last_undegraded":"2024-09-17T06:04:52.414771+0000","last_fullsized":"2024-09-17T06:04:52.414771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:57.212238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414662+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:04:52.414662+0000","last_peered":"2024-09-17T06:04:52.414662+0000","last_clean":"2024-09-17T06:04:52.414662+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:04:52.414662+0000","last_undegraded":"2024-09-17T06:04:52.414662+0000","last_fullsized":"2024-09-17T06:04:52.414662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414816+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:04:52.414816+0000","last_peered":"2024-09-17T06:04:52.414816+0000","last_clean":"2024-09-17T06:04:52.414816+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:04:52.414816+0000","last_undegraded":"2024-09-17T06:04:52.414816+0000","last_fullsized":"2024-09-17T06:04:52.414816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.131265+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:04:49.131265+0000","last_peered":"2024-09-17T06:04:49.131265+0000","last_clean":"2024-09-17T06:04:49.131265+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:04:49.131265+0000","last_undegraded":"2024-09-17T06:04:49.131265+0000","last_fullsized":"2024-09-17T06:04:49.131265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764885+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:04:51.764885+0000","last_peered":"2024-09-17T06:04:51.764885+0000","last_clean":"2024-09-17T06:04:51.764885+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:04:51.764885+0000","last_undegraded":"2024-09-17T06:04:51.764885+0000","last_fullsized":"2024-09-17T06:04:51.764885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414645+0000","last_change":"2024-09-17T06:04:08.853837+0000","last_active":"2024-09-17T06:04:52.414645+0000","last_peered":"2024-09-17T06:04:52.414645+0000","last_clean":"2024-09-17T06:04:52.414645+0000","last_became_active":"2024-09-17T06:04:08.847311+0000","last_became_peered":"2024-09-17T06:04:08.847311+0000","last_unstale":"2024-09-17T06:04:52.414645+0000","last_undegraded":"2024-09-17T06:04:52.414645+0000","last_fullsized":"2024-09-17T06:04:52.414645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:39.705332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413154+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:04:52.413154+0000","last_peered":"2024-09-17T06:04:52.413154+0000","last_clean":"2024-09-17T06:04:52.413154+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:04:52.413154+0000","last_undegraded":"2024-09-17T06:04:52.413154+0000","last_fullsized":"2024-09-17T06:04:52.413154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.416691+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:04:52.416691+0000","last_peered":"2024-09-17T06:04:52.416691+0000","last_clean":"2024-09-17T06:04:52.416691+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:04:52.416691+0000","last_undegraded":"2024-09-17T06:04:52.416691+0000","last_fullsized":"2024-09-17T06:04:52.416691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415163+0000","last_change":"2024-09-17T06:04:08.847264+0000","last_active":"2024-09-17T06:04:52.415163+0000","last_peered":"2024-09-17T06:04:52.415163+0000","last_clean":"2024-09-17T06:04:52.415163+0000","last_became_active":"2024-09-17T06:04:08.846741+0000","last_became_peered":"2024-09-17T06:04:08.846741+0000","last_unstale":"2024-09-17T06:04:52.415163+0000","last_undegraded":"2024-09-17T06:04:52.415163+0000","last_fullsized":"2024-09-17T06:04:52.415163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413043+0000","last_change":"2024-09-17T06:04:49.310980+0000","last_active":"2024-09-17T06:04:52.413043+0000","last_peered":"2024-09-17T06:04:52.413043+0000","last_clean":"2024-09-17T06:04:52.413043+0000","last_became_active":"2024-09-17T06:04:49.309178+0000","last_became_peered":"2024-09-17T06:04:49.309178+0000","last_unstale":"2024-09-17T06:04:52.413043+0000","last_undegraded":"2024-09-17T06:04:52.413043+0000","last_fullsized":"2024-09-17T06:04:52.413043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:17.741267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.416413+0000","last_change":"2024-09-17T06:04:08.851245+0000","last_active":"2024-09-17T06:04:52.416413+0000","last_peered":"2024-09-17T06:04:52.416413+0000","last_clean":"2024-09-17T06:04:52.416413+0000","last_became_active":"2024-09-17T06:04:08.847488+0000","last_became_peered":"2024-09-17T06:04:08.847488+0000","last_unstale":"2024-09-17T06:04:52.416413+0000","last_undegraded":"2024-09-17T06:04:52.416413+0000","last_fullsized":"2024-09-17T06:04:52.416413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.134196+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:04:49.134196+0000","last_peered":"2024-09-17T06:04:49.134196+0000","last_clean":"2024-09-17T06:04:49.134196+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:04:49.134196+0000","last_undegraded":"2024-09-17T06:04:49.134196+0000","last_fullsized":"2024-09-17T06:04:49.134196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764474+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:04:51.764474+0000","last_peered":"2024-09-17T06:04:51.764474+0000","last_clean":"2024-09-17T06:04:51.764474+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:04:51.764474+0000","last_undegraded":"2024-09-17T06:04:51.764474+0000","last_fullsized":"2024-09-17T06:04:51.764474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415950+0000","last_change":"2024-09-17T06:04:08.847877+0000","last_active":"2024-09-17T06:04:52.415950+0000","last_peered":"2024-09-17T06:04:52.415950+0000","last_clean":"2024-09-17T06:04:52.415950+0000","last_became_active":"2024-09-17T06:04:08.847538+0000","last_became_peered":"2024-09-17T06:04:08.847538+0000","last_unstale":"2024-09-17T06:04:52.415950+0000","last_undegraded":"2024-09-17T06:04:52.415950+0000","last_fullsized":"2024-09-17T06:04:52.415950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.105572+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:04:52.105572+0000","last_peered":"2024-09-17T06:04:52.105572+0000","last_clean":"2024-09-17T06:04:52.105572+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:04:52.105572+0000","last_undegraded":"2024-09-17T06:04:52.105572+0000","last_fullsized":"2024-09-17T06:04:52.105572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.415915+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:04:52.415915+0000","last_peered":"2024-09-17T06:04:52.415915+0000","last_clean":"2024-09-17T06:04:52.415915+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:04:52.415915+0000","last_undegraded":"2024-09-17T06:04:52.415915+0000","last_fullsized":"2024-09-17T06:04:52.415915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.135325+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:04:49.135325+0000","last_peered":"2024-09-17T06:04:49.135325+0000","last_clean":"2024-09-17T06:04:49.135325+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:04:49.135325+0000","last_undegraded":"2024-09-17T06:04:49.135325+0000","last_fullsized":"2024-09-17T06:04:49.135325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.132610+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:04:49.132610+0000","last_peered":"2024-09-17T06:04:49.132610+0000","last_clean":"2024-09-17T06:04:49.132610+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:04:49.132610+0000","last_undegraded":"2024-09-17T06:04:49.132610+0000","last_fullsized":"2024-09-17T06:04:49.132610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413161+0000","last_change":"2024-09-17T06:04:08.824718+0000","last_active":"2024-09-17T06:04:52.413161+0000","last_peered":"2024-09-17T06:04:52.413161+0000","last_clean":"2024-09-17T06:04:52.413161+0000","last_became_active":"2024-09-17T06:04:08.823771+0000","last_became_peered":"2024-09-17T06:04:08.823771+0000","last_unstale":"2024-09-17T06:04:52.413161+0000","last_undegraded":"2024-09-17T06:04:52.413161+0000","last_fullsized":"2024-09-17T06:04:52.413161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:53.735092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764945+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:04:51.764945+0000","last_peered":"2024-09-17T06:04:51.764945+0000","last_clean":"2024-09-17T06:04:51.764945+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:04:51.764945+0000","last_undegraded":"2024-09-17T06:04:51.764945+0000","last_fullsized":"2024-09-17T06:04:51.764945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413595+0000","last_change":"2024-09-17T06:04:08.850255+0000","last_active":"2024-09-17T06:04:52.413595+0000","last_peered":"2024-09-17T06:04:52.413595+0000","last_clean":"2024-09-17T06:04:52.413595+0000","last_became_active":"2024-09-17T06:04:08.847637+0000","last_became_peered":"2024-09-17T06:04:08.847637+0000","last_unstale":"2024-09-17T06:04:52.413595+0000","last_undegraded":"2024-09-17T06:04:52.413595+0000","last_fullsized":"2024-09-17T06:04:52.413595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.766301+0000","last_change":"2024-09-17T06:04:08.845829+0000","last_active":"2024-09-17T06:04:51.766301+0000","last_peered":"2024-09-17T06:04:51.766301+0000","last_clean":"2024-09-17T06:04:51.766301+0000","last_became_active":"2024-09-17T06:04:08.845441+0000","last_became_peered":"2024-09-17T06:04:08.845441+0000","last_unstale":"2024-09-17T06:04:51.766301+0000","last_undegraded":"2024-09-17T06:04:51.766301+0000","last_fullsized":"2024-09-17T06:04:51.766301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:38.878124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.416870+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:04:52.416870+0000","last_peered":"2024-09-17T06:04:52.416870+0000","last_clean":"2024-09-17T06:04:52.416870+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:04:52.416870+0000","last_undegraded":"2024-09-17T06:04:52.416870+0000","last_fullsized":"2024-09-17T06:04:52.416870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.416438+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:04:52.416438+0000","last_peered":"2024-09-17T06:04:52.416438+0000","last_clean":"2024-09-17T06:04:52.416438+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:04:52.416438+0000","last_undegraded":"2024-09-17T06:04:52.416438+0000","last_fullsized":"2024-09-17T06:04:52.416438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.106444+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:04:52.106444+0000","last_peered":"2024-09-17T06:04:52.106444+0000","last_clean":"2024-09-17T06:04:52.106444+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:04:52.106444+0000","last_undegraded":"2024-09-17T06:04:52.106444+0000","last_fullsized":"2024-09-17T06:04:52.106444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.414404+0000","last_change":"2024-09-17T06:04:08.853473+0000","last_active":"2024-09-17T06:04:52.414404+0000","last_peered":"2024-09-17T06:04:52.414404+0000","last_clean":"2024-09-17T06:04:52.414404+0000","last_became_active":"2024-09-17T06:04:08.851946+0000","last_became_peered":"2024-09-17T06:04:08.851946+0000","last_unstale":"2024-09-17T06:04:52.414404+0000","last_undegraded":"2024-09-17T06:04:52.414404+0000","last_fullsized":"2024-09-17T06:04:52.414404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.105223+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:04:52.105223+0000","last_peered":"2024-09-17T06:04:52.105223+0000","last_clean":"2024-09-17T06:04:52.105223+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:04:52.105223+0000","last_undegraded":"2024-09-17T06:04:52.105223+0000","last_fullsized":"2024-09-17T06:04:52.105223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.133809+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:04:49.133809+0000","last_peered":"2024-09-17T06:04:49.133809+0000","last_clean":"2024-09-17T06:04:49.133809+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:04:49.133809+0000","last_undegraded":"2024-09-17T06:04:49.133809+0000","last_fullsized":"2024-09-17T06:04:49.133809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.105096+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:04:52.105096+0000","last_peered":"2024-09-17T06:04:52.105096+0000","last_clean":"2024-09-17T06:04:52.105096+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:04:52.105096+0000","last_undegraded":"2024-09-17T06:04:52.105096+0000","last_fullsized":"2024-09-17T06:04:52.105096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T06:04:49.131520+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:04:49.131520+0000","last_peered":"2024-09-17T06:04:49.131520+0000","last_clean":"2024-09-17T06:04:49.131520+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:04:49.131520+0000","last_undegraded":"2024-09-17T06:04:49.131520+0000","last_fullsized":"2024-09-17T06:04:49.131520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:51.764883+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:04:51.764883+0000","last_peered":"2024-09-17T06:04:51.764883+0000","last_clean":"2024-09-17T06:04:51.764883+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:04:51.764883+0000","last_undegraded":"2024-09-17T06:04:51.764883+0000","last_fullsized":"2024-09-17T06:04:51.764883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.413904+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:04:52.413904+0000","last_peered":"2024-09-17T06:04:52.413904+0000","last_clean":"2024-09-17T06:04:52.413904+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:04:52.413904+0000","last_undegraded":"2024-09-17T06:04:52.413904+0000","last_fullsized":"2024-09-17T06:04:52.413904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T06:04:52.106328+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:04:52.106328+0000","last_peered":"2024-09-17T06:04:52.106328+0000","last_clean":"2024-09-17T06:04:52.106328+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:04:52.106328+0000","last_undegraded":"2024-09-17T06:04:52.106328+0000","last_fullsized":"2024-09-17T06:04:52.106328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7097,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":311296,"data_stored":126320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":120021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":913408,"data_stored":717970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":905216,"data_stored":717914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":133263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":307200,"data_stored":120147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":127124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":120111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:04:53.644 INFO:tasks.thrashosds.thrasher:Setting 4.19 to [6, 5, 0, 4] 2024-09-17T06:04:53.644 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.19', '6', '5', '0', '4'] 2024-09-17T06:04:53.644 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.19 6 5 0 4 2024-09-17T06:04:53.728 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:53.726+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:53.733 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:53.733 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:53.751 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:04:53.789 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T06:04:53.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.826+0000 7f2978492640 1 -- 172.21.15.122:0/3617499347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f295c004810 msgr2=0x7f295c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.826+0000 7f2978492640 1 --2- 172.21.15.122:0/3617499347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f295c004810 0x7f295c004c20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f29600016c0 tx=0x7f296001c790 comp rx=0 tx=0).stop 2024-09-17T06:04:53.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.826+0000 7f2976a2f640 1 -- 172.21.15.122:0/3617499347 reap_dead start 2024-09-17T06:04:53.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.826+0000 7f2978492640 1 -- 172.21.15.122:0/3617499347 shutdown_connections 2024-09-17T06:04:53.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.826+0000 7f2978492640 1 -- 172.21.15.122:0/3617499347 >> 172.21.15.122:0/3617499347 conn(0x7f2970070e40 msgr2=0x7f2970071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:53.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.826+0000 7f2978492640 1 -- 172.21.15.122:0/3617499347 shutdown_connections 2024-09-17T06:04:53.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.826+0000 7f2978492640 1 -- 172.21.15.122:0/3617499347 wait complete. 2024-09-17T06:04:53.831 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:53.826+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:53.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.826+0000 7f2978492640 1 Processor -- start 2024-09-17T06:04:53.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.826+0000 7f2978492640 1 -- start start 2024-09-17T06:04:53.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2978492640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f295c004810 0x7f2970150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:53.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2978492640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2970157500 0x7f29701e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:53.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2978492640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2970158e10 0x7f29701470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:53.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2978492640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f29700cb860 con 0x7f2970158e10 2024-09-17T06:04:53.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2978492640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2970159c40 con 0x7f2970157500 2024-09-17T06:04:53.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2978492640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f297015a160 con 0x7f295c004810 2024-09-17T06:04:53.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2976a2f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2970158e10 0x7f29701470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:53.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2976a2f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2970158e10 0x7f29701470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35186/0 (socket says 172.21.15.122:35186) 2024-09-17T06:04:53.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2976a2f640 1 -- 172.21.15.122:0/2354985062 learned_addr learned my addr 172.21.15.122:0/2354985062 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:53.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2975a2d640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2970157500 0x7f29701e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:53.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f297622e640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f295c004810 0x7f2970150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:53.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2976a2f640 1 -- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f295c004810 msgr2=0x7f2970150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2976a2f640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f295c004810 0x7f2970150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2976a2f640 1 -- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2970157500 msgr2=0x7f29701e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2976a2f640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2970157500 0x7f29701e3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2976a2f640 1 -- 172.21.15.122:0/2354985062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29701e4610 con 0x7f2970158e10 2024-09-17T06:04:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2975a2d640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2970157500 0x7f29701e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:04:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2976a2f640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2970158e10 0x7f29701470b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2968001340 tx=0x7f2968010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2966ffd640 1 -- 172.21.15.122:0/2354985062 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296800edc0 con 0x7f2970158e10 2024-09-17T06:04:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2978492640 1 -- 172.21.15.122:0/2354985062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2970158970 con 0x7f2970158e10 2024-09-17T06:04:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2966ffd640 1 -- 172.21.15.122:0/2354985062 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2968013570 con 0x7f2970158e10 2024-09-17T06:04:53.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2966ffd640 1 -- 172.21.15.122:0/2354985062 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2968013940 con 0x7f2970158e10 2024-09-17T06:04:53.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2978492640 1 -- 172.21.15.122:0/2354985062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29701f5100 con 0x7f2970158e10 2024-09-17T06:04:53.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.830+0000 7f2978492640 1 -- 172.21.15.122:0/2354985062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29701f4c10 con 0x7f2970158e10 2024-09-17T06:04:53.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.834+0000 7f2966ffd640 1 -- 172.21.15.122:0/2354985062 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2968013ae0 con 0x7f2970158e10 2024-09-17T06:04:53.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.834+0000 7f2966ffd640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2954073230 0x7f2954075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:53.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.834+0000 7f2966ffd640 1 -- 172.21.15.122:0/2354985062 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6743+0+0 (secure 0 0 0) 0x7f2968098570 con 0x7f2970158e10 2024-09-17T06:04:53.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.834+0000 7f297622e640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2954073230 0x7f2954075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:53.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.834+0000 7f297622e640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2954073230 0x7f2954075740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f296c009ab0 tx=0x7f296c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:53.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.838+0000 7f2966ffd640 1 -- 172.21.15.122:0/2354985062 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2968063100 con 0x7f2970158e10 2024-09-17T06:04:53.927 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:53.923+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:53.940 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:53.940 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:53.957 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:04:53.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 -- 172.21.15.122:0/3213040722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860142640 msgr2=0x7fb86006f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 --2- 172.21.15.122:0/3213040722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860142640 0x7fb86006f750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb850009840 tx=0x7fb85001f010 comp rx=0 tx=0).stop 2024-09-17T06:04:53.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 -- 172.21.15.122:0/3213040722 shutdown_connections 2024-09-17T06:04:53.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 --2- 172.21.15.122:0/3213040722 >> v2:172.21.15.173:3300/0 conn(0x7fb86006fc90 0x7fb86006d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 --2- 172.21.15.122:0/3213040722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860142640 0x7fb86006f750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 -- 172.21.15.122:0/3213040722 >> 172.21.15.122:0/3213040722 conn(0x7fb8600ca380 msgr2=0x7fb8600ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:53.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 -- 172.21.15.122:0/3213040722 shutdown_connections 2024-09-17T06:04:53.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 -- 172.21.15.122:0/3213040722 wait complete. 2024-09-17T06:04:53.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 Processor -- start 2024-09-17T06:04:53.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 -- start start 2024-09-17T06:04:53.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb86006fc90 0x7fb8601e0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:53.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860142640 0x7fb8601f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:53.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb860159240 0x7fb860139fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:53.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb86006dca0 con 0x7fb86006fc90 2024-09-17T06:04:53.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb86015a000 con 0x7fb860159240 2024-09-17T06:04:53.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb867405640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb86006de20 con 0x7fb860142640 2024-09-17T06:04:53.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.958+0000 7fb8651a1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb86006fc90 0x7fb8601e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:53.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb8651a1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb86006fc90 0x7fb8601e0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:35196/0 (socket says 172.21.15.122:35196) 2024-09-17T06:04:53.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb8651a1640 1 -- 172.21.15.122:0/4043469118 learned_addr learned my addr 172.21.15.122:0/4043469118 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:53.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb8659a2640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb860159240 0x7fb860139fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:53.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb8649a0640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860142640 0x7fb8601f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:53.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb8651a1640 1 -- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860142640 msgr2=0x7fb8601f37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb8651a1640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860142640 0x7fb8601f37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb8651a1640 1 -- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb860159240 msgr2=0x7fb860139fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:53.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb8651a1640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb860159240 0x7fb860139fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:53.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb8651a1640 1 -- 172.21.15.122:0/4043469118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb860156990 con 0x7fb86006fc90 2024-09-17T06:04:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb8651a1640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb86006fc90 0x7fb8601e0110 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00c3f0 tx=0x7fb85c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb855ffb640 1 -- 172.21.15.122:0/4043469118 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c017070 con 0x7fb86006fc90 2024-09-17T06:04:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb855ffb640 1 -- 172.21.15.122:0/4043469118 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb85c0053c0 con 0x7fb86006fc90 2024-09-17T06:04:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb867405640 1 -- 172.21.15.122:0/4043469118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8601df9a0 con 0x7fb86006fc90 2024-09-17T06:04:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb855ffb640 1 -- 172.21.15.122:0/4043469118 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c003860 con 0x7fb86006fc90 2024-09-17T06:04:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb867405640 1 -- 172.21.15.122:0/4043469118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8601e4320 con 0x7fb86006fc90 2024-09-17T06:04:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb867405640 1 -- 172.21.15.122:0/4043469118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8601f44f0 con 0x7fb86006fc90 2024-09-17T06:04:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb855ffb640 1 -- 172.21.15.122:0/4043469118 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb85c01a070 con 0x7fb86006fc90 2024-09-17T06:04:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb855ffb640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb844073200 0x7fb844075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb855ffb640 1 -- 172.21.15.122:0/4043469118 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6743+0+0 (secure 0 0 0) 0x7fb85c093c30 con 0x7fb86006fc90 2024-09-17T06:04:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.962+0000 7fb8649a0640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb844073200 0x7fb844075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:53.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.966+0000 7fb8649a0640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb844073200 0x7fb844075710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb8500b2000 tx=0x7fb85001d850 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:53.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:53.970+0000 7fb855ffb640 1 -- 172.21.15.122:0/4043469118 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb8601f44f0 con 0x7fb86006fc90 2024-09-17T06:04:54.029 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:04:54.026+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:04:54.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.046+0000 7f2978492640 1 -- 172.21.15.122:0/2354985062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pg-upmap", "pgid": "4.19", "id": [6, 5, 0, 4]} v 0) -- 0x7f29700c9df0 con 0x7f2970158e10 2024-09-17T06:04:54.093 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:54.093 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:54.109 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:04:54.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.142+0000 7fb867405640 1 -- 172.21.15.122:0/4043469118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7fb86006e2c0 con 0x7fb86006fc90 2024-09-17T06:04:54.146 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:54.142+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:54.230 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:54.226+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:54.286 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:54.286 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:54.302 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:04:54.330 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:54.327+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:54.433 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:54.430+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:54.485 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:54.486 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:54.501 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T06:04:54.545 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:54.543+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:54.635 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:54.630+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:54.657 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:04:54.657 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:54.658 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:54.674 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T06:04:54.769 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:54.767+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:54.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.778+0000 7f2966ffd640 1 -- 172.21.15.122:0/2354985062 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pg-upmap", "pgid": "4.19", "id": [6, 5, 0, 4]}]=0 set 4.19 pg_upmap mapping to [6,5,0,4] v30) ==== 134+0+0 (secure 0 0 0) 0x7f2968062a00 con 0x7f2970158e10 2024-09-17T06:04:54.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.778+0000 7fb855ffb640 1 -- 172.21.15.122:0/4043469118 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v30) ==== 91+0+0 (secure 0 0 0) 0x7fb85c021020 con 0x7fb86006fc90 2024-09-17T06:04:54.784 INFO:teuthology.orchestra.run.smithi122.stderr:noscrub is unset 2024-09-17T06:04:54.784 INFO:teuthology.orchestra.run.smithi122.stderr:set 4.19 pg_upmap mapping to [6,5,0,4] 2024-09-17T06:04:54.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.782+0000 7f2978492640 1 -- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2954073230 msgr2=0x7f2954075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.782+0000 7f2978492640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2954073230 0x7f2954075740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f296c009ab0 tx=0x7f296c0091e0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.782+0000 7f2978492640 1 -- 172.21.15.122:0/2354985062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2970158e10 msgr2=0x7f29701470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.782+0000 7f2978492640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2970158e10 0x7f29701470b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2968001340 tx=0x7f2968010ef0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.782+0000 7f2978492640 1 -- 172.21.15.122:0/2354985062 shutdown_connections 2024-09-17T06:04:54.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.782+0000 7f2978492640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2970158e10 0x7f29701470b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.782+0000 7f2978492640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2954073230 0x7f2954075740 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.782+0000 7f2978492640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2970157500 0x7f29701e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.782+0000 7f2978492640 1 --2- 172.21.15.122:0/2354985062 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f295c004810 0x7f2970150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.782+0000 7f2978492640 1 -- 172.21.15.122:0/2354985062 >> 172.21.15.122:0/2354985062 conn(0x7f2970070e40 msgr2=0x7f29700caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:54.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.782+0000 7f2978492640 1 -- 172.21.15.122:0/2354985062 shutdown_connections 2024-09-17T06:04:54.787 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.782+0000 7f2978492640 1 -- 172.21.15.122:0/2354985062 wait complete. 2024-09-17T06:04:54.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.786+0000 7fb867405640 1 -- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb844073200 msgr2=0x7fb844075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.786+0000 7fb867405640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb844073200 0x7fb844075710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb8500b2000 tx=0x7fb85001d850 comp rx=0 tx=0).stop 2024-09-17T06:04:54.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.786+0000 7fb867405640 1 -- 172.21.15.122:0/4043469118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb86006fc90 msgr2=0x7fb8601e0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.786+0000 7fb867405640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb86006fc90 0x7fb8601e0110 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00c3f0 tx=0x7fb85c00c8b0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.786+0000 7fb867405640 1 -- 172.21.15.122:0/4043469118 shutdown_connections 2024-09-17T06:04:54.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.786+0000 7fb867405640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb844073200 0x7fb844075710 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.786+0000 7fb867405640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb860159240 0x7fb860139fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.786+0000 7fb867405640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860142640 0x7fb8601f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.786+0000 7fb867405640 1 --2- 172.21.15.122:0/4043469118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb86006fc90 0x7fb8601e0110 secure :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00c3f0 tx=0x7fb85c00c8b0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.786+0000 7fb867405640 1 -- 172.21.15.122:0/4043469118 >> 172.21.15.122:0/4043469118 conn(0x7fb8600ca380 msgr2=0x7fb8600c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:54.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.786+0000 7fb867405640 1 -- 172.21.15.122:0/4043469118 shutdown_connections 2024-09-17T06:04:54.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.786+0000 7fb867405640 1 -- 172.21.15.122:0/4043469118 wait complete. 2024-09-17T06:04:54.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.814+0000 7fb7d9d35640 1 -- 172.21.15.122:0/3450282128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7d40c2a60 msgr2=0x7fb7d4154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.814+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/3450282128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7d40c2a60 0x7fb7d4154c80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009840 tx=0x7fb7c801c820 comp rx=0 tx=0).stop 2024-09-17T06:04:54.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.814+0000 7fb7d9d35640 1 -- 172.21.15.122:0/3450282128 shutdown_connections 2024-09-17T06:04:54.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.814+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/3450282128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7d40c2a60 0x7fb7d4154c80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.814+0000 7fb7d9d35640 1 -- 172.21.15.122:0/3450282128 >> 172.21.15.122:0/3450282128 conn(0x7fb7d406ce90 msgr2=0x7fb7d406d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:54.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.814+0000 7fb7d9d35640 1 -- 172.21.15.122:0/3450282128 shutdown_connections 2024-09-17T06:04:54.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.814+0000 7fb7d9d35640 1 -- 172.21.15.122:0/3450282128 wait complete. 2024-09-17T06:04:54.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d9d35640 1 Processor -- start 2024-09-17T06:04:54.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d9d35640 1 -- start start 2024-09-17T06:04:54.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d9d35640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40713e0 0x7fb7d41f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:54.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d9d35640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7d40c2080 0x7fb7d40c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:54.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d9d35640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7d40c2a60 0x7fb7d4151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:54.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d9d35640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d4073270 con 0x7fb7d40c2a60 2024-09-17T06:04:54.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d9d35640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d4071c00 con 0x7fb7d40713e0 2024-09-17T06:04:54.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d9d35640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d41551c0 con 0x7fb7d40c2080 2024-09-17T06:04:54.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7d40c2a60 0x7fb7d4151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:54.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7d40c2a60 0x7fb7d4151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54748/0 (socket says 172.21.15.122:54748) 2024-09-17T06:04:54.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d3fff640 1 -- 172.21.15.122:0/4075429558 learned_addr learned my addr 172.21.15.122:0/4075429558 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:54.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d2ffd640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7d40c2080 0x7fb7d40c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:54.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d37fe640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40713e0 0x7fb7d41f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:54.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d3fff640 1 -- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7d40c2080 msgr2=0x7fb7d40c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d3fff640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7d40c2080 0x7fb7d40c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d3fff640 1 -- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40713e0 msgr2=0x7fb7d41f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d3fff640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40713e0 0x7fb7d41f6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d3fff640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d4150140 con 0x7fb7d40c2a60 2024-09-17T06:04:54.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d37fe640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7d40713e0 0x7fb7d41f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:04:54.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d3fff640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7d40c2a60 0x7fb7d4151c70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00ca80 tx=0x7fb7cc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:54.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc016020 con 0x7fb7d40c2a60 2024-09-17T06:04:54.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7cc00a950 con 0x7fb7d40c2a60 2024-09-17T06:04:54.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d41f71d0 con 0x7fb7d40c2a60 2024-09-17T06:04:54.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc00ade0 con 0x7fb7d40c2a60 2024-09-17T06:04:54.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d4149560 con 0x7fb7d40c2a60 2024-09-17T06:04:54.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.818+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fb7d41f73a0 con 0x7fb7d40c2a60 2024-09-17T06:04:54.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.822+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb7cc019020 con 0x7fb7d40c2a60 2024-09-17T06:04:54.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.822+0000 7fb7bbfff640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb7c0073200 0x7fb7c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:54.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.822+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6780+0+0 (secure 0 0 0) 0x7fb7cc094410 con 0x7fb7d40c2a60 2024-09-17T06:04:54.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.822+0000 7fb7d37fe640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb7c0073200 0x7fb7c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:54.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.822+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v30) ==== 54+0+16 (secure 0 0 0) 0x7fb7d41f73a0 con 0x7fb7d40c2a60 2024-09-17T06:04:54.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.822+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fb7d41521b0 0x7fb7d41488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:54.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.822+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7d40cc590 con 0x7fb7d41521b0 2024-09-17T06:04:54.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.822+0000 7fb7d2ffd640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fb7d41521b0 0x7fb7d41488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:54.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.822+0000 7fb7d37fe640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb7c0073200 0x7fb7c0075710 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80af000 tx=0x7fb7c801b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:54.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.822+0000 7fb7d2ffd640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fb7d41521b0 0x7fb7d41488a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:54.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.822+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7d40cc590 con 0x7fb7d41521b0 2024-09-17T06:04:54.836 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:54.834+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:54.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.838+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb7d40cc2b0 con 0x7fb7d41521b0 2024-09-17T06:04:54.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.842+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb7d40cc2b0 con 0x7fb7d41521b0 2024-09-17T06:04:54.844 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:04:54.844 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:04:54.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.842+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fb7d41440d0 0x7fb7d414b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.842+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fb7d4069aa0 con 0x7fb7d41440d0 2024-09-17T06:04:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.842+0000 7fb7d37fe640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fb7d41440d0 0x7fb7d414b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.842+0000 7fb7d37fe640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fb7d41440d0 0x7fb7d414b9f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:54.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.842+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7d4069aa0 con 0x7fb7d41440d0 2024-09-17T06:04:54.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.854+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb7d41f6800 con 0x7fb7d41440d0 2024-09-17T06:04:54.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.858+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb7d41f6800 con 0x7fb7d41440d0 2024-09-17T06:04:54.860 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:04:54.861 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:04:54.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.858+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fb7d414c440 0x7fb7d40638b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:54.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.858+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fb7d40c93b0 con 0x7fb7d414c440 2024-09-17T06:04:54.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.858+0000 7fb7d2ffd640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fb7d414c440 0x7fb7d40638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:54.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.858+0000 7fb7d2ffd640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fb7d414c440 0x7fb7d40638b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:54.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.858+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7d40c93b0 con 0x7fb7d414c440 2024-09-17T06:04:54.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.870+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb7d414c850 con 0x7fb7d414c440 2024-09-17T06:04:54.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.874+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb7d414c850 con 0x7fb7d414c440 2024-09-17T06:04:54.877 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:04:54.878 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:04:54.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.874+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fb7d41498d0 0x7fb7d4149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:54.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.874+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fb7d40646c0 con 0x7fb7d41498d0 2024-09-17T06:04:54.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.874+0000 7fb7d3fff640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fb7d41498d0 0x7fb7d4149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:54.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.874+0000 7fb7d3fff640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fb7d41498d0 0x7fb7d4149ce0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:54.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.874+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7d40646c0 con 0x7fb7d41498d0 2024-09-17T06:04:54.879 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:54.879 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:54.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.886+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb7d414a4f0 con 0x7fb7d41498d0 2024-09-17T06:04:54.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.890+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb7d414a4f0 con 0x7fb7d41498d0 2024-09-17T06:04:54.893 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:04:54.894 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:04:54.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.890+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fb7d402d4d0 0x7fb7d402d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:54.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.890+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fb7d402de20 con 0x7fb7d402d4d0 2024-09-17T06:04:54.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.890+0000 7fb7d37fe640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fb7d402d4d0 0x7fb7d402d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:54.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.890+0000 7fb7d37fe640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fb7d402d4d0 0x7fb7d402d8e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:54.897 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T06:04:54.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.894+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7d402de20 con 0x7fb7d402d4d0 2024-09-17T06:04:54.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.906+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb7d402de20 con 0x7fb7d402d4d0 2024-09-17T06:04:54.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.910+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb7d402de20 con 0x7fb7d402d4d0 2024-09-17T06:04:54.915 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:04:54.916 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:04:54.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.910+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fb7d402e4a0 0x7fb7d4209820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:54.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.910+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fb7d402e8b0 con 0x7fb7d402e4a0 2024-09-17T06:04:54.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.914+0000 7fb7d2ffd640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fb7d402e4a0 0x7fb7d4209820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:54.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.914+0000 7fb7d2ffd640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fb7d402e4a0 0x7fb7d4209820 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:54.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.914+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7d402e8b0 con 0x7fb7d402e4a0 2024-09-17T06:04:54.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.926+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb7d402e8b0 con 0x7fb7d402e4a0 2024-09-17T06:04:54.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.930+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb7d402e8b0 con 0x7fb7d402e4a0 2024-09-17T06:04:54.934 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:04:54.935 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:04:54.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.930+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fb7d420a270 0x7fb7d420c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:54.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.930+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fb7d420f510 con 0x7fb7d420a270 2024-09-17T06:04:54.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.930+0000 7fb7d3fff640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fb7d420a270 0x7fb7d420c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:54.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.934+0000 7fb7d3fff640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fb7d420a270 0x7fb7d420c690 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:54.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.934+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7d420f510 con 0x7fb7d420a270 2024-09-17T06:04:54.937 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:04:54.934+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:04:54.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.946+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb7d420cea0 con 0x7fb7d420a270 2024-09-17T06:04:54.953 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:04:54.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.950+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb7d420cea0 con 0x7fb7d420a270 2024-09-17T06:04:54.954 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:04:54.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.950+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fb7d420d5c0 0x7fb7d420d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:54.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.950+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fb7d4212960 con 0x7fb7d420d5c0 2024-09-17T06:04:54.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.950+0000 7fb7d37fe640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fb7d420d5c0 0x7fb7d420d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:54.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.950+0000 7fb7d37fe640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fb7d420d5c0 0x7fb7d420d9d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:54.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.950+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7d4212960 con 0x7fb7d420d5c0 2024-09-17T06:04:54.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb7d4211760 con 0x7fb7d420d5c0 2024-09-17T06:04:54.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7bbfff640 1 -- 172.21.15.122:0/4075429558 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb7d4211760 con 0x7fb7d420d5c0 2024-09-17T06:04:54.971 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:04:54.973 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:04:54.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fb7d41521b0 msgr2=0x7fb7d41488a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fb7d41521b0 0x7fb7d41488a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fb7d41440d0 msgr2=0x7fb7d414b9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fb7d41440d0 0x7fb7d414b9f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fb7d414c440 msgr2=0x7fb7d40638b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fb7d414c440 0x7fb7d40638b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fb7d41498d0 msgr2=0x7fb7d4149ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fb7d41498d0 0x7fb7d4149ce0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fb7d402d4d0 msgr2=0x7fb7d402d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d3fff640 1 -- 172.21.15.122:0/4075429558 reap_dead start 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fb7d402d4d0 0x7fb7d402d8e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d3fff640 1 -- 172.21.15.122:0/4075429558 reap_dead start 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fb7d402e4a0 msgr2=0x7fb7d4209820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fb7d402e4a0 0x7fb7d4209820 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fb7d420a270 msgr2=0x7fb7d420c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fb7d420a270 0x7fb7d420c690 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fb7d420d5c0 msgr2=0x7fb7d420d9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fb7d420d5c0 0x7fb7d420d9d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb7c0073200 msgr2=0x7fb7c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb7c0073200 0x7fb7c0075710 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80af000 tx=0x7fb7c801b060 comp rx=0 tx=0).stop 2024-09-17T06:04:54.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7d40c2a60 msgr2=0x7fb7d4151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:54.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7d40c2a60 0x7fb7d4151c70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00ca80 tx=0x7fb7cc00cb70 comp rx=0 tx=0).stop 2024-09-17T06:04:54.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.966+0000 7fb7d3fff640 1 -- 172.21.15.122:0/4075429558 reap_dead start 2024-09-17T06:04:54.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.970+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 shutdown_connections 2024-09-17T06:04:54.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.970+0000 7fb7d9d35640 1 --2- 172.21.15.122:0/4075429558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7d40c2a60 0x7fb7d4151c70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:54.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.970+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 >> 172.21.15.122:0/4075429558 conn(0x7fb7d406ce90 msgr2=0x7fb7d40c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:54.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.970+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 shutdown_connections 2024-09-17T06:04:54.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:54.970+0000 7fb7d9d35640 1 -- 172.21.15.122:0/4075429558 wait complete. 2024-09-17T06:04:55.037 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:55.034+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:55.088 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:55.089 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:04:55.089 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:04:55.089 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:04:55.089 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.089 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:55.089 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:04:55.089 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.268093716000003, 2024-09-17T06:04:55.089 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.013495551, 2024-09-17T06:04:55.089 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.089 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.090 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:55.090 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.090 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.090 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.090 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:04:55.090 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.090 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.090 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.090 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820818+0000", 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.858e-06 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820836+0000", 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7955e-05 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.091 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820863+0000", 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7013999999999999e-05 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820885+0000", 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1695000000000002e-05 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821084+0000", 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019876400000000001 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821305+0000", 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022121099999999999 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821563+0000", 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025797100000000001 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825504+0000", 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039410119999999998 2024-09-17T06:04:55.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.094 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.094 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:55.094 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834165+0000", 2024-09-17T06:04:55.094 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086608810000000005 2024-09-17T06:04:55.094 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.094 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.094 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:55.094 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834252+0000", 2024-09-17T06:04:55.094 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7276999999999998e-05 2024-09-17T06:04:55.094 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.094 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.095 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.095 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834311+0000", 2024-09-17T06:04:55.095 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8913000000000003e-05 2024-09-17T06:04:55.095 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.095 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.095 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.095 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.095 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.095 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:55.095 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:04:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.264870442000003, 2024-09-17T06:04:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037604380000000001, 2024-09-17T06:04:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:04:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:04:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824040+0000", 2024-09-17T06:04:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8649999999999999e-06 2024-09-17T06:04:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.097 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824070+0000", 2024-09-17T06:04:55.098 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9162e-05 2024-09-17T06:04:55.098 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.098 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.098 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824088+0000", 2024-09-17T06:04:55.098 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8529000000000002e-05 2024-09-17T06:04:55.098 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.098 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.098 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824103+0000", 2024-09-17T06:04:55.098 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5081e-05 2024-09-17T06:04:55.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.099 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.099 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824193+0000", 2024-09-17T06:04:55.099 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9896999999999997e-05 2024-09-17T06:04:55.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.099 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:55.099 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:04:55.099 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1649000000000001e-05 2024-09-17T06:04:55.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827740+0000", 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035152069999999998 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827799+0000", 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9048000000000001e-05 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.100 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.264684889999998, 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035104340000000002, 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.101 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1909999999999999e-06 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.102 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824237+0000", 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1914e-05 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824252+0000", 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5071e-05 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824265+0000", 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2748000000000001e-05 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.103 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824346+0000", 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0530000000000003e-05 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824375+0000", 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9805e-05 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827659+0000", 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032838569999999998 2024-09-17T06:04:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827735+0000", 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5318e-05 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 75 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.26448809, 2024-09-17T06:04:55.105 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003402553, 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.106 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824422+0000", 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3399999999999998e-07 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824434+0000", 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1960000000000001e-05 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824771+0000", 2024-09-17T06:04:55.107 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033676799999999998 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824798+0000", 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7838e-05 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824920+0000", 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012210699999999999 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.108 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827824+0000", 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029030459999999998 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 4 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.263801581999999, 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003032833, 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.109 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.110 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825108+0000", 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6099999999999999e-07 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825120+0000", 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1780000000000001e-05 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825136+0000", 2024-09-17T06:04:55.111 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6229999999999999e-05 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825152+0000", 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6104e-05 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825297+0000", 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014498399999999999 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.112 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828140+0000", 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002842874 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.259092803000001, 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032580460000000001, 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.113 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829817+0000", 2024-09-17T06:04:55.114 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.176e-06 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0178e-05 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829847+0000", 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9402000000000002e-05 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.115 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829858+0000", 2024-09-17T06:04:55.116 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1141000000000001e-05 2024-09-17T06:04:55.116 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.116 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.116 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.116 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830004+0000", 2024-09-17T06:04:55.116 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014622699999999999 2024-09-17T06:04:55.116 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.116 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.116 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:55.116 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830027+0000", 2024-09-17T06:04:55.116 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2826000000000001e-05 2024-09-17T06:04:55.116 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833000+0000", 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029729000000000001 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833074+0000", 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4196000000000006e-05 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-17T06:04:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:04:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.257978022000003, 2024-09-17T06:04:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0043957220000000003, 2024-09-17T06:04:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830933+0000", 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5090000000000001e-06 2024-09-17T06:04:55.119 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.120 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.120 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.120 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830946+0000", 2024-09-17T06:04:55.120 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3018e-05 2024-09-17T06:04:55.120 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.120 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.120 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.120 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830968+0000", 2024-09-17T06:04:55.120 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2558999999999999e-05 2024-09-17T06:04:55.120 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830984+0000", 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5376999999999999e-05 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831072+0000", 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8745000000000005e-05 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:55.121 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831104+0000", 2024-09-17T06:04:55.122 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1265e-05 2024-09-17T06:04:55.122 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.122 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.122 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:55.122 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835260+0000", 2024-09-17T06:04:55.122 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0041569559999999998 2024-09-17T06:04:55.122 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.122 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.122 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.122 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835327+0000", 2024-09-17T06:04:55.122 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.6292999999999997e-05 2024-09-17T06:04:55.122 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.123 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.123 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.123 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.123 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.123 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-17T06:04:55.123 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:04:55.123 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.254874489000002, 2024-09-17T06:04:55.123 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029529399999999998, 2024-09-17T06:04:55.123 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.123 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.123 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:04:55.123 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.124 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.124 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.124 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:04:55.124 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.124 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.124 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.124 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.124 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:04:55.124 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.124 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.124 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.125 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.125 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834036+0000", 2024-09-17T06:04:55.125 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9999999999999995e-07 2024-09-17T06:04:55.125 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.125 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.125 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.125 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834042+0000", 2024-09-17T06:04:55.125 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.7240000000000003e-06 2024-09-17T06:04:55.125 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.125 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.125 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.125 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834058+0000", 2024-09-17T06:04:55.126 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5648e-05 2024-09-17T06:04:55.126 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.126 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.126 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.126 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834068+0000", 2024-09-17T06:04:55.126 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0383999999999999e-05 2024-09-17T06:04:55.126 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.126 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.126 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.126 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834145+0000", 2024-09-17T06:04:55.126 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.64e-05 2024-09-17T06:04:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834157+0000", 2024-09-17T06:04:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2414e-05 2024-09-17T06:04:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834330+0000", 2024-09-17T06:04:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017272399999999999 2024-09-17T06:04:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.128 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.128 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.128 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.128 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.128 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:55.129 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:04:55.173 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:55.171+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:55.239 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:55.234+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:55.280 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:55.280 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:55.280 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:04:55.281 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:55.296 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:04:55.341 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:55.339+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:55.440 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:55.438+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:55.491 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:55.492 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:04:55.492 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:04:55.492 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:55.507 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:04:55.553 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:55.551+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:55.642 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:55.639+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:55.654 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.832202563999999, 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:04:55.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:04:55.659 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.832090340000001, 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:04:55.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:04:55.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.663 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.831884989999999, 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.664 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.666 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:04:55.667 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.668 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.825744464000003, 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:04:55.669 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:04:55.672 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:04:55.673 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.825589737999998, 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:55.674 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:04:55.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:55.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.675 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:55.675 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:04:55.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:04:55.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.675 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:55.675 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:04:55.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:04:55.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.676 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:55.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:04:55.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:04:55.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.676 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:55.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:04:55.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:04:55.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:04:55.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:55.678 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:55.678 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:55.678 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:04:55.678 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:04:55.678 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.678 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.678 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.678 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:55.678 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:55.678 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:55.679 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:04:55.743 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:55.738+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:55.844 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:55.842+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:55.878 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:55.878 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:55.878 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:04:55.878 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:55.895 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:04:55.945 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:04:55.942+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:04:56.038 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:56.038 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:56.039 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:04:56.039 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:04:56.039 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:56.046 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:56.043+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:56.055 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:04:56.147 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:56.142+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:56.248 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:56.248 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:04:56.248 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:04:56.248 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:04:56.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.249 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:56.249 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:04:56.249 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.424777640999999, 2024-09-17T06:04:56.249 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:04:56.249 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.249 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.249 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.249 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.249 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.249 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:04:56.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.252 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.252 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:04:56.252 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:04:56.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.252 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.252 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:04:56.252 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:04:56.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.252 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:04:56.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.254 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.424657238999998, 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.255 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.256 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.257 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:04:56.258 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.259 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.260 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.424529325000002, 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.261 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:04:56.262 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.263 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.263 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.263 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:04:56.263 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:04:56.263 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.263 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.263 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.263 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:04:56.263 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:04:56.263 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.263 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.263 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.264 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:04:56.265 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:04:56.266 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.423503361999998, 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.267 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.268 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:04:56.269 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.270 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.423422418999998, 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.272 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.273 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:04:56.274 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:04:56.275 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.276 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:04:56.277 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.423360017, 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.278 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:04:56.279 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.280 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.281 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:04:56.282 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.283 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.423287926999997, 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:04:56.284 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.285 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:04:56.287 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.423245727000001, 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.288 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.289 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.289 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:04:56.289 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.289 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.289 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.289 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.289 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:04:56.289 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.289 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.289 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:04:56.290 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.291 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.292 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.420653795, 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.293 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:04:56.294 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.295 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:04:56.296 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.42055766, 2024-09-17T06:04:56.297 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:04:56.298 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.298 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.298 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.298 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.298 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.298 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.298 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:04:56.298 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.298 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.298 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.298 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.298 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.299 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:04:56.300 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:04:56.301 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.412125373999999, 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.302 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:04:56.303 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.304 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:04:56.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.306 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.307 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.308 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.308 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.308 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.308 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:04:56.308 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:04:56.308 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.318536154, 2024-09-17T06:04:56.308 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:04:56.308 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.308 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.308 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.308 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.308 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:04:56.309 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:04:56.310 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.310 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.310 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.310 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:04:56.310 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:04:56.310 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.310 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.310 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.310 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:04:56.310 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:04:56.310 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.310 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:04:56.311 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.312 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 35.647905788999999, 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.313 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.314 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:04:56.315 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:04:56.316 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.316 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.316 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.316 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:04:56.316 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:04:56.316 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.316 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.316 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.316 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:04:56.316 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:04:56.316 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.316 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:04:56.317 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.318 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 33.927234833, 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.319 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:04:56.320 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.321 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.322 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:04:56.322 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:04:56.322 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.322 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.322 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.322 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:04:56.322 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:04:56.322 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.322 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.322 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:56.322 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:04:56.322 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.323 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.324 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:04:56.324 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:04:56.324 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.324 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.324 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.324 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:04:56.324 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:04:56.324 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.324 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.324 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.324 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.324 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.325 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:04:56.325 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:04:56.325 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 33.924550584000002, 2024-09-17T06:04:56.325 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:04:56.325 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.325 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.325 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:04:56.325 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.325 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.325 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.326 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:04:56.326 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.326 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.326 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.326 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.326 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:04:56.326 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.326 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.326 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.326 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.326 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:04:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 33.055347910999998, 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:04:56.329 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.330 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.331 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.332 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:04:56.333 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.334 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 12.528906999, 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.335 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.336 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:04:56.337 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.338 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.339 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:04:56.340 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 12.528677482999999, 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.341 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:04:56.342 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.343 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.344 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:04:56.344 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:04:56.344 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.344 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.344 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.344 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:04:56.344 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:04:56.344 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.344 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.344 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.344 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:04:56.344 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.345 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:04:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 12.526712786999999, 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.347 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:04:56.348 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.349 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.350 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 8.5931499000000002, 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.351 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.352 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:04:56.353 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:04:56.354 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.355 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.356 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.357 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.357 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.357 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.357 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:56.358 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:56.246+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:56.358 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:04:56.359 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:56.355+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:56.459 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:56.458+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:56.553 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:56.553 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:56.553 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:04:56.553 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:56.560 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:04:56.558+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:04:56.570 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:04:56.661 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:56.658+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:56.713 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:56.713 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:56.713 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:04:56.713 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:04:56.713 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:56.730 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:04:56.773 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:04:56.771+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:04:56.822 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T06:04:56.868 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:56.866+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:56.886 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:56.887 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:04:56.887 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:04:56.887 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:04:56.887 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.887 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.887 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:04:56.887 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 58.247484630999999, 2024-09-17T06:04:56.887 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.55819121299999996, 2024-09-17T06:04:56.887 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.887 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.887 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 1 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.888 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.889 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:04:56.889 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.889 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.889 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.889 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636958+0000", 2024-09-17T06:04:56.889 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4690000000000002e-06 2024-09-17T06:04:56.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.889 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.889 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.889 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636976+0000", 2024-09-17T06:04:56.889 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.802e-05 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637001+0000", 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4552000000000001e-05 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637024+0000", 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3391999999999999e-05 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.890 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637134+0000", 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000109715 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for peered", 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637157+0000", 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3363999999999999e-05 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.191892+0000", 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.55473470899999999 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.892 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.892 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.192190+0000", 2024-09-17T06:04:56.892 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029832200000000001 2024-09-17T06:04:56.892 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.892 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.892 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.892 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.192541+0000", 2024-09-17T06:04:56.892 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00035034999999999998 2024-09-17T06:04:56.892 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.194061+0000", 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0015205959999999999 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.194944+0000", 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00088236399999999996 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.893 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.195056+0000", 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011200399999999999 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.195146+0000", 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0356e-05 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.894 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.543191380000003, 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.01182241, 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 42 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.895 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341249+0000", 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0729999999999999e-06 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.896 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341257+0000", 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8800000000000008e-06 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341275+0000", 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7842e-05 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341292+0000", 2024-09-17T06:04:56.897 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6829000000000001e-05 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346218+0000", 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049260329999999998 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346372+0000", 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015433299999999999 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.898 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346635+0000", 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026296700000000002 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351575+0000", 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049397959999999998 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352898+0000", 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013230060000000001 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.899 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.900 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.900 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352994+0000", 2024-09-17T06:04:56.900 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6045000000000006e-05 2024-09-17T06:04:56.900 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.900 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.900 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.900 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353070+0000", 2024-09-17T06:04:56.900 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6606000000000005e-05 2024-09-17T06:04:56.900 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.900 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.900 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.900 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.542699030999998, 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011645713, 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 43 2024-09-17T06:04:56.901 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.902 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341743+0000", 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.903e-06 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341764+0000", 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0988999999999998e-05 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341808+0000", 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3791000000000001e-05 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.903 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.904 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341839+0000", 2024-09-17T06:04:56.904 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1216000000000001e-05 2024-09-17T06:04:56.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.904 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.904 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.904 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.348686+0000", 2024-09-17T06:04:56.904 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068463589999999998 2024-09-17T06:04:56.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.904 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.904 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.904 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.348832+0000", 2024-09-17T06:04:56.904 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014631 2024-09-17T06:04:56.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.905 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.905 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.905 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.349079+0000", 2024-09-17T06:04:56.905 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024698800000000001 2024-09-17T06:04:56.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.905 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.905 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.905 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353095+0000", 2024-09-17T06:04:56.905 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040160869999999998 2024-09-17T06:04:56.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.905 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.906 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.906 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353170+0000", 2024-09-17T06:04:56.906 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4976999999999997e-05 2024-09-17T06:04:56.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.906 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.906 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.906 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353259+0000", 2024-09-17T06:04:56.906 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9305e-05 2024-09-17T06:04:56.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.906 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.906 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.906 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353386+0000", 2024-09-17T06:04:56.907 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012678799999999999 2024-09-17T06:04:56.907 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.907 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.907 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.907 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.907 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.907 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.907 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:04:56.907 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.542542298000001, 2024-09-17T06:04:56.907 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015057846, 2024-09-17T06:04:56.907 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 44 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.909 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.909 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.909 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:04:56.909 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.909 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.909 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.909 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341899+0000", 2024-09-17T06:04:56.909 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9e-06 2024-09-17T06:04:56.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.909 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.909 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.910 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342021+0000", 2024-09-17T06:04:56.910 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012252000000000001 2024-09-17T06:04:56.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.910 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.910 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342055+0000", 2024-09-17T06:04:56.910 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3095000000000001e-05 2024-09-17T06:04:56.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.910 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.910 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342078+0000", 2024-09-17T06:04:56.911 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3456e-05 2024-09-17T06:04:56.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.911 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.911 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.911 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.349806+0000", 2024-09-17T06:04:56.911 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.007728253 2024-09-17T06:04:56.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.911 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.911 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.911 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.350088+0000", 2024-09-17T06:04:56.911 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00028207900000000002 2024-09-17T06:04:56.912 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.912 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.912 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.912 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.350527+0000", 2024-09-17T06:04:56.912 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00043892200000000001 2024-09-17T06:04:56.912 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.912 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.912 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.912 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353510+0000", 2024-09-17T06:04:56.912 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029825590000000001 2024-09-17T06:04:56.912 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.912 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356661+0000", 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0031514099999999999 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356817+0000", 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015552900000000001 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356955+0000", 2024-09-17T06:04:56.913 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013812300000000001 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.542287404, 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015109994, 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.914 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 45 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:04:56.915 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342154+0000", 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9999999999999999e-06 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342170+0000", 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6506000000000001e-05 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.916 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342196+0000", 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5412e-05 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342216+0000", 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0191999999999999e-05 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351692+0000", 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0094760650000000005 2024-09-17T06:04:56.917 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351849+0000", 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015737600000000001 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352102+0000", 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025282000000000001 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.918 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356610+0000", 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045081940000000001 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356984+0000", 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037321899999999999 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357126+0000", 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014265999999999999 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.919 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357262+0000", 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013554999999999999 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.542186469000001, 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015392114, 2024-09-17T06:04:56.920 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 46 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.921 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342254+0000", 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4169999999999999e-06 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342268+0000", 2024-09-17T06:04:56.922 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4086e-05 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342283+0000", 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4919000000000001e-05 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342297+0000", 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3993e-05 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.923 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353648+0000", 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011350783 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353815+0000", 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016706499999999999 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.354039+0000", 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022362599999999999 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357286+0000", 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003246882 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357422+0000", 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000136093 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357521+0000", 2024-09-17T06:04:56.925 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.8876000000000007e-05 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357645+0000", 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012437400000000001 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.542092150000002, 2024-09-17T06:04:56.926 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.018409992999999999, 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 47 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342348+0000", 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.333e-06 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.928 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342464+0000", 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011581100000000001 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342485+0000", 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0222000000000001e-05 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342512+0000", 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7158999999999999e-05 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.929 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.354773+0000", 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.012261752000000001 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.355011+0000", 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000237982 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.355427+0000", 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000415234 2024-09-17T06:04:56.930 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357770+0000", 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023435320000000002 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360464+0000", 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026934820000000001 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.931 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360614+0000", 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015075900000000001 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360757+0000", 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014272699999999999 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.932 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.541876924, 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.020363284999999998, 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 48 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.933 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342564+0000", 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5269999999999999e-06 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.934 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342593+0000", 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9261e-05 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342617+0000", 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4258999999999999e-05 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342644+0000", 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6645999999999999e-05 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.935 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357867+0000", 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015222591000000001 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.358013+0000", 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014652299999999999 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.358238+0000", 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000225193 2024-09-17T06:04:56.936 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362590+0000", 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.004351471 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362643+0000", 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2957000000000001e-05 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362799+0000", 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015606600000000001 2024-09-17T06:04:56.937 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362926+0000", 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012679100000000001 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.541752027000001, 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.021916326, 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.938 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 49 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.939 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342689+0000", 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.79e-06 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342703+0000", 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3653e-05 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.940 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.941 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342740+0000", 2024-09-17T06:04:56.941 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6801000000000002e-05 2024-09-17T06:04:56.941 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.941 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.941 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.941 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342761+0000", 2024-09-17T06:04:56.941 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1713e-05 2024-09-17T06:04:56.941 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.941 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.941 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.941 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359009+0000", 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.016247663999999998 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359291+0000", 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00028178399999999998 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359738+0000", 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00044704500000000003 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.942 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363113+0000", 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033748150000000002 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364339+0000", 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001226067 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364484+0000", 2024-09-17T06:04:56.943 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014500599999999999 2024-09-17T06:04:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364604+0000", 2024-09-17T06:04:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000119988 2024-09-17T06:04:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.541582052000003, 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023299408000000001, 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 50 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.945 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342859+0000", 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.663e-06 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.946 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342981+0000", 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012199800000000001 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343001+0000", 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0432e-05 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343020+0000", 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8236e-05 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.947 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.948 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.948 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360863+0000", 2024-09-17T06:04:56.948 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.017843741 2024-09-17T06:04:56.948 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.948 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.948 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.948 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.361095+0000", 2024-09-17T06:04:56.948 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00023198199999999999 2024-09-17T06:04:56.948 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.948 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.948 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.361364+0000", 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026886 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364745+0000", 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033806690000000002 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365860+0000", 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011155679999999999 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.949 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366017+0000", 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015673299999999999 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366157+0000", 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013952600000000001 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:04:56.950 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.541392021, 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023463673000000001, 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 51 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.951 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343048+0000", 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0729999999999999e-06 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.952 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343057+0000", 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.2959999999999999e-06 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343068+0000", 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1793e-05 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343094+0000", 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5882000000000001e-05 2024-09-17T06:04:56.953 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363287+0000", 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.020192673000000001 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363457+0000", 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017029600000000001 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363687+0000", 2024-09-17T06:04:56.954 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022974099999999999 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366188+0000", 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025014049999999999 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366282+0000", 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3992000000000004e-05 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366378+0000", 2024-09-17T06:04:56.955 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5152e-05 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366511+0000", 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013337000000000001 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:04:56.956 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.541326224000002, 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023823882000000001, 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 52 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:04:56.957 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343114+0000", 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5700000000000001e-07 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.958 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343122+0000", 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4919999999999993e-06 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343134+0000", 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1970000000000001e-05 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343144+0000", 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6690000000000001e-06 2024-09-17T06:04:56.959 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364849+0000", 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.021704826 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365104+0000", 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025510700000000002 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.960 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365359+0000", 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025527500000000001 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366737+0000", 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001377739 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366772+0000", 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4629000000000003e-05 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.961 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366865+0000", 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3220999999999994e-05 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366937+0000", 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.2096999999999998e-05 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.962 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.271050430000003, 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010475561, 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 69 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.963 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613390+0000", 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.8899999999999998e-07 2024-09-17T06:04:56.964 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613458+0000", 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.8127999999999996e-05 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613467+0000", 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0909999999999999e-06 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613474+0000", 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.2919999999999998e-06 2024-09-17T06:04:56.965 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.615892+0000", 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002417836 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.615956+0000", 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3380000000000006e-05 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616042+0000", 2024-09-17T06:04:56.966 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6012000000000003e-05 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619165+0000", 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00312321 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623808+0000", 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0046427339999999999 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623836+0000", 2024-09-17T06:04:56.967 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8839999999999998e-05 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623864+0000", 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8048999999999999e-05 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:04:56.968 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.270932678000001, 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010433403000000001, 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 70 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.969 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.8800000000000002e-07 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.970 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613512+0000", 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.2719999999999999e-06 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613518+0000", 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.4350000000000002e-06 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613524+0000", 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5110000000000003e-06 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.971 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.972 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.972 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616673+0000", 2024-09-17T06:04:56.972 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003149102 2024-09-17T06:04:56.972 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.972 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.972 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.972 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616764+0000", 2024-09-17T06:04:56.972 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1290000000000002e-05 2024-09-17T06:04:56.972 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.972 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.972 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.972 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616880+0000", 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011597800000000001 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619172+0000", 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0022917670000000001 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623892+0000", 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.004720391 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.973 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623918+0000", 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6186999999999998e-05 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623940+0000", 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1781999999999999e-05 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.974 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.270790521999999, 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010700696000000001, 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 71 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.975 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613650+0000", 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7300000000000005e-07 2024-09-17T06:04:56.976 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613654+0000", 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6920000000000001e-06 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613662+0000", 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8439999999999998e-06 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613668+0000", 2024-09-17T06:04:56.977 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6400000000000002e-06 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617192+0000", 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035246499999999998 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617294+0000", 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000101259 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.978 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617388+0000", 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4228999999999995e-05 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620154+0000", 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0027657459999999999 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624067+0000", 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039132730000000001 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624226+0000", 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015945600000000001 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624349+0000", 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000123034 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.980 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.270760592000002, 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010774550000000001, 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 72 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.981 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.7399999999999998e-07 2024-09-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613717+0000", 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7406000000000001e-05 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613723+0000", 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.652e-06 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.983 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613728+0000", 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6789999999999996e-06 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617676+0000", 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039476759999999998 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617728+0000", 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2871999999999998e-05 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.984 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617814+0000", 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5463999999999994e-05 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621037+0000", 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032232910000000001 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624400+0000", 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033624240000000001 2024-09-17T06:04:56.985 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624430+0000", 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0552000000000002e-05 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624453+0000", 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3059999999999999e-05 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.986 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.270688047999997, 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010781999, 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 73 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.987 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613752+0000", 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.61e-07 2024-09-17T06:04:56.988 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613758+0000", 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7209999999999999e-06 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613764+0000", 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3470000000000004e-06 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613769+0000", 2024-09-17T06:04:56.989 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8810000000000004e-06 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618508+0000", 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047387669999999996 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618559+0000", 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1440999999999998e-05 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.990 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618705+0000", 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014593900000000001 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621041+0000", 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023357400000000002 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624482+0000", 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034416999999999998 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.991 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.992 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624511+0000", 2024-09-17T06:04:56.992 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8070000000000001e-05 2024-09-17T06:04:56.992 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.992 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.992 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.992 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624533+0000", 2024-09-17T06:04:56.992 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2731999999999999e-05 2024-09-17T06:04:56.992 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.992 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.992 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.270660239000001, 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010828374999999999, 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.993 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 74 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.994 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8599999999999999e-07 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613782+0000", 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7010000000000001e-06 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613787+0000", 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3980000000000001e-06 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.995 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613790+0000", 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.805e-06 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619344+0000", 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.005553685 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619427+0000", 2024-09-17T06:04:56.996 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.2897000000000003e-05 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619562+0000", 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013549699999999999 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621581+0000", 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020184719999999999 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624559+0000", 2024-09-17T06:04:56.997 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029778230000000001 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624586+0000", 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7093e-05 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624607+0000", 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1617999999999999e-05 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:56.998 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.270588846000003, 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011087911000000001, 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 75 2024-09-17T06:04:56.999 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:57.000 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613851+0000", 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.1099999999999995e-07 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613923+0000", 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1439999999999994e-05 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613930+0000", 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9629999999999998e-06 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.001 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613936+0000", 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5659999999999997e-06 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620210+0000", 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.006273514 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620263+0000", 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2982000000000002e-05 2024-09-17T06:04:57.002 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620363+0000", 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000100802 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621596+0000", 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012330329999999999 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624709+0000", 2024-09-17T06:04:57.003 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003112971 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624838+0000", 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012835099999999999 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624938+0000", 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000100678 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:57.004 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.270488677000003, 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011079701000000001, 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:04:57.005 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 76 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.006 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1099999999999996e-07 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613954+0000", 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2009999999999999e-06 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613959+0000", 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0440000000000003e-06 2024-09-17T06:04:57.007 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613964+0000", 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4329999999999997e-06 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621073+0000", 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0071095209999999997 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621133+0000", 2024-09-17T06:04:57.008 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9740000000000001e-05 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621250+0000", 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000117287 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621908+0000", 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00065739599999999998 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.009 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624980+0000", 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0030722039999999998 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.625008+0000", 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8061000000000001e-05 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.625030+0000", 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2303e-05 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:57.010 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:57.011 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:57.011 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:57.011 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:57.011 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:57.011 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:04:57.014 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:57.007+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:57.014 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:04:57.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.986+0000 7feabdd9d640 1 -- 172.21.15.122:0/2624062933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feab814e9e0 msgr2=0x7feab815b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.986+0000 7feabdd9d640 1 --2- 172.21.15.122:0/2624062933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feab814e9e0 0x7feab815b7b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feaac009870 tx=0x7feaac01c820 comp rx=0 tx=0).stop 2024-09-17T06:04:57.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.986+0000 7feabdd9d640 1 -- 172.21.15.122:0/2624062933 shutdown_connections 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.986+0000 7feabdd9d640 1 --2- 172.21.15.122:0/2624062933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feab814e9e0 0x7feab815b7b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.986+0000 7feabdd9d640 1 -- 172.21.15.122:0/2624062933 >> 172.21.15.122:0/2624062933 conn(0x7feab80746d0 msgr2=0x7feab8074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.986+0000 7feabdd9d640 1 -- 172.21.15.122:0/2624062933 shutdown_connections 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.986+0000 7feabdd9d640 1 -- 172.21.15.122:0/2624062933 wait complete. 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feabdd9d640 1 Processor -- start 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feabdd9d640 1 -- start start 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feabdd9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feab80c67a0 0x7feab81f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feabdd9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feab814e9e0 0x7feab814f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feabdd9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feab815bcf0 0x7feab80cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feabdd9d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feab815c100 con 0x7feab814e9e0 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feabdd9d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feab8158b30 con 0x7feab815bcf0 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feabdd9d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7feab8152540 con 0x7feab80c67a0 2024-09-17T06:04:57.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feab6ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feab814e9e0 0x7feab814f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feab6ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feab814e9e0 0x7feab814f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54772/0 (socket says 172.21.15.122:54772) 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feab6ffd640 1 -- 172.21.15.122:0/1369773197 learned_addr learned my addr 172.21.15.122:0/1369773197 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feab7fff640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feab815bcf0 0x7feab80cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feab77fe640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feab80c67a0 0x7feab81f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feab6ffd640 1 -- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feab80c67a0 msgr2=0x7feab81f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feab6ffd640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feab80c67a0 0x7feab81f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feab6ffd640 1 -- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feab815bcf0 msgr2=0x7feab80cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feab6ffd640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feab815bcf0 0x7feab80cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feab6ffd640 1 -- 172.21.15.122:0/1369773197 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab81f6360 con 0x7feab814e9e0 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feab77fe640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feab80c67a0 0x7feab81f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feab6ffd640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feab814e9e0 0x7feab814f330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feaac01cd90 tx=0x7feaac005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7fea9ffff640 1 -- 172.21.15.122:0/1369773197 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac0b2040 con 0x7feab814e9e0 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7fea9ffff640 1 -- 172.21.15.122:0/1369773197 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feaac004130 con 0x7feab814e9e0 2024-09-17T06:04:57.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7fea9ffff640 1 -- 172.21.15.122:0/1369773197 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac003600 con 0x7feab814e9e0 2024-09-17T06:04:57.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feabdd9d640 1 -- 172.21.15.122:0/1369773197 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab8154ee0 con 0x7feab814e9e0 2024-09-17T06:04:57.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.990+0000 7feabdd9d640 1 -- 172.21.15.122:0/1369773197 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab81551c0 con 0x7feab814e9e0 2024-09-17T06:04:57.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.994+0000 7feabdd9d640 1 -- 172.21.15.122:0/1369773197 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab80c8df0 con 0x7feab814e9e0 2024-09-17T06:04:57.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.994+0000 7fea9ffff640 1 -- 172.21.15.122:0/1369773197 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7feaac0bd030 con 0x7feab814e9e0 2024-09-17T06:04:57.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.994+0000 7fea9ffff640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7feaa4073200 0x7feaa4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.994+0000 7fea9ffff640 1 -- 172.21.15.122:0/1369773197 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6780+0+0 (secure 0 0 0) 0x7feaac12e170 con 0x7feab814e9e0 2024-09-17T06:04:57.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.994+0000 7feab77fe640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7feaa4073200 0x7feaa4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.994+0000 7feab77fe640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7feaa4073200 0x7feaa4075710 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feaa8001230 tx=0x7feaa8009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:57.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:56.998+0000 7fea9ffff640 1 -- 172.21.15.122:0/1369773197 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7feaac0c4060 con 0x7feab814e9e0 2024-09-17T06:04:57.113 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:57.111+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:57.163 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:04:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:04:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-09-17T06:04:57.163 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:04:57.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.162+0000 7fc8237d7640 1 -- 172.21.15.122:0/2267489907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc808004d50 msgr2=0x7fc808005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.162+0000 7fc8237d7640 1 --2- 172.21.15.122:0/2267489907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc808004d50 0x7fc808005160 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc814009eb0 tx=0x7fc81401d680 comp rx=0 tx=0).stop 2024-09-17T06:04:57.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.162+0000 7fc821d74640 1 -- 172.21.15.122:0/2267489907 reap_dead start 2024-09-17T06:04:57.167 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.162+0000 7fc8237d7640 1 -- 172.21.15.122:0/2267489907 shutdown_connections 2024-09-17T06:04:57.167 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.162+0000 7fc8237d7640 1 -- 172.21.15.122:0/2267489907 >> 172.21.15.122:0/2267489907 conn(0x7fc81c06ce90 msgr2=0x7fc81c06d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:57.167 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.162+0000 7fc8237d7640 1 -- 172.21.15.122:0/2267489907 shutdown_connections 2024-09-17T06:04:57.167 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.162+0000 7fc8237d7640 1 -- 172.21.15.122:0/2267489907 wait complete. 2024-09-17T06:04:57.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc8237d7640 1 Processor -- start 2024-09-17T06:04:57.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc8237d7640 1 -- start start 2024-09-17T06:04:57.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc8237d7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc81c1e21d0 0x7fc81c0c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc8237d7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc81c14d5b0 0x7fc81c148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc8237d7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc81c148e90 0x7fc81c1e39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc8237d7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c153780 con 0x7fc81c1e21d0 2024-09-17T06:04:57.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc8237d7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c14ffa0 con 0x7fc81c14d5b0 2024-09-17T06:04:57.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc8237d7640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc81c159830 con 0x7fc81c148e90 2024-09-17T06:04:57.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc821573640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc81c1e21d0 0x7fc81c0c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc821573640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc81c1e21d0 0x7fc81c0c31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54794/0 (socket says 172.21.15.122:54794) 2024-09-17T06:04:57.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc821573640 1 -- 172.21.15.122:0/349541933 learned_addr learned my addr 172.21.15.122:0/349541933 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:57.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc821d74640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc81c148e90 0x7fc81c1e39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc820d72640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc81c14d5b0 0x7fc81c148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc821573640 1 -- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc81c148e90 msgr2=0x7fc81c1e39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc821573640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc81c148e90 0x7fc81c1e39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc821573640 1 -- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc81c14d5b0 msgr2=0x7fc81c148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc821573640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc81c14d5b0 0x7fc81c148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc821573640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81c14af10 con 0x7fc81c1e21d0 2024-09-17T06:04:57.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc821573640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc81c1e21d0 0x7fc81c0c31a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc818001820 tx=0x7fc81800e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:57.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818012850 con 0x7fc81c1e21d0 2024-09-17T06:04:57.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc818012ae0 con 0x7fc81c1e21d0 2024-09-17T06:04:57.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81c1f4a80 con 0x7fc81c1e21d0 2024-09-17T06:04:57.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81801a400 con 0x7fc81c1e21d0 2024-09-17T06:04:57.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.166+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc81c0c26c0 con 0x7fc81c1e21d0 2024-09-17T06:04:57.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.170+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fc81c069e60 con 0x7fc81c1e21d0 2024-09-17T06:04:57.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.170+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc81800d030 con 0x7fc81c1e21d0 2024-09-17T06:04:57.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.170+0000 7fc811ffb640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc800073230 0x7fc800075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.170+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6780+0+0 (secure 0 0 0) 0x7fc818097b60 con 0x7fc81c1e21d0 2024-09-17T06:04:57.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.170+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v31) ==== 54+0+16 (secure 0 0 0) 0x7fc818028070 con 0x7fc81c1e21d0 2024-09-17T06:04:57.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.170+0000 7fc820d72640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc800073230 0x7fc800075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.170+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fc81c1e3f00 0x7fc81c1e4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.170+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc81c070010 con 0x7fc81c1e3f00 2024-09-17T06:04:57.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.170+0000 7fc821d74640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fc81c1e3f00 0x7fc81c1e4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.170+0000 7fc821d74640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fc81c1e3f00 0x7fc81c1e4310 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:57.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.174+0000 7fc820d72640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc800073230 0x7fc800075740 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009b60 tx=0x7fc80c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:57.176 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.174+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc81c070010 con 0x7fc81c1e3f00 2024-09-17T06:04:57.182 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:04:57.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.186+0000 7feabdd9d640 1 -- 172.21.15.122:0/1369773197 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) -- 0x7feab80c33d0 con 0x7feab814e9e0 2024-09-17T06:04:57.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.186+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc81c0c2e90 con 0x7fc81c1e3f00 2024-09-17T06:04:57.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.190+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc81c0c2e90 con 0x7fc81c1e3f00 2024-09-17T06:04:57.193 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:04:57.194 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:04:57.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.190+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fc81c149d70 0x7fc81c14a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.190+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fc81c14a6c0 con 0x7fc81c149d70 2024-09-17T06:04:57.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.190+0000 7fc821573640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fc81c149d70 0x7fc81c14a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.190+0000 7fc821573640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fc81c149d70 0x7fc81c14a180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:57.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.190+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc81c14a6c0 con 0x7fc81c149d70 2024-09-17T06:04:57.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.206+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc81c1e5220 con 0x7fc81c149d70 2024-09-17T06:04:57.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.206+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc81c1e5220 con 0x7fc81c149d70 2024-09-17T06:04:57.211 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:04:57.211 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:04:57.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.206+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fc81c063dc0 0x7fc81c0641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.206+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fc81c0c2a70 con 0x7fc81c063dc0 2024-09-17T06:04:57.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.206+0000 7fc820d72640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fc81c063dc0 0x7fc81c0641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.206+0000 7fc820d72640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fc81c063dc0 0x7fc81c0641d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:57.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.210+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc81c0c2a70 con 0x7fc81c063dc0 2024-09-17T06:04:57.213 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:57.211+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:57.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.222+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc81c14d9c0 con 0x7fc81c063dc0 2024-09-17T06:04:57.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.226+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc81c14d9c0 con 0x7fc81c063dc0 2024-09-17T06:04:57.228 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:04:57.228 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:04:57.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.226+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc81c071480 0x7fc81c02d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.226+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fc81c14dbd0 con 0x7fc81c071480 2024-09-17T06:04:57.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.226+0000 7fc821d74640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc81c071480 0x7fc81c02d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.226+0000 7fc821d74640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc81c071480 0x7fc81c02d4d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:57.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.226+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc81c14dbd0 con 0x7fc81c071480 2024-09-17T06:04:57.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.238+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc81c071ba0 con 0x7fc81c071480 2024-09-17T06:04:57.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.242+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc81c071ba0 con 0x7fc81c071480 2024-09-17T06:04:57.245 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:04:57.246 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:04:57.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.242+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fc81c02df20 0x7fc81c02e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.242+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fc81c14dbd0 con 0x7fc81c02df20 2024-09-17T06:04:57.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.242+0000 7fc821573640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fc81c02df20 0x7fc81c02e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.242+0000 7fc821573640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fc81c02df20 0x7fc81c02e330 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:57.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.246+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc81c14dbd0 con 0x7fc81c02df20 2024-09-17T06:04:57.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.258+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc81c14dbf0 con 0x7fc81c02df20 2024-09-17T06:04:57.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.262+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc81806bbc0 con 0x7fc81c02df20 2024-09-17T06:04:57.268 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:04:57.268 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:04:57.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.266+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc81c206270 0x7fc81c208690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.266+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fc81c20b530 con 0x7fc81c206270 2024-09-17T06:04:57.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.266+0000 7fc820d72640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc81c206270 0x7fc81c208690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.266+0000 7fc820d72640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc81c206270 0x7fc81c208690 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:57.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.266+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc81c20b530 con 0x7fc81c206270 2024-09-17T06:04:57.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.282+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc81c208bd0 con 0x7fc81c206270 2024-09-17T06:04:57.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.286+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc81c208bd0 con 0x7fc81c206270 2024-09-17T06:04:57.289 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:04:57.290 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:04:57.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.286+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fc81c2092f0 0x7fc81c209700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.286+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fc81c20e980 con 0x7fc81c2092f0 2024-09-17T06:04:57.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.286+0000 7fc821d74640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fc81c2092f0 0x7fc81c209700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.286+0000 7fc821d74640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fc81c2092f0 0x7fc81c209700 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:57.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.290+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc81c20e980 con 0x7fc81c2092f0 2024-09-17T06:04:57.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.302+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc81c20d780 con 0x7fc81c2092f0 2024-09-17T06:04:57.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.306+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc81c20d780 con 0x7fc81c2092f0 2024-09-17T06:04:57.311 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:04:57.312 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:04:57.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.310+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fc81c20de00 0x7fc81c20e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:57.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.310+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fc81c211d20 con 0x7fc81c20de00 2024-09-17T06:04:57.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.310+0000 7fc821573640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fc81c20de00 0x7fc81c20e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:57.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.310+0000 7fc821573640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fc81c20de00 0x7fc81c20e230 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:57.313 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:57.311+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:57.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.310+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc81c211d20 con 0x7fc81c20de00 2024-09-17T06:04:57.322 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:57.322 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:57.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.326+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc81c209c40 con 0x7fc81c20de00 2024-09-17T06:04:57.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc811ffb640 1 -- 172.21.15.122:0/349541933 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc81c209c40 con 0x7fc81c20de00 2024-09-17T06:04:57.334 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:04:57.336 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:04:57.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fc81c1e3f00 msgr2=0x7fc81c1e4310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fc81c1e3f00 0x7fc81c1e4310 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fc81c149d70 msgr2=0x7fc81c14a180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fc81c149d70 0x7fc81c14a180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fc81c063dc0 msgr2=0x7fc81c0641d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fc81c063dc0 0x7fc81c0641d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc81c071480 msgr2=0x7fc81c02d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc81c071480 0x7fc81c02d4d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fc81c02df20 msgr2=0x7fc81c02e330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fc81c02df20 0x7fc81c02e330 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc821d74640 1 -- 172.21.15.122:0/349541933 reap_dead start 2024-09-17T06:04:57.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc81c206270 msgr2=0x7fc81c208690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc81c206270 0x7fc81c208690 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc821d74640 1 -- 172.21.15.122:0/349541933 reap_dead start 2024-09-17T06:04:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fc81c2092f0 msgr2=0x7fc81c209700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fc81c2092f0 0x7fc81c209700 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fc81c20de00 msgr2=0x7fc81c20e230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fc81c20de00 0x7fc81c20e230 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc821d74640 1 -- 172.21.15.122:0/349541933 reap_dead start 2024-09-17T06:04:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc800073230 msgr2=0x7fc800075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc800073230 0x7fc800075740 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009b60 tx=0x7fc80c0091e0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc81c1e21d0 msgr2=0x7fc81c0c31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc81c1e21d0 0x7fc81c0c31a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc818001820 tx=0x7fc81800e770 comp rx=0 tx=0).stop 2024-09-17T06:04:57.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 shutdown_connections 2024-09-17T06:04:57.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc800073230 0x7fc800075740 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 --2- 172.21.15.122:0/349541933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc81c1e21d0 0x7fc81c0c31a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.330+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 >> 172.21.15.122:0/349541933 conn(0x7fc81c06ce90 msgr2=0x7fc81c14e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:57.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.334+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 shutdown_connections 2024-09-17T06:04:57.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.334+0000 7fc8237d7640 1 -- 172.21.15.122:0/349541933 wait complete. 2024-09-17T06:04:57.340 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:04:57.440 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:57.438+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:57.515 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:57.510+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:57.538 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:57.538 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:57.555 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:04:57.616 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:57.611+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:57.717 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:57.715+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:57.745 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:57.745 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:57.763 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:04:57.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7fea9ffff640 1 -- 172.21.15.122:0/1369773197 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v32) ==== 101+0+0 (secure 0 0 0) 0x7feaac016410 con 0x7feab814e9e0 2024-09-17T06:04:57.796 INFO:teuthology.orchestra.run.smithi122.stderr:nodeep-scrub is unset 2024-09-17T06:04:57.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7feabdd9d640 1 -- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7feaa4073200 msgr2=0x7feaa4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7feabdd9d640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7feaa4073200 0x7feaa4075710 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feaa8001230 tx=0x7feaa8009040 comp rx=0 tx=0).stop 2024-09-17T06:04:57.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7feabdd9d640 1 -- 172.21.15.122:0/1369773197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feab814e9e0 msgr2=0x7feab814f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:57.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7feabdd9d640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feab814e9e0 0x7feab814f330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feaac01cd90 tx=0x7feaac005ca0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7feabdd9d640 1 -- 172.21.15.122:0/1369773197 shutdown_connections 2024-09-17T06:04:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7feabdd9d640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7feaa4073200 0x7feaa4075710 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7feabdd9d640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feab815bcf0 0x7feab80cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7feabdd9d640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feab814e9e0 0x7feab814f330 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7feabdd9d640 1 --2- 172.21.15.122:0/1369773197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feab80c67a0 0x7feab81f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7feabdd9d640 1 -- 172.21.15.122:0/1369773197 >> 172.21.15.122:0/1369773197 conn(0x7feab80746d0 msgr2=0x7feab814b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7feabdd9d640 1 -- 172.21.15.122:0/1369773197 shutdown_connections 2024-09-17T06:04:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:57.794+0000 7feabdd9d640 1 -- 172.21.15.122:0/1369773197 wait complete. 2024-09-17T06:04:57.817 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:57.815+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:57.906 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:57.906 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:57.919 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:04:57.914+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:04:57.922 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:04:58.020 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:58.015+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:58.104 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:58.105 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:58.120 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:58.115+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:58.122 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:04:58.221 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:58.219+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:58.272 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:58.272 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:58.290 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:04:58.321 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:58.319+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:58.423 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:04:58.419+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:04:58.439 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:58.440 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:58.457 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:04:58.524 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:58.518+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:58.607 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:58.608 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:58.625 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:58.623+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:58.625 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:04:58.725 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:58.722+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:58.818 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:58.818 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:58.826 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:58.822+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:58.836 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:04:58.927 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:58.923+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:59.028 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:59.026+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:59.029 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:59.029 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:59.047 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:04:59.129 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:59.127+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:59.230 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:04:59.226+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:04:59.243 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:59.243 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:59.261 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T06:04:59.331 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:04:59.326+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:04:59.355 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:04:59.420 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:04:59.420 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:04:59.432 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:59.427+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:04:59.437 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T06:04:59.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.510+0000 7f9ba7589640 1 -- 172.21.15.122:0/2562979936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0151950 msgr2=0x7f9ba00c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.510+0000 7f9ba7589640 1 --2- 172.21.15.122:0/2562979936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0151950 0x7f9ba00c2010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00b2750 tx=0x7f9b9001c7a0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.510+0000 7f9ba7589640 1 -- 172.21.15.122:0/2562979936 shutdown_connections 2024-09-17T06:04:59.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.510+0000 7f9ba7589640 1 --2- 172.21.15.122:0/2562979936 >> v2:172.21.15.173:3300/0 conn(0x7f9ba00c2550 0x7f9ba00c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.510+0000 7f9ba7589640 1 --2- 172.21.15.122:0/2562979936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0151950 0x7f9ba00c2010 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.510+0000 7f9ba7589640 1 -- 172.21.15.122:0/2562979936 >> 172.21.15.122:0/2562979936 conn(0x7f9ba0070d80 msgr2=0x7f9ba0072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:59.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.510+0000 7f9ba7589640 1 -- 172.21.15.122:0/2562979936 shutdown_connections 2024-09-17T06:04:59.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.510+0000 7f9ba7589640 1 -- 172.21.15.122:0/2562979936 wait complete. 2024-09-17T06:04:59.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba7589640 1 Processor -- start 2024-09-17T06:04:59.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba7589640 1 -- start start 2024-09-17T06:04:59.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba7589640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ba00c2550 0x7f9ba014cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:59.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba7589640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ba0151950 0x7f9ba013d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:59.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba7589640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0158290 0x7f9ba013dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:59.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba7589640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba00c3f30 con 0x7f9ba0158290 2024-09-17T06:04:59.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba7589640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba00c3a60 con 0x7f9ba00c2550 2024-09-17T06:04:59.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba7589640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba00c40b0 con 0x7f9ba0151950 2024-09-17T06:04:59.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba5b26640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0158290 0x7f9ba013dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:59.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba5b26640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0158290 0x7f9ba013dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54806/0 (socket says 172.21.15.122:54806) 2024-09-17T06:04:59.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba5b26640 1 -- 172.21.15.122:0/19385555 learned_addr learned my addr 172.21.15.122:0/19385555 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:04:59.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba5325640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ba00c2550 0x7f9ba014cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:59.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba4b24640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ba0151950 0x7f9ba013d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:59.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba5b26640 1 -- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ba0151950 msgr2=0x7f9ba013d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba5b26640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ba0151950 0x7f9ba013d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba5b26640 1 -- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ba00c2550 msgr2=0x7f9ba014cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba5b26640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ba00c2550 0x7f9ba014cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba5b26640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba01645f0 con 0x7f9ba0158290 2024-09-17T06:04:59.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba5b26640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0158290 0x7f9ba013dd70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800eab0 tx=0x7f9b9800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:59.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9800cea0 con 0x7f9ba0158290 2024-09-17T06:04:59.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b98004b30 con 0x7f9ba0158290 2024-09-17T06:04:59.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba0161aa0 con 0x7f9ba0158290 2024-09-17T06:04:59.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98005020 con 0x7f9ba0158290 2024-09-17T06:04:59.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba0164b70 con 0x7f9ba0158290 2024-09-17T06:04:59.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.514+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f9ba00c79f0 con 0x7f9ba0158290 2024-09-17T06:04:59.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.518+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9b980051c0 con 0x7f9ba0158290 2024-09-17T06:04:59.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.518+0000 7f9b95ffb640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9b84073200 0x7f9b84075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:59.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.518+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6780+0+0 (secure 0 0 0) 0x7f9b98095780 con 0x7f9ba0158290 2024-09-17T06:04:59.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.518+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v32) ==== 54+0+16 (secure 0 0 0) 0x7f9b98026020 con 0x7f9ba0158290 2024-09-17T06:04:59.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.518+0000 7f9ba5325640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9b84073200 0x7f9b84075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:59.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.518+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f9ba0161570 0x7f9ba01418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:59.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.518+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ba0144f90 con 0x7f9ba0161570 2024-09-17T06:04:59.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.518+0000 7f9ba4b24640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f9ba0161570 0x7f9ba01418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:59.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.518+0000 7f9ba5325640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9b84073200 0x7f9b84075710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c007fd0 tx=0x7f9b9c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:59.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.518+0000 7f9ba4b24640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f9ba0161570 0x7f9ba01418e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:59.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.518+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ba0144f90 con 0x7f9ba0161570 2024-09-17T06:04:59.533 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:04:59.530+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:04:59.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.534+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f9ba0141e20 con 0x7f9ba0161570 2024-09-17T06:04:59.539 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.534+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9ba0141e20 con 0x7f9ba0161570 2024-09-17T06:04:59.539 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:04:59.540 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:04:59.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.534+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f9ba0165490 0x7f9ba01658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:59.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.534+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f9ba0155cc0 con 0x7f9ba0165490 2024-09-17T06:04:59.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.538+0000 7f9ba5325640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f9ba0165490 0x7f9ba01658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:59.540 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.538+0000 7f9ba5325640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f9ba0165490 0x7f9ba01658a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:59.541 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.538+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ba0155cc0 con 0x7f9ba0165490 2024-09-17T06:04:59.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.550+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f9ba013edc0 con 0x7f9ba0165490 2024-09-17T06:04:59.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.554+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9ba013edc0 con 0x7f9ba0165490 2024-09-17T06:04:59.556 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:04:59.557 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:04:59.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.554+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f9ba00638b0 0x7f9ba0063cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:59.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.554+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f9ba01662f0 con 0x7f9ba00638b0 2024-09-17T06:04:59.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.554+0000 7f9ba4b24640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f9ba00638b0 0x7f9ba0063cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:59.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.554+0000 7f9ba4b24640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f9ba00638b0 0x7f9ba0063cc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:59.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.554+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ba01662f0 con 0x7f9ba00638b0 2024-09-17T06:04:59.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.566+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f9ba0165090 con 0x7f9ba00638b0 2024-09-17T06:04:59.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.570+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9ba0165090 con 0x7f9ba00638b0 2024-09-17T06:04:59.573 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:04:59.573 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:04:59.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.570+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f9ba00645c0 0x7f9ba014c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:59.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.570+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f9ba014c620 con 0x7f9ba00645c0 2024-09-17T06:04:59.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.570+0000 7f9ba5b26640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f9ba00645c0 0x7f9ba014c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:59.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.570+0000 7f9ba5b26640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f9ba00645c0 0x7f9ba014c0e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:59.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.570+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ba014c620 con 0x7f9ba00645c0 2024-09-17T06:04:59.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.582+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f9ba014cab0 con 0x7f9ba00645c0 2024-09-17T06:04:59.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.586+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9ba014cab0 con 0x7f9ba00645c0 2024-09-17T06:04:59.589 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:04:59.590 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:04:59.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.586+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f9ba002dda0 0x7f9ba002e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:59.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.586+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f9ba014cab0 con 0x7f9ba002dda0 2024-09-17T06:04:59.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.586+0000 7f9ba5325640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f9ba002dda0 0x7f9ba002e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:59.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.586+0000 7f9ba5325640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f9ba002dda0 0x7f9ba002e1b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:59.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.590+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ba014cab0 con 0x7f9ba002dda0 2024-09-17T06:04:59.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.602+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f9ba014cab0 con 0x7f9ba002dda0 2024-09-17T06:04:59.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.606+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9ba014cab0 con 0x7f9ba002dda0 2024-09-17T06:04:59.611 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:04:59.611 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:04:59.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.606+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f9ba0209b10 0x7f9ba020bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:59.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.606+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f9ba014cab0 con 0x7f9ba0209b10 2024-09-17T06:04:59.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.606+0000 7f9ba4b24640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f9ba0209b10 0x7f9ba020bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:59.612 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.610+0000 7f9ba4b24640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f9ba0209b10 0x7f9ba020bf30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:59.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.610+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ba014cab0 con 0x7f9ba0209b10 2024-09-17T06:04:59.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.626+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f9ba014cab0 con 0x7f9ba0209b10 2024-09-17T06:04:59.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.630+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9ba014cab0 con 0x7f9ba0209b10 2024-09-17T06:04:59.632 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:04:59.632 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:04:59.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.630+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f9ba020c980 0x7f9ba020eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:59.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.630+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f9ba0165240 con 0x7f9ba020c980 2024-09-17T06:04:59.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.630+0000 7f9ba5b26640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f9ba020c980 0x7f9ba020eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:59.634 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:59.634 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:04:59.634 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:04:59.634 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:04:59.634 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:59.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.630+0000 7f9ba5b26640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f9ba020c980 0x7f9ba020eda0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:59.634 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:04:59.630+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:04:59.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.630+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ba0165240 con 0x7f9ba020c980 2024-09-17T06:04:59.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.646+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f9ba0165240 con 0x7f9ba020c980 2024-09-17T06:04:59.651 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T06:04:59.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.650+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9ba0165240 con 0x7f9ba020c980 2024-09-17T06:04:59.654 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:04:59.654 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:04:59.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.650+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f9ba020f7f0 0x7f9ba0211c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:04:59.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.650+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f9ba0214a60 con 0x7f9ba020f7f0 2024-09-17T06:04:59.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.650+0000 7f9ba5325640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f9ba020f7f0 0x7f9ba0211c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:04:59.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.650+0000 7f9ba5325640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f9ba020f7f0 0x7f9ba0211c10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:04:59.656 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.654+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ba0214a60 con 0x7f9ba020f7f0 2024-09-17T06:04:59.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.666+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f9ba02121d0 con 0x7f9ba020f7f0 2024-09-17T06:04:59.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9b95ffb640 1 -- 172.21.15.122:0/19385555 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9ba02121d0 con 0x7f9ba020f7f0 2024-09-17T06:04:59.674 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:04:59.676 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:04:59.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f9ba0161570 msgr2=0x7f9ba01418e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f9ba0161570 0x7f9ba01418e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f9ba0165490 msgr2=0x7f9ba01658a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f9ba0165490 0x7f9ba01658a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f9ba00638b0 msgr2=0x7f9ba0063cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f9ba00638b0 0x7f9ba0063cc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f9ba00645c0 msgr2=0x7f9ba014c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f9ba00645c0 0x7f9ba014c0e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba5b26640 1 -- 172.21.15.122:0/19385555 reap_dead start 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f9ba002dda0 msgr2=0x7f9ba002e1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f9ba002dda0 0x7f9ba002e1b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f9ba0209b10 msgr2=0x7f9ba020bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f9ba0209b10 0x7f9ba020bf30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f9ba020c980 msgr2=0x7f9ba020eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f9ba020c980 0x7f9ba020eda0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f9ba020f7f0 msgr2=0x7f9ba0211c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f9ba020f7f0 0x7f9ba0211c10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba5b26640 1 -- 172.21.15.122:0/19385555 reap_dead start 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9b84073200 msgr2=0x7f9b84075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9b84073200 0x7f9b84075710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c007fd0 tx=0x7f9b9c009040 comp rx=0 tx=0).stop 2024-09-17T06:04:59.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0158290 msgr2=0x7f9ba013dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:04:59.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0158290 0x7f9ba013dd70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800eab0 tx=0x7f9b9800ef70 comp rx=0 tx=0).stop 2024-09-17T06:04:59.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 shutdown_connections 2024-09-17T06:04:59.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ba0158290 0x7f9ba013dd70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 --2- 172.21.15.122:0/19385555 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9b84073200 0x7f9b84075710 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:04:59.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 >> 172.21.15.122:0/19385555 conn(0x7f9ba0070d80 msgr2=0x7f9ba0068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:04:59.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 shutdown_connections 2024-09-17T06:04:59.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:04:59.670+0000 7f9ba7589640 1 -- 172.21.15.122:0/19385555 wait complete. 2024-09-17T06:04:59.735 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:59.731+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:59.802 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:04:59.803 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:04:59.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:04:59.803 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:04:59.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.803 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:04:59.803 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:04:59.803 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 45.982253387, 2024-09-17T06:04:59.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.013495551, 2024-09-17T06:04:59.803 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:59.803 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:59.803 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820818+0000", 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.858e-06 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820836+0000", 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7955e-05 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820863+0000", 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7013999999999999e-05 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820885+0000", 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1695000000000002e-05 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821084+0000", 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019876400000000001 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821305+0000", 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022121099999999999 2024-09-17T06:04:59.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.807 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.807 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:04:59.807 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821563+0000", 2024-09-17T06:04:59.807 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025797100000000001 2024-09-17T06:04:59.807 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.807 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.807 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:04:59.807 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825504+0000", 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039410119999999998 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834165+0000", 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086608810000000005 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834252+0000", 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7276999999999998e-05 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.809 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:59.809 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834311+0000", 2024-09-17T06:04:59.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8913000000000003e-05 2024-09-17T06:04:59.809 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.809 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:59.809 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.809 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.809 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.809 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:59.809 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:04:59.809 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 45.979030113, 2024-09-17T06:04:59.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037604380000000001, 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:04:59.810 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824040+0000", 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8649999999999999e-06 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824070+0000", 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9162e-05 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:59.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824088+0000", 2024-09-17T06:04:59.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8529000000000002e-05 2024-09-17T06:04:59.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:59.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824103+0000", 2024-09-17T06:04:59.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5081e-05 2024-09-17T06:04:59.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:59.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824193+0000", 2024-09-17T06:04:59.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9896999999999997e-05 2024-09-17T06:04:59.813 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.813 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.813 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:59.813 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:04:59.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1649000000000001e-05 2024-09-17T06:04:59.813 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.813 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.813 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:59.813 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827740+0000", 2024-09-17T06:04:59.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035152069999999998 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827799+0000", 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9048000000000001e-05 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 45.978844561000002, 2024-09-17T06:04:59.814 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035104340000000002, 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.815 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1909999999999999e-06 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824237+0000", 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1914e-05 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824252+0000", 2024-09-17T06:04:59.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5071e-05 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824265+0000", 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2748000000000001e-05 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824346+0000", 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0530000000000003e-05 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:59.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824375+0000", 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9805e-05 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827659+0000", 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032838569999999998 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827735+0000", 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5318e-05 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.818 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 75 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 45.978647760999998, 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003402553, 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:59.819 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824422+0000", 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3399999999999998e-07 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.820 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:59.821 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824434+0000", 2024-09-17T06:04:59.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1960000000000001e-05 2024-09-17T06:04:59.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.821 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:59.821 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824771+0000", 2024-09-17T06:04:59.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033676799999999998 2024-09-17T06:04:59.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.821 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:59.821 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824798+0000", 2024-09-17T06:04:59.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7838e-05 2024-09-17T06:04:59.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:59.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824920+0000", 2024-09-17T06:04:59.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012210699999999999 2024-09-17T06:04:59.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:59.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827824+0000", 2024-09-17T06:04:59.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029030459999999998 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 4 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 45.977961252999997, 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003032833, 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:59.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825108+0000", 2024-09-17T06:04:59.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6099999999999999e-07 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825120+0000", 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1780000000000001e-05 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825136+0000", 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6229999999999999e-05 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825152+0000", 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6104e-05 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825297+0000", 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014498399999999999 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828140+0000", 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002842874 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.826 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 45.973252473999999, 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032580460000000001, 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.827 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829817+0000", 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.176e-06 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0178e-05 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829847+0000", 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9402000000000002e-05 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829858+0000", 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1141000000000001e-05 2024-09-17T06:04:59.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830004+0000", 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014622699999999999 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830027+0000", 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2826000000000001e-05 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833000+0000", 2024-09-17T06:04:59.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029729000000000001 2024-09-17T06:04:59.831 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.831 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:59.831 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833074+0000", 2024-09-17T06:04:59.831 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4196000000000006e-05 2024-09-17T06:04:59.831 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.831 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:59.831 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.831 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.831 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-17T06:04:59.832 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:04:59.832 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 45.972137693000001, 2024-09-17T06:04:59.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0043957220000000003, 2024-09-17T06:04:59.832 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:59.832 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:59.832 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:04:59.832 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:59.832 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.832 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:59.832 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:04:59.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830933+0000", 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5090000000000001e-06 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830946+0000", 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3018e-05 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830968+0000", 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2558999999999999e-05 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830984+0000", 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5376999999999999e-05 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831072+0000", 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8745000000000005e-05 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831104+0000", 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1265e-05 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835260+0000", 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0041569559999999998 2024-09-17T06:04:59.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835327+0000", 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.6292999999999997e-05 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 45.96903416, 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029529399999999998, 2024-09-17T06:04:59.836 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:04:59.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.838 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:04:59.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834036+0000", 2024-09-17T06:04:59.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9999999999999995e-07 2024-09-17T06:04:59.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.838 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:04:59.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834042+0000", 2024-09-17T06:04:59.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.7240000000000003e-06 2024-09-17T06:04:59.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834058+0000", 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5648e-05 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834068+0000", 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0383999999999999e-05 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834145+0000", 2024-09-17T06:04:59.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.64e-05 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834157+0000", 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2414e-05 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834330+0000", 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017272399999999999 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:59.840 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.841 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:04:59.841 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:04:59.841 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:04:59.841 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-17T06:04:59.841 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T06:04:59.841 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-17T06:04:59.841 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T06:04:59.841 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T06:04:59.842 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-17T06:04:59.842 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T06:04:59.843 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:04:59.844 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:04:59.839+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:04:59.944 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:04:59.939+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:00.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.006+0000 7f8589685640 1 -- 172.21.15.122:0/1043328665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8584072270 msgr2=0x7f8584072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:00.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.006+0000 7f8589685640 1 --2- 172.21.15.122:0/1043328665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8584072270 0x7f8584072680 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8578009bc0 tx=0x7f857801f2d0 comp rx=0 tx=0).stop 2024-09-17T06:05:00.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.006+0000 7f8589685640 1 -- 172.21.15.122:0/1043328665 shutdown_connections 2024-09-17T06:05:00.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.006+0000 7f8589685640 1 --2- 172.21.15.122:0/1043328665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8584072270 0x7f8584072680 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:00.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.006+0000 7f8589685640 1 --2- 172.21.15.122:0/1043328665 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85840c67a0 0x7f858414e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:00.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.006+0000 7f8589685640 1 -- 172.21.15.122:0/1043328665 >> 172.21.15.122:0/1043328665 conn(0x7f85840746d0 msgr2=0x7f8584074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:00.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.006+0000 7f8589685640 1 -- 172.21.15.122:0/1043328665 shutdown_connections 2024-09-17T06:05:00.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.006+0000 7f8589685640 1 -- 172.21.15.122:0/1043328665 wait complete. 2024-09-17T06:05:00.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f8589685640 1 Processor -- start 2024-09-17T06:05:00.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f8589685640 1 -- start start 2024-09-17T06:05:00.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f8589685640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8584072270 0x7f8584148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:00.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f8589685640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85840c67a0 0x7f85840c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:00.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f8589685640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f858415b7b0 0x7f8584154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:00.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f8589685640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8584158a70 con 0x7f858415b7b0 2024-09-17T06:05:00.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f8589685640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8584158790 con 0x7f85840c67a0 2024-09-17T06:05:00.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f8589685640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8584158d50 con 0x7f8584072270 2024-09-17T06:05:00.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f85837fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f858415b7b0 0x7f8584154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:00.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f85837fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f858415b7b0 0x7f8584154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54822/0 (socket says 172.21.15.122:54822) 2024-09-17T06:05:00.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f85837fe640 1 -- 172.21.15.122:0/632675046 learned_addr learned my addr 172.21.15.122:0/632675046 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:00.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f8582ffd640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8584072270 0x7f8584148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:00.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f85827fc640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85840c67a0 0x7f85840c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:00.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f85837fe640 1 -- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8584072270 msgr2=0x7f8584148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:00.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f85837fe640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8584072270 0x7f8584148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:00.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f85837fe640 1 -- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85840c67a0 msgr2=0x7f85840c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:00.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f85837fe640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85840c67a0 0x7f85840c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:00.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f85837fe640 1 -- 172.21.15.122:0/632675046 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858414bdd0 con 0x7f858415b7b0 2024-09-17T06:05:00.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f85837fe640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f858415b7b0 0x7f8584154e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c500 tx=0x7f857c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:00.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f856b7fe640 1 -- 172.21.15.122:0/632675046 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c011790 con 0x7f858415b7b0 2024-09-17T06:05:00.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f856b7fe640 1 -- 172.21.15.122:0/632675046 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f857c017070 con 0x7f858415b7b0 2024-09-17T06:05:00.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f8589685640 1 -- 172.21.15.122:0/632675046 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85841ef7e0 con 0x7f858415b7b0 2024-09-17T06:05:00.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f856b7fe640 1 -- 172.21.15.122:0/632675046 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c011ce0 con 0x7f858415b7b0 2024-09-17T06:05:00.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.010+0000 7f8589685640 1 -- 172.21.15.122:0/632675046 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85841efda0 con 0x7f858415b7b0 2024-09-17T06:05:00.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.014+0000 7f8589685640 1 -- 172.21.15.122:0/632675046 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8584152620 con 0x7f858415b7b0 2024-09-17T06:05:00.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.014+0000 7f856b7fe640 1 -- 172.21.15.122:0/632675046 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f857c026430 con 0x7f858415b7b0 2024-09-17T06:05:00.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.014+0000 7f856b7fe640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8570073200 0x7f8570075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:00.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.014+0000 7f856b7fe640 1 -- 172.21.15.122:0/632675046 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6780+0+0 (secure 0 0 0) 0x7f857c094e60 con 0x7f858415b7b0 2024-09-17T06:05:00.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.014+0000 7f8582ffd640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8570073200 0x7f8570075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:00.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.014+0000 7f8582ffd640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8570073200 0x7f8570075710 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8574009b40 tx=0x7f85740091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:00.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.018+0000 7f856b7fe640 1 -- 172.21.15.122:0/632675046 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f857c05f520 con 0x7f858415b7b0 2024-09-17T06:05:00.032 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "success": "" 2024-09-17T06:05:00.033 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:00.033 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:00.033 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:00.045 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:00.039+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:00.053 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:05:00.146 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:00.142+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:00.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.198+0000 7f8589685640 1 -- 172.21.15.122:0/632675046 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) -- 0x7f85840c33d0 con 0x7f858415b7b0 2024-09-17T06:05:00.238 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:00.239 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:00.239 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:00.239 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:00.239 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:00.247 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:00.242+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:00.255 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:05:00.348 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:00.346+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:00.398 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:00.398 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:00.398 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:00.398 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:00.398 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.398 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:00.398 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:00.398 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 46.575237528000002, 2024-09-17T06:05:00.398 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:00.399 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.400 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.401 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:05:00.402 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:05:00.403 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:00.403 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:00.403 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:00.403 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.403 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.403 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:00.403 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 46.575125303999997, 2024-09-17T06:05:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:05:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:05:00.405 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:00.406 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 46.574919954000002, 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:00.408 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.409 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:05:00.410 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.411 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.411 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:00.411 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:05:00.411 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:05:00.411 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.411 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.411 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:00.411 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:05:00.411 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:05:00.411 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:00.412 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:05:00.413 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:05:00.413 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:00.413 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:00.413 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:00.413 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.413 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.413 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:00.413 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:00.413 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 46.568779427999999, 2024-09-17T06:05:00.413 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:00.414 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:00.415 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.416 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 46.568624702000001, 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:00.418 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.419 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.420 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:05:00.421 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.422 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.422 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:00.422 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:05:00.422 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:05:00.422 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:00.422 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:00.422 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:00.422 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:00.422 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:00.422 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:00.423 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:05:00.473 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:00.471+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:00.550 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:00.547+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:00.568 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:00.568 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:00.568 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:00.568 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:00.585 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:05:00.677 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:00.675+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:00.751 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:00.747+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:00.781 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:00.781 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:00.782 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:00.782 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:00.782 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:00.798 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:05:00.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.826+0000 7f856b7fe640 1 -- 172.21.15.122:0/632675046 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v33) ==== 87+0+0 (secure 0 0 0) 0x7f857c063f50 con 0x7f858415b7b0 2024-09-17T06:05:00.828 INFO:teuthology.orchestra.run.smithi122.stderr:noscrub is set 2024-09-17T06:05:00.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.826+0000 7f8589685640 1 -- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8570073200 msgr2=0x7f8570075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:00.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.826+0000 7f8589685640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8570073200 0x7f8570075710 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8574009b40 tx=0x7f85740091e0 comp rx=0 tx=0).stop 2024-09-17T06:05:00.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.826+0000 7f8589685640 1 -- 172.21.15.122:0/632675046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f858415b7b0 msgr2=0x7f8584154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:00.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.826+0000 7f8589685640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f858415b7b0 0x7f8584154e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c500 tx=0x7f857c00c9c0 comp rx=0 tx=0).stop 2024-09-17T06:05:00.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.826+0000 7f8589685640 1 -- 172.21.15.122:0/632675046 shutdown_connections 2024-09-17T06:05:00.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.830+0000 7f8589685640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f858415b7b0 0x7f8584154e80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:00.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.830+0000 7f8589685640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8570073200 0x7f8570075710 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:00.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.830+0000 7f8589685640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85840c67a0 0x7f85840c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:00.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.830+0000 7f8589685640 1 --2- 172.21.15.122:0/632675046 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8584072270 0x7f8584148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:00.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.830+0000 7f8589685640 1 -- 172.21.15.122:0/632675046 >> 172.21.15.122:0/632675046 conn(0x7f85840746d0 msgr2=0x7f858415bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:00.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.830+0000 7f8589685640 1 -- 172.21.15.122:0/632675046 shutdown_connections 2024-09-17T06:05:00.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:00.830+0000 7f8589685640 1 -- 172.21.15.122:0/632675046 wait complete. 2024-09-17T06:05:00.852 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:00.850+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:00.952 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:00.947+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:00.994 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:00.994 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:00.995 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:00.995 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:00.995 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.995 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:00.995 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:00.995 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.171009349000002, 2024-09-17T06:05:00.996 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:05:00.996 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:00.996 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:00.996 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:00.996 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:00.996 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:05:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:05:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:05:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:05:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:05:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:05:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:05:01.001 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.170888947000002, 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.002 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:05:01.003 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:05:01.004 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.005 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:05:01.006 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.007 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.170761032999998, 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:01.008 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.009 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.010 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:05:01.011 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.012 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.012 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.012 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:05:01.012 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:05:01.012 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.012 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.012 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.012 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:05:01.012 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:05:01.012 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.012 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.012 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:01.013 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.169735070000002, 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.014 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.015 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.016 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:05:01.016 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:05:01.016 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.016 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.016 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.016 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:05:01.016 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:05:01.016 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.016 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.016 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.016 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:05:01.016 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.018 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.169654127000001, 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:05:01.019 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.020 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:05:01.021 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.022 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.023 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.024 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.169591724999997, 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.025 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:01.026 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.026 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.026 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.026 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.026 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:01.026 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.026 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.026 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.026 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.026 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:05:01.026 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:05:01.026 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:05:01.027 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.028 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.029 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.030 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.169519635, 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.031 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.032 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:01.032 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.032 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.032 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.032 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.032 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:05:01.032 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:05:01.032 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.032 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.032 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.032 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:05:01.032 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.033 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.034 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.169477434999997, 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.035 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.036 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:05:01.037 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.038 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.166885503000003, 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.039 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.040 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.041 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.042 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.043 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.166789368000003, 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.044 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:05:01.045 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:05:01.046 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.047 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.158357082000002, 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.048 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:05:01.049 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.050 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.051 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.052 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.053 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.053 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:05:01.053 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:05:01.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.053 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.053 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.053 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:05:01.053 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.064767861999997, 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.054 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:05:01.055 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.056 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.057 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.058 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 40.394137497000003, 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.059 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:05:01.060 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.061 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.062 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:05:01.063 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 38.673466541000003, 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:05:01.064 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.065 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:05:01.066 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:05:01.067 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.068 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.069 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 38.670782291999998, 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.070 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.071 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:05:01.072 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.073 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.801579619000002, 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.074 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.075 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.076 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.077 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:05:01.078 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.079 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 17.275138707, 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.080 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.081 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.082 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.083 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:05:01.084 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 17.274909190999999, 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:05:01.085 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.086 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:05:01.087 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.088 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.089 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 17.272944495000001, 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.091 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:05:01.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.094 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.095 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:05:01.095 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:05:01.095 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.095 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.095 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.095 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.095 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.095 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:01.095 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:01.096 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 13.339381608, 2024-09-17T06:05:01.096 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:05:01.096 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.096 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.096 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.096 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.096 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.096 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.096 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:01.096 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.096 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.096 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:05:01.097 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:05:01.098 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.099 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.100 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.101 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.101 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:05:01.101 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:05:01.101 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.101 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.101 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.101 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.101 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.101 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:01.103 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:05:01.103 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:01.098+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:01.203 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:01.199+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:01.300 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:01.300 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:01.300 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:01.300 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:01.304 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:01.302+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:01.319 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:05:01.405 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:01.403+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:01.506 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:01.502+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:01.508 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:01.508 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:01.508 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:01.508 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:01.509 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:01.526 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:05:01.613 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:01.611+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:01.696 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:05:01.717 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:05:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 63.080369494000003, 2024-09-17T06:05:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.55819121299999996, 2024-09-17T06:05:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 1 2024-09-17T06:05:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:05:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:05:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636958+0000", 2024-09-17T06:05:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4690000000000002e-06 2024-09-17T06:05:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636976+0000", 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.802e-05 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637001+0000", 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4552000000000001e-05 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637024+0000", 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3391999999999999e-05 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637134+0000", 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000109715 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for peered", 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637157+0000", 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3363999999999999e-05 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.191892+0000", 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.55473470899999999 2024-09-17T06:05:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.192190+0000", 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029832200000000001 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.192541+0000", 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00035034999999999998 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.194061+0000", 2024-09-17T06:05:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0015205959999999999 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.194944+0000", 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00088236399999999996 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.195056+0000", 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011200399999999999 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.195146+0000", 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0356e-05 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.376076243, 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.01182241, 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.726 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.726 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.726 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.726 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 42 2024-09-17T06:05:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:05:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:05:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341249+0000", 2024-09-17T06:05:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0729999999999999e-06 2024-09-17T06:05:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341257+0000", 2024-09-17T06:05:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8800000000000008e-06 2024-09-17T06:05:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341275+0000", 2024-09-17T06:05:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7842e-05 2024-09-17T06:05:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341292+0000", 2024-09-17T06:05:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6829000000000001e-05 2024-09-17T06:05:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346218+0000", 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049260329999999998 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346372+0000", 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015433299999999999 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346635+0000", 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026296700000000002 2024-09-17T06:05:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351575+0000", 2024-09-17T06:05:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049397959999999998 2024-09-17T06:05:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352898+0000", 2024-09-17T06:05:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013230060000000001 2024-09-17T06:05:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352994+0000", 2024-09-17T06:05:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6045000000000006e-05 2024-09-17T06:05:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353070+0000", 2024-09-17T06:05:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6606000000000005e-05 2024-09-17T06:05:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.375583894000002, 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011645713, 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 43 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341743+0000", 2024-09-17T06:05:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.903e-06 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341764+0000", 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0988999999999998e-05 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341808+0000", 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3791000000000001e-05 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341839+0000", 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1216000000000001e-05 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.348686+0000", 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068463589999999998 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.348832+0000", 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014631 2024-09-17T06:05:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.349079+0000", 2024-09-17T06:05:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024698800000000001 2024-09-17T06:05:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353095+0000", 2024-09-17T06:05:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040160869999999998 2024-09-17T06:05:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353170+0000", 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4976999999999997e-05 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353259+0000", 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9305e-05 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353386+0000", 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012678799999999999 2024-09-17T06:05:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.375427160999998, 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015057846, 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 44 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341899+0000", 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9e-06 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342021+0000", 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012252000000000001 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342055+0000", 2024-09-17T06:05:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3095000000000001e-05 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342078+0000", 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3456e-05 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.349806+0000", 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.007728253 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.350088+0000", 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00028207900000000002 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.350527+0000", 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00043892200000000001 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353510+0000", 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029825590000000001 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356661+0000", 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0031514099999999999 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356817+0000", 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015552900000000001 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356955+0000", 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013812300000000001 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.375172267000004, 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015109994, 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 45 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342154+0000", 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9999999999999999e-06 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342170+0000", 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6506000000000001e-05 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342196+0000", 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5412e-05 2024-09-17T06:05:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342216+0000", 2024-09-17T06:05:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0191999999999999e-05 2024-09-17T06:05:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351692+0000", 2024-09-17T06:05:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0094760650000000005 2024-09-17T06:05:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351849+0000", 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015737600000000001 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352102+0000", 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025282000000000001 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356610+0000", 2024-09-17T06:05:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045081940000000001 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356984+0000", 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037321899999999999 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357126+0000", 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014265999999999999 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357262+0000", 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013554999999999999 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.375071331999997, 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015392114, 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 46 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:05:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342254+0000", 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4169999999999999e-06 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342268+0000", 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4086e-05 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342283+0000", 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4919000000000001e-05 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342297+0000", 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3993e-05 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353648+0000", 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011350783 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.754 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353815+0000", 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016706499999999999 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.354039+0000", 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022362599999999999 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357286+0000", 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003246882 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.755 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357422+0000", 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000136093 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357521+0000", 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.8876000000000007e-05 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357645+0000", 2024-09-17T06:05:01.756 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012437400000000001 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.374977012999999, 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.018409992999999999, 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.757 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 47 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.758 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342348+0000", 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.333e-06 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342464+0000", 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011581100000000001 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342485+0000", 2024-09-17T06:05:01.759 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0222000000000001e-05 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342512+0000", 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7158999999999999e-05 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.354773+0000", 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.012261752000000001 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.760 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.355011+0000", 2024-09-17T06:05:01.761 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000237982 2024-09-17T06:05:01.761 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.761 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.761 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.761 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.355427+0000", 2024-09-17T06:05:01.761 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000415234 2024-09-17T06:05:01.761 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.761 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.761 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.761 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357770+0000", 2024-09-17T06:05:01.761 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023435320000000002 2024-09-17T06:05:01.761 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360464+0000", 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026934820000000001 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360614+0000", 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015075900000000001 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360757+0000", 2024-09-17T06:05:01.762 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014272699999999999 2024-09-17T06:05:01.763 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.763 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.763 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.763 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.763 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.763 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.763 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:05:01.763 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.374761786999997, 2024-09-17T06:05:01.763 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.020363284999999998, 2024-09-17T06:05:01.763 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.763 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.763 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 48 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.764 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:05:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342564+0000", 2024-09-17T06:05:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5269999999999999e-06 2024-09-17T06:05:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342593+0000", 2024-09-17T06:05:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9261e-05 2024-09-17T06:05:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342617+0000", 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4258999999999999e-05 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342644+0000", 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6645999999999999e-05 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357867+0000", 2024-09-17T06:05:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015222591000000001 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.358013+0000", 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014652299999999999 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.358238+0000", 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000225193 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.767 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362590+0000", 2024-09-17T06:05:01.768 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.004351471 2024-09-17T06:05:01.768 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.768 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.768 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.768 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362643+0000", 2024-09-17T06:05:01.768 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2957000000000001e-05 2024-09-17T06:05:01.768 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.768 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.768 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.768 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362799+0000", 2024-09-17T06:05:01.768 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015606600000000001 2024-09-17T06:05:01.768 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362926+0000", 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012679100000000001 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.374636889999998, 2024-09-17T06:05:01.769 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.021916326, 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 49 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.770 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342689+0000", 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.79e-06 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342703+0000", 2024-09-17T06:05:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3653e-05 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342740+0000", 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6801000000000002e-05 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342761+0000", 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1713e-05 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359009+0000", 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.016247663999999998 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359291+0000", 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00028178399999999998 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359738+0000", 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00044704500000000003 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363113+0000", 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033748150000000002 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364339+0000", 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001226067 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364484+0000", 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014500599999999999 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364604+0000", 2024-09-17T06:05:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000119988 2024-09-17T06:05:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:05:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.374466914999999, 2024-09-17T06:05:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023299408000000001, 2024-09-17T06:05:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 50 2024-09-17T06:05:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:05:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:05:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342859+0000", 2024-09-17T06:05:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.663e-06 2024-09-17T06:05:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342981+0000", 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012199800000000001 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343001+0000", 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0432e-05 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343020+0000", 2024-09-17T06:05:01.778 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8236e-05 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360863+0000", 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.017843741 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.361095+0000", 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00023198199999999999 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.779 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.361364+0000", 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026886 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364745+0000", 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033806690000000002 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365860+0000", 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011155679999999999 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.780 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366017+0000", 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015673299999999999 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366157+0000", 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013952600000000001 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.781 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.374276883999997, 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023463673000000001, 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 51 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.782 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343048+0000", 2024-09-17T06:05:01.783 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0729999999999999e-06 2024-09-17T06:05:01.784 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.784 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.784 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.784 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343057+0000", 2024-09-17T06:05:01.784 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.2959999999999999e-06 2024-09-17T06:05:01.784 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.784 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.784 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.784 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343068+0000", 2024-09-17T06:05:01.784 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1793e-05 2024-09-17T06:05:01.784 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.784 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343094+0000", 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5882000000000001e-05 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363287+0000", 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.020192673000000001 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363457+0000", 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017029600000000001 2024-09-17T06:05:01.785 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363687+0000", 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022974099999999999 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366188+0000", 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025014049999999999 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.786 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366282+0000", 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3992000000000004e-05 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366378+0000", 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5152e-05 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366511+0000", 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013337000000000001 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.374211086999999, 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023823882000000001, 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.788 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 52 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.789 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343114+0000", 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5700000000000001e-07 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343122+0000", 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4919999999999993e-06 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.790 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343134+0000", 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1970000000000001e-05 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343144+0000", 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6690000000000001e-06 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364849+0000", 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.021704826 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.791 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365104+0000", 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025510700000000002 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365359+0000", 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025527500000000001 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366737+0000", 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001377739 2024-09-17T06:05:01.792 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366772+0000", 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4629000000000003e-05 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366865+0000", 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3220999999999994e-05 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366937+0000", 2024-09-17T06:05:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.2096999999999998e-05 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.103935292999999, 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010475561, 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.794 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.795 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.795 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.795 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 69 2024-09-17T06:05:01.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.795 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.795 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.795 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.795 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:05:01.795 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.795 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.795 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613390+0000", 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.8899999999999998e-07 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613458+0000", 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.8127999999999996e-05 2024-09-17T06:05:01.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613467+0000", 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0909999999999999e-06 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613474+0000", 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.2919999999999998e-06 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.797 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.615892+0000", 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002417836 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.615956+0000", 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3380000000000006e-05 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616042+0000", 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6012000000000003e-05 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.798 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619165+0000", 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00312321 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623808+0000", 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0046427339999999999 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623836+0000", 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8839999999999998e-05 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.799 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623864+0000", 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8048999999999999e-05 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.103817540999998, 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010433403000000001, 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.800 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.801 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.801 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.801 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.801 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.801 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 70 2024-09-17T06:05:01.801 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.801 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.801 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.801 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.801 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:01.801 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.801 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.8800000000000002e-07 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613512+0000", 2024-09-17T06:05:01.802 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.2719999999999999e-06 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613518+0000", 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.4350000000000002e-06 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613524+0000", 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5110000000000003e-06 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.803 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616673+0000", 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003149102 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616764+0000", 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1290000000000002e-05 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616880+0000", 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011597800000000001 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619172+0000", 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0022917670000000001 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623892+0000", 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.004720391 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623918+0000", 2024-09-17T06:05:01.805 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6186999999999998e-05 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623940+0000", 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1781999999999999e-05 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:05:01.806 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.103675385000003, 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010700696000000001, 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 71 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.807 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613650+0000", 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7300000000000005e-07 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613654+0000", 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6920000000000001e-06 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613662+0000", 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8439999999999998e-06 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613668+0000", 2024-09-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6400000000000002e-06 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617192+0000", 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035246499999999998 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617294+0000", 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000101259 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617388+0000", 2024-09-17T06:05:01.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4228999999999995e-05 2024-09-17T06:05:01.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620154+0000", 2024-09-17T06:05:01.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0027657459999999999 2024-09-17T06:05:01.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624067+0000", 2024-09-17T06:05:01.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039132730000000001 2024-09-17T06:05:01.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624226+0000", 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015945600000000001 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624349+0000", 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000123034 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.103645454999999, 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010774550000000001, 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 72 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.813 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.7399999999999998e-07 2024-09-17T06:05:01.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613717+0000", 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7406000000000001e-05 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613723+0000", 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.652e-06 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613728+0000", 2024-09-17T06:05:01.815 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6789999999999996e-06 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617676+0000", 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039476759999999998 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617728+0000", 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2871999999999998e-05 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617814+0000", 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5463999999999994e-05 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621037+0000", 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032232910000000001 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624400+0000", 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033624240000000001 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624430+0000", 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0552000000000002e-05 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624453+0000", 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3059999999999999e-05 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.103572911000001, 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010781999, 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 73 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.819 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.820 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613752+0000", 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.61e-07 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613758+0000", 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7209999999999999e-06 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613764+0000", 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3470000000000004e-06 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613769+0000", 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8810000000000004e-06 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618508+0000", 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047387669999999996 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618559+0000", 2024-09-17T06:05:01.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1440999999999998e-05 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618705+0000", 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014593900000000001 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621041+0000", 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023357400000000002 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624482+0000", 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034416999999999998 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624511+0000", 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8070000000000001e-05 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624533+0000", 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2731999999999999e-05 2024-09-17T06:05:01.824 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.103545101999998, 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010828374999999999, 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.825 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.826 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 74 2024-09-17T06:05:01.826 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.826 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.826 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.826 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:01.826 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.826 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.826 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.827 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:01.827 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.827 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.827 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.827 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.827 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:01.827 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8599999999999999e-07 2024-09-17T06:05:01.827 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.827 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.827 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.827 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613782+0000", 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7010000000000001e-06 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613787+0000", 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3980000000000001e-06 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613790+0000", 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.805e-06 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619344+0000", 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.005553685 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619427+0000", 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.2897000000000003e-05 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619562+0000", 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013549699999999999 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621581+0000", 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020184719999999999 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624559+0000", 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029778230000000001 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624586+0000", 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7093e-05 2024-09-17T06:05:01.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624607+0000", 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1617999999999999e-05 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.103473708999999, 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011087911000000001, 2024-09-17T06:05:01.831 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 75 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.832 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613851+0000", 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.1099999999999995e-07 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.833 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613923+0000", 2024-09-17T06:05:01.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1439999999999994e-05 2024-09-17T06:05:01.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.834 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.834 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613930+0000", 2024-09-17T06:05:01.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9629999999999998e-06 2024-09-17T06:05:01.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.834 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.834 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613936+0000", 2024-09-17T06:05:01.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5659999999999997e-06 2024-09-17T06:05:01.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620210+0000", 2024-09-17T06:05:01.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.006273514 2024-09-17T06:05:01.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620263+0000", 2024-09-17T06:05:01.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2982000000000002e-05 2024-09-17T06:05:01.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620363+0000", 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000100802 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621596+0000", 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012330329999999999 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624709+0000", 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003112971 2024-09-17T06:05:01.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624838+0000", 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012835099999999999 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624938+0000", 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000100678 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.10337354, 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011079701000000001, 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 76 2024-09-17T06:05:01.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:01.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1099999999999996e-07 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613954+0000", 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2009999999999999e-06 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613959+0000", 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0440000000000003e-06 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:01.840 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613964+0000", 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4329999999999997e-06 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621073+0000", 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0071095209999999997 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621133+0000", 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9740000000000001e-05 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.841 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:01.842 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621250+0000", 2024-09-17T06:05:01.842 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000117287 2024-09-17T06:05:01.842 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:01.842 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621908+0000", 2024-09-17T06:05:01.842 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00065739599999999998 2024-09-17T06:05:01.842 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624980+0000", 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0030722039999999998 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.625008+0000", 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8061000000000001e-05 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.625030+0000", 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2303e-05 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.843 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.844 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.844 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:01.844 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:01.844 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:01.845 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:01.738+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:01.846 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:05:01.846 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:01.842+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:01.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.858+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2642581375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48c4004810 msgr2=0x7f48c4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:01.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.858+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2642581375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48c4004810 0x7f48c4004c20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f48d400c310 tx=0x7f48d401cfc0 comp rx=0 tx=0).stop 2024-09-17T06:05:01.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.858+0000 7f48de197640 1 -- 172.21.15.122:0/2642581375 reap_dead start 2024-09-17T06:05:01.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.858+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2642581375 shutdown_connections 2024-09-17T06:05:01.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.858+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2642581375 >> 172.21.15.122:0/2642581375 conn(0x7f48d8070d80 msgr2=0x7f48d8072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:01.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.858+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2642581375 shutdown_connections 2024-09-17T06:05:01.861 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.858+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2642581375 wait complete. 2024-09-17T06:05:01.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.858+0000 7f48dfbfa640 1 Processor -- start 2024-09-17T06:05:01.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.858+0000 7f48dfbfa640 1 -- start start 2024-09-17T06:05:01.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.858+0000 7f48dfbfa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d8153780 0x7f48d80c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:01.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dfbfa640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f48d81ed790 0x7f48d8155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:01.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dfbfa640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d8154350 0x7f48d8154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:01.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dfbfa640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f48d80c2ac0 con 0x7f48d8153780 2024-09-17T06:05:01.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dfbfa640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f48d80c89c0 con 0x7f48d8154350 2024-09-17T06:05:01.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dfbfa640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f48d80c2da0 con 0x7f48d81ed790 2024-09-17T06:05:01.865 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dd996640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d8153780 0x7f48d80c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dd996640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d8153780 0x7f48d80c4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54848/0 (socket says 172.21.15.122:54848) 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dd996640 1 -- 172.21.15.122:0/2183245614 learned_addr learned my addr 172.21.15.122:0/2183245614 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dd195640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f48d81ed790 0x7f48d8155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48de197640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d8154350 0x7f48d8154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dd996640 1 -- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f48d81ed790 msgr2=0x7f48d8155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dd996640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f48d81ed790 0x7f48d8155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dd996640 1 -- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d8154350 msgr2=0x7f48d8154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dd996640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d8154350 0x7f48d8154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dd996640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d81ecfd0 con 0x7f48d8153780 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dd195640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f48d81ed790 0x7f48d8155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dd996640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d8153780 0x7f48d80c4fb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f48c800e9a0 tx=0x7f48c800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c800cc60 con 0x7f48d8153780 2024-09-17T06:05:01.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48c800ce00 con 0x7f48d8153780 2024-09-17T06:05:01.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d80c6a40 con 0x7f48d8153780 2024-09-17T06:05:01.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8005280 con 0x7f48d8153780 2024-09-17T06:05:01.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d80c4cd0 con 0x7f48d8153780 2024-09-17T06:05:01.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f48d80c3080 con 0x7f48d8153780 2024-09-17T06:05:01.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f48c8005420 con 0x7f48d8153780 2024-09-17T06:05:01.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48ce7fc640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f48bc073200 0x7f48bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:01.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6780+0+0 (secure 0 0 0) 0x7f48c8094ed0 con 0x7f48d8153780 2024-09-17T06:05:01.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v33) ==== 54+0+16 (secure 0 0 0) 0x7f48c8097550 con 0x7f48d8153780 2024-09-17T06:05:01.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.862+0000 7f48dd195640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f48bc073200 0x7f48bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:01.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.866+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f48d81ed1a0 0x7f48d814d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:01.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.866+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48d80c9ab0 con 0x7f48d81ed1a0 2024-09-17T06:05:01.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.866+0000 7f48de197640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f48d81ed1a0 0x7f48d814d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:01.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.866+0000 7f48de197640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f48d81ed1a0 0x7f48d814d3c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:01.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.866+0000 7f48dd195640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f48bc073200 0x7f48bc075710 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f48d40ac000 tx=0x7f48d4019e00 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:01.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.866+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48d80c9ab0 con 0x7f48d81ed1a0 2024-09-17T06:05:01.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.882+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f48d80c97d0 con 0x7f48d81ed1a0 2024-09-17T06:05:01.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.882+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f48d80c97d0 con 0x7f48d81ed1a0 2024-09-17T06:05:01.886 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:01.887 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:01.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.882+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f48d81f03b0 0x7f48d81f07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:01.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.882+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f48d81edba0 con 0x7f48d81f03b0 2024-09-17T06:05:01.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.882+0000 7f48dd996640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f48d81f03b0 0x7f48d81f07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:01.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.882+0000 7f48dd996640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f48d81f03b0 0x7f48d81f07c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:01.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.882+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48d81edba0 con 0x7f48d81f03b0 2024-09-17T06:05:01.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.898+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f48d81f0f50 con 0x7f48d81f03b0 2024-09-17T06:05:01.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.898+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f48d81f0f50 con 0x7f48d81f03b0 2024-09-17T06:05:01.903 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:01.904 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:01.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.898+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f48d8063dc0 0x7f48d80641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:01.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.898+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f48d8064710 con 0x7f48d8063dc0 2024-09-17T06:05:01.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.898+0000 7f48dd195640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f48d8063dc0 0x7f48d80641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:01.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.902+0000 7f48dd195640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f48d8063dc0 0x7f48d80641d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:01.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.902+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48d8064710 con 0x7f48d8063dc0 2024-09-17T06:05:01.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.914+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f48d81e3680 con 0x7f48d8063dc0 2024-09-17T06:05:01.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.918+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f48d81e3680 con 0x7f48d8063dc0 2024-09-17T06:05:01.920 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:01.921 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:01.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.918+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f48d802d4d0 0x7f48d802d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:01.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.918+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f48d81e3600 con 0x7f48d802d4d0 2024-09-17T06:05:01.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.918+0000 7f48de197640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f48d802d4d0 0x7f48d802d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:01.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.918+0000 7f48de197640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f48d802d4d0 0x7f48d802d8e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.918+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48d81e3600 con 0x7f48d802d4d0 2024-09-17T06:05:01.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.930+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f48d81e3600 con 0x7f48d802d4d0 2024-09-17T06:05:01.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.934+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f48d81e3600 con 0x7f48d802d4d0 2024-09-17T06:05:01.937 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:01.938 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:01.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.934+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f48d802e330 0x7f48d8201790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:01.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.934+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f48d802e740 con 0x7f48d802e330 2024-09-17T06:05:01.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.934+0000 7f48dd996640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f48d802e330 0x7f48d8201790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:01.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.934+0000 7f48dd996640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f48d802e330 0x7f48d8201790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:01.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.938+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48d802e740 con 0x7f48d802e330 2024-09-17T06:05:01.946 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:01.942+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:01.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.950+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f48d802e740 con 0x7f48d802e330 2024-09-17T06:05:01.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.954+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f48d802e740 con 0x7f48d802e330 2024-09-17T06:05:01.959 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:05:01.960 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:05:01.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.954+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f48d82021e0 0x7f48d8204600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:01.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.954+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f48d82073d0 con 0x7f48d82021e0 2024-09-17T06:05:01.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.954+0000 7f48dd195640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f48d82021e0 0x7f48d8204600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:01.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.958+0000 7f48dd195640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f48d82021e0 0x7f48d8204600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:01.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.958+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48d82073d0 con 0x7f48d82021e0 2024-09-17T06:05:01.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.970+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f48d8204b40 con 0x7f48d82021e0 2024-09-17T06:05:01.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.978+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f48d8204b40 con 0x7f48d82021e0 2024-09-17T06:05:01.980 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:01.981 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:01.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.978+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f48d82051c0 0x7f48d82075e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:01.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.978+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f48d820a540 con 0x7f48d82051c0 2024-09-17T06:05:01.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.978+0000 7f48de197640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f48d82051c0 0x7f48d82075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:01.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.978+0000 7f48de197640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f48d82051c0 0x7f48d82075e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:01.982 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:01.982 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:01.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.978+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48d820a540 con 0x7f48d82051c0 2024-09-17T06:05:01.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.994+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f48d820a510 con 0x7f48d82051c0 2024-09-17T06:05:01.998 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:05:02.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.998+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f48d820a510 con 0x7f48d82051c0 2024-09-17T06:05:02.002 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:02.003 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:02.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.998+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f48d8209770 0x7f48d8209ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:02.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.998+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f48d820d910 con 0x7f48d8209770 2024-09-17T06:05:02.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.998+0000 7f48dd996640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f48d8209770 0x7f48d8209ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:02.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:01.998+0000 7f48dd996640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f48d8209770 0x7f48d8209ba0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:02.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.002+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48d820d910 con 0x7f48d8209770 2024-09-17T06:05:02.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.014+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f48d8207b20 con 0x7f48d8209770 2024-09-17T06:05:02.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48ce7fc640 1 -- 172.21.15.122:0/2183245614 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f48d8207b20 con 0x7f48d8209770 2024-09-17T06:05:02.023 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:02.025 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:02.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f48d81ed1a0 msgr2=0x7f48d814d3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:02.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f48d81ed1a0 0x7f48d814d3c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:02.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f48d81f03b0 msgr2=0x7f48d81f07c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:02.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f48d81f03b0 0x7f48d81f07c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:02.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f48d8063dc0 msgr2=0x7f48d80641d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:02.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f48d8063dc0 0x7f48d80641d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:02.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f48d802d4d0 msgr2=0x7f48d802d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:02.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f48d802d4d0 0x7f48d802d8e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:02.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f48d802e330 msgr2=0x7f48d8201790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:02.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f48d802e330 0x7f48d8201790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f48d82021e0 msgr2=0x7f48d8204600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f48d82021e0 0x7f48d8204600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f48d82051c0 msgr2=0x7f48d82075e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f48d82051c0 0x7f48d82075e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48de197640 1 -- 172.21.15.122:0/2183245614 reap_dead start 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f48d8209770 msgr2=0x7f48d8209ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f48d8209770 0x7f48d8209ba0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.018+0000 7f48de197640 1 -- 172.21.15.122:0/2183245614 reap_dead start 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.022+0000 7f48de197640 1 -- 172.21.15.122:0/2183245614 reap_dead start 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.022+0000 7f48de197640 1 -- 172.21.15.122:0/2183245614 reap_dead start 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.022+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f48bc073200 msgr2=0x7f48bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.022+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f48bc073200 0x7f48bc075710 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f48d40ac000 tx=0x7f48d4019e00 comp rx=0 tx=0).stop 2024-09-17T06:05:02.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.022+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d8153780 msgr2=0x7f48d80c4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:02.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.022+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d8153780 0x7f48d80c4fb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f48c800e9a0 tx=0x7f48c800ee60 comp rx=0 tx=0).stop 2024-09-17T06:05:02.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.022+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 shutdown_connections 2024-09-17T06:05:02.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.022+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f48bc073200 0x7f48bc075710 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:02.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.022+0000 7f48dfbfa640 1 --2- 172.21.15.122:0/2183245614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48d8153780 0x7f48d80c4fb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:02.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.022+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 >> 172.21.15.122:0/2183245614 conn(0x7f48d8070d80 msgr2=0x7f48d814f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:02.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.022+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 shutdown_connections 2024-09-17T06:05:02.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:02.022+0000 7f48dfbfa640 1 -- 172.21.15.122:0/2183245614 wait complete. 2024-09-17T06:05:02.047 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:02.043+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:02.130 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:02.131 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:02.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:05:02.147 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:02.143+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:02.248 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:02.246+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:02.285 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:02.286 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:02.303 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:05:02.348 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:02.347+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:02.449 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:02.446+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:02.493 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:02.493 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:02.512 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:05:02.550 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:02.547+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:02.651 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:02.646+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:02.706 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:02.707 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:02.723 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:05:02.772 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:02.770+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:02.853 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:02.851+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:02.855 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T06:05:02.924 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:02.924 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:02.944 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:05:02.954 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:02.951+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:03.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.018+0000 7fb0a818a640 1 -- 172.21.15.122:0/3481637677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0a006e370 msgr2=0x7fb0a01522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:03.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.018+0000 7fb0a818a640 1 --2- 172.21.15.122:0/3481637677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0a006e370 0x7fb0a01522c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00cac60 tx=0x7fb09801eff0 comp rx=0 tx=0).stop 2024-09-17T06:05:03.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.018+0000 7fb0a818a640 1 -- 172.21.15.122:0/3481637677 shutdown_connections 2024-09-17T06:05:03.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.018+0000 7fb0a818a640 1 --2- 172.21.15.122:0/3481637677 >> v2:172.21.15.173:3300/0 conn(0x7fb0a006d7e0 0x7fb0a006dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:03.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.018+0000 7fb0a818a640 1 --2- 172.21.15.122:0/3481637677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0a006e370 0x7fb0a01522c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:03.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.018+0000 7fb0a818a640 1 -- 172.21.15.122:0/3481637677 >> 172.21.15.122:0/3481637677 conn(0x7fb0a00cd4f0 msgr2=0x7fb0a00cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:03.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.018+0000 7fb0a818a640 1 -- 172.21.15.122:0/3481637677 shutdown_connections 2024-09-17T06:05:03.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.018+0000 7fb0a818a640 1 -- 172.21.15.122:0/3481637677 wait complete. 2024-09-17T06:05:03.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.018+0000 7fb0a818a640 1 Processor -- start 2024-09-17T06:05:03.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.018+0000 7fb0a818a640 1 -- start start 2024-09-17T06:05:03.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a818a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0a006d7e0 0x7fb0a01503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:03.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a818a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0a006e370 0x7fb0a0155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:03.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a818a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0a00c26f0 0x7fb0a00af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:03.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a818a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a0158af0 con 0x7fb0a00c26f0 2024-09-17T06:05:03.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a818a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a0158810 con 0x7fb0a006d7e0 2024-09-17T06:05:03.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a818a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a00c4240 con 0x7fb0a006e370 2024-09-17T06:05:03.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a6727640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0a00c26f0 0x7fb0a00af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:03.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a6727640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0a00c26f0 0x7fb0a00af210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54876/0 (socket says 172.21.15.122:54876) 2024-09-17T06:05:03.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a6727640 1 -- 172.21.15.122:0/2115212831 learned_addr learned my addr 172.21.15.122:0/2115212831 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:03.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a5f26640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0a006d7e0 0x7fb0a01503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:03.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a5725640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0a006e370 0x7fb0a0155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:03.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a6727640 1 -- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0a006e370 msgr2=0x7fb0a0155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:03.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a6727640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0a006e370 0x7fb0a0155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:03.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a6727640 1 -- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0a006d7e0 msgr2=0x7fb0a01503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:03.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a6727640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0a006d7e0 0x7fb0a01503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:03.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a6727640 1 -- 172.21.15.122:0/2115212831 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a0150900 con 0x7fb0a00c26f0 2024-09-17T06:05:03.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a6727640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0a00c26f0 0x7fb0a00af210 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00cad0 tx=0x7fb09c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:03.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0967fc640 1 -- 172.21.15.122:0/2115212831 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00ae20 con 0x7fb0a00c26f0 2024-09-17T06:05:03.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0967fc640 1 -- 172.21.15.122:0/2115212831 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb09c003a70 con 0x7fb0a00c26f0 2024-09-17T06:05:03.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0967fc640 1 -- 172.21.15.122:0/2115212831 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c004030 con 0x7fb0a00c26f0 2024-09-17T06:05:03.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a818a640 1 -- 172.21.15.122:0/2115212831 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a0156eb0 con 0x7fb0a00c26f0 2024-09-17T06:05:03.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.022+0000 7fb0a818a640 1 -- 172.21.15.122:0/2115212831 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a0157450 con 0x7fb0a00c26f0 2024-09-17T06:05:03.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.026+0000 7fb0a818a640 1 -- 172.21.15.122:0/2115212831 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a006ed50 con 0x7fb0a00c26f0 2024-09-17T06:05:03.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.026+0000 7fb0967fc640 1 -- 172.21.15.122:0/2115212831 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb09c0041d0 con 0x7fb0a00c26f0 2024-09-17T06:05:03.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.026+0000 7fb0967fc640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb084073200 0x7fb084075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:03.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.026+0000 7fb0967fc640 1 -- 172.21.15.122:0/2115212831 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6780+0+0 (secure 0 0 0) 0x7fb09c094f80 con 0x7fb0a00c26f0 2024-09-17T06:05:03.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.026+0000 7fb0a5f26640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb084073200 0x7fb084075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:03.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.026+0000 7fb0a5f26640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb084073200 0x7fb084075710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb0980b2000 tx=0x7fb09801d830 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:03.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.030+0000 7fb0967fc640 1 -- 172.21.15.122:0/2115212831 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb09c014070 con 0x7fb0a00c26f0 2024-09-17T06:05:03.055 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:03.050+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:03.088 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:03.088 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:03.106 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:05:03.156 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:03.151+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:03.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.210+0000 7fb0a818a640 1 -- 172.21.15.122:0/2115212831 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) -- 0x7fb0a014ffe0 con 0x7fb0a00c26f0 2024-09-17T06:05:03.257 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:03.255+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:03.296 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:03.296 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:03.313 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:05:03.360 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:03.358+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:03.459 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:03.458+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:03.461 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:03.462 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:03.479 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:05:03.561 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:03.555+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:03.662 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:03.658+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:03.670 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:03.671 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:03.687 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:05:03.776 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:03.774+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:03.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.842+0000 7fb0967fc640 1 -- 172.21.15.122:0/2115212831 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v34) ==== 97+0+0 (secure 0 0 0) 0x7fb09c05fb70 con 0x7fb0a00c26f0 2024-09-17T06:05:03.846 INFO:teuthology.orchestra.run.smithi122.stderr:nodeep-scrub is set 2024-09-17T06:05:03.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.846+0000 7fb0a818a640 1 -- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb084073200 msgr2=0x7fb084075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:03.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.846+0000 7fb0a818a640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb084073200 0x7fb084075710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb0980b2000 tx=0x7fb09801d830 comp rx=0 tx=0).stop 2024-09-17T06:05:03.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.846+0000 7fb0a818a640 1 -- 172.21.15.122:0/2115212831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0a00c26f0 msgr2=0x7fb0a00af210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:03.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.846+0000 7fb0a818a640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0a00c26f0 0x7fb0a00af210 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00cad0 tx=0x7fb09c00cf90 comp rx=0 tx=0).stop 2024-09-17T06:05:03.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.846+0000 7fb0a818a640 1 -- 172.21.15.122:0/2115212831 shutdown_connections 2024-09-17T06:05:03.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.846+0000 7fb0a818a640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0a00c26f0 0x7fb0a00af210 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:03.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.846+0000 7fb0a818a640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0a006e370 0x7fb0a0155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:03.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.846+0000 7fb0a818a640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb084073200 0x7fb084075710 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:03.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.846+0000 7fb0a818a640 1 --2- 172.21.15.122:0/2115212831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0a006d7e0 0x7fb0a01503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:03.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.846+0000 7fb0a818a640 1 -- 172.21.15.122:0/2115212831 >> 172.21.15.122:0/2115212831 conn(0x7fb0a00cd4f0 msgr2=0x7fb0a0146bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:03.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.846+0000 7fb0a818a640 1 -- 172.21.15.122:0/2115212831 shutdown_connections 2024-09-17T06:05:03.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:03.846+0000 7fb0a818a640 1 -- 172.21.15.122:0/2115212831 wait complete. 2024-09-17T06:05:03.862 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:03.858+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:03.888 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:03.888 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:03.905 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:05:03.963 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:03.958+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:04.044 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:05:04.064 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:04.058+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:04.105 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:04.105 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:04.126 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T06:05:04.166 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:04.162+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:04.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 -- 172.21.15.122:0/345429120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf3c005260 msgr2=0x7fcf3c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 --2- 172.21.15.122:0/345429120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf3c005260 0x7fcf3c00b9d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00c660 tx=0x7fcf4c01d2e0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 -- 172.21.15.122:0/345429120 shutdown_connections 2024-09-17T06:05:04.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 --2- 172.21.15.122:0/345429120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf3c005260 0x7fcf3c00b9d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 -- 172.21.15.122:0/345429120 >> 172.21.15.122:0/345429120 conn(0x7fcf5406d6c0 msgr2=0x7fcf540d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:04.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 -- 172.21.15.122:0/345429120 shutdown_connections 2024-09-17T06:05:04.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 -- 172.21.15.122:0/345429120 wait complete. 2024-09-17T06:05:04.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 Processor -- start 2024-09-17T06:05:04.193 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 -- start start 2024-09-17T06:05:04.196 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf3c005260 0x7fcf5415f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:04.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf541572a0 0x7fcf5415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:04.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf54152010 0x7fcf541e6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:04.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5415c200 con 0x7fcf541572a0 2024-09-17T06:05:04.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5415bf20 con 0x7fcf3c005260 2024-09-17T06:05:04.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf59105640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5415b8c0 con 0x7fcf54152010 2024-09-17T06:05:04.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf5259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf541572a0 0x7fcf5415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:04.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf5259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf541572a0 0x7fcf5415eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54896/0 (socket says 172.21.15.122:54896) 2024-09-17T06:05:04.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf5259c640 1 -- 172.21.15.122:0/4154677103 learned_addr learned my addr 172.21.15.122:0/4154677103 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:04.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf52d9d640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf3c005260 0x7fcf5415f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:04.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf5359e640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf54152010 0x7fcf541e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:04.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf5259c640 1 -- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf54152010 msgr2=0x7fcf541e6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf5259c640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf54152010 0x7fcf541e6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf5259c640 1 -- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf3c005260 msgr2=0x7fcf5415f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf5259c640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf3c005260 0x7fcf5415f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf5259c640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf54157ec0 con 0x7fcf541572a0 2024-09-17T06:05:04.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf5359e640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf54152010 0x7fcf541e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:05:04.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.190+0000 7fcf5259c640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf541572a0 0x7fcf5415eac0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcf44004d50 tx=0x7fcf44001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:04.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf440107d0 con 0x7fcf541572a0 2024-09-17T06:05:04.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf44016070 con 0x7fcf541572a0 2024-09-17T06:05:04.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5415f000 con 0x7fcf541572a0 2024-09-17T06:05:04.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44010d20 con 0x7fcf541572a0 2024-09-17T06:05:04.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf54157be0 con 0x7fcf541572a0 2024-09-17T06:05:04.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fcf5408c9e0 con 0x7fcf541572a0 2024-09-17T06:05:04.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcf44011460 con 0x7fcf541572a0 2024-09-17T06:05:04.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf3b7fe640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf40073200 0x7fcf40075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:04.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6780+0+0 (secure 0 0 0) 0x7fcf440956e0 con 0x7fcf541572a0 2024-09-17T06:05:04.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v34) ==== 54+0+16 (secure 0 0 0) 0x7fcf44095b70 con 0x7fcf541572a0 2024-09-17T06:05:04.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf52d9d640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf40073200 0x7fcf40075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:04.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fcf54152420 0x7fcf540cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:04.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf54152cc0 con 0x7fcf54152420 2024-09-17T06:05:04.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf5359e640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fcf54152420 0x7fcf540cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:04.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf5359e640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fcf54152420 0x7fcf540cc540 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:04.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.194+0000 7fcf52d9d640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf40073200 0x7fcf40075710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009a80 tx=0x7fcf480091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:04.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.198+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf54152cc0 con 0x7fcf54152420 2024-09-17T06:05:04.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.210+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcf54157870 con 0x7fcf54152420 2024-09-17T06:05:04.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.214+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcf54157870 con 0x7fcf54152420 2024-09-17T06:05:04.217 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:04.218 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:04.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.214+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fcf541f4c50 0x7fcf541f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:04.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.214+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fcf541f55a0 con 0x7fcf541f4c50 2024-09-17T06:05:04.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.214+0000 7fcf52d9d640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fcf541f4c50 0x7fcf541f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:04.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.214+0000 7fcf52d9d640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fcf541f4c50 0x7fcf541f5060 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:04.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.214+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf541f55a0 con 0x7fcf541f4c50 2024-09-17T06:05:04.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.230+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcf541f1e00 con 0x7fcf541f4c50 2024-09-17T06:05:04.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.230+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcf541f1e00 con 0x7fcf541f4c50 2024-09-17T06:05:04.234 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:04.235 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:04.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.230+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fcf54063dc0 0x7fcf540641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:04.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.230+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fcf540ccfa0 con 0x7fcf54063dc0 2024-09-17T06:05:04.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.230+0000 7fcf5259c640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fcf54063dc0 0x7fcf540641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:04.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.230+0000 7fcf5259c640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fcf54063dc0 0x7fcf540641d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:04.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.230+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf540ccfa0 con 0x7fcf54063dc0 2024-09-17T06:05:04.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.246+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcf540cbc10 con 0x7fcf54063dc0 2024-09-17T06:05:04.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.246+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcf540cbc10 con 0x7fcf54063dc0 2024-09-17T06:05:04.251 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:04.251 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:04.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.246+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fcf540c6750 0x7fcf5402d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:04.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.246+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fcf541e74b0 con 0x7fcf540c6750 2024-09-17T06:05:04.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.246+0000 7fcf5359e640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fcf540c6750 0x7fcf5402d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:04.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.246+0000 7fcf5359e640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fcf540c6750 0x7fcf5402d4d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:04.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.250+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf541e74b0 con 0x7fcf540c6750 2024-09-17T06:05:04.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.262+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcf540c6e30 con 0x7fcf540c6750 2024-09-17T06:05:04.267 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:04.262+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:04.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.262+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcf540c6e30 con 0x7fcf540c6750 2024-09-17T06:05:04.267 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:04.268 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:04.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.262+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fcf5402df20 0x7fcf5402e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:04.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.262+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fcf540c6db0 con 0x7fcf5402df20 2024-09-17T06:05:04.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.266+0000 7fcf52d9d640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fcf5402df20 0x7fcf5402e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:04.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.266+0000 7fcf52d9d640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fcf5402df20 0x7fcf5402e330 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:04.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.266+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf540c6db0 con 0x7fcf5402df20 2024-09-17T06:05:04.281 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:04.281 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:04.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.282+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcf540c6b60 con 0x7fcf5402df20 2024-09-17T06:05:04.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.286+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcf540c6b60 con 0x7fcf5402df20 2024-09-17T06:05:04.289 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:05:04.289 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:05:04.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.286+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fcf54206030 0x7fcf54208450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:04.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.286+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fcf5420b220 con 0x7fcf54206030 2024-09-17T06:05:04.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.286+0000 7fcf5259c640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fcf54206030 0x7fcf54208450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:04.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.286+0000 7fcf5259c640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fcf54206030 0x7fcf54208450 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:04.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.290+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf5420b220 con 0x7fcf54206030 2024-09-17T06:05:04.298 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T06:05:04.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.302+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcf54208990 con 0x7fcf54206030 2024-09-17T06:05:04.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.306+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcf54208990 con 0x7fcf54206030 2024-09-17T06:05:04.308 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:04.309 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:04.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.306+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fcf54208ea0 0x7fcf5420b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:04.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.306+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fcf5420e410 con 0x7fcf54208ea0 2024-09-17T06:05:04.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.306+0000 7fcf5359e640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fcf54208ea0 0x7fcf5420b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:04.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.306+0000 7fcf5359e640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fcf54208ea0 0x7fcf5420b370 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:04.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.306+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf5420e410 con 0x7fcf54208ea0 2024-09-17T06:05:04.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.318+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcf5402e950 con 0x7fcf54208ea0 2024-09-17T06:05:04.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.322+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcf5402e950 con 0x7fcf54208ea0 2024-09-17T06:05:04.325 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:04.326 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:04.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.322+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fcf5420d640 0x7fcf5420da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:04.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.322+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fcf54211860 con 0x7fcf5420d640 2024-09-17T06:05:04.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.322+0000 7fcf52d9d640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fcf5420d640 0x7fcf5420da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:04.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.322+0000 7fcf52d9d640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fcf5420d640 0x7fcf5420da90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:04.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.322+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf54211860 con 0x7fcf5420d640 2024-09-17T06:05:04.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcf542106e0 con 0x7fcf5420d640 2024-09-17T06:05:04.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf3b7fe640 1 -- 172.21.15.122:0/4154677103 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcf542106e0 con 0x7fcf5420d640 2024-09-17T06:05:04.343 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:04.344 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:04.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fcf54152420 msgr2=0x7fcf540cc540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fcf54152420 0x7fcf540cc540 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fcf541f4c50 msgr2=0x7fcf541f5060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fcf541f4c50 0x7fcf541f5060 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fcf54063dc0 msgr2=0x7fcf540641d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fcf54063dc0 0x7fcf540641d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fcf540c6750 msgr2=0x7fcf5402d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fcf540c6750 0x7fcf5402d4d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf5359e640 1 -- 172.21.15.122:0/4154677103 reap_dead start 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fcf5402df20 msgr2=0x7fcf5402e330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fcf5402df20 0x7fcf5402e330 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf5359e640 1 -- 172.21.15.122:0/4154677103 reap_dead start 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fcf54206030 msgr2=0x7fcf54208450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fcf54206030 0x7fcf54208450 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fcf54208ea0 msgr2=0x7fcf5420b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fcf54208ea0 0x7fcf5420b370 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fcf5420d640 msgr2=0x7fcf5420da90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fcf5420d640 0x7fcf5420da90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf40073200 msgr2=0x7fcf40075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf40073200 0x7fcf40075710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009a80 tx=0x7fcf480091e0 comp rx=0 tx=0).stop 2024-09-17T06:05:04.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf541572a0 msgr2=0x7fcf5415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:04.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 --2- 172.21.15.122:0/4154677103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf541572a0 0x7fcf5415eac0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcf44004d50 tx=0x7fcf44001640 comp rx=0 tx=0).stop 2024-09-17T06:05:04.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf5359e640 1 -- 172.21.15.122:0/4154677103 reap_dead start 2024-09-17T06:05:04.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 shutdown_connections 2024-09-17T06:05:04.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.338+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 >> 172.21.15.122:0/4154677103 conn(0x7fcf5406d6c0 msgr2=0x7fcf541547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:04.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.342+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 shutdown_connections 2024-09-17T06:05:04.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:04.342+0000 7fcf59105640 1 -- 172.21.15.122:0/4154677103 wait complete. 2024-09-17T06:05:04.404 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:04.402+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:04.468 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:04.466+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:04.487 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:04.487 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:04.488 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:04.488 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:04.488 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:04.504 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T06:05:04.569 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:04.566+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:04.654 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:04.654 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:04.654 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:04.654 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:04.654 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.655 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:04.655 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:05:04.655 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 50.8333552, 2024-09-17T06:05:04.655 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.013495551, 2024-09-17T06:05:04.655 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:04.655 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:04.655 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:04.655 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:04.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:04.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:05:04.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.656 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:04.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:05:04.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.656 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:04.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820818+0000", 2024-09-17T06:05:04.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.858e-06 2024-09-17T06:05:04.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:04.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820836+0000", 2024-09-17T06:05:04.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7955e-05 2024-09-17T06:05:04.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:04.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820863+0000", 2024-09-17T06:05:04.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7013999999999999e-05 2024-09-17T06:05:04.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:04.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820885+0000", 2024-09-17T06:05:04.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1695000000000002e-05 2024-09-17T06:05:04.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:04.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821084+0000", 2024-09-17T06:05:04.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019876400000000001 2024-09-17T06:05:04.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.659 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:04.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821305+0000", 2024-09-17T06:05:04.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022121099999999999 2024-09-17T06:05:04.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.659 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:04.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821563+0000", 2024-09-17T06:05:04.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025797100000000001 2024-09-17T06:05:04.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:04.660 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825504+0000", 2024-09-17T06:05:04.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039410119999999998 2024-09-17T06:05:04.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:04.660 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834165+0000", 2024-09-17T06:05:04.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086608810000000005 2024-09-17T06:05:04.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:04.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834252+0000", 2024-09-17T06:05:04.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7276999999999998e-05 2024-09-17T06:05:04.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:04.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834311+0000", 2024-09-17T06:05:04.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8913000000000003e-05 2024-09-17T06:05:04.662 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.662 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:04.662 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.662 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.662 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.662 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:04.662 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:05:04.662 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 50.830131926, 2024-09-17T06:05:04.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037604380000000001, 2024-09-17T06:05:04.662 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:04.663 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:04.663 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:04.663 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:04.663 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.663 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:04.663 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:05:04.663 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.663 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.663 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.663 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:04.664 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:05:04.664 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.664 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.664 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.664 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:04.664 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824040+0000", 2024-09-17T06:05:04.664 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8649999999999999e-06 2024-09-17T06:05:04.664 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.664 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:04.665 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824070+0000", 2024-09-17T06:05:04.665 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9162e-05 2024-09-17T06:05:04.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:04.665 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824088+0000", 2024-09-17T06:05:04.665 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8529000000000002e-05 2024-09-17T06:05:04.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.666 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:04.666 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824103+0000", 2024-09-17T06:05:04.666 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5081e-05 2024-09-17T06:05:04.666 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.666 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.666 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:04.666 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824193+0000", 2024-09-17T06:05:04.666 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9896999999999997e-05 2024-09-17T06:05:04.666 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.666 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.667 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:04.667 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:05:04.667 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1649000000000001e-05 2024-09-17T06:05:04.667 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.667 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.667 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:04.667 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827740+0000", 2024-09-17T06:05:04.667 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035152069999999998 2024-09-17T06:05:04.667 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.667 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.668 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:04.668 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827799+0000", 2024-09-17T06:05:04.668 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9048000000000001e-05 2024-09-17T06:05:04.668 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.668 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:04.668 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.668 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.668 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.668 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:04.668 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:05:04.669 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 50.829946374000002, 2024-09-17T06:05:04.669 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035104340000000002, 2024-09-17T06:05:04.669 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:04.669 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:04.669 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:04.669 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:04.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.669 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:04.669 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:05:04.669 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.669 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:04.670 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:05:04.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:04.670 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:05:04.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1909999999999999e-06 2024-09-17T06:05:04.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:04.671 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824237+0000", 2024-09-17T06:05:04.671 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1914e-05 2024-09-17T06:05:04.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.671 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:04.671 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824252+0000", 2024-09-17T06:05:04.671 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5071e-05 2024-09-17T06:05:04.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.671 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:04.672 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824265+0000", 2024-09-17T06:05:04.672 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2748000000000001e-05 2024-09-17T06:05:04.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.672 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:04.672 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824346+0000", 2024-09-17T06:05:04.672 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0530000000000003e-05 2024-09-17T06:05:04.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.672 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:04.673 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824375+0000", 2024-09-17T06:05:04.673 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9805e-05 2024-09-17T06:05:04.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.673 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.673 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:04.673 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827659+0000", 2024-09-17T06:05:04.673 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032838569999999998 2024-09-17T06:05:04.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.673 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.673 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:04.673 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827735+0000", 2024-09-17T06:05:04.674 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5318e-05 2024-09-17T06:05:04.674 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.674 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:04.674 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.674 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.674 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 75 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:04.674 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:05:04.674 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 50.829749573999997, 2024-09-17T06:05:04.674 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003402553, 2024-09-17T06:05:04.675 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:04.675 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:04.675 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:04.675 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:04.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.675 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:04.675 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:05:04.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.675 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:04.675 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:05:04.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.676 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:04.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824422+0000", 2024-09-17T06:05:04.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3399999999999998e-07 2024-09-17T06:05:04.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.676 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:04.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824434+0000", 2024-09-17T06:05:04.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1960000000000001e-05 2024-09-17T06:05:04.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.677 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:04.677 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824771+0000", 2024-09-17T06:05:04.677 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033676799999999998 2024-09-17T06:05:04.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.677 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:04.677 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824798+0000", 2024-09-17T06:05:04.677 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7838e-05 2024-09-17T06:05:04.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.678 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.678 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:04.678 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824920+0000", 2024-09-17T06:05:04.678 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012210699999999999 2024-09-17T06:05:04.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.678 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.678 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:04.678 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827824+0000", 2024-09-17T06:05:04.678 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029030459999999998 2024-09-17T06:05:04.678 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.678 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:04.679 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.679 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.679 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 4 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:04.679 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:05:04.679 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 50.829063066000003, 2024-09-17T06:05:04.679 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003032833, 2024-09-17T06:05:04.679 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:04.679 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:04.679 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:04.679 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:04.679 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.680 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:04.680 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:05:04.680 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.680 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.680 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:04.680 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:05:04.680 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.680 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.680 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:04.681 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825108+0000", 2024-09-17T06:05:04.681 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6099999999999999e-07 2024-09-17T06:05:04.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.681 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.681 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:04.681 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825120+0000", 2024-09-17T06:05:04.681 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1780000000000001e-05 2024-09-17T06:05:04.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.681 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.681 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:04.681 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825136+0000", 2024-09-17T06:05:04.682 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6229999999999999e-05 2024-09-17T06:05:04.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.682 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.682 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:04.682 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825152+0000", 2024-09-17T06:05:04.682 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6104e-05 2024-09-17T06:05:04.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.682 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.682 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:04.682 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825297+0000", 2024-09-17T06:05:04.682 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014498399999999999 2024-09-17T06:05:04.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828140+0000", 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002842874 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 50.824354286999998, 2024-09-17T06:05:04.683 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032580460000000001, 2024-09-17T06:05:04.684 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:04.684 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:04.684 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:04.684 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:04.684 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.684 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:04.684 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:05:04.684 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.684 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.684 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.684 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:04.684 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:05:04.685 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.685 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.685 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.685 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:04.685 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829817+0000", 2024-09-17T06:05:04.685 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.176e-06 2024-09-17T06:05:04.685 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.685 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.685 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:04.685 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:04.685 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0178e-05 2024-09-17T06:05:04.685 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.686 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.686 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:04.686 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829847+0000", 2024-09-17T06:05:04.686 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9402000000000002e-05 2024-09-17T06:05:04.686 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.686 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.686 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:04.686 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829858+0000", 2024-09-17T06:05:04.686 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1141000000000001e-05 2024-09-17T06:05:04.686 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.686 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.687 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:04.687 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830004+0000", 2024-09-17T06:05:04.687 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014622699999999999 2024-09-17T06:05:04.687 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.687 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.687 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:04.687 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830027+0000", 2024-09-17T06:05:04.687 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2826000000000001e-05 2024-09-17T06:05:04.687 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.687 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.687 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:04.687 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833000+0000", 2024-09-17T06:05:04.688 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029729000000000001 2024-09-17T06:05:04.688 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.688 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.688 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:04.688 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833074+0000", 2024-09-17T06:05:04.688 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4196000000000006e-05 2024-09-17T06:05:04.688 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.688 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:04.688 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.688 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.688 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.689 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:04.689 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:05:04.689 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 50.823239506, 2024-09-17T06:05:04.689 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0043957220000000003, 2024-09-17T06:05:04.689 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:04.689 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:04.689 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:04.689 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:04.689 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.689 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:04.689 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830933+0000", 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5090000000000001e-06 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.690 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.691 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:04.691 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830946+0000", 2024-09-17T06:05:04.691 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3018e-05 2024-09-17T06:05:04.691 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.691 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.691 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:04.691 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830968+0000", 2024-09-17T06:05:04.691 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2558999999999999e-05 2024-09-17T06:05:04.691 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.691 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.691 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:04.691 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830984+0000", 2024-09-17T06:05:04.692 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5376999999999999e-05 2024-09-17T06:05:04.692 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.692 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.692 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:04.692 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831072+0000", 2024-09-17T06:05:04.692 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8745000000000005e-05 2024-09-17T06:05:04.692 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.692 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.692 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:04.692 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831104+0000", 2024-09-17T06:05:04.692 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1265e-05 2024-09-17T06:05:04.693 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.693 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.693 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:04.693 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835260+0000", 2024-09-17T06:05:04.693 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0041569559999999998 2024-09-17T06:05:04.693 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.693 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.693 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:04.693 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835327+0000", 2024-09-17T06:05:04.693 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.6292999999999997e-05 2024-09-17T06:05:04.693 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.693 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:04.694 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.694 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.694 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.694 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-17T06:05:04.694 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:05:04.694 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 50.820135972999999, 2024-09-17T06:05:04.694 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029529399999999998, 2024-09-17T06:05:04.694 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:04.694 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:04.694 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:04.694 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:04.694 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.695 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:04.695 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:05:04.695 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.695 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.695 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.695 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:04.695 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:05:04.695 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:04.695 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.695 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.695 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:04.695 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834036+0000", 2024-09-17T06:05:04.696 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9999999999999995e-07 2024-09-17T06:05:04.696 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.696 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.696 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:04.696 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834042+0000", 2024-09-17T06:05:04.696 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.7240000000000003e-06 2024-09-17T06:05:04.696 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.696 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.696 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:04.696 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834058+0000", 2024-09-17T06:05:04.696 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5648e-05 2024-09-17T06:05:04.696 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.697 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.697 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:04.697 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834068+0000", 2024-09-17T06:05:04.697 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0383999999999999e-05 2024-09-17T06:05:04.697 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.697 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.697 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:04.697 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834145+0000", 2024-09-17T06:05:04.697 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.64e-05 2024-09-17T06:05:04.697 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.697 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.697 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:04.698 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834157+0000", 2024-09-17T06:05:04.698 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2414e-05 2024-09-17T06:05:04.698 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:04.698 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:04.698 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:04.698 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834330+0000", 2024-09-17T06:05:04.698 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017272399999999999 2024-09-17T06:05:04.698 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.698 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:04.698 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.698 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:04.699 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:04.699 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:04.700 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:05:04.701 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:04.698+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:04.801 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:04.798+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:04.856 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:04.856 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:04.856 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:04.856 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:04.874 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:05:04.921 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:04.918+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:05.003 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:04.998+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:05.022 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:05.023 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:05.023 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:05.023 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:05.023 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:05.040 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:05:05.053 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-17T06:05:05.053 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T06:05:05.054 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-17T06:05:05.054 INFO:tasks.thrashosds.thrasher:Setting osd 3 primary_affinity to 0.000000 2024-09-17T06:05:05.054 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 0 2024-09-17T06:05:05.125 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:05.122+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:05.205 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:05.202+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:05.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.214+0000 7f2ed12ca640 1 -- 172.21.15.122:0/2685581633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ecc15bb70 msgr2=0x7f2ecc15bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:05.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.214+0000 7f2ed12ca640 1 --2- 172.21.15.122:0/2685581633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ecc15bb70 0x7f2ecc15bf80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009c80 tx=0x7f2ec401f5a0 comp rx=0 tx=0).stop 2024-09-17T06:05:05.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.214+0000 7f2ed12ca640 1 -- 172.21.15.122:0/2685581633 shutdown_connections 2024-09-17T06:05:05.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.214+0000 7f2ed12ca640 1 --2- 172.21.15.122:0/2685581633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ecc15bb70 0x7f2ecc15bf80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:05.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.214+0000 7f2ed12ca640 1 --2- 172.21.15.122:0/2685581633 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2ecc152250 0x7f2ecc15b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:05.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.214+0000 7f2ed12ca640 1 -- 172.21.15.122:0/2685581633 >> 172.21.15.122:0/2685581633 conn(0x7f2ecc070c10 msgr2=0x7f2ecc072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:05.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.214+0000 7f2ed12ca640 1 -- 172.21.15.122:0/2685581633 shutdown_connections 2024-09-17T06:05:05.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.214+0000 7f2ed12ca640 1 -- 172.21.15.122:0/2685581633 wait complete. 2024-09-17T06:05:05.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.214+0000 7f2ed12ca640 1 Processor -- start 2024-09-17T06:05:05.219 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.214+0000 7f2ed12ca640 1 -- start start 2024-09-17T06:05:05.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ed12ca640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ecc0c2220 0x7f2ecc0c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:05.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ed12ca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ecc152250 0x7f2ecc159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:05.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ed12ca640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2ecc15bb70 0x7f2ecc1468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:05.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ed12ca640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc0c2ba0 con 0x7f2ecc152250 2024-09-17T06:05:05.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ed12ca640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc0c87f0 con 0x7f2ecc0c2220 2024-09-17T06:05:05.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ed12ca640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f2ecc073450 con 0x7f2ecc15bb70 2024-09-17T06:05:05.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ecc152250 0x7f2ecc159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:05.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ecc152250 0x7f2ecc159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37024/0 (socket says 172.21.15.122:37024) 2024-09-17T06:05:05.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec3fff640 1 -- 172.21.15.122:0/1085668886 learned_addr learned my addr 172.21.15.122:0/1085668886 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ecaffd640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ecc0c2220 0x7f2ecc0c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ecb7fe640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2ecc15bb70 0x7f2ecc1468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec3fff640 1 -- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2ecc15bb70 msgr2=0x7f2ecc1468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec3fff640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2ecc15bb70 0x7f2ecc1468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec3fff640 1 -- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ecc0c2220 msgr2=0x7f2ecc0c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec3fff640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ecc0c2220 0x7f2ecc0c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec3fff640 1 -- 172.21.15.122:0/1085668886 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc0c6770 con 0x7f2ecc152250 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec3fff640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ecc152250 0x7f2ecc159700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400e770 tx=0x7f2eb400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec37fe640 1 -- 172.21.15.122:0/1085668886 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400cc60 con 0x7f2ecc152250 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec37fe640 1 -- 172.21.15.122:0/1085668886 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2eb400ce00 con 0x7f2ecc152250 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec37fe640 1 -- 172.21.15.122:0/1085668886 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4005280 con 0x7f2ecc152250 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ed12ca640 1 -- 172.21.15.122:0/1085668886 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ecc15a150 con 0x7f2ecc152250 2024-09-17T06:05:05.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ed12ca640 1 -- 172.21.15.122:0/1085668886 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ecc15ad80 con 0x7f2ecc152250 2024-09-17T06:05:05.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ed12ca640 1 -- 172.21.15.122:0/1085668886 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ecc06f110 con 0x7f2ecc152250 2024-09-17T06:05:05.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.218+0000 7f2ec37fe640 1 -- 172.21.15.122:0/1085668886 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2eb4005420 con 0x7f2ecc152250 2024-09-17T06:05:05.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.222+0000 7f2ec37fe640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2eac073230 0x7f2eac075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:05.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.222+0000 7f2ec37fe640 1 -- 172.21.15.122:0/1085668886 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6780+0+0 (secure 0 0 0) 0x7f2eb4094da0 con 0x7f2ecc152250 2024-09-17T06:05:05.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.222+0000 7f2ecaffd640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2eac073230 0x7f2eac075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:05.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.222+0000 7f2ecaffd640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2eac073230 0x7f2eac075740 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc007fd0 tx=0x7f2ebc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:05.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.226+0000 7f2ec37fe640 1 -- 172.21.15.122:0/1085668886 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2eb405fa20 con 0x7f2ecc152250 2024-09-17T06:05:05.232 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:05.232 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:05.232 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:05.232 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:05.232 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.232 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:05.232 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:05.232 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.409355220999998, 2024-09-17T06:05:05.232 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:05:05.232 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.234 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.235 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:05:05.236 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.409242997, 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.237 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.238 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:05:05.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.240 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:05.241 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.409037646999998, 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.242 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.243 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.244 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:05:05.244 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:05:05.244 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.244 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.244 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.244 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:05:05.244 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:05:05.244 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.244 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.244 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.244 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:05:05.244 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.245 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.402897121000002, 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.246 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:05:05.247 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.248 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.249 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.250 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.402742394999997, 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:05:05.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.254 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:05:05.255 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:05:05.255 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.255 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.255 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.255 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.255 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.255 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:05.255 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:05:05.256 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:05:05.258 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:05:05.328 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:05.326+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:05.406 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:05.402+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:05.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.410+0000 7f2ed12ca640 1 -- 172.21.15.122:0/1085668886 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 3, "weight": 0.0} v 0) -- 0x7f2ecc0c8d80 con 0x7f2ecc152250 2024-09-17T06:05:05.445 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:05.445 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:05.445 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:05.445 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:05.461 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:05:05.507 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:05.502+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:05.608 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:05.606+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:05.656 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:05.656 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:05.657 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:05.657 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:05.657 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:05.673 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:05:05.709 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:05.706+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:05.810 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:05.806+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:05.822 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:05.822 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:05.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:05.822 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:05.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.822 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:05.822 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:05.823 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.998715806999996, 2024-09-17T06:05:05.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:05:05.823 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.823 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.823 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.823 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:05.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:05:05.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:05:05.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:05:05.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:05:05.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:05:05.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:05:05.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:05:05.826 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.827 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:05:05.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:05:05.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:05:05.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:05:05.828 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.828 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.828 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.828 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.998595405000003, 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:05:05.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:05:05.831 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.832 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.834 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.834 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:05:05.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:05:05.834 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.834 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.834 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.834 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:05.834 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:05.834 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.998467491, 2024-09-17T06:05:05.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.836 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:05:05.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:05:05.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.836 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:05:05.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:05:05.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.837 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:05:05.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:05:05.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.837 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.837 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:05.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:05:05.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.837 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:05:05.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:05:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:05:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:05.840 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.997441528000003, 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.841 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.843 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:05:05.844 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.845 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.997360585000003, 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.846 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.847 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:05:05.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.849 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.849 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.849 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:05:05.849 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:05:05.849 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.849 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.849 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.849 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:05:05.849 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.850 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.851 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.997298182999998, 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.852 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.853 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:05:05.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:05:05.855 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.856 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:05.857 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.997226093000002, 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:05.858 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.859 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.860 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.861 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:05:05.861 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:05:05.861 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.861 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.861 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.861 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:05:05.861 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:05:05.861 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.861 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.861 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.861 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.861 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.997183892999999, 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.862 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.863 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.864 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.865 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.994591960999998, 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.866 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.867 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.868 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.869 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.870 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.870 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.870 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.870 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:05.870 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:05.870 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.994495825999998, 2024-09-17T06:05:05.870 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:05:05.870 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.870 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.870 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.870 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:05:05.871 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:05:05.872 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:05:05.873 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.986063540000004, 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:05:05.874 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.875 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.876 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.878 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:05:05.879 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:05.880 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 46.892474319999998, 2024-09-17T06:05:05.880 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:05:05.880 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.880 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.880 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.880 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.880 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.880 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.880 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:05.880 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.880 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.880 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:05:05.881 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.882 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:05:05.883 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:05:05.883 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.883 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.883 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.883 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:05:05.883 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:05:05.883 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.883 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.883 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.883 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:05:05.883 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:05:05.883 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 45.221843954999997, 2024-09-17T06:05:05.884 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:05:05.885 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.885 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.885 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.885 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.885 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.885 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.885 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:05.885 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.885 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.885 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.885 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.885 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.886 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.887 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.888 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:05:05.888 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:05:05.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.888 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.888 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:05.888 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:05:05.888 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:05:05.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.888 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.888 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.888 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:05:05.888 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.889 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 43.501172998999998, 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.890 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:05:05.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.892 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.893 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:05:05.894 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.895 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 43.49848875, 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:05.896 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.897 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:05:05.898 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.899 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.899 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.899 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:05:05.899 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:05:05.899 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.899 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.899 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.899 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:05:05.899 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:05:05.900 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.900 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.900 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.900 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:05:05.900 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:05:05.900 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.900 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.900 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.900 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.900 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.900 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.629286077000003, 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.901 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:05:05.902 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.903 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.904 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:05:05.904 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:05:05.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.904 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.904 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.904 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:05:05.904 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:05:05.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.904 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.904 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:05.904 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.905 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:05.906 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 22.102845165000002, 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.907 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.908 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:05:05.909 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.910 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:05:05.911 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:05:05.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.911 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.911 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.911 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:05:05.911 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:05:05.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.911 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.911 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.911 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:05:05.911 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:05:05.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 22.102615649000001, 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:05:05.912 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.913 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:05:05.914 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:05:05.915 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.916 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.917 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 22.100650952999999, 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:05.918 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.919 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.920 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:05:05.921 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 18.167088066000002, 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:05.922 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.923 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.924 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:05.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:05:05.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:05:05.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.924 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.924 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:05.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:05:05.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:05:05.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.924 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.924 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:05.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:05:05.925 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:05:05.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.925 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.925 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:05.925 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:05:05.925 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:05:05.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.925 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.925 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:05.925 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.926 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:05:05.927 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.928 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.928 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.928 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:05.928 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:05.928 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:05.928 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T06:05:05.930 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:05:05.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.854+0000 7f2ec37fe640 1 -- 172.21.15.122:0/1085668886 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 3, "weight": 0.0}]=0 set osd.3 primary-affinity to 0 (802) v35) ==== 129+0+0 (secure 0 0 0) 0x7f2eb405f320 con 0x7f2ecc152250 2024-09-17T06:05:05.931 INFO:teuthology.orchestra.run.smithi122.stderr:set osd.3 primary-affinity to 0 (802) 2024-09-17T06:05:05.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.858+0000 7f2ed12ca640 1 -- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2eac073230 msgr2=0x7f2eac075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:05.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.858+0000 7f2ed12ca640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2eac073230 0x7f2eac075740 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc007fd0 tx=0x7f2ebc009040 comp rx=0 tx=0).stop 2024-09-17T06:05:05.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.858+0000 7f2ed12ca640 1 -- 172.21.15.122:0/1085668886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ecc152250 msgr2=0x7f2ecc159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:05.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.858+0000 7f2ed12ca640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ecc152250 0x7f2ecc159700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400e770 tx=0x7f2eb400ec30 comp rx=0 tx=0).stop 2024-09-17T06:05:05.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.858+0000 7f2ed12ca640 1 -- 172.21.15.122:0/1085668886 shutdown_connections 2024-09-17T06:05:05.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.858+0000 7f2ed12ca640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2ecc15bb70 0x7f2ecc1468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:05.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.858+0000 7f2ed12ca640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ecc152250 0x7f2ecc159700 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:05.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.858+0000 7f2ed12ca640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2eac073230 0x7f2eac075740 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:05.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.858+0000 7f2ed12ca640 1 --2- 172.21.15.122:0/1085668886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ecc0c2220 0x7f2ecc0c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:05.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.858+0000 7f2ed12ca640 1 -- 172.21.15.122:0/1085668886 >> 172.21.15.122:0/1085668886 conn(0x7f2ecc070c10 msgr2=0x7f2ecc0c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:05.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.862+0000 7f2ed12ca640 1 -- 172.21.15.122:0/1085668886 shutdown_connections 2024-09-17T06:05:05.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:05.862+0000 7f2ed12ca640 1 -- 172.21.15.122:0/1085668886 wait complete. 2024-09-17T06:05:05.933 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:05.926+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:06.031 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:06.026+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:06.086 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:06.086 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:06.087 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:06.087 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:06.103 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:05:06.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.126+0000 7f2a2a71b640 1 -- 172.21.15.122:0/923617108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a2406e780 msgr2=0x7f2a2406eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.126+0000 7f2a2a71b640 1 --2- 172.21.15.122:0/923617108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a2406e780 0x7f2a2406eb90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009900 tx=0x7f2a1801c8e0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.126+0000 7f2a2a71b640 1 -- 172.21.15.122:0/923617108 shutdown_connections 2024-09-17T06:05:06.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.126+0000 7f2a2a71b640 1 --2- 172.21.15.122:0/923617108 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a240c2010 0x7f2a240c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.126+0000 7f2a2a71b640 1 --2- 172.21.15.122:0/923617108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a2406e780 0x7f2a2406eb90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.126+0000 7f2a2a71b640 1 -- 172.21.15.122:0/923617108 >> 172.21.15.122:0/923617108 conn(0x7f2a24070c10 msgr2=0x7f2a24072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:06.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.126+0000 7f2a2a71b640 1 -- 172.21.15.122:0/923617108 shutdown_connections 2024-09-17T06:05:06.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.126+0000 7f2a2a71b640 1 -- 172.21.15.122:0/923617108 wait complete. 2024-09-17T06:05:06.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.126+0000 7f2a2a71b640 1 Processor -- start 2024-09-17T06:05:06.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.126+0000 7f2a2a71b640 1 -- start start 2024-09-17T06:05:06.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a2a71b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a2406e780 0x7f2a240cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a2a71b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a240c2010 0x7f2a240cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a2a71b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a240c3440 0x7f2a240c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a2a71b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2a24151eb0 con 0x7f2a240c3440 2024-09-17T06:05:06.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a2a71b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2a24151d30 con 0x7f2a2406e780 2024-09-17T06:05:06.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a2a71b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f2a240c3a00 con 0x7f2a240c2010 2024-09-17T06:05:06.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a28cb8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a240c3440 0x7f2a240c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a28cb8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a240c3440 0x7f2a240c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37042/0 (socket says 172.21.15.122:37042) 2024-09-17T06:05:06.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a28cb8640 1 -- 172.21.15.122:0/1925670688 learned_addr learned my addr 172.21.15.122:0/1925670688 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:06.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a237fe640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a240c2010 0x7f2a240cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a23fff640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a2406e780 0x7f2a240cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a28cb8640 1 -- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a240c2010 msgr2=0x7f2a240cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a28cb8640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a240c2010 0x7f2a240cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a28cb8640 1 -- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a2406e780 msgr2=0x7f2a240cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a28cb8640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a2406e780 0x7f2a240cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a28cb8640 1 -- 172.21.15.122:0/1925670688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a240cc250 con 0x7f2a240c3440 2024-09-17T06:05:06.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a28cb8640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a240c3440 0x7f2a240c6920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00db50 tx=0x7f2a1c007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:06.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a20ff9640 1 -- 172.21.15.122:0/1925670688 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c01a070 con 0x7f2a240c3440 2024-09-17T06:05:06.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a20ff9640 1 -- 172.21.15.122:0/1925670688 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a1c004b30 con 0x7f2a240c3440 2024-09-17T06:05:06.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a2a71b640 1 -- 172.21.15.122:0/1925670688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a241f1a70 con 0x7f2a240c3440 2024-09-17T06:05:06.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a20ff9640 1 -- 172.21.15.122:0/1925670688 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c005020 con 0x7f2a240c3440 2024-09-17T06:05:06.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a2a71b640 1 -- 172.21.15.122:0/1925670688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a241490b0 con 0x7f2a240c3440 2024-09-17T06:05:06.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a2a71b640 1 -- 172.21.15.122:0/1925670688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a240c4110 con 0x7f2a240c3440 2024-09-17T06:05:06.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.130+0000 7f2a20ff9640 1 -- 172.21.15.122:0/1925670688 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2a1c0051c0 con 0x7f2a240c3440 2024-09-17T06:05:06.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.134+0000 7f2a20ff9640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2a10073230 0x7f2a10075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.134+0000 7f2a20ff9640 1 -- 172.21.15.122:0/1925670688 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6812+0+0 (secure 0 0 0) 0x7f2a1c096410 con 0x7f2a240c3440 2024-09-17T06:05:06.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.134+0000 7f2a23fff640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2a10073230 0x7f2a10075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.134+0000 7f2a23fff640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2a10073230 0x7f2a10075740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2a14007fd0 tx=0x7f2a14009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:06.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.138+0000 7f2a20ff9640 1 -- 172.21.15.122:0/1925670688 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2a1c060ab0 con 0x7f2a240c3440 2024-09-17T06:05:06.149 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:06.146+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:06.233 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:06.226+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:06.247 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:06.247 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:06.247 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:06.247 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:06.247 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:06.264 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:05:06.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.322+0000 7f2a2a71b640 1 -- 172.21.15.122:0/1925670688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7f2a24161ed0 con 0x7f2a240c3440 2024-09-17T06:05:06.349 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:06.346+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:06.364 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:05:06.433 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:06.430+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:06.460 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:06.460 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:06.460 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:06.460 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:06.460 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.460 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.820343120000004, 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.55819121299999996, 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 1 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.461 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636958+0000", 2024-09-17T06:05:06.462 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4690000000000002e-06 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636976+0000", 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.802e-05 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637001+0000", 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4552000000000001e-05 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.463 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.464 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637024+0000", 2024-09-17T06:05:06.464 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3391999999999999e-05 2024-09-17T06:05:06.464 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.464 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.464 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.464 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637134+0000", 2024-09-17T06:05:06.464 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000109715 2024-09-17T06:05:06.464 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.464 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.464 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for peered", 2024-09-17T06:05:06.464 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637157+0000", 2024-09-17T06:05:06.464 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3363999999999999e-05 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.191892+0000", 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.55473470899999999 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.192190+0000", 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029832200000000001 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.465 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.192541+0000", 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00035034999999999998 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.194061+0000", 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0015205959999999999 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.194944+0000", 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00088236399999999996 2024-09-17T06:05:06.466 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.467 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.467 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.467 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.195056+0000", 2024-09-17T06:05:06.467 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011200399999999999 2024-09-17T06:05:06.467 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.467 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.467 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.467 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.195146+0000", 2024-09-17T06:05:06.467 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0356e-05 2024-09-17T06:05:06.467 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.467 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.467 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.116049868999994, 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.01182241, 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.468 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 42 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.469 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341249+0000", 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0729999999999999e-06 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341257+0000", 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8800000000000008e-06 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341275+0000", 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7842e-05 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.470 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341292+0000", 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6829000000000001e-05 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346218+0000", 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049260329999999998 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346372+0000", 2024-09-17T06:05:06.471 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015433299999999999 2024-09-17T06:05:06.472 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.472 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.472 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.472 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346635+0000", 2024-09-17T06:05:06.472 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026296700000000002 2024-09-17T06:05:06.472 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.472 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.472 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351575+0000", 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049397959999999998 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352898+0000", 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013230060000000001 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352994+0000", 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6045000000000006e-05 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.473 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353070+0000", 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6606000000000005e-05 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.115557519999996, 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011645713, 2024-09-17T06:05:06.474 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 43 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.475 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341743+0000", 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.903e-06 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341764+0000", 2024-09-17T06:05:06.476 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0988999999999998e-05 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341808+0000", 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3791000000000001e-05 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341839+0000", 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1216000000000001e-05 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.477 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.348686+0000", 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068463589999999998 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.348832+0000", 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014631 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.349079+0000", 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024698800000000001 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.478 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353095+0000", 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040160869999999998 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353170+0000", 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4976999999999997e-05 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353259+0000", 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9305e-05 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353386+0000", 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012678799999999999 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.115400786999999, 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015057846, 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.480 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 44 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.481 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341899+0000", 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9e-06 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342021+0000", 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012252000000000001 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.482 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342055+0000", 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3095000000000001e-05 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342078+0000", 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3456e-05 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.349806+0000", 2024-09-17T06:05:06.483 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.007728253 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.350088+0000", 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00028207900000000002 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.350527+0000", 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00043892200000000001 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.484 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.485 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353510+0000", 2024-09-17T06:05:06.485 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029825590000000001 2024-09-17T06:05:06.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.485 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.485 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.485 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356661+0000", 2024-09-17T06:05:06.485 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0031514099999999999 2024-09-17T06:05:06.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.485 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.485 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356817+0000", 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015552900000000001 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356955+0000", 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013812300000000001 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.486 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.115145893000005, 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015109994, 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 45 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.487 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342154+0000", 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9999999999999999e-06 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.488 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342170+0000", 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6506000000000001e-05 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342196+0000", 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5412e-05 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342216+0000", 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0191999999999999e-05 2024-09-17T06:05:06.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351692+0000", 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0094760650000000005 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351849+0000", 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015737600000000001 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352102+0000", 2024-09-17T06:05:06.490 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025282000000000001 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356610+0000", 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045081940000000001 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356984+0000", 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037321899999999999 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.491 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357126+0000", 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014265999999999999 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357262+0000", 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013554999999999999 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:05:06.492 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.115044957999999, 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015392114, 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 46 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.493 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342254+0000", 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4169999999999999e-06 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.494 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.495 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342268+0000", 2024-09-17T06:05:06.495 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4086e-05 2024-09-17T06:05:06.495 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.495 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.495 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.495 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342283+0000", 2024-09-17T06:05:06.495 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4919000000000001e-05 2024-09-17T06:05:06.495 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.495 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.495 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.495 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342297+0000", 2024-09-17T06:05:06.495 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3993e-05 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353648+0000", 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011350783 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353815+0000", 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016706499999999999 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.496 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.354039+0000", 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022362599999999999 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357286+0000", 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003246882 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357422+0000", 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000136093 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.497 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357521+0000", 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.8876000000000007e-05 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357645+0000", 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012437400000000001 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.498 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.114950639, 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.018409992999999999, 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 47 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.499 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.500 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.500 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:05:06.500 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.500 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.500 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.500 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.500 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:05:06.500 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.500 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.500 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.500 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.500 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342348+0000", 2024-09-17T06:05:06.501 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.333e-06 2024-09-17T06:05:06.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.501 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.501 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.501 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342464+0000", 2024-09-17T06:05:06.501 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011581100000000001 2024-09-17T06:05:06.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.501 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.501 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.501 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342485+0000", 2024-09-17T06:05:06.501 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0222000000000001e-05 2024-09-17T06:05:06.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.502 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.502 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.502 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342512+0000", 2024-09-17T06:05:06.502 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7158999999999999e-05 2024-09-17T06:05:06.502 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.502 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.502 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.503 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.354773+0000", 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.012261752000000001 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.355011+0000", 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000237982 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.355427+0000", 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000415234 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.504 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357770+0000", 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023435320000000002 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360464+0000", 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026934820000000001 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360614+0000", 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015075900000000001 2024-09-17T06:05:06.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360757+0000", 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014272699999999999 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.114735413000005, 2024-09-17T06:05:06.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.020363284999999998, 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 48 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342564+0000", 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5269999999999999e-06 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.508 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342593+0000", 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9261e-05 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342617+0000", 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4258999999999999e-05 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342644+0000", 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6645999999999999e-05 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.509 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.510 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357867+0000", 2024-09-17T06:05:06.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015222591000000001 2024-09-17T06:05:06.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.510 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.510 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.510 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.358013+0000", 2024-09-17T06:05:06.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014652299999999999 2024-09-17T06:05:06.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.510 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.510 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.358238+0000", 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000225193 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362590+0000", 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.004351471 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362643+0000", 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2957000000000001e-05 2024-09-17T06:05:06.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362799+0000", 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015606600000000001 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362926+0000", 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012679100000000001 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.114610515999999, 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.021916326, 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 49 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.513 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342689+0000", 2024-09-17T06:05:06.514 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.79e-06 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342703+0000", 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3653e-05 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342740+0000", 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6801000000000002e-05 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.515 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342761+0000", 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1713e-05 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359009+0000", 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.016247663999999998 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359291+0000", 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00028178399999999998 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359738+0000", 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00044704500000000003 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363113+0000", 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033748150000000002 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364339+0000", 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001226067 2024-09-17T06:05:06.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364484+0000", 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014500599999999999 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364604+0000", 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000119988 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.518 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.114440540999993, 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023299408000000001, 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 50 2024-09-17T06:05:06.519 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.520 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342859+0000", 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.663e-06 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342981+0000", 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012199800000000001 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343001+0000", 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0432e-05 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343020+0000", 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8236e-05 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360863+0000", 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.017843741 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.361095+0000", 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00023198199999999999 2024-09-17T06:05:06.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.523 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.523 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.523 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.361364+0000", 2024-09-17T06:05:06.523 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026886 2024-09-17T06:05:06.523 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.523 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.523 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.523 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364745+0000", 2024-09-17T06:05:06.523 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033806690000000002 2024-09-17T06:05:06.523 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.523 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.523 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365860+0000", 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011155679999999999 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366017+0000", 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015673299999999999 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366157+0000", 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013952600000000001 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.524 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.114250510000005, 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023463673000000001, 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.525 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 51 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.527 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.527 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343048+0000", 2024-09-17T06:05:06.527 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0729999999999999e-06 2024-09-17T06:05:06.527 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.527 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.527 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.527 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343057+0000", 2024-09-17T06:05:06.527 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.2959999999999999e-06 2024-09-17T06:05:06.527 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.528 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.528 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.528 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343068+0000", 2024-09-17T06:05:06.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1793e-05 2024-09-17T06:05:06.528 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.528 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.528 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.528 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343094+0000", 2024-09-17T06:05:06.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5882000000000001e-05 2024-09-17T06:05:06.528 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.528 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.528 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363287+0000", 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.020192673000000001 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363457+0000", 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017029600000000001 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363687+0000", 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022974099999999999 2024-09-17T06:05:06.529 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366188+0000", 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025014049999999999 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366282+0000", 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3992000000000004e-05 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.530 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366378+0000", 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5152e-05 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366511+0000", 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013337000000000001 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:05:06.531 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.114184713, 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023823882000000001, 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 52 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.532 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343114+0000", 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5700000000000001e-07 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.533 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343122+0000", 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4919999999999993e-06 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343134+0000", 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1970000000000001e-05 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343144+0000", 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6690000000000001e-06 2024-09-17T06:05:06.534 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364849+0000", 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.021704826 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365104+0000", 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025510700000000002 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365359+0000", 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025527500000000001 2024-09-17T06:05:06.535 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366737+0000", 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001377739 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366772+0000", 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4629000000000003e-05 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366865+0000", 2024-09-17T06:05:06.536 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3220999999999994e-05 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366937+0000", 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.2096999999999998e-05 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:05:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.843908919, 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010475561, 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 69 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:05:06.538 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613390+0000", 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.8899999999999998e-07 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613458+0000", 2024-09-17T06:05:06.539 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.8127999999999996e-05 2024-09-17T06:05:06.540 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.540 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.540 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.540 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613467+0000", 2024-09-17T06:05:06.540 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0909999999999999e-06 2024-09-17T06:05:06.540 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.540 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.540 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.540 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613474+0000", 2024-09-17T06:05:06.540 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.2919999999999998e-06 2024-09-17T06:05:06.540 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.540 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.615892+0000", 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002417836 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.615956+0000", 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3380000000000006e-05 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616042+0000", 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6012000000000003e-05 2024-09-17T06:05:06.541 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619165+0000", 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00312321 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623808+0000", 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0046427339999999999 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623836+0000", 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8839999999999998e-05 2024-09-17T06:05:06.542 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623864+0000", 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8048999999999999e-05 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.843791167000006, 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010433403000000001, 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.543 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 70 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.544 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.8800000000000002e-07 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613512+0000", 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.2719999999999999e-06 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.545 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613518+0000", 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.4350000000000002e-06 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613524+0000", 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5110000000000003e-06 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616673+0000", 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003149102 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.546 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616764+0000", 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1290000000000002e-05 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616880+0000", 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011597800000000001 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619172+0000", 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0022917670000000001 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.547 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623892+0000", 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.004720391 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623918+0000", 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6186999999999998e-05 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623940+0000", 2024-09-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1781999999999999e-05 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.843649010999997, 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010700696000000001, 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.549 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 71 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.550 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613650+0000", 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7300000000000005e-07 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613654+0000", 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6920000000000001e-06 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613662+0000", 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8439999999999998e-06 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.551 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613668+0000", 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6400000000000002e-06 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617192+0000", 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035246499999999998 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617294+0000", 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000101259 2024-09-17T06:05:06.552 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617388+0000", 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4228999999999995e-05 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620154+0000", 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0027657459999999999 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.553 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624067+0000", 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039132730000000001 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624226+0000", 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015945600000000001 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624349+0000", 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000123034 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.554 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.843619081, 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010774550000000001, 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.555 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 72 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.556 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.7399999999999998e-07 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613717+0000", 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7406000000000001e-05 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613723+0000", 2024-09-17T06:05:06.557 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.652e-06 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613728+0000", 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6789999999999996e-06 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617676+0000", 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039476759999999998 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.558 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.559 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617728+0000", 2024-09-17T06:05:06.559 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2871999999999998e-05 2024-09-17T06:05:06.559 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.559 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.559 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.559 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617814+0000", 2024-09-17T06:05:06.559 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5463999999999994e-05 2024-09-17T06:05:06.559 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.559 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.559 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.559 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621037+0000", 2024-09-17T06:05:06.559 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032232910000000001 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624400+0000", 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033624240000000001 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624430+0000", 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0552000000000002e-05 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.560 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624453+0000", 2024-09-17T06:05:06.561 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3059999999999999e-05 2024-09-17T06:05:06.561 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.561 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.561 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.561 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.561 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.561 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.561 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:05:06.561 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.843546536999995, 2024-09-17T06:05:06.561 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010781999, 2024-09-17T06:05:06.561 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.561 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.562 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.562 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.562 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.562 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.562 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 73 2024-09-17T06:05:06.562 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.562 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.562 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.562 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.562 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:05:06.563 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.563 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.563 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.563 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.563 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:05:06.563 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.563 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.563 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.563 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.563 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613752+0000", 2024-09-17T06:05:06.563 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.61e-07 2024-09-17T06:05:06.563 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.564 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.564 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.564 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613758+0000", 2024-09-17T06:05:06.564 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7209999999999999e-06 2024-09-17T06:05:06.564 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.564 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.564 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.564 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613764+0000", 2024-09-17T06:05:06.564 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3470000000000004e-06 2024-09-17T06:05:06.564 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.564 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.564 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613769+0000", 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8810000000000004e-06 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618508+0000", 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047387669999999996 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618559+0000", 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1440999999999998e-05 2024-09-17T06:05:06.565 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618705+0000", 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014593900000000001 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621041+0000", 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023357400000000002 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.566 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624482+0000", 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034416999999999998 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624511+0000", 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8070000000000001e-05 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624533+0000", 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2731999999999999e-05 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.567 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.843518728000006, 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010828374999999999, 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.568 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 74 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.569 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8599999999999999e-07 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613782+0000", 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7010000000000001e-06 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613787+0000", 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3980000000000001e-06 2024-09-17T06:05:06.570 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613790+0000", 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.805e-06 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619344+0000", 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.005553685 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619427+0000", 2024-09-17T06:05:06.571 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.2897000000000003e-05 2024-09-17T06:05:06.572 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.572 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.572 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.572 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619562+0000", 2024-09-17T06:05:06.572 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013549699999999999 2024-09-17T06:05:06.572 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.572 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.572 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.572 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621581+0000", 2024-09-17T06:05:06.572 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020184719999999999 2024-09-17T06:05:06.572 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624559+0000", 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029778230000000001 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624586+0000", 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7093e-05 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.573 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624607+0000", 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1617999999999999e-05 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.843447334999993, 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011087911000000001, 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.574 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 75 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.575 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613851+0000", 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.1099999999999995e-07 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613923+0000", 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1439999999999994e-05 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613930+0000", 2024-09-17T06:05:06.576 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9629999999999998e-06 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613936+0000", 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5659999999999997e-06 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620210+0000", 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.006273514 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.577 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620263+0000", 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2982000000000002e-05 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620363+0000", 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000100802 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621596+0000", 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012330329999999999 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.578 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624709+0000", 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003112971 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624838+0000", 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012835099999999999 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624938+0000", 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000100678 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.579 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.843347166000001, 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011079701000000001, 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:06.580 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 76 2024-09-17T06:05:06.581 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.581 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:06.581 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.581 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:06.581 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:06.581 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.581 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.581 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.581 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:06.581 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:06.581 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:06.581 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1099999999999996e-07 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613954+0000", 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2009999999999999e-06 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613959+0000", 2024-09-17T06:05:06.582 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0440000000000003e-06 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613964+0000", 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4329999999999997e-06 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621073+0000", 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0071095209999999997 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:06.583 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621133+0000", 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9740000000000001e-05 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621250+0000", 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000117287 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621908+0000", 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00065739599999999998 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:06.584 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624980+0000", 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0030722039999999998 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.625008+0000", 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8061000000000001e-05 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.625030+0000", 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2303e-05 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.585 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.586 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.586 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:06.586 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:06.586 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:06.588 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.506+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/355801389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d64003fe0 msgr2=0x7f9d64004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.506+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/355801389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d64003fe0 0x7f9d64004810 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9d7815d920 tx=0x7f9d6801cff0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.506+0000 7f9d7e129640 1 -- 172.21.15.122:0/355801389 reap_dead start 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.506+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/355801389 shutdown_connections 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.506+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/355801389 >> 172.21.15.122:0/355801389 conn(0x7f9d78070380 msgr2=0x7f9d78070790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.506+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/355801389 shutdown_connections 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.506+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/355801389 wait complete. 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.506+0000 7f9d7fb8c640 1 Processor -- start 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.506+0000 7f9d7fb8c640 1 -- start start 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7fb8c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d64003fe0 0x7f9d78148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7fb8c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d781476b0 0x7f9d78147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7fb8c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d78152110 0x7f9d78152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7fb8c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9d78159ff0 con 0x7f9d78152110 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7fb8c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9d78159d10 con 0x7f9d781476b0 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7fb8c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9d780b24b0 con 0x7f9d64003fe0 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7e129640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d78152110 0x7f9d78152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7e129640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d78152110 0x7f9d78152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37058/0 (socket says 172.21.15.122:37058) 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7e129640 1 -- 172.21.15.122:0/2995221596 learned_addr learned my addr 172.21.15.122:0/2995221596 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7d928640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d64003fe0 0x7f9d78148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7d127640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d781476b0 0x7f9d78147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7e129640 1 -- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d64003fe0 msgr2=0x7f9d78148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7e129640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d64003fe0 0x7f9d78148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7e129640 1 -- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d781476b0 msgr2=0x7f9d78147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7e129640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d781476b0 0x7f9d78147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7e129640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7814fa80 con 0x7f9d78152110 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7d928640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d64003fe0 0x7f9d78148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:05:06.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7e129640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d78152110 0x7f9d78152520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9d780c5ff0 tx=0x7f9d70009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:06.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7000fd40 con 0x7f9d78152110 2024-09-17T06:05:06.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d70004b30 con 0x7f9d78152110 2024-09-17T06:05:06.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d78149130 con 0x7f9d78152110 2024-09-17T06:05:06.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d70005020 con 0x7f9d78152110 2024-09-17T06:05:06.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d7814d4b0 con 0x7f9d78152110 2024-09-17T06:05:06.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f9d7814fc50 con 0x7f9d78152110 2024-09-17T06:05:06.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9d70020020 con 0x7f9d78152110 2024-09-17T06:05:06.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d6e7fc640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9d5c073230 0x7f9d5c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6812+0+0 (secure 0 0 0) 0x7f9d70095220 con 0x7f9d78152110 2024-09-17T06:05:06.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v35) ==== 54+0+16 (secure 0 0 0) 0x7f9d70029020 con 0x7f9d78152110 2024-09-17T06:05:06.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.510+0000 7f9d7d928640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9d5c073230 0x7f9d5c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.514+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f9d7814ee80 0x7f9d781ef950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.514+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d780ca100 con 0x7f9d7814ee80 2024-09-17T06:05:06.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.514+0000 7f9d7d127640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f9d7814ee80 0x7f9d781ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.514+0000 7f9d7d928640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9d5c073230 0x7f9d5c075740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009e70 tx=0x7f9d740091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:06.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.514+0000 7f9d7d127640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f9d7814ee80 0x7f9d781ef950 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:06.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.514+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d780ca100 con 0x7f9d7814ee80 2024-09-17T06:05:06.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.530+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f9d7814bb50 con 0x7f9d7814ee80 2024-09-17T06:05:06.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.530+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9d7814bb50 con 0x7f9d7814ee80 2024-09-17T06:05:06.594 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:06.595 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:06.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.530+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f9d78150ec0 0x7f9d781512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.530+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f9d78158230 con 0x7f9d78150ec0 2024-09-17T06:05:06.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.530+0000 7f9d7d928640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f9d78150ec0 0x7f9d781512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.530+0000 7f9d7d928640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f9d78150ec0 0x7f9d781512d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:06.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.530+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d78158230 con 0x7f9d78150ec0 2024-09-17T06:05:06.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.546+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f9d78157f50 con 0x7f9d78150ec0 2024-09-17T06:05:06.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.546+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9d78157f50 con 0x7f9d78150ec0 2024-09-17T06:05:06.596 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:06.597 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:06.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.546+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f9d78063dc0 0x7f9d780641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.546+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f9d78069460 con 0x7f9d78063dc0 2024-09-17T06:05:06.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.546+0000 7f9d7d127640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f9d78063dc0 0x7f9d780641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.546+0000 7f9d7d127640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f9d78063dc0 0x7f9d780641d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:06.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.550+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d78069460 con 0x7f9d78063dc0 2024-09-17T06:05:06.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.574+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f9d781f37b0 con 0x7f9d78063dc0 2024-09-17T06:05:06.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.578+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9d781f37b0 con 0x7f9d78063dc0 2024-09-17T06:05:06.598 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:06.598 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:06.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.578+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f9d7814ab40 0x7f9d7814af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.578+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f9d7814b490 con 0x7f9d7814ab40 2024-09-17T06:05:06.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.578+0000 7f9d7e129640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f9d7814ab40 0x7f9d7814af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.578+0000 7f9d7e129640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f9d7814ab40 0x7f9d7814af50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:06.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.578+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d7814b490 con 0x7f9d7814ab40 2024-09-17T06:05:06.599 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:06.582+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:06.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.590+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f9d7802d720 con 0x7f9d7814ab40 2024-09-17T06:05:06.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.594+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9d7802d720 con 0x7f9d7814ab40 2024-09-17T06:05:06.600 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:06.601 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:06.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.594+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f9d7802dda0 0x7f9d7802e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.594+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f9d7802e6f0 con 0x7f9d7802dda0 2024-09-17T06:05:06.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.594+0000 7f9d7d928640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f9d7802dda0 0x7f9d7802e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.594+0000 7f9d7d928640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f9d7802dda0 0x7f9d7802e1b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:06.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.598+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d7802e6f0 con 0x7f9d7802dda0 2024-09-17T06:05:06.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.610+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f9d7802e6f0 con 0x7f9d7802dda0 2024-09-17T06:05:06.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.614+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9d7802e6f0 con 0x7f9d7802dda0 2024-09-17T06:05:06.618 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:05:06.619 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:05:06.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.614+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f9d78204190 0x7f9d782065b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.614+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f9d7802e930 con 0x7f9d78204190 2024-09-17T06:05:06.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.614+0000 7f9d7d127640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f9d78204190 0x7f9d782065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.618+0000 7f9d7d127640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f9d78204190 0x7f9d782065b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:06.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.618+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d7802e930 con 0x7f9d78204190 2024-09-17T06:05:06.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.646+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f9d7802e930 con 0x7f9d78204190 2024-09-17T06:05:06.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.650+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9d7802e930 con 0x7f9d78204190 2024-09-17T06:05:06.652 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:06.653 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:06.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.650+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f9d78207000 0x7f9d78207410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.650+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f9d7820c560 con 0x7f9d78207000 2024-09-17T06:05:06.653 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.650+0000 7f9d7e129640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f9d78207000 0x7f9d78207410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.654 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.650+0000 7f9d7e129640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f9d78207000 0x7f9d78207410 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:06.655 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.654+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d7820c560 con 0x7f9d78207000 2024-09-17T06:05:06.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.666+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f9d78207a60 con 0x7f9d78207000 2024-09-17T06:05:06.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.670+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9d78207a60 con 0x7f9d78207000 2024-09-17T06:05:06.675 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:06.675 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:06.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.670+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f9d78208180 0x7f9d78208590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:06.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.670+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f9d78208c80 con 0x7f9d78208180 2024-09-17T06:05:06.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.670+0000 7f9d7d928640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f9d78208180 0x7f9d78208590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:06.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.674+0000 7f9d7d928640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f9d78208180 0x7f9d78208590 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:06.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.674+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d78208c80 con 0x7f9d78208180 2024-09-17T06:05:06.688 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:06.686+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:06.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.690+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f9d78208c80 con 0x7f9d78208180 2024-09-17T06:05:06.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d6e7fc640 1 -- 172.21.15.122:0/2995221596 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9d78208c80 con 0x7f9d78208180 2024-09-17T06:05:06.696 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:06.698 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:06.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f9d7814ee80 msgr2=0x7f9d781ef950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f9d7814ee80 0x7f9d781ef950 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f9d78150ec0 msgr2=0x7f9d781512d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f9d78150ec0 0x7f9d781512d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f9d78063dc0 msgr2=0x7f9d780641d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f9d78063dc0 0x7f9d780641d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f9d7814ab40 msgr2=0x7f9d7814af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f9d7814ab40 0x7f9d7814af50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7e129640 1 -- 172.21.15.122:0/2995221596 reap_dead start 2024-09-17T06:05:06.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f9d7802dda0 msgr2=0x7f9d7802e1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f9d7802dda0 0x7f9d7802e1b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7e129640 1 -- 172.21.15.122:0/2995221596 reap_dead start 2024-09-17T06:05:06.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f9d78204190 msgr2=0x7f9d782065b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f9d78204190 0x7f9d782065b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f9d78207000 msgr2=0x7f9d78207410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f9d78207000 0x7f9d78207410 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f9d78208180 msgr2=0x7f9d78208590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f9d78208180 0x7f9d78208590 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9d5c073230 msgr2=0x7f9d5c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9d5c073230 0x7f9d5c075740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009e70 tx=0x7f9d740091e0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d78152110 msgr2=0x7f9d78152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 --2- 172.21.15.122:0/2995221596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d78152110 0x7f9d78152520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9d780c5ff0 tx=0x7f9d70009200 comp rx=0 tx=0).stop 2024-09-17T06:05:06.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7e129640 1 -- 172.21.15.122:0/2995221596 reap_dead start 2024-09-17T06:05:06.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 shutdown_connections 2024-09-17T06:05:06.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 >> 172.21.15.122:0/2995221596 conn(0x7f9d78070380 msgr2=0x7f9d781574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:06.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 shutdown_connections 2024-09-17T06:05:06.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.694+0000 7f9d7fb8c640 1 -- 172.21.15.122:0/2995221596 wait complete. 2024-09-17T06:05:06.736 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:06.736 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:06.751 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:05:06.789 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:06.786+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:06.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.854+0000 7f2a20ff9640 1 -- 172.21.15.122:0/1925670688 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v36) ==== 91+0+0 (secure 0 0 0) 0x7f2a1c0654e0 con 0x7f2a240c3440 2024-09-17T06:05:06.858 INFO:teuthology.orchestra.run.smithi122.stderr:noscrub is unset 2024-09-17T06:05:06.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.858+0000 7f2a2a71b640 1 -- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2a10073230 msgr2=0x7f2a10075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.858+0000 7f2a2a71b640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2a10073230 0x7f2a10075740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2a14007fd0 tx=0x7f2a14009040 comp rx=0 tx=0).stop 2024-09-17T06:05:06.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.858+0000 7f2a2a71b640 1 -- 172.21.15.122:0/1925670688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a240c3440 msgr2=0x7f2a240c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:06.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.858+0000 7f2a2a71b640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a240c3440 0x7f2a240c6920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00db50 tx=0x7f2a1c007590 comp rx=0 tx=0).stop 2024-09-17T06:05:06.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.858+0000 7f2a2a71b640 1 -- 172.21.15.122:0/1925670688 shutdown_connections 2024-09-17T06:05:06.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.858+0000 7f2a2a71b640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a240c3440 0x7f2a240c6920 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.858+0000 7f2a2a71b640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a240c2010 0x7f2a240cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.858+0000 7f2a2a71b640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2a10073230 0x7f2a10075740 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.858+0000 7f2a2a71b640 1 --2- 172.21.15.122:0/1925670688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a2406e780 0x7f2a240cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:06.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.858+0000 7f2a2a71b640 1 -- 172.21.15.122:0/1925670688 >> 172.21.15.122:0/1925670688 conn(0x7f2a24070c10 msgr2=0x7f2a2414bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:06.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.858+0000 7f2a2a71b640 1 -- 172.21.15.122:0/1925670688 shutdown_connections 2024-09-17T06:05:06.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:06.858+0000 7f2a2a71b640 1 -- 172.21.15.122:0/1925670688 wait complete. 2024-09-17T06:05:06.889 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:06.886+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:06.938 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:06.939 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:06.954 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:05:06.996 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:06.994+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:07.091 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:07.086+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:07.153 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:07.153 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:07.170 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:05:07.192 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:07.186+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:07.293 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:07.290+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:07.362 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:07.362 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:07.379 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:05:07.424 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:07.422+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:07.496 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:07.494+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:07.523 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:07.523 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:07.540 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:05:07.596 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:07.590+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:07.697 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:07.694+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:07.730 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:07.730 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:07.747 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:05:07.836 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:07.834+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:07.899 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:07.894+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:07.945 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:07.945 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:07.962 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:05:08.001 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:07.998+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:08.101 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:08.098+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:08.153 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:08.153 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:08.169 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:05:08.216 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:08.214+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:08.303 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:08.298+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:08.313 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:08.313 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:08.329 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:05:08.404 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:08.398+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:08.505 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:08.502+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:08.517 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:08.517 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:08.533 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:05:08.620 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:08.618+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:08.707 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:08.702+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:08.716 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:05:08.727 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:08.727 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:08.746 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:05:08.809 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:08.806+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:08.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.858+0000 7f587e38a640 1 -- 172.21.15.122:0/1114280106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5860003a60 msgr2=0x7f5860003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:08.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.858+0000 7f587e38a640 1 --2- 172.21.15.122:0/1114280106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5860003a60 0x7f5860003ed0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5868009b60 tx=0x7f586801d270 comp rx=0 tx=0).stop 2024-09-17T06:05:08.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.858+0000 7f587e38a640 1 -- 172.21.15.122:0/1114280106 shutdown_connections 2024-09-17T06:05:08.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.858+0000 7f587e38a640 1 --2- 172.21.15.122:0/1114280106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5860003a60 0x7f5860003ed0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:08.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.858+0000 7f587e38a640 1 -- 172.21.15.122:0/1114280106 >> 172.21.15.122:0/1114280106 conn(0x7f587808caf0 msgr2=0x7f587808cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:08.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.858+0000 7f587e38a640 1 -- 172.21.15.122:0/1114280106 shutdown_connections 2024-09-17T06:05:08.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.858+0000 7f587e38a640 1 -- 172.21.15.122:0/1114280106 wait complete. 2024-09-17T06:05:08.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.862+0000 7f587e38a640 1 Processor -- start 2024-09-17T06:05:08.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.862+0000 7f587e38a640 1 -- start start 2024-09-17T06:05:08.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587e38a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5860003a60 0x7f58780b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:08.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587e38a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f587815e360 0x7f58781588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:08.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587e38a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58781f5f50 0x7f5878154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:08.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587e38a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f58780d1200 con 0x7f58781f5f50 2024-09-17T06:05:08.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587e38a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f58780cbd90 con 0x7f5860003a60 2024-09-17T06:05:08.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587e38a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f587815c250 con 0x7f587815e360 2024-09-17T06:05:08.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587c927640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58781f5f50 0x7f5878154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:08.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587c927640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58781f5f50 0x7f5878154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37086/0 (socket says 172.21.15.122:37086) 2024-09-17T06:05:08.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587c927640 1 -- 172.21.15.122:0/4243457428 learned_addr learned my addr 172.21.15.122:0/4243457428 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:08.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f5877fff640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5860003a60 0x7f58780b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:08.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f58777fe640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f587815e360 0x7f58781588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:08.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587c927640 1 -- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f587815e360 msgr2=0x7f58781588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:08.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587c927640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f587815e360 0x7f58781588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:08.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587c927640 1 -- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5860003a60 msgr2=0x7f58780b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:08.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587c927640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5860003a60 0x7f58780b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:08.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587c927640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58781f6360 con 0x7f58781f5f50 2024-09-17T06:05:08.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f58777fe640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f587815e360 0x7f58781588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:05:08.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587c927640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58781f5f50 0x7f5878154580 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f587808d990 tx=0x7f587000db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:08.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870018070 con 0x7f58781f5f50 2024-09-17T06:05:08.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5870003980 con 0x7f58781f5f50 2024-09-17T06:05:08.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870003db0 con 0x7f58781f5f50 2024-09-17T06:05:08.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58781f5490 con 0x7f58781f5f50 2024-09-17T06:05:08.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58781562a0 con 0x7f58781f5f50 2024-09-17T06:05:08.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f58780ce1c0 con 0x7f58781f5f50 2024-09-17T06:05:08.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.866+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f587001b070 con 0x7f58781f5f50 2024-09-17T06:05:08.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.870+0000 7f5874ff9640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f5864073200 0x7f5864075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:08.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.870+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6812+0+0 (secure 0 0 0) 0x7f5870094370 con 0x7f58781f5f50 2024-09-17T06:05:08.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.870+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v36) ==== 54+0+16 (secure 0 0 0) 0x7f5870022070 con 0x7f58781f5f50 2024-09-17T06:05:08.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.870+0000 7f5877fff640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f5864073200 0x7f5864075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:08.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.870+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f58781f8bb0 0x7f58780c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:08.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.870+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f58781f5b70 con 0x7f58781f8bb0 2024-09-17T06:05:08.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.870+0000 7f58777fe640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f58781f8bb0 0x7f58780c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:08.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.870+0000 7f58777fe640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f58781f8bb0 0x7f58780c62b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:08.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.870+0000 7f5877fff640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f5864073200 0x7f5864075710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f58680ae000 tx=0x7f586801a010 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:08.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.870+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f58781f5b70 con 0x7f58781f8bb0 2024-09-17T06:05:08.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.886+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f58780cc980 con 0x7f58781f8bb0 2024-09-17T06:05:08.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.890+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f58780cc980 con 0x7f58781f8bb0 2024-09-17T06:05:08.894 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:08.894 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:08.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.890+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f587814f270 0x7f587815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:08.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.890+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f58780ca8a0 con 0x7f587814f270 2024-09-17T06:05:08.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.890+0000 7f5877fff640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f587814f270 0x7f587815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:08.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.890+0000 7f5877fff640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f587814f270 0x7f587815c580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:08.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.890+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f58780ca8a0 con 0x7f587814f270 2024-09-17T06:05:08.898 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T06:05:08.909 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:08.906+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:08.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.906+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f58780ceb60 con 0x7f587814f270 2024-09-17T06:05:08.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.910+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f58780ceb60 con 0x7f587814f270 2024-09-17T06:05:08.914 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:08.914 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:08.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.910+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f587815cfd0 0x7f58780638b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:08.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.910+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f587815d3e0 con 0x7f587815cfd0 2024-09-17T06:05:08.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.910+0000 7f58777fe640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f587815cfd0 0x7f58780638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:08.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.910+0000 7f58777fe640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f587815cfd0 0x7f58780638b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:08.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.914+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f587815d3e0 con 0x7f587815cfd0 2024-09-17T06:05:08.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.926+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f58780640c0 con 0x7f587815cfd0 2024-09-17T06:05:08.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.930+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f58780640c0 con 0x7f587815cfd0 2024-09-17T06:05:08.933 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:08.934 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:08.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.930+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f58780cf590 0x7f58780cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:08.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.930+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f587815a560 con 0x7f58780cf590 2024-09-17T06:05:08.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.930+0000 7f587c927640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f58780cf590 0x7f58780cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:08.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.930+0000 7f587c927640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f58780cf590 0x7f58780cf9a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:08.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.930+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f587815a560 con 0x7f58780cf590 2024-09-17T06:05:08.936 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:08.936 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:08.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.958+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f587815a280 con 0x7f58780cf590 2024-09-17T06:05:08.965 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T06:05:08.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.962+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f587815a280 con 0x7f58780cf590 2024-09-17T06:05:08.966 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:08.966 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:08.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.962+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f587802d9e0 0x7f587802ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:08.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.962+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f5878064690 con 0x7f587802d9e0 2024-09-17T06:05:08.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.962+0000 7f5877fff640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f587802d9e0 0x7f587802ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:08.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.962+0000 7f5877fff640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f587802d9e0 0x7f587802ddf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:08.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.962+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5878064690 con 0x7f587802d9e0 2024-09-17T06:05:08.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.978+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5878064690 con 0x7f587802d9e0 2024-09-17T06:05:08.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.982+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5878064690 con 0x7f587802d9e0 2024-09-17T06:05:08.985 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:05:08.985 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:05:08.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.982+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f5878209e60 0x7f587820c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:08.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.982+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f587802e8c0 con 0x7f5878209e60 2024-09-17T06:05:08.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.982+0000 7f58777fe640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f5878209e60 0x7f587820c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:08.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.982+0000 7f58777fe640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f5878209e60 0x7f587820c280 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:08.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.982+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f587802e8c0 con 0x7f5878209e60 2024-09-17T06:05:09.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:08.998+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5878064710 con 0x7f5878209e60 2024-09-17T06:05:09.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.002+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5878064710 con 0x7f5878209e60 2024-09-17T06:05:09.005 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:09.005 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:09.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.002+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f587820ccd0 0x7f587820d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:09.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.002+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f5878212230 con 0x7f587820ccd0 2024-09-17T06:05:09.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.002+0000 7f587c927640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f587820ccd0 0x7f587820d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:09.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.002+0000 7f587c927640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f587820ccd0 0x7f587820d0e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:09.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.002+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5878212230 con 0x7f587820ccd0 2024-09-17T06:05:09.009 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:09.006+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:09.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.018+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f587820d730 con 0x7f587820ccd0 2024-09-17T06:05:09.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.022+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f587820d730 con 0x7f587820ccd0 2024-09-17T06:05:09.024 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:09.025 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:09.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.022+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f587820ddb0 0x7f587820e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:09.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.022+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f587820e970 con 0x7f587820ddb0 2024-09-17T06:05:09.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.022+0000 7f5877fff640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f587820ddb0 0x7f587820e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:09.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.022+0000 7f5877fff640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f587820ddb0 0x7f587820e1c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:09.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.022+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f587820e970 con 0x7f587820ddb0 2024-09-17T06:05:09.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.038+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f587820e970 con 0x7f587820ddb0 2024-09-17T06:05:09.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f5874ff9640 1 -- 172.21.15.122:0/4243457428 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f587820e970 con 0x7f587820ddb0 2024-09-17T06:05:09.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3618613137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f10159240 msgr2=0x7f9f10142640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f9f15ddb640 1 --2- 172.21.15.122:0/3618613137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f10159240 0x7f9f10142640 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9f10072bc0 tx=0x7f9f0001f0b0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.045 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:09.045 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:09.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3618613137 shutdown_connections 2024-09-17T06:05:09.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f9f15ddb640 1 --2- 172.21.15.122:0/3618613137 >> v2:172.21.15.173:3300/0 conn(0x7f9f1006fe60 0x7f9f1006d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f9f15ddb640 1 --2- 172.21.15.122:0/3618613137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f10159240 0x7f9f10142640 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3618613137 >> 172.21.15.122:0/3618613137 conn(0x7f9f100ca380 msgr2=0x7f9f100ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:09.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3618613137 shutdown_connections 2024-09-17T06:05:09.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3618613137 wait complete. 2024-09-17T06:05:09.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f58781f8bb0 msgr2=0x7f58780c62b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f58781f8bb0 0x7f58780c62b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f587814f270 msgr2=0x7f587815c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f587814f270 0x7f587815c580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f587815cfd0 msgr2=0x7f58780638b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f587815cfd0 0x7f58780638b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f58780cf590 msgr2=0x7f58780cf9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f58780cf590 0x7f58780cf9a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f587802d9e0 msgr2=0x7f587802ddf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f587802d9e0 0x7f587802ddf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f5878209e60 msgr2=0x7f587820c280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f5878209e60 0x7f587820c280 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f587820ccd0 msgr2=0x7f587820d0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f587820ccd0 0x7f587820d0e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f587820ddb0 msgr2=0x7f587820e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f587820ddb0 0x7f587820e1c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587c927640 1 -- 172.21.15.122:0/4243457428 reap_dead start 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587c927640 1 -- 172.21.15.122:0/4243457428 reap_dead start 2024-09-17T06:05:09.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587c927640 1 -- 172.21.15.122:0/4243457428 reap_dead start 2024-09-17T06:05:09.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587c927640 1 -- 172.21.15.122:0/4243457428 reap_dead start 2024-09-17T06:05:09.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587c927640 1 -- 172.21.15.122:0/4243457428 reap_dead start 2024-09-17T06:05:09.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f5864073200 msgr2=0x7f5864075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f5864073200 0x7f5864075710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f58680ae000 tx=0x7f586801a010 comp rx=0 tx=0).stop 2024-09-17T06:05:09.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58781f5f50 msgr2=0x7f5878154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58781f5f50 0x7f5878154580 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f587808d990 tx=0x7f587000db60 comp rx=0 tx=0).stop 2024-09-17T06:05:09.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 shutdown_connections 2024-09-17T06:05:09.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58781f5f50 0x7f5878154580 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 --2- 172.21.15.122:0/4243457428 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f5864073200 0x7f5864075710 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 >> 172.21.15.122:0/4243457428 conn(0x7f587808caf0 msgr2=0x7f5878068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:09.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 shutdown_connections 2024-09-17T06:05:09.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f587e38a640 1 -- 172.21.15.122:0/4243457428 wait complete. 2024-09-17T06:05:09.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f9f15ddb640 1 Processor -- start 2024-09-17T06:05:09.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.042+0000 7f9f15ddb640 1 -- start start 2024-09-17T06:05:09.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f15ddb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f10159240 0x7f9f100c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:09.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f15ddb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f1015d240 0x7f9f1013cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:09.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f15ddb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f100c8860 0x7f9f100c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:09.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f15ddb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1006de20 con 0x7f9f1015d240 2024-09-17T06:05:09.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f15ddb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1006dca0 con 0x7f9f100c8860 2024-09-17T06:05:09.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f15ddb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9f1006dfa0 con 0x7f9f10159240 2024-09-17T06:05:09.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f0effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f1015d240 0x7f9f1013cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:09.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f0effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f1015d240 0x7f9f1013cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37102/0 (socket says 172.21.15.122:37102) 2024-09-17T06:05:09.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f0effd640 1 -- 172.21.15.122:0/3754731241 learned_addr learned my addr 172.21.15.122:0/3754731241 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:09.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f0ffff640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f100c8860 0x7f9f100c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:09.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f0f7fe640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f10159240 0x7f9f100c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f0effd640 1 -- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f10159240 msgr2=0x7f9f100c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f0effd640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f10159240 0x7f9f100c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f0effd640 1 -- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f100c8860 msgr2=0x7f9f100c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f0effd640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f100c8860 0x7f9f100c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f0effd640 1 -- 172.21.15.122:0/3754731241 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f100c6d10 con 0x7f9f1015d240 2024-09-17T06:05:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f0effd640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f1015d240 0x7f9f1013cf80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400c3f0 tx=0x7f9f0400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9ef7fff640 1 -- 172.21.15.122:0/3754731241 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04017070 con 0x7f9f1015d240 2024-09-17T06:05:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9ef7fff640 1 -- 172.21.15.122:0/3754731241 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f040053c0 con 0x7f9f1015d240 2024-09-17T06:05:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3754731241 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f100c52c0 con 0x7f9f1015d240 2024-09-17T06:05:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9ef7fff640 1 -- 172.21.15.122:0/3754731241 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04003860 con 0x7f9f1015d240 2024-09-17T06:05:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3754731241 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f100c7260 con 0x7f9f1015d240 2024-09-17T06:05:09.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.046+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3754731241 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f1006e4c0 con 0x7f9f1015d240 2024-09-17T06:05:09.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.050+0000 7f9ef7fff640 1 -- 172.21.15.122:0/3754731241 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9f0401a070 con 0x7f9f1015d240 2024-09-17T06:05:09.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.050+0000 7f9ef7fff640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9efc073200 0x7f9efc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:09.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.050+0000 7f9ef7fff640 1 -- 172.21.15.122:0/3754731241 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6812+0+0 (secure 0 0 0) 0x7f9f04093810 con 0x7f9f1015d240 2024-09-17T06:05:09.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.050+0000 7f9f0f7fe640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9efc073200 0x7f9efc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:09.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.050+0000 7f9f0f7fe640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9efc073200 0x7f9efc075710 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f000b2000 tx=0x7f9f0001d8f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:09.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.058+0000 7f9ef7fff640 1 -- 172.21.15.122:0/3754731241 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9f0405deb0 con 0x7f9f1015d240 2024-09-17T06:05:09.111 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:09.106+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:09.128 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:09.128 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:09.128 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:09.128 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:09.145 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T06:05:09.212 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:09.210+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:09.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.238+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3754731241 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) -- 0x7f9f10157d80 con 0x7f9f1015d240 2024-09-17T06:05:09.313 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:09.310+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:09.337 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:09.337 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:09.337 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:09.337 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:09.337 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:09.354 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T06:05:09.414 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:09.410+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:09.503 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:09.503 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:09.503 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:09.503 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:09.503 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.503 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:09.503 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 55.682730888999998, 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.013495551, 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:09.504 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820818+0000", 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.858e-06 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820836+0000", 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7955e-05 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:09.506 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820863+0000", 2024-09-17T06:05:09.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7013999999999999e-05 2024-09-17T06:05:09.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.506 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:09.506 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820885+0000", 2024-09-17T06:05:09.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1695000000000002e-05 2024-09-17T06:05:09.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.506 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:09.506 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821084+0000", 2024-09-17T06:05:09.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019876400000000001 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821305+0000", 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022121099999999999 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821563+0000", 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025797100000000001 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825504+0000", 2024-09-17T06:05:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039410119999999998 2024-09-17T06:05:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834165+0000", 2024-09-17T06:05:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086608810000000005 2024-09-17T06:05:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834252+0000", 2024-09-17T06:05:09.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7276999999999998e-05 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834311+0000", 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8913000000000003e-05 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:05:09.509 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 55.679507614999999, 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037604380000000001, 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:05:09.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824040+0000", 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8649999999999999e-06 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824070+0000", 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9162e-05 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824088+0000", 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8529000000000002e-05 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824103+0000", 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5081e-05 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824193+0000", 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9896999999999997e-05 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1649000000000001e-05 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827740+0000", 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035152069999999998 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827799+0000", 2024-09-17T06:05:09.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9048000000000001e-05 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 55.679322063000001, 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035104340000000002, 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:09.514 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:05:09.515 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1909999999999999e-06 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824237+0000", 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1914e-05 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824252+0000", 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5071e-05 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824265+0000", 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2748000000000001e-05 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824346+0000", 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0530000000000003e-05 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824375+0000", 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9805e-05 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.517 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827659+0000", 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032838569999999998 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827735+0000", 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5318e-05 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.518 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 75 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 55.679125263000003, 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003402553, 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.519 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824422+0000", 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3399999999999998e-07 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824434+0000", 2024-09-17T06:05:09.520 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1960000000000001e-05 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824771+0000", 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033676799999999998 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824798+0000", 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7838e-05 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.521 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824920+0000", 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012210699999999999 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827824+0000", 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029030459999999998 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 4 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:09.522 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 55.678438755000002, 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003032833, 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.523 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825108+0000", 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6099999999999999e-07 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825120+0000", 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1780000000000001e-05 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.524 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825136+0000", 2024-09-17T06:05:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6229999999999999e-05 2024-09-17T06:05:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825152+0000", 2024-09-17T06:05:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6104e-05 2024-09-17T06:05:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:09.525 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825297+0000", 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014498399999999999 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828140+0000", 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002842874 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:09.526 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 55.673729975999997, 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032580460000000001, 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.527 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829817+0000", 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.176e-06 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0178e-05 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.528 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829847+0000", 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9402000000000002e-05 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829858+0000", 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1141000000000001e-05 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830004+0000", 2024-09-17T06:05:09.529 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014622699999999999 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830027+0000", 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2826000000000001e-05 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833000+0000", 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029729000000000001 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.530 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833074+0000", 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4196000000000006e-05 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 55.672615194999999, 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0043957220000000003, 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:09.531 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830933+0000", 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5090000000000001e-06 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830946+0000", 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3018e-05 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830968+0000", 2024-09-17T06:05:09.533 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2558999999999999e-05 2024-09-17T06:05:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830984+0000", 2024-09-17T06:05:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5376999999999999e-05 2024-09-17T06:05:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831072+0000", 2024-09-17T06:05:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8745000000000005e-05 2024-09-17T06:05:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.534 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831104+0000", 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1265e-05 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835260+0000", 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0041569559999999998 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835327+0000", 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.6292999999999997e-05 2024-09-17T06:05:09.535 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.536 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:09.536 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.536 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.536 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.536 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-17T06:05:09.536 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:05:09.536 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 55.669511661999998, 2024-09-17T06:05:09.536 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029529399999999998, 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:05:09.537 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:09.538 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.538 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.538 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:09.538 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834036+0000", 2024-09-17T06:05:09.538 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9999999999999995e-07 2024-09-17T06:05:09.538 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.538 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.538 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:09.538 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834042+0000", 2024-09-17T06:05:09.538 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.7240000000000003e-06 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834058+0000", 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5648e-05 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834068+0000", 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0383999999999999e-05 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:09.539 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834145+0000", 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.64e-05 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834157+0000", 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2414e-05 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834330+0000", 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017272399999999999 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.540 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:09.541 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.541 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:09.541 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:09.541 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:09.542 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:05:09.543 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:09.538+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:09.643 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:09.638+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:09.738 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:09.738 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:09.738 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:09.738 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:09.744 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:09.742+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:09.755 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:05:09.846 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:09.842+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:09.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.890+0000 7f9ef7fff640 1 -- 172.21.15.122:0/3754731241 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v37) ==== 101+0+0 (secure 0 0 0) 0x7f9f040628e0 con 0x7f9f1015d240 2024-09-17T06:05:09.894 INFO:teuthology.orchestra.run.smithi122.stderr:nodeep-scrub is unset 2024-09-17T06:05:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.894+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9efc073200 msgr2=0x7f9efc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.894+0000 7f9f15ddb640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9efc073200 0x7f9efc075710 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f000b2000 tx=0x7f9f0001d8f0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.894+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3754731241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f1015d240 msgr2=0x7f9f1013cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.894+0000 7f9f15ddb640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f1015d240 0x7f9f1013cf80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400c3f0 tx=0x7f9f0400c8b0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.894+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3754731241 shutdown_connections 2024-09-17T06:05:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.894+0000 7f9f15ddb640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9efc073200 0x7f9efc075710 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.894+0000 7f9f15ddb640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f100c8860 0x7f9f100c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.894+0000 7f9f15ddb640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f1015d240 0x7f9f1013cf80 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400c3f0 tx=0x7f9f0400c8b0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.894+0000 7f9f15ddb640 1 --2- 172.21.15.122:0/3754731241 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9f10159240 0x7f9f100c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:09.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.894+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3754731241 >> 172.21.15.122:0/3754731241 conn(0x7f9f100ca380 msgr2=0x7f9f10140870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:09.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.894+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3754731241 shutdown_connections 2024-09-17T06:05:09.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:09.894+0000 7f9f15ddb640 1 -- 172.21.15.122:0/3754731241 wait complete. 2024-09-17T06:05:09.904 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:09.904 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:09.904 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:09.904 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:09.904 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:09.922 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:05:09.960 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:09.958+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:10.047 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:10.042+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:10.072 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:10.072 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:10.072 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:10.072 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:10.072 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.072 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:10.072 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:10.072 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.248969631999998, 2024-09-17T06:05:10.072 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:05:10.072 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.072 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.073 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.074 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:05:10.075 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:05:10.076 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.076 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.076 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.076 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:05:10.076 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:05:10.076 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.076 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.076 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.076 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:05:10.076 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:05:10.076 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.076 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.248857407999999, 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.077 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.078 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:05:10.079 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.080 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:10.081 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.248652057999998, 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.082 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:05:10.083 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.084 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:05:10.085 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:05:10.085 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.085 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.085 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.085 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:05:10.085 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:05:10.085 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.085 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.085 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.085 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:10.086 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.242511532000002, 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.087 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:05:10.088 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:05:10.089 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.089 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.089 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.089 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:05:10.089 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:05:10.089 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.089 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.089 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.089 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:05:10.089 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:05:10.090 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.090 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.090 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.090 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:05:10.090 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:05:10.090 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.090 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.090 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.090 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:10.090 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:05:10.090 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.242356805999997, 2024-09-17T06:05:10.091 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:05:10.092 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.092 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.092 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.092 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.092 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:10.092 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.092 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.094 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.094 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:05:10.094 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:05:10.094 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.094 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.094 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.094 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:05:10.094 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:05:10.094 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.094 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.094 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.094 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.095 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:05:10.096 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:05:10.096 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.096 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.096 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.096 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.096 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.096 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:10.097 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:05:10.149 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:10.146+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:10.241 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:10.241 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:10.241 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:10.241 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:10.250 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:10.246+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:10.258 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:05:10.351 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:10.346+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:10.533 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:10.533 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:10.533 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:10.533 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:10.533 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:10.533 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:05:10.534 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:10.526+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:10.633 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:10.630+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:10.734 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:10.730+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:10.736 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:10.736 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:10.736 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:10.736 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:10.736 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.736 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:10.736 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:10.736 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.912233041, 2024-09-17T06:05:10.736 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:05:10.736 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.736 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.736 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.737 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.738 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:05:10.738 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:05:10.738 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.738 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.738 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.738 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:05:10.738 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:05:10.738 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.738 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:05:10.739 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:05:10.741 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:05:10.741 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.741 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.741 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.741 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:05:10.741 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:05:10.741 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.741 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.741 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.741 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:05:10.741 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:05:10.741 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.912112639, 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:05:10.742 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.743 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.744 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.745 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:05:10.746 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:05:10.747 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:05:10.748 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.748 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.748 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.748 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.748 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.748 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:10.748 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:10.748 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.911984725000003, 2024-09-17T06:05:10.748 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:05:10.748 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.748 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.749 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:05:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:05:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:05:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:05:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:05:10.750 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:05:10.751 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.751 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.751 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.751 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:10.751 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:05:10.751 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.752 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.752 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.752 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:05:10.752 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:05:10.752 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.752 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.752 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.752 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:10.753 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:05:10.753 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.753 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.753 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:10.753 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:05:10.753 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:05:10.753 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.753 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.753 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.753 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:05:10.754 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:05:10.754 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.754 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.754 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.754 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:05:10.754 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:05:10.754 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.755 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.755 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.755 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:05:10.755 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:05:10.755 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.755 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.756 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.756 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:05:10.756 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:05:10.756 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.756 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.756 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.757 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.757 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.757 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:10.757 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:10.757 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.910958762, 2024-09-17T06:05:10.757 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:05:10.757 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.758 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.758 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.758 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.758 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.758 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.758 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:10.759 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.759 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.759 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.759 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.759 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:10.759 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.760 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.760 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.760 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.760 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:05:10.760 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:05:10.760 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.761 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.761 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.761 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:05:10.761 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:05:10.761 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.761 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.762 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:05:10.762 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:05:10.762 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.762 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.763 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:05:10.763 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:05:10.763 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.763 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.763 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.763 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:05:10.764 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:05:10.764 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.764 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.764 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.764 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:05:10.764 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:05:10.765 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.765 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.765 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:10.765 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:05:10.765 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:05:10.766 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.766 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.766 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.766 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:05:10.766 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:05:10.766 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.767 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.767 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.767 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:05:10.767 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:05:10.767 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.767 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.768 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.768 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:05:10.768 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:05:10.768 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.768 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.768 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.769 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:05:10.769 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:05:10.769 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.769 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.769 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.769 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.769 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.770 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:10.770 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:10.770 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.910877819, 2024-09-17T06:05:10.770 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:05:10.770 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.770 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.770 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.771 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.771 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.771 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.771 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:10.771 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.771 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.772 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.772 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:10.772 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.772 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.772 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.772 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:05:10.773 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:05:10.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.773 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.773 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.773 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:05:10.773 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:05:10.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.773 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.773 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.773 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:05:10.773 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:05:10.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:05:10.774 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.775 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.776 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.910815417000002, 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:05:10.778 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.779 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.779 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.779 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:05:10.779 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:05:10.779 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.779 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.779 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.779 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:05:10.779 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:05:10.779 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.779 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.779 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.780 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:05:10.780 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:05:10.780 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.780 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.780 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.780 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:05:10.780 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:05:10.780 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.781 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:05:10.782 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:05:10.782 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.782 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.782 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.782 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:05:10.782 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:05:10.782 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.782 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.782 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.782 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:05:10.782 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.910743326999999, 2024-09-17T06:05:10.783 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:05:10.784 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.784 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.784 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:10.784 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.784 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.784 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.784 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:10.784 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.784 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.784 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.785 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.785 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:10.785 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.785 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.785 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.785 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.785 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:05:10.785 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:05:10.785 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.785 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.785 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.785 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:05:10.787 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.788 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.788 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.788 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.788 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.788 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:10.788 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:10.788 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.910701127000003, 2024-09-17T06:05:10.788 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:05:10.788 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.788 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.789 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:10.789 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.789 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.789 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.789 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:10.789 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.789 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.789 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.789 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.789 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:10.790 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.790 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.790 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.790 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.790 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:05:10.790 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:05:10.790 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.790 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.790 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.790 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:05:10.790 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:05:10.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.791 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.791 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.791 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:05:10.791 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:05:10.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.791 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.791 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:05:10.792 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:05:10.792 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.792 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.792 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:05:10.792 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:05:10.792 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.792 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.792 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:05:10.792 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:10.793 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.908109195000002, 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.794 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.795 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.796 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:05:10.796 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:05:10.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.796 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.796 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.796 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:05:10.796 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:05:10.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.796 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.797 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.797 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:05:10.797 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:05:10.797 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.797 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.797 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.798 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:05:10.798 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:05:10.798 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.798 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.800 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.800 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:05:10.800 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:05:10.800 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.800 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.800 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.800 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:05:10.801 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:05:10.801 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.801 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.801 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.801 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.801 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.801 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:10.802 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:10.802 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.908013060000002, 2024-09-17T06:05:10.802 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:05:10.802 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.802 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.802 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.802 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.803 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.803 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:10.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.803 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:10.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.804 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:05:10.805 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:05:10.805 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.805 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:05:10.806 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:05:10.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.806 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.806 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.806 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:05:10.806 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:05:10.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.807 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.807 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.807 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:05:10.807 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:05:10.807 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.807 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.807 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.807 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:05:10.807 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:05:10.807 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.808 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.808 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:05:10.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:05:10.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.808 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.808 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:05:10.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:05:10.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.808 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.809 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:05:10.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:05:10.809 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.809 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.809 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.809 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.809 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.809 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:05:10.809 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:10.809 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.899580774, 2024-09-17T06:05:10.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:05:10.809 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.810 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:05:10.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:05:10.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.814 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.814 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.814 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:05:10.814 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:05:10.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.814 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.814 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.814 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:05:10.814 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:05:10.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.805991554000002, 2024-09-17T06:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:05:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:05:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:05:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:05:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:05:10.819 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 50.135361189000001, 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.820 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.821 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:05:10.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:10.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:05:10.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:05:10.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:05:10.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:05:10.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.825 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 48.414690233000002, 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.826 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:05:10.827 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:10.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:05:10.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:05:10.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:05:10.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:05:10.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.831 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:05:10.831 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:05:10.831 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.831 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.831 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:05:10.831 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:05:10.831 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.831 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.831 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:05:10.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:05:10.832 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.832 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.832 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.832 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.832 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.832 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:10.832 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:10.832 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 48.412005983999997, 2024-09-17T06:05:10.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:05:10.832 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.832 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.833 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:10.833 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.833 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:10.833 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.833 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:10.833 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:05:10.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:05:10.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:05:10.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:05:10.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.836 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.542803311, 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.837 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:05:10.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:05:10.841 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.842 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 27.016362398999998, 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.843 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:05:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:05:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.844 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:05:10.845 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:05:10.846 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.847 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:05:10.848 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:05:10.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.848 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.848 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.848 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:05:10.848 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:05:10.848 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.848 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.848 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.848 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 27.016132883000001, 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.849 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:05:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:05:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.850 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:05:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:05:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:05:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:05:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:05:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:05:10.851 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.852 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.852 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.852 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:05:10.852 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:05:10.852 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.852 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.852 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.852 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:05:10.852 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:05:10.852 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.852 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:05:10.853 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.854 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.855 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.855 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.855 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:10.855 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:10.855 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 27.014168186999999, 2024-09-17T06:05:10.855 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:05:10.855 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.855 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.855 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:10.855 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.855 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.855 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:05:10.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.857 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.858 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 23.080605299999998, 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:10.859 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.860 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:05:10.861 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:05:10.862 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:05:10.863 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.864 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.865 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:10.865 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:10.865 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:10.866 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:05:10.867 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:10.862+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:10.933 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-17T06:05:10.933 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T06:05:10.933 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-17T06:05:10.934 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T06:05:10.980 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:10.978+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:11.064 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:11.065 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:11.065 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:11.065 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:11.067 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:11.062+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:11.068 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:05:11.081 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:05:11.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.086+0000 7f3fd1beb640 1 -- 172.21.15.122:0/2301238180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fcc06fc90 msgr2=0x7f3fcc06d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.086+0000 7f3fd1beb640 1 --2- 172.21.15.122:0/2301238180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fcc06fc90 0x7f3fcc06d760 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009c80 tx=0x7f3fc401f5a0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.086+0000 7f3fd1beb640 1 -- 172.21.15.122:0/2301238180 shutdown_connections 2024-09-17T06:05:11.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.086+0000 7f3fd1beb640 1 --2- 172.21.15.122:0/2301238180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fcc06fc90 0x7f3fcc06d760 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.086+0000 7f3fd1beb640 1 --2- 172.21.15.122:0/2301238180 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3fcc142640 0x7f3fcc06f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.086+0000 7f3fd1beb640 1 -- 172.21.15.122:0/2301238180 >> 172.21.15.122:0/2301238180 conn(0x7f3fcc0ca380 msgr2=0x7f3fcc0ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:11.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.086+0000 7f3fd1beb640 1 -- 172.21.15.122:0/2301238180 shutdown_connections 2024-09-17T06:05:11.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.086+0000 7f3fd1beb640 1 -- 172.21.15.122:0/2301238180 wait complete. 2024-09-17T06:05:11.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.090+0000 7f3fd1beb640 1 Processor -- start 2024-09-17T06:05:11.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.090+0000 7f3fd1beb640 1 -- start start 2024-09-17T06:05:11.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fd1beb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fcc06fc90 0x7f3fcc13d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fd1beb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fcc142640 0x7f3fcc0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fd1beb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3fcc159240 0x7f3fcc0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fd1beb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc06dca0 con 0x7f3fcc06fc90 2024-09-17T06:05:11.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fd1beb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc15a000 con 0x7f3fcc142640 2024-09-17T06:05:11.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fd1beb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3fcc06de20 con 0x7f3fcc159240 2024-09-17T06:05:11.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fcb7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fcc06fc90 0x7f3fcc13d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fcb7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fcc06fc90 0x7f3fcc13d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37124/0 (socket says 172.21.15.122:37124) 2024-09-17T06:05:11.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fcaffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fcc142640 0x7f3fcc0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fcb7fe640 1 -- 172.21.15.122:0/4107663648 learned_addr learned my addr 172.21.15.122:0/4107663648 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:11.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fcbfff640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3fcc159240 0x7f3fcc0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fcb7fe640 1 -- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3fcc159240 msgr2=0x7f3fcc0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fcb7fe640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3fcc159240 0x7f3fcc0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fcb7fe640 1 -- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fcc142640 msgr2=0x7f3fcc0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fcb7fe640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fcc142640 0x7f3fcc0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fcb7fe640 1 -- 172.21.15.122:0/4107663648 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fcc154fa0 con 0x7f3fcc06fc90 2024-09-17T06:05:11.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fcb7fe640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fcc06fc90 0x7f3fcc13d3d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000c3f0 tx=0x7f3fc000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fb3fff640 1 -- 172.21.15.122:0/4107663648 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0017070 con 0x7f3fcc06fc90 2024-09-17T06:05:11.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fb3fff640 1 -- 172.21.15.122:0/4107663648 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fc00053c0 con 0x7f3fcc06fc90 2024-09-17T06:05:11.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fd1beb640 1 -- 172.21.15.122:0/4107663648 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fcc155280 con 0x7f3fcc06fc90 2024-09-17T06:05:11.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fb3fff640 1 -- 172.21.15.122:0/4107663648 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0003860 con 0x7f3fcc06fc90 2024-09-17T06:05:11.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fd1beb640 1 -- 172.21.15.122:0/4107663648 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fcc155840 con 0x7f3fcc06fc90 2024-09-17T06:05:11.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.094+0000 7f3fd1beb640 1 -- 172.21.15.122:0/4107663648 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fcc06e310 con 0x7f3fcc06fc90 2024-09-17T06:05:11.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.098+0000 7f3fb3fff640 1 -- 172.21.15.122:0/4107663648 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3fc001a070 con 0x7f3fcc06fc90 2024-09-17T06:05:11.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.098+0000 7f3fb3fff640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3fb8073200 0x7f3fb8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.098+0000 7f3fb3fff640 1 -- 172.21.15.122:0/4107663648 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6812+0+0 (secure 0 0 0) 0x7f3fc0093dc0 con 0x7f3fcc06fc90 2024-09-17T06:05:11.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.098+0000 7f3fcaffd640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3fb8073200 0x7f3fb8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.098+0000 7f3fcaffd640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3fb8073200 0x7f3fb8075710 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc1e9e80 tx=0x7f3fbc00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.106+0000 7f3fb3fff640 1 -- 172.21.15.122:0/4107663648 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3fc0021020 con 0x7f3fcc06fc90 2024-09-17T06:05:11.169 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:11.166+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:11.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.210+0000 7f072c5a1640 1 -- 172.21.15.122:0/820334472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07240c8940 msgr2=0x7f072406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.210+0000 7f072c5a1640 1 --2- 172.21.15.122:0/820334472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07240c8940 0x7f072406d8a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f07240c9f60 tx=0x7f071401f0b0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.210+0000 7f072c5a1640 1 -- 172.21.15.122:0/820334472 shutdown_connections 2024-09-17T06:05:11.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.210+0000 7f072c5a1640 1 --2- 172.21.15.122:0/820334472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07240c8940 0x7f072406d8a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.210+0000 7f072c5a1640 1 --2- 172.21.15.122:0/820334472 >> v2:172.21.15.173:3300/0 conn(0x7f07240c3910 0x7f07240c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072c5a1640 1 -- 172.21.15.122:0/820334472 >> 172.21.15.122:0/820334472 conn(0x7f0724073640 msgr2=0x7f07240cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:11.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072c5a1640 1 -- 172.21.15.122:0/820334472 shutdown_connections 2024-09-17T06:05:11.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072c5a1640 1 -- 172.21.15.122:0/820334472 wait complete. 2024-09-17T06:05:11.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072c5a1640 1 Processor -- start 2024-09-17T06:05:11.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072c5a1640 1 -- start start 2024-09-17T06:05:11.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072c5a1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07240c3910 0x7f07241f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072c5a1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07240c4450 0x7f0724157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072c5a1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07240c8940 0x7f07240c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072c5a1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f072415bf50 con 0x7f07240c3910 2024-09-17T06:05:11.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072c5a1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f072415bc70 con 0x7f07240c8940 2024-09-17T06:05:11.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072c5a1640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f072406f750 con 0x7f07240c4450 2024-09-17T06:05:11.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072a33d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07240c3910 0x7f07241f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072a33d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07240c3910 0x7f07241f2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37150/0 (socket says 172.21.15.122:37150) 2024-09-17T06:05:11.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072a33d640 1 -- 172.21.15.122:0/1051452096 learned_addr learned my addr 172.21.15.122:0/1051452096 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:11.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072ab3e640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07240c8940 0x7f07240c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f0729b3c640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07240c4450 0x7f0724157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072a33d640 1 -- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07240c4450 msgr2=0x7f0724157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072a33d640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07240c4450 0x7f0724157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072a33d640 1 -- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07240c8940 msgr2=0x7f07240c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072a33d640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07240c8940 0x7f07240c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072a33d640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0724158090 con 0x7f07240c3910 2024-09-17T06:05:11.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.214+0000 7f072ab3e640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07240c8940 0x7f07240c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:05:11.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f072a33d640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07240c3910 0x7f07241f2620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f072000d950 tx=0x7f072000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720017070 con 0x7f07240c3910 2024-09-17T06:05:11.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0724157390 con 0x7f07240c3910 2024-09-17T06:05:11.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0720009d20 con 0x7f07240c3910 2024-09-17T06:05:11.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07200106c0 con 0x7f07240c3910 2024-09-17T06:05:11.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07240c6e60 con 0x7f07240c3910 2024-09-17T06:05:11.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f0724155ab0 con 0x7f07240c3910 2024-09-17T06:05:11.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f072001a070 con 0x7f07240c3910 2024-09-17T06:05:11.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f071affd640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0708073200 0x7f0708075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6812+0+0 (secure 0 0 0) 0x7f07200948d0 con 0x7f07240c3910 2024-09-17T06:05:11.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v37) ==== 54+0+16 (secure 0 0 0) 0x7f0720099240 con 0x7f07240c3910 2024-09-17T06:05:11.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f0729b3c640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0708073200 0x7f0708075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f07241ebd60 0x7f07240c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07240c36f0 con 0x7f07241ebd60 2024-09-17T06:05:11.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.218+0000 7f072ab3e640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f07241ebd60 0x7f07240c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.222+0000 7f072ab3e640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f07241ebd60 0x7f07240c5680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.222+0000 7f0729b3c640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0708073200 0x7f0708075710 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f07140b2000 tx=0x7f071401d8f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.222+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f07240c36f0 con 0x7f07241ebd60 2024-09-17T06:05:11.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.238+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0724159380 con 0x7f07241ebd60 2024-09-17T06:05:11.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.238+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0724159380 con 0x7f07241ebd60 2024-09-17T06:05:11.242 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:11.242 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:11.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.238+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f07241f5140 0x7f07241f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.238+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f07240c60d0 con 0x7f07241f5140 2024-09-17T06:05:11.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.238+0000 7f072a33d640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f07241f5140 0x7f07241f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.238+0000 7f072a33d640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f07241f5140 0x7f07241f5550 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.238+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f07240c60d0 con 0x7f07241f5140 2024-09-17T06:05:11.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.254+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0724154cc0 con 0x7f07241f5140 2024-09-17T06:05:11.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.258+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0724154cc0 con 0x7f07241f5140 2024-09-17T06:05:11.260 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:11.261 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:11.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.258+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f07240638b0 0x7f0724063cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.258+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f07241f5fa0 con 0x7f07240638b0 2024-09-17T06:05:11.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.258+0000 7f0729b3c640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f07240638b0 0x7f0724063cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.258+0000 7f0729b3c640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f07240638b0 0x7f0724063cc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.258+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f07241f5fa0 con 0x7f07240638b0 2024-09-17T06:05:11.269 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:11.262+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:11.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.270+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0724064200 con 0x7f07240638b0 2024-09-17T06:05:11.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.274+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0724064200 con 0x7f07240638b0 2024-09-17T06:05:11.277 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:11.277 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:11.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.274+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f072402d9e0 0x7f072402ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.274+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f072415afb0 con 0x7f072402d9e0 2024-09-17T06:05:11.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.274+0000 7f072ab3e640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f072402d9e0 0x7f072402ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.274+0000 7f072ab3e640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f072402d9e0 0x7f072402ddf0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.278 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:11.278 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:11.279 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:11.279 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:11.279 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:11.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.274+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f072415afb0 con 0x7f072402d9e0 2024-09-17T06:05:11.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.286+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f072402e330 con 0x7f072402d9e0 2024-09-17T06:05:11.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.290+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f072402e330 con 0x7f072402d9e0 2024-09-17T06:05:11.293 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:11.294 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:11.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.290+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f0724159db0 0x7f072415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.290+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f072402e330 con 0x7f0724159db0 2024-09-17T06:05:11.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.290+0000 7f072a33d640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f0724159db0 0x7f072415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.290+0000 7f072a33d640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f0724159db0 0x7f072415a1c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.296 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:05:11.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.294+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f072402e330 con 0x7f0724159db0 2024-09-17T06:05:11.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.294+0000 7f3fd1beb640 1 -- 172.21.15.122:0/4107663648 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f3fcc156c60 con 0x7f3fcc06fc90 2024-09-17T06:05:11.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.298+0000 7f3fb3fff640 1 -- 172.21.15.122:0/4107663648 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v37) ==== 81+0+39255 (secure 0 0 0) 0x7f3fcc0700a0 con 0x7f3fcc06fc90 2024-09-17T06:05:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 37, 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "5aff0fc3-254a-48aa-be08-0081a34bd09c", 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "created": "2024-09-17T06:03:42.642598+0000", 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-09-17T06:05:09.885449+0000", 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "last_up_change": "2024-09-17T06:03:56.580331+0000", 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "last_in_change": "2024-09-17T06:03:46.879949+0000", 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_num": 5799936, 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_set": [ 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "pglog_hardlimit", 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "purged_snapdirs", 2024-09-17T06:05:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_deletes", 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "sortbitwise" 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_version": 6, 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_snapshot": "", 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_max": 4, 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "max_osd": 8, 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "require_min_compat_client": "luminous", 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "min_compat_client": "luminous", 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "require_osd_release": "squid", 2024-09-17T06:05:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "allow_crimson": false, 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "pools": [ 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 1, 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": ".mgr", 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:03:57.560955+0000", 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 1, 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 1, 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 1, 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 1, 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 1, 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "18", 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:05:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_max": 32, 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 1 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": {} 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 6.9000000953674316, 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 6.9000000953674316, 2024-09-17T06:05:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 0.28999999165534973, 2024-09-17T06:05:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 2, 2024-09-17T06:05:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 2, 2024-09-17T06:05:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 0.875, 2024-09-17T06:05:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:05:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-17T06:05:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 2, 2024-09-17T06:05:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_metadata", 2024-09-17T06:05:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:06.110710+0000", 2024-09-17T06:05:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 32, 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 32, 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 32, 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 32, 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 32, 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "21", 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:05:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_bias": 4, 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 16, 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_priority": 5 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "metadata": "cephfs" 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 1.5399999618530273, 2024-09-17T06:05:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 1.5399999618530273, 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 1.1399999856948853, 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 1.75, 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 1.75, 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 0.875, 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 3, 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_data", 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:07.186655+0000", 2024-09-17T06:05:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 64, 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 64, 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 64, 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 64, 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 64, 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "22", 2024-09-17T06:05:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:05:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:05:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 64, 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "target_size_ratio": 0.05000000074505806 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "data": "cephfs" 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:05:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 1.3200000524520874, 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 1.3200000524520874, 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 1.1399999856948853, 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 1.5, 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 1.5, 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 0.875, 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 4, 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_data_ec", 2024-09-17T06:05:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:10.901448+0000", 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 5, 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool,ec_overwrites", 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 3, 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 4, 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 3, 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 1, 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 32, 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 32, 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 32, 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 32, 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 32, 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "26", 2024-09-17T06:05:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "cephfs_data_ec", 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 8192, 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 64, 2024-09-17T06:05:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: "data": "cephfs" 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: "osds": [ 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 0, 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "b8a621d5-9187-4034-ac89-5adb5b22ca7a", 2024-09-17T06:05:11.330 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.331 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.332 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6824", 2024-09-17T06:05:11.332 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:11.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.332 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.332 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6825", 2024-09-17T06:05:11.332 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:11.332 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.332 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.332 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:11.332 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6826", 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6827", 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.333 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6830", 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6831", 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6828", 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6829", 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.335 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6825/776463314", 2024-09-17T06:05:11.336 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6827/776463314", 2024-09-17T06:05:11.336 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6831/776463314", 2024-09-17T06:05:11.336 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6829/776463314", 2024-09-17T06:05:11.336 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:11.336 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:11.336 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:11.336 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.336 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 1, 2024-09-17T06:05:11.336 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "992e1af1-06d0-4849-93bf-4be8fc437183", 2024-09-17T06:05:11.336 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:11.337 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:11.337 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:11.337 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:11.337 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:11.337 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:11.337 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:11.337 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:11.337 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:11.337 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:11.337 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:11.337 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6800", 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6801", 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:11.338 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6802", 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6803", 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.339 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:11.340 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.340 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.340 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6806", 2024-09-17T06:05:11.340 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:11.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.340 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.340 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6807", 2024-09-17T06:05:11.340 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:11.340 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.341 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.341 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:11.341 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.341 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.341 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6804", 2024-09-17T06:05:11.341 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:11.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.341 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.341 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6805", 2024-09-17T06:05:11.342 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:11.342 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.342 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.342 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6801/2272556556", 2024-09-17T06:05:11.342 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6803/2272556556", 2024-09-17T06:05:11.342 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6807/2272556556", 2024-09-17T06:05:11.342 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6805/2272556556", 2024-09-17T06:05:11.342 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:11.342 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:11.342 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:11.343 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.343 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 2, 2024-09-17T06:05:11.343 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "e3a31b77-d4db-4ee6-af7c-60af7df4bd69", 2024-09-17T06:05:11.343 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:11.343 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:11.343 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:11.343 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:11.343 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:11.343 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:11.344 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:11.344 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 27, 2024-09-17T06:05:11.344 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:11.344 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:11.344 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:11.344 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.344 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.344 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6816", 2024-09-17T06:05:11.344 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:11.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6817", 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6818", 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:11.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.346 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.346 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6819", 2024-09-17T06:05:11.346 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:11.346 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.346 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.346 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:11.346 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.346 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.346 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6822", 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6823", 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.347 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.348 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6820", 2024-09-17T06:05:11.348 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:11.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.348 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.348 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6821", 2024-09-17T06:05:11.348 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:11.348 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.348 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.348 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6817/1205784459", 2024-09-17T06:05:11.348 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6819/1205784459", 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6823/1205784459", 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6821/1205784459", 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 3, 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "9f473452-18cd-44a4-803a-e908e21ab405", 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:11.349 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 0, 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 27, 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6808", 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:11.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6809", 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6810", 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:11.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6811", 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6814", 2024-09-17T06:05:11.352 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6815", 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6812", 2024-09-17T06:05:11.353 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6813", 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6809/3198016774", 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6811/3198016774", 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6815/3198016774", 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6813/3198016774", 2024-09-17T06:05:11.354 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 4, 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "f11201b3-22f8-4b9e-873c-0ed12835e2d3", 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:11.355 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:11.356 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:11.356 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:11.356 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:11.356 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:11.356 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.356 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.356 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6810", 2024-09-17T06:05:11.356 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:11.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.356 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6811", 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6812", 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6813", 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6816", 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:11.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6817", 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6814", 2024-09-17T06:05:11.359 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6815", 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6811/920798795", 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6813/920798795", 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6817/920798795", 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6815/920798795", 2024-09-17T06:05:11.360 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 5, 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "3f853011-9aea-4f7c-bb97-2c74fba1e33e", 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:11.361 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 14, 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6802", 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.362 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6803", 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6804", 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.363 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6805", 2024-09-17T06:05:11.364 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:11.364 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.364 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.364 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:11.364 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.364 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.364 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6808", 2024-09-17T06:05:11.364 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:11.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6809", 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6806", 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6807", 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6803/2576144160", 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6805/2576144160", 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6809/2576144160", 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6807/2576144160", 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:11.366 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 6, 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "445606c9-7e18-44b2-997d-68d280a3a37c", 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:11.367 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6818", 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6819", 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:11.368 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6820", 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6821", 2024-09-17T06:05:11.369 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6824", 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.370 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6825", 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6822", 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.371 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6823", 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6819/1877869793", 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6821/1877869793", 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6825/1877869793", 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6823/1877869793", 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 7, 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "ce0b67c6-0618-41b7-87e3-bf2d4c708907", 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:11.373 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6826", 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6827", 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.374 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6828", 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6829", 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:11.375 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6832", 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6833", 2024-09-17T06:05:11.376 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6830", 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6831", 2024-09-17T06:05:11.377 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6827/1719466778", 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6829/1719466778", 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6833/1719466778", 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6831/1719466778", 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.378 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_xinfo": [ 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 0, 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.176942+0000", 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.379 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 1, 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.431303+0000", 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 2, 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:11.380 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.354201+0000", 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 3, 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.748604+0000", 2024-09-17T06:05:11.381 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 4, 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.473848+0000", 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.382 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 5, 2024-09-17T06:05:11.383 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:11.383 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:11.383 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:11.383 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:11.383 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:11.383 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.458683+0000", 2024-09-17T06:05:11.383 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:11.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.383 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 6, 2024-09-17T06:05:11.383 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.617928+0000", 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 7, 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:11.384 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.088763+0000", 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap": [ 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.19", 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: "osds": [ 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: 6, 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: 5, 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-09-17T06:05:11.385 INFO:teuthology.orchestra.run.smithi122.stdout: 4 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap_items": [ 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.2", 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 5, 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 1 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.d", 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 7, 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.1d", 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:11.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 5, 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.28", 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 5, 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.389 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 3, 2024-09-17T06:05:11.389 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 1 2024-09-17T06:05:11.389 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.389 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.389 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.c", 2024-09-17T06:05:11.389 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:11.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.389 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:05:11.389 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:05:11.389 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.d", 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 5 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.390 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.1d", 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 5 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap_primaries": [], 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_temp": [], 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_temp": [], 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: "blocklist": {}, 2024-09-17T06:05:11.391 INFO:teuthology.orchestra.run.smithi122.stdout: "range_blocklist": {}, 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profiles": { 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_data_ec": { 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-device-class": "", 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-failure-domain": "osd", 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-num-failure-domains": "0", 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-osds-per-failure-domain": "0", 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-root": "default", 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "jerasure-per-chunk-alignment": "false", 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "k": "2", 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "m": "2", 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "plugin": "jerasure", 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "technique": "reed_sol_van", 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: "w": "8" 2024-09-17T06:05:11.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: "default": { 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-failure-domain": "osd", 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: "k": "2", 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: "m": "1", 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: "plugin": "jerasure", 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: "technique": "reed_sol_van" 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps_queue": [], 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: "new_removed_snaps": [], 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: "new_purged_snaps": [], 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_node_flags": {}, 2024-09-17T06:05:11.393 INFO:teuthology.orchestra.run.smithi122.stdout: "device_class_flags": {}, 2024-09-17T06:05:11.394 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode": { 2024-09-17T06:05:11.394 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode_enabled": false, 2024-09-17T06:05:11.394 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_bucket_count": 0, 2024-09-17T06:05:11.394 INFO:teuthology.orchestra.run.smithi122.stdout: "degraded_stretch_mode": 0, 2024-09-17T06:05:11.394 INFO:teuthology.orchestra.run.smithi122.stdout: "recovering_stretch_mode": 0, 2024-09-17T06:05:11.394 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode_bucket": 0 2024-09-17T06:05:11.394 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:11.394 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:11.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.302+0000 7f3fd1beb640 1 -- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3fb8073200 msgr2=0x7f3fb8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.302+0000 7f3fd1beb640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3fb8073200 0x7f3fb8075710 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc1e9e80 tx=0x7f3fbc00b2e0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.302+0000 7f3fd1beb640 1 -- 172.21.15.122:0/4107663648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fcc06fc90 msgr2=0x7f3fcc13d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.302+0000 7f3fd1beb640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fcc06fc90 0x7f3fcc13d3d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000c3f0 tx=0x7f3fc000c8b0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.302+0000 7f3fd1beb640 1 -- 172.21.15.122:0/4107663648 shutdown_connections 2024-09-17T06:05:11.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.302+0000 7f3fd1beb640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3fcc159240 0x7f3fcc0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.302+0000 7f3fd1beb640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3fb8073200 0x7f3fb8075710 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.302+0000 7f3fd1beb640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3fcc142640 0x7f3fcc0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.302+0000 7f3fd1beb640 1 --2- 172.21.15.122:0/4107663648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fcc06fc90 0x7f3fcc13d3d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.302+0000 7f3fd1beb640 1 -- 172.21.15.122:0/4107663648 >> 172.21.15.122:0/4107663648 conn(0x7f3fcc0ca380 msgr2=0x7f3fcc13f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:11.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.302+0000 7f3fd1beb640 1 -- 172.21.15.122:0/4107663648 shutdown_connections 2024-09-17T06:05:11.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.302+0000 7f3fd1beb640 1 -- 172.21.15.122:0/4107663648 wait complete. 2024-09-17T06:05:11.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.310+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f072402e330 con 0x7f0724159db0 2024-09-17T06:05:11.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.314+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f072402e330 con 0x7f0724159db0 2024-09-17T06:05:11.397 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:05:11.398 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:05:11.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.314+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f072402e330 0x7f0724208580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.314+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f072415ade0 con 0x7f072402e330 2024-09-17T06:05:11.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.314+0000 7f0729b3c640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f072402e330 0x7f0724208580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.314+0000 7f0729b3c640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f072402e330 0x7f0724208580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.318+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f072415ade0 con 0x7f072402e330 2024-09-17T06:05:11.400 INFO:tasks.thrashosds.thrasher:j is {'epoch': 37, 'fsid': '5aff0fc3-254a-48aa-be08-0081a34bd09c', 'created': '2024-09-17T06:03:42.642598+0000', 'modified': '2024-09-17T06:05:09.885449+0000', 'last_up_change': '2024-09-17T06:03:56.580331+0000', 'last_in_change': '2024-09-17T06:03:46.879949+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T06:03:57.560955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T06:04:06.110710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T06:04:07.186655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3200000524520874, 'score_stable': 1.3200000524520874, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-17T06:04:10.901448+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}], 'osds': [{'osd': 0, 'uuid': 'b8a621d5-9187-4034-ac89-5adb5b22ca7a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6824', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6825', 'nonce': 776463314}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6826', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6827', 'nonce': 776463314}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6830', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6831', 'nonce': 776463314}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6828', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6829', 'nonce': 776463314}]}, 'public_addr': '172.21.15.122:6825/776463314', 'cluster_addr': '172.21.15.122:6827/776463314', 'heartbeat_back_addr': '172.21.15.122:6831/776463314', 'heartbeat_front_addr': '172.21.15.122:6829/776463314', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '992e1af1-06d0-4849-93bf-4be8fc437183', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6800', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6801', 'nonce': 2272556556}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6802', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6803', 'nonce': 2272556556}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6806', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6807', 'nonce': 2272556556}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6804', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6805', 'nonce': 2272556556}]}, 'public_addr': '172.21.15.122:6801/2272556556', 'cluster_addr': '172.21.15.122:6803/2272556556', 'heartbeat_back_addr': '172.21.15.122:6807/2272556556', 'heartbeat_front_addr': '172.21.15.122:6805/2272556556', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'e3a31b77-d4db-4ee6-af7c-60af7df4bd69', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6816', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6817', 'nonce': 1205784459}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6818', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6819', 'nonce': 1205784459}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6822', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6823', 'nonce': 1205784459}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6820', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6821', 'nonce': 1205784459}]}, 'public_addr': '172.21.15.122:6817/1205784459', 'cluster_addr': '172.21.15.122:6819/1205784459', 'heartbeat_back_addr': '172.21.15.122:6823/1205784459', 'heartbeat_front_addr': '172.21.15.122:6821/1205784459', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '9f473452-18cd-44a4-803a-e908e21ab405', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6808', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6809', 'nonce': 3198016774}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6810', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6811', 'nonce': 3198016774}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6814', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6815', 'nonce': 3198016774}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6812', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6813', 'nonce': 3198016774}]}, 'public_addr': '172.21.15.122:6809/3198016774', 'cluster_addr': '172.21.15.122:6811/3198016774', 'heartbeat_back_addr': '172.21.15.122:6815/3198016774', 'heartbeat_front_addr': '172.21.15.122:6813/3198016774', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'f11201b3-22f8-4b9e-873c-0ed12835e2d3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6810', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6811', 'nonce': 920798795}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6812', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6813', 'nonce': 920798795}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6816', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6817', 'nonce': 920798795}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6814', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6815', 'nonce': 920798795}]}, 'public_addr': '172.21.15.173:6811/920798795', 'cluster_addr': '172.21.15.173:6813/920798795', 'heartbeat_back_addr': '172.21.15.173:6817/920798795', 'heartbeat_front_addr': '172.21.15.173:6815/920798795', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '3f853011-9aea-4f7c-bb97-2c74fba1e33e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6802', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6803', 'nonce': 2576144160}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6804', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6805', 'nonce': 2576144160}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6808', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6809', 'nonce': 2576144160}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6806', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6807', 'nonce': 2576144160}]}, 'public_addr': '172.21.15.173:6803/2576144160', 'cluster_addr': '172.21.15.173:6805/2576144160', 'heartbeat_back_addr': '172.21.15.173:6809/2576144160', 'heartbeat_front_addr': '172.21.15.173:6807/2576144160', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '445606c9-7e18-44b2-997d-68d280a3a37c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6818', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6819', 'nonce': 1877869793}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6820', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6821', 'nonce': 1877869793}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6824', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6825', 'nonce': 1877869793}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6822', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6823', 'nonce': 1877869793}]}, 'public_addr': '172.21.15.173:6819/1877869793', 'cluster_addr': '172.21.15.173:6821/1877869793', 'heartbeat_back_addr': '172.21.15.173:6825/1877869793', 'heartbeat_front_addr': '172.21.15.173:6823/1877869793', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'ce0b67c6-0618-41b7-87e3-bf2d4c708907', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6826', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6827', 'nonce': 1719466778}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6828', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6829', 'nonce': 1719466778}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 1719466778}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6830', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6831', 'nonce': 1719466778}]}, 'public_addr': '172.21.15.173:6827/1719466778', 'cluster_addr': '172.21.15.173:6829/1719466778', 'heartbeat_back_addr': '172.21.15.173:6833/1719466778', 'heartbeat_front_addr': '172.21.15.173:6831/1719466778', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.176942+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.431303+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.354201+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.748604+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.473848+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.458683+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.617928+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.088763+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.19', 'osds': [6, 5, 0, 4]}], 'pg_upmap_items': [{'pgid': '3.2', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '3.d', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '3.1d', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.28', 'mappings': [{'from': 5, 'to': 2}, {'from': 3, 'to': 1}]}, {'pgid': '4.c', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.d', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.1d', 'mappings': [{'from': 1, 'to': 5}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'cephfs_data_ec': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-num-failure-domains': '0', 'crush-osds-per-failure-domain': '0', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '2', 'plugin': 'jerasure', 'technique': 'reed_sol_van', 'w': '8'}, 'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T06:05:11.400 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.28 2024-09-17T06:05:11.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap-items 3.28 2024-09-17T06:05:11.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.330+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0724208ac0 con 0x7f072402e330 2024-09-17T06:05:11.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.338+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0724208ac0 con 0x7f072402e330 2024-09-17T06:05:11.402 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:11.403 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:11.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.338+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f07242091e0 0x7f07242095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.338+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f072420e5f0 con 0x7f07242091e0 2024-09-17T06:05:11.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.338+0000 7f072ab3e640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f07242091e0 0x7f07242095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.338+0000 7f072ab3e640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f07242091e0 0x7f07242095f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.338+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f072420e5f0 con 0x7f07242091e0 2024-09-17T06:05:11.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.354+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f072420d470 con 0x7f07242091e0 2024-09-17T06:05:11.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.354+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f072420d470 con 0x7f07242091e0 2024-09-17T06:05:11.404 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:11.405 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:11.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.354+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f072420daf0 0x7f072420df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.354+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f07242119b0 con 0x7f072420daf0 2024-09-17T06:05:11.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.354+0000 7f072a33d640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f072420daf0 0x7f072420df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.358+0000 7f072a33d640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f072420daf0 0x7f072420df20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.358+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f07242119b0 con 0x7f072420daf0 2024-09-17T06:05:11.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.370+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0724209b80 con 0x7f072420daf0 2024-09-17T06:05:11.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.374+0000 7f071affd640 1 -- 172.21.15.122:0/1051452096 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0724209b80 con 0x7f072420daf0 2024-09-17T06:05:11.406 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:11.407 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:11.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f07241ebd60 msgr2=0x7f07240c5680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.407 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f07241ebd60 0x7f07240c5680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f07241f5140 msgr2=0x7f07241f5550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f07241f5140 0x7f07241f5550 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f07240638b0 msgr2=0x7f0724063cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f07240638b0 0x7f0724063cc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f072402d9e0 msgr2=0x7f072402ddf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f072402d9e0 0x7f072402ddf0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f0724159db0 msgr2=0x7f072415a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f0724159db0 0x7f072415a1c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f072402e330 msgr2=0x7f0724208580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072ab3e640 1 -- 172.21.15.122:0/1051452096 reap_dead start 2024-09-17T06:05:11.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f072402e330 0x7f0724208580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072ab3e640 1 -- 172.21.15.122:0/1051452096 reap_dead start 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f07242091e0 msgr2=0x7f07242095f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f07242091e0 0x7f07242095f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072ab3e640 1 -- 172.21.15.122:0/1051452096 reap_dead start 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f072420daf0 msgr2=0x7f072420df20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f072420daf0 0x7f072420df20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0708073200 msgr2=0x7f0708075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0708073200 0x7f0708075710 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f07140b2000 tx=0x7f071401d8f0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07240c3910 msgr2=0x7f07241f2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07240c3910 0x7f07241f2620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f072000d950 tx=0x7f072000de10 comp rx=0 tx=0).stop 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 shutdown_connections 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0708073200 0x7f0708075710 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f072420daf0 0x7f072420df20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 --2- 172.21.15.122:0/1051452096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07240c3910 0x7f07241f2620 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 >> 172.21.15.122:0/1051452096 conn(0x7f0724073640 msgr2=0x7f07241510c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:11.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 shutdown_connections 2024-09-17T06:05:11.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.378+0000 7f072c5a1640 1 -- 172.21.15.122:0/1051452096 wait complete. 2024-09-17T06:05:11.412 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:11.390+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:11.497 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:11.490+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:11.549 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:11.549 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:11.566 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:05:11.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.586+0000 7fd5e7b7c640 1 -- 172.21.15.122:0/1982255175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5e014eb30 msgr2=0x7fd5e00c28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.586+0000 7fd5e7b7c640 1 --2- 172.21.15.122:0/1982255175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5e014eb30 0x7fd5e00c28a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00752f0 tx=0x7fd5d001f090 comp rx=0 tx=0).stop 2024-09-17T06:05:11.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.586+0000 7fd5e7b7c640 1 -- 172.21.15.122:0/1982255175 shutdown_connections 2024-09-17T06:05:11.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.586+0000 7fd5e7b7c640 1 --2- 172.21.15.122:0/1982255175 >> v2:172.21.15.173:3300/0 conn(0x7fd5e00c89d0 0x7fd5e00c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.586+0000 7fd5e7b7c640 1 --2- 172.21.15.122:0/1982255175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5e014eb30 0x7fd5e00c28a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.586+0000 7fd5e7b7c640 1 --2- 172.21.15.122:0/1982255175 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5e006fe00 0x7fd5e0158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.586+0000 7fd5e7b7c640 1 -- 172.21.15.122:0/1982255175 >> 172.21.15.122:0/1982255175 conn(0x7fd5e00ca380 msgr2=0x7fd5e00ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:11.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.586+0000 7fd5e7b7c640 1 -- 172.21.15.122:0/1982255175 shutdown_connections 2024-09-17T06:05:11.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.586+0000 7fd5e7b7c640 1 -- 172.21.15.122:0/1982255175 wait complete. 2024-09-17T06:05:11.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.586+0000 7fd5e7b7c640 1 Processor -- start 2024-09-17T06:05:11.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.586+0000 7fd5e7b7c640 1 -- start start 2024-09-17T06:05:11.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e7b7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5e006fe00 0x7fd5e014a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e7b7c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5e00c89d0 0x7fd5e01464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e7b7c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e014eb30 0x7fd5e00cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e7b7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e006f320 con 0x7fd5e006fe00 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e7b7c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e006f040 con 0x7fd5e014eb30 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e7b7c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e006f600 con 0x7fd5e00c89d0 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e5918640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5e006fe00 0x7fd5e014a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e5918640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5e006fe00 0x7fd5e014a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37176/0 (socket says 172.21.15.122:37176) 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e5918640 1 -- 172.21.15.122:0/3532642915 learned_addr learned my addr 172.21.15.122:0/3532642915 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e6119640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e014eb30 0x7fd5e00cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e5117640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5e00c89d0 0x7fd5e01464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e5918640 1 -- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5e00c89d0 msgr2=0x7fd5e01464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e5918640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5e00c89d0 0x7fd5e01464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e5918640 1 -- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e014eb30 msgr2=0x7fd5e00cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e5918640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e014eb30 0x7fd5e00cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e5918640 1 -- 172.21.15.122:0/3532642915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e014aa80 con 0x7fd5e006fe00 2024-09-17T06:05:11.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e6119640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e014eb30 0x7fd5e00cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:05:11.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e5918640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5e006fe00 0x7fd5e014a540 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00d690 tx=0x7fd5dc00db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5d67fc640 1 -- 172.21.15.122:0/3532642915 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc017070 con 0x7fd5e006fe00 2024-09-17T06:05:11.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e7b7c640 1 -- 172.21.15.122:0/3532642915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e00b3200 con 0x7fd5e006fe00 2024-09-17T06:05:11.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5e7b7c640 1 -- 172.21.15.122:0/3532642915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e0157af0 con 0x7fd5e006fe00 2024-09-17T06:05:11.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5d67fc640 1 -- 172.21.15.122:0/3532642915 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5dc005220 con 0x7fd5e006fe00 2024-09-17T06:05:11.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5d67fc640 1 -- 172.21.15.122:0/3532642915 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc020060 con 0x7fd5e006fe00 2024-09-17T06:05:11.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5c3fff640 1 -- 172.21.15.122:0/3532642915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5bc0052a0 con 0x7fd5e006fe00 2024-09-17T06:05:11.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.590+0000 7fd5d67fc640 1 -- 172.21.15.122:0/3532642915 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd5dc0097c0 con 0x7fd5e006fe00 2024-09-17T06:05:11.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.594+0000 7fd5d67fc640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd5c4073230 0x7fd5c4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:11.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.594+0000 7fd5d67fc640 1 -- 172.21.15.122:0/3532642915 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6812+0+0 (secure 0 0 0) 0x7fd5dc094690 con 0x7fd5e006fe00 2024-09-17T06:05:11.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.594+0000 7fd5e5117640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd5c4073230 0x7fd5c4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:11.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.594+0000 7fd5e5117640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd5c4073230 0x7fd5c4075740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00b2000 tx=0x7fd5d001d8d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:11.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.598+0000 7fd5d67fc640 1 -- 172.21.15.122:0/3532642915 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd5dc05ec20 con 0x7fd5e006fe00 2024-09-17T06:05:11.609 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:11.606+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:11.699 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:11.694+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:11.711 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:11.711 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:11.727 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:05:11.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.790+0000 7fd5c3fff640 1 -- 172.21.15.122:0/3532642915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd rm-pg-upmap-items", "pgid": "3.28"} v 0) -- 0x7fd5bc005860 con 0x7fd5e006fe00 2024-09-17T06:05:11.800 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:11.794+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:11.901 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:11.894+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:11.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.902+0000 7fd5d67fc640 1 -- 172.21.15.122:0/3532642915 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd rm-pg-upmap-items", "pgid": "3.28"}]=0 clear 3.28 pg_upmap_items mapping v38) ==== 118+0+0 (secure 0 0 0) 0x7fd5dc063650 con 0x7fd5e006fe00 2024-09-17T06:05:11.904 INFO:teuthology.orchestra.run.smithi122.stderr:clear 3.28 pg_upmap_items mapping 2024-09-17T06:05:11.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.906+0000 7fd5c3fff640 1 -- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd5c4073230 msgr2=0x7fd5c4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.906+0000 7fd5c3fff640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd5c4073230 0x7fd5c4075740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00b2000 tx=0x7fd5d001d8d0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.906+0000 7fd5c3fff640 1 -- 172.21.15.122:0/3532642915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5e006fe00 msgr2=0x7fd5e014a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:11.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.906+0000 7fd5c3fff640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5e006fe00 0x7fd5e014a540 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00d690 tx=0x7fd5dc00db50 comp rx=0 tx=0).stop 2024-09-17T06:05:11.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.906+0000 7fd5c3fff640 1 -- 172.21.15.122:0/3532642915 shutdown_connections 2024-09-17T06:05:11.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.906+0000 7fd5c3fff640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd5c4073230 0x7fd5c4075740 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.906+0000 7fd5c3fff640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5e014eb30 0x7fd5e00cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.906+0000 7fd5c3fff640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5e00c89d0 0x7fd5e01464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.906+0000 7fd5c3fff640 1 --2- 172.21.15.122:0/3532642915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5e006fe00 0x7fd5e014a540 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:11.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.906+0000 7fd5c3fff640 1 -- 172.21.15.122:0/3532642915 >> 172.21.15.122:0/3532642915 conn(0x7fd5e00ca380 msgr2=0x7fd5e0069500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:11.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.906+0000 7fd5c3fff640 1 -- 172.21.15.122:0/3532642915 shutdown_connections 2024-09-17T06:05:11.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:11.906+0000 7fd5c3fff640 1 -- 172.21.15.122:0/3532642915 wait complete. 2024-09-17T06:05:11.913 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:11.914 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:11.919 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T06:05:11.940 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:05:12.028 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:12.026+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:12.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.058+0000 7effbe3b3640 1 -- 172.21.15.122:0/1242731108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb80c38c0 msgr2=0x7effb81534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:12.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.058+0000 7effbe3b3640 1 --2- 172.21.15.122:0/1242731108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb80c38c0 0x7effb81534d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7effb80c4830 tx=0x7effa801c8c0 comp rx=0 tx=0).stop 2024-09-17T06:05:12.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.058+0000 7effbe3b3640 1 -- 172.21.15.122:0/1242731108 shutdown_connections 2024-09-17T06:05:12.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.058+0000 7effbe3b3640 1 --2- 172.21.15.122:0/1242731108 >> v2:172.21.15.173:3300/0 conn(0x7effb80c4330 0x7effb80cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:12.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.058+0000 7effbe3b3640 1 --2- 172.21.15.122:0/1242731108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb80c38c0 0x7effb81534d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:12.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.058+0000 7effbe3b3640 1 -- 172.21.15.122:0/1242731108 >> 172.21.15.122:0/1242731108 conn(0x7effb8070e40 msgr2=0x7effb8071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:12.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.058+0000 7effbe3b3640 1 -- 172.21.15.122:0/1242731108 shutdown_connections 2024-09-17T06:05:12.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.058+0000 7effbe3b3640 1 -- 172.21.15.122:0/1242731108 wait complete. 2024-09-17T06:05:12.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.058+0000 7effbe3b3640 1 Processor -- start 2024-09-17T06:05:12.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.058+0000 7effbe3b3640 1 -- start start 2024-09-17T06:05:12.064 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effbe3b3640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7effb80c38c0 0x7effb81f7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:12.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effbe3b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb80c4330 0x7effb8148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:12.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effbe3b3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effb80cb690 0x7effb81421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:12.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effbe3b3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7effb80cf500 con 0x7effb80c4330 2024-09-17T06:05:12.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effbe3b3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7effb80ca2a0 con 0x7effb80cb690 2024-09-17T06:05:12.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effbe3b3640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7effb80cf680 con 0x7effb80c38c0 2024-09-17T06:05:12.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb80c4330 0x7effb8148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:12.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb80c4330 0x7effb8148df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37198/0 (socket says 172.21.15.122:37198) 2024-09-17T06:05:12.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb77fe640 1 -- 172.21.15.122:0/2555053787 learned_addr learned my addr 172.21.15.122:0/2555053787 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:12.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effbc950640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effb80cb690 0x7effb81421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:12.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb7fff640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7effb80c38c0 0x7effb81f7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:12.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb77fe640 1 -- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7effb80c38c0 msgr2=0x7effb81f7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:12.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb77fe640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7effb80c38c0 0x7effb81f7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:12.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb77fe640 1 -- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effb80cb690 msgr2=0x7effb81421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:12.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb77fe640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effb80cb690 0x7effb81421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:12.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb77fe640 1 -- 172.21.15.122:0/2555053787 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb81f8500 con 0x7effb80c4330 2024-09-17T06:05:12.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb77fe640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb80c4330 0x7effb8148df0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7effac00c940 tx=0x7effac00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:12.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb4ff9640 1 -- 172.21.15.122:0/2555053787 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac004220 con 0x7effb80c4330 2024-09-17T06:05:12.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb4ff9640 1 -- 172.21.15.122:0/2555053787 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effac0079b0 con 0x7effb80c4330 2024-09-17T06:05:12.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effbe3b3640 1 -- 172.21.15.122:0/2555053787 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb80c84e0 con 0x7effb80c4330 2024-09-17T06:05:12.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effb4ff9640 1 -- 172.21.15.122:0/2555053787 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac0044b0 con 0x7effb80c4330 2024-09-17T06:05:12.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effbe3b3640 1 -- 172.21.15.122:0/2555053787 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb806eea0 con 0x7effb80c4330 2024-09-17T06:05:12.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.062+0000 7effbe3b3640 1 -- 172.21.15.122:0/2555053787 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb80c9df0 con 0x7effb80c4330 2024-09-17T06:05:12.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.066+0000 7effb4ff9640 1 -- 172.21.15.122:0/2555053787 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7effac005020 con 0x7effb80c4330 2024-09-17T06:05:12.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.066+0000 7effb4ff9640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7effa4073230 0x7effa4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:12.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.066+0000 7effb4ff9640 1 -- 172.21.15.122:0/2555053787 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6775+0+0 (secure 0 0 0) 0x7effac094a90 con 0x7effb80c4330 2024-09-17T06:05:12.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.066+0000 7effb7fff640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7effa4073230 0x7effa4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:12.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.066+0000 7effb7fff640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7effa4073230 0x7effa4075740 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7effa80af000 tx=0x7effa801b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:12.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.070+0000 7effb4ff9640 1 -- 172.21.15.122:0/2555053787 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7effac014030 con 0x7effb80c4330 2024-09-17T06:05:12.102 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:12.098+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:12.125 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:12.126 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:12.141 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:05:12.229 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:12.226+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:12.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.262+0000 7effbe3b3640 1 -- 172.21.15.122:0/2555053787 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) -- 0x7effb8158f30 con 0x7effb80c4330 2024-09-17T06:05:12.303 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:12.298+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:12.344 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:12.344 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:12.361 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:05:12.404 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:12.402+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:12.505 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:12.502+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:12.547 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:12.548 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:12.564 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:05:12.608 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:12.606+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:12.707 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:12.702+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:12.759 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:12.759 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:12.774 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:05:12.808 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:12.802+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:12.909 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:12.906+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:12.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.910+0000 7effb4ff9640 1 -- 172.21.15.122:0/2555053787 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v39) ==== 87+0+0 (secure 0 0 0) 0x7effac05f760 con 0x7effb80c4330 2024-09-17T06:05:12.915 INFO:teuthology.orchestra.run.smithi122.stderr:noscrub is set 2024-09-17T06:05:12.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.914+0000 7effbe3b3640 1 -- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7effa4073230 msgr2=0x7effa4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:12.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.914+0000 7effbe3b3640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7effa4073230 0x7effa4075740 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7effa80af000 tx=0x7effa801b100 comp rx=0 tx=0).stop 2024-09-17T06:05:12.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.914+0000 7effbe3b3640 1 -- 172.21.15.122:0/2555053787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb80c4330 msgr2=0x7effb8148df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:12.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.914+0000 7effbe3b3640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb80c4330 0x7effb8148df0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7effac00c940 tx=0x7effac00ce00 comp rx=0 tx=0).stop 2024-09-17T06:05:12.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.914+0000 7effbe3b3640 1 -- 172.21.15.122:0/2555053787 shutdown_connections 2024-09-17T06:05:12.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.914+0000 7effbe3b3640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7effa4073230 0x7effa4075740 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:12.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.914+0000 7effbe3b3640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effb80cb690 0x7effb81421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:12.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.914+0000 7effbe3b3640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb80c4330 0x7effb8148df0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:12.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.914+0000 7effbe3b3640 1 --2- 172.21.15.122:0/2555053787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7effb80c38c0 0x7effb81f7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:12.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.914+0000 7effbe3b3640 1 -- 172.21.15.122:0/2555053787 >> 172.21.15.122:0/2555053787 conn(0x7effb8070e40 msgr2=0x7effb8157080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:12.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.914+0000 7effbe3b3640 1 -- 172.21.15.122:0/2555053787 shutdown_connections 2024-09-17T06:05:12.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:12.914+0000 7effbe3b3640 1 -- 172.21.15.122:0/2555053787 wait complete. 2024-09-17T06:05:12.966 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:12.966 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:12.981 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:05:13.024 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:13.022+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:13.110 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:13.106+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:13.159 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:13.159 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:13.175 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:05:13.211 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:13.210+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:13.312 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:13.310+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:13.378 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:13.378 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:13.396 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:05:13.414 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:05:13.440 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:13.438+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:13.514 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:13.510+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:13.539 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:13.539 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:13.557 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:05:13.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 -- 172.21.15.122:0/4211757711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9000c9b10 msgr2=0x7fe900153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 --2- 172.21.15.122:0/4211757711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9000c9b10 0x7fe900153410 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe9000c4b10 tx=0x7fe8f801f580 comp rx=0 tx=0).stop 2024-09-17T06:05:13.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 -- 172.21.15.122:0/4211757711 shutdown_connections 2024-09-17T06:05:13.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 --2- 172.21.15.122:0/4211757711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9000c9b10 0x7fe900153410 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 --2- 172.21.15.122:0/4211757711 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9000c9700 0x7fe900152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 --2- 172.21.15.122:0/4211757711 >> v2:172.21.15.173:3300/0 conn(0x7fe900159b50 0x7fe900071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 -- 172.21.15.122:0/4211757711 >> 172.21.15.122:0/4211757711 conn(0x7fe9000cdbf0 msgr2=0x7fe9000ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:13.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 -- 172.21.15.122:0/4211757711 shutdown_connections 2024-09-17T06:05:13.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 -- 172.21.15.122:0/4211757711 wait complete. 2024-09-17T06:05:13.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 Processor -- start 2024-09-17T06:05:13.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 -- start start 2024-09-17T06:05:13.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9000c9700 0x7fe9001547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:13.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9000c9b10 0x7fe90014c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:13.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe900159b50 0x7fe900148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:13.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe900071c90 con 0x7fe9000c9700 2024-09-17T06:05:13.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe9000ca070 con 0x7fe900159b50 2024-09-17T06:05:13.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe906d85640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe900159f60 con 0x7fe9000c9b10 2024-09-17T06:05:13.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.582+0000 7fe904b21640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9000c9700 0x7fe9001547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:13.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe904b21640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9000c9700 0x7fe9001547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37220/0 (socket says 172.21.15.122:37220) 2024-09-17T06:05:13.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe904b21640 1 -- 172.21.15.122:0/1918756904 learned_addr learned my addr 172.21.15.122:0/1918756904 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:13.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe905322640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe900159b50 0x7fe900148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe904b21640 1 -- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9000c9b10 msgr2=0x7fe90014c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe8fffff640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9000c9b10 0x7fe90014c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe904b21640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9000c9b10 0x7fe90014c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe904b21640 1 -- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe900159b50 msgr2=0x7fe900148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe904b21640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe900159b50 0x7fe900148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe904b21640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe900158160 con 0x7fe9000c9700 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe905322640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe900159b50 0x7fe900148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe904b21640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9000c9700 0x7fe9001547c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400d950 tx=0x7fe8f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4017070 con 0x7fe9000c9700 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8f4009d20 con 0x7fe9000c9700 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f40106c0 con 0x7fe9000c9700 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90014b970 con 0x7fe9000c9700 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9001583d0 con 0x7fe9000c9700 2024-09-17T06:05:13.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fe900071750 con 0x7fe9000c9700 2024-09-17T06:05:13.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe8f401a070 con 0x7fe9000c9700 2024-09-17T06:05:13.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe8fd7fa640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe8e4073200 0x7fe8e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:13.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7fe8f40947f0 con 0x7fe9000c9700 2024-09-17T06:05:13.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v39) ==== 54+0+16 (secure 0 0 0) 0x7fe8f4094bd0 con 0x7fe9000c9700 2024-09-17T06:05:13.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe8fffff640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe8e4073200 0x7fe8e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:13.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fe9001588f0 0x7fe9000ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:13.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe900148cc0 con 0x7fe9001588f0 2024-09-17T06:05:13.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.586+0000 7fe905322640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fe9001588f0 0x7fe9000ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:13.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.590+0000 7fe905322640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fe9001588f0 0x7fe9000ca280 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:13.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.590+0000 7fe8fffff640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe8e4073200 0x7fe8e4075710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe90014e4f0 tx=0x7fe8ec005c50 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:13.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.590+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe900148cc0 con 0x7fe9001588f0 2024-09-17T06:05:13.607 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.602+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe9000c78e0 con 0x7fe9001588f0 2024-09-17T06:05:13.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.606+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe9000c78e0 con 0x7fe9001588f0 2024-09-17T06:05:13.609 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:13.610 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:13.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.606+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fe90006ed20 0x7fe90006f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:13.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.606+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fe90006f670 con 0x7fe90006ed20 2024-09-17T06:05:13.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.606+0000 7fe904b21640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fe90006ed20 0x7fe90006f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:13.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.606+0000 7fe904b21640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fe90006ed20 0x7fe90006f130 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:13.610 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.606+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe90006f670 con 0x7fe90006ed20 2024-09-17T06:05:13.615 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:13.610+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:13.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.622+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe9001f2b50 con 0x7fe90006ed20 2024-09-17T06:05:13.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.626+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe9001f2b50 con 0x7fe90006ed20 2024-09-17T06:05:13.628 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:13.628 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:13.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.626+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fe900063dc0 0x7fe9000641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:13.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.626+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fe90014b4d0 con 0x7fe900063dc0 2024-09-17T06:05:13.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.626+0000 7fe8fffff640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fe900063dc0 0x7fe9000641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:13.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.626+0000 7fe8fffff640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fe900063dc0 0x7fe9000641d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:13.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.626+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe90014b4d0 con 0x7fe900063dc0 2024-09-17T06:05:13.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.642+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe90014dd80 con 0x7fe900063dc0 2024-09-17T06:05:13.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.642+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe90014dd80 con 0x7fe900063dc0 2024-09-17T06:05:13.646 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:13.646 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:13.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.642+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fe900157450 0x7fe900157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:13.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.642+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fe90014dd80 con 0x7fe900157450 2024-09-17T06:05:13.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.642+0000 7fe905322640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fe900157450 0x7fe900157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:13.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.642+0000 7fe905322640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fe900157450 0x7fe900157860 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:13.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.642+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe90014dd80 con 0x7fe900157450 2024-09-17T06:05:13.660 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.658+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe90014dd80 con 0x7fe900157450 2024-09-17T06:05:13.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.658+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe90014dd80 con 0x7fe900157450 2024-09-17T06:05:13.662 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:13.663 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:13.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.658+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fe90002d9e0 0x7fe90002ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:13.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.658+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fe90006d520 con 0x7fe90002d9e0 2024-09-17T06:05:13.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.658+0000 7fe904b21640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fe90002d9e0 0x7fe90002ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:13.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.662+0000 7fe904b21640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fe90002d9e0 0x7fe90002ddf0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:13.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.662+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe90006d520 con 0x7fe90002d9e0 2024-09-17T06:05:13.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.674+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe90006d4a0 con 0x7fe90002d9e0 2024-09-17T06:05:13.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.682+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe90006d4a0 con 0x7fe90002d9e0 2024-09-17T06:05:13.684 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:05:13.685 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:05:13.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.682+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fe900203c10 0x7fe900206030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:13.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.682+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fe90002ea20 con 0x7fe900203c10 2024-09-17T06:05:13.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.682+0000 7fe8fffff640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fe900203c10 0x7fe900206030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:13.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.682+0000 7fe8fffff640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fe900203c10 0x7fe900206030 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:13.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.682+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8ec00f420 con 0x7fe900203c10 2024-09-17T06:05:13.701 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:13.701 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:13.701 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 180, 2024-09-17T06:05:13.701 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-09-17T06:05:13.701 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:13.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.698+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe900153ad0 con 0x7fe900203c10 2024-09-17T06:05:13.707 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.702+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe900153ad0 con 0x7fe900203c10 2024-09-17T06:05:13.707 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:13.708 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:13.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.702+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fe900206a80 0x7fe900208ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:13.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.702+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fe90020bd70 con 0x7fe900206a80 2024-09-17T06:05:13.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.706+0000 7fe905322640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fe900206a80 0x7fe900208ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:13.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.706+0000 7fe905322640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fe900206a80 0x7fe900208ea0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:13.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.706+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe90020bd70 con 0x7fe900206a80 2024-09-17T06:05:13.715 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:13.710+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:13.717 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:05:13.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.722+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe9002093e0 con 0x7fe900206a80 2024-09-17T06:05:13.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.726+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe9002093e0 con 0x7fe900206a80 2024-09-17T06:05:13.729 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:13.729 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:13.729 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.726+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fe900209b00 0x7fe900209f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:13.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.726+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fe90020f140 con 0x7fe900209b00 2024-09-17T06:05:13.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.726+0000 7fe904b21640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fe900209b00 0x7fe900209f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:13.730 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.726+0000 7fe904b21640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fe900209b00 0x7fe900209f10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:13.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.730+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe90020f140 con 0x7fe900209b00 2024-09-17T06:05:13.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.742+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe90020dfc0 con 0x7fe900209b00 2024-09-17T06:05:13.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe8fd7fa640 1 -- 172.21.15.122:0/1918756904 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe90020dfc0 con 0x7fe900209b00 2024-09-17T06:05:13.751 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:13.752 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:13.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fe9001588f0 msgr2=0x7fe9000ca280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fe9001588f0 0x7fe9000ca280 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fe90006ed20 msgr2=0x7fe90006f130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fe90006ed20 0x7fe90006f130 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fe900063dc0 msgr2=0x7fe9000641d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fe900063dc0 0x7fe9000641d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fe900157450 msgr2=0x7fe900157860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fe900157450 0x7fe900157860 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.753 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fe90002d9e0 msgr2=0x7fe90002ddf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fe90002d9e0 0x7fe90002ddf0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fe900203c10 msgr2=0x7fe900206030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fe900203c10 0x7fe900206030 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe905322640 1 -- 172.21.15.122:0/1918756904 reap_dead start 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe905322640 1 -- 172.21.15.122:0/1918756904 reap_dead start 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fe900206a80 msgr2=0x7fe900208ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fe900206a80 0x7fe900208ea0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fe900209b00 msgr2=0x7fe900209f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe905322640 1 -- 172.21.15.122:0/1918756904 reap_dead start 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fe900209b00 0x7fe900209f10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe8e4073200 msgr2=0x7fe8e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe8e4073200 0x7fe8e4075710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe90014e4f0 tx=0x7fe8ec005c50 comp rx=0 tx=0).stop 2024-09-17T06:05:13.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9000c9700 msgr2=0x7fe9001547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:13.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9000c9700 0x7fe9001547c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400d950 tx=0x7fe8f400de10 comp rx=0 tx=0).stop 2024-09-17T06:05:13.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 shutdown_connections 2024-09-17T06:05:13.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe8e4073200 0x7fe8e4075710 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fe900209b00 0x7fe900209f10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.746+0000 7fe906d85640 1 --2- 172.21.15.122:0/1918756904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9000c9700 0x7fe9001547c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:13.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.750+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 >> 172.21.15.122:0/1918756904 conn(0x7fe9000cdbf0 msgr2=0x7fe900069500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:13.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.750+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 shutdown_connections 2024-09-17T06:05:13.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:13.750+0000 7fe906d85640 1 -- 172.21.15.122:0/1918756904 wait complete. 2024-09-17T06:05:13.817 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:13.814+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:13.867 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:13.867 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:13.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.041356463, 2024-09-17T06:05:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044462499999999997, 2024-09-17T06:05:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823264+0000", 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3300000000000001e-06 2024-09-17T06:05:13.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823284+0000", 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0132e-05 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823364+0000", 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9583e-05 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823395+0000", 2024-09-17T06:05:13.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1171999999999999e-05 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823538+0000", 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014286600000000001 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823594+0000", 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890999999999997e-05 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827597+0000", 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004003665 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827708+0000", 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110611 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.872 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.041164012000003, 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043686330000000002, 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823455+0000", 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2160000000000001e-06 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823471+0000", 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5702999999999999e-05 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823492+0000", 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1039e-05 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823512+0000", 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0364999999999999e-05 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824294+0000", 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00078187600000000003 2024-09-17T06:05:13.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824350+0000", 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5367e-05 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827719+0000", 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003368916 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827823+0000", 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104151 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.040603232999999, 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0094234149999999992, 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.877 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824018+0000", 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3629999999999998e-06 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824036+0000", 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7606000000000001e-05 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824065+0000", 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9005000000000001e-05 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824092+0000", 2024-09-17T06:05:13.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7396e-05 2024-09-17T06:05:13.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826491+0000", 2024-09-17T06:05:13.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002398776 2024-09-17T06:05:13.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826804+0000", 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000312782 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833438+0000", 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066344869999999997 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:13.881 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.040533250000003, 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048433540000000002, 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824087+0000", 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1830000000000001e-06 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824106+0000", 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8595999999999999e-05 2024-09-17T06:05:13.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824137+0000", 2024-09-17T06:05:13.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1322000000000003e-05 2024-09-17T06:05:13.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824164+0000", 2024-09-17T06:05:13.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6605e-05 2024-09-17T06:05:13.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824807+0000", 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064339900000000001 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824861+0000", 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3687000000000003e-05 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828809+0000", 2024-09-17T06:05:13.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039483909999999999 2024-09-17T06:05:13.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828928+0000", 2024-09-17T06:05:13.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119171 2024-09-17T06:05:13.886 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.886 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.886 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.886 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:13.886 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.040452580999997, 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092145760000000004, 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:13.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824167+0000", 2024-09-17T06:05:13.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7540000000000001e-06 2024-09-17T06:05:13.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824178+0000", 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0276e-05 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824202+0000", 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4685000000000002e-05 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824223+0000", 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1036e-05 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825070+0000", 2024-09-17T06:05:13.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084684500000000004 2024-09-17T06:05:13.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825392+0000", 2024-09-17T06:05:13.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032213499999999998 2024-09-17T06:05:13.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833380+0000", 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079878450000000004 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.03944765, 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038480469999999998, 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.891 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.892 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:13.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:13.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825172+0000", 2024-09-17T06:05:13.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.967e-06 2024-09-17T06:05:13.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825190+0000", 2024-09-17T06:05:13.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7866000000000001e-05 2024-09-17T06:05:13.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825217+0000", 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6682e-05 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825239+0000", 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1968999999999999e-05 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825632+0000", 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00039355100000000001 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825690+0000", 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7797000000000002e-05 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828935+0000", 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032449449999999999 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829018+0000", 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3269999999999994e-05 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.895 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.038393147000001, 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002834755, 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826227+0000", 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.906e-06 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826256+0000", 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8872000000000001e-05 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826399+0000", 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143156 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826453+0000", 2024-09-17T06:05:13.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4465000000000001e-05 2024-09-17T06:05:13.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826628+0000", 2024-09-17T06:05:13.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017420700000000001 2024-09-17T06:05:13.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829060+0000", 2024-09-17T06:05:13.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024321490000000002 2024-09-17T06:05:13.899 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.899 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.036642516000001, 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055191049999999998, 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827978+0000", 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0200000000000001e-06 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827997+0000", 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9836000000000001e-05 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828029+0000", 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1720999999999997e-05 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828055+0000", 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5519000000000001e-05 2024-09-17T06:05:13.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828193+0000", 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013821699999999999 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828232+0000", 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9351000000000003e-05 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833396+0000", 2024-09-17T06:05:13.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051640119999999999 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833495+0000", 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8429000000000002e-05 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.036516974999998, 2024-09-17T06:05:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054928850000000003, 2024-09-17T06:05:13.905 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.905 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.905 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.905 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:13.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828102+0000", 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-06 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828116+0000", 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3716e-05 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828139+0000", 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3028999999999999e-05 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828156+0000", 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869000000000001e-05 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829124+0000", 2024-09-17T06:05:13.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096778700000000001 2024-09-17T06:05:13.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829158+0000", 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4671000000000001e-05 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833509+0000", 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004350802 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833594+0000", 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4814999999999993e-05 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.031765749999998, 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064859200000000003, 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:13.910 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832854+0000", 2024-09-17T06:05:13.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8330000000000001e-06 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832867+0000", 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.332e-05 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832906+0000", 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8800999999999997e-05 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6468000000000003e-05 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833094+0000", 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014082600000000001 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833501+0000", 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040734400000000002 2024-09-17T06:05:13.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.031668945, 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00050376900000000005, 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832952+0000", 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4269999999999998e-06 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832965+0000", 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3736e-05 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832998+0000", 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2264999999999997e-05 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833027+0000", 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9658999999999998e-05 2024-09-17T06:05:13.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833172+0000", 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014431900000000001 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833453+0000", 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028136300000000002 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.029672009000002, 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00294042, 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:13.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834948+0000", 2024-09-17T06:05:13.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.21e-06 2024-09-17T06:05:13.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834968+0000", 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9443e-05 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835013+0000", 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5324000000000002e-05 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835038+0000", 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5358999999999999e-05 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835255+0000", 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021677600000000001 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835304+0000", 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9261000000000002e-05 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837761+0000", 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024567230000000001 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837886+0000", 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012532400000000001 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.265760653000001, 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001082132, 2024-09-17T06:05:13.922 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598860+0000", 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4569999999999999e-06 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598901+0000", 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1400999999999999e-05 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598934+0000", 2024-09-17T06:05:13.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3012000000000002e-05 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598959+0000", 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4839000000000001e-05 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599073+0000", 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113763 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599099+0000", 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6120999999999999e-05 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599900+0000", 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00080140099999999998 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599940+0000", 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9137999999999997e-05 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.926 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.545112742000001, 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00153148, 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319508+0000", 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5399999999999998e-06 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319533+0000", 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4759000000000001e-05 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319568+0000", 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5305000000000002e-05 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319602+0000", 2024-09-17T06:05:13.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3992999999999998e-05 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319715+0000", 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113112 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319745+0000", 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9580000000000001e-05 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.320978+0000", 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233165 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.321037+0000", 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9026e-05 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:13.931 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.672941631999997, 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00083231099999999997, 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191678+0000", 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869999999999999e-06 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191693+0000", 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4409e-05 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191713+0000", 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0523e-05 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191726+0000", 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3386e-05 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191806+0000", 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9287000000000002e-05 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191834+0000", 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8323e-05 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192473+0000", 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063865000000000005 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192509+0000", 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6046e-05 2024-09-17T06:05:13.935 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.146833355999998, 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096842599999999999, 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717787+0000", 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.951e-06 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717801+0000", 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3973e-05 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717822+0000", 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1328e-05 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717836+0000", 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3944000000000001e-05 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717908+0000", 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1674999999999994e-05 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717940+0000", 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2728999999999998e-05 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718710+0000", 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076948100000000003 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718753+0000", 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3344999999999999e-05 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.145752545000001, 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065812800000000001, 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.940 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5000000000000001e-07 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718872+0000", 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5130000000000004e-06 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718883+0000", 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1195e-05 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718892+0000", 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5669999999999995e-06 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718931+0000", 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8850000000000002e-05 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718948+0000", 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7425999999999999e-05 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719496+0000", 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00054753699999999996 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719524+0000", 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.809e-05 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.944 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:45 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'12, mlcod=26'10)", 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.211386564000001, 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013449270000000001, 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653233+0000", 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.796e-06 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653250+0000", 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7025999999999999e-05 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653272+0000", 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1338000000000001e-05 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653287+0000", 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5509999999999999e-05 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653383+0000", 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5904999999999997e-05 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653417+0000", 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3923e-05 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654510+0000", 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001092602 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654576+0000", 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6827000000000002e-05 2024-09-17T06:05:13.948 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.949 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.949 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.949 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:13.949 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:13.949 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:13.950 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T06:05:13.951 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:13.946+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:14.051 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:14.046+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:14.109 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:14.109 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:14.109 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:14.109 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:14.126 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T06:05:14.173 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:14.170+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:14.253 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:14.250+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:14.270 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:14.270 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:14.270 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:14.271 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:14.271 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:14.287 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T06:05:14.354 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:14.350+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:14.456 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:14.450+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:14.480 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:14.480 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 60.659605526999997, 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.013495551, 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.481 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820818+0000", 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.858e-06 2024-09-17T06:05:14.482 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820836+0000", 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7955e-05 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820863+0000", 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7013999999999999e-05 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:14.483 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820885+0000", 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1695000000000002e-05 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821084+0000", 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019876400000000001 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821305+0000", 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022121099999999999 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.484 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821563+0000", 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025797100000000001 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825504+0000", 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039410119999999998 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834165+0000", 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086608810000000005 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.485 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834252+0000", 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7276999999999998e-05 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834311+0000", 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8913000000000003e-05 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.486 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:05:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 60.656382252999997, 2024-09-17T06:05:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037604380000000001, 2024-09-17T06:05:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:05:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.487 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824040+0000", 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8649999999999999e-06 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:14.488 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824070+0000", 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9162e-05 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824088+0000", 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8529000000000002e-05 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824103+0000", 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5081e-05 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.489 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824193+0000", 2024-09-17T06:05:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9896999999999997e-05 2024-09-17T06:05:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:05:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1649000000000001e-05 2024-09-17T06:05:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827740+0000", 2024-09-17T06:05:14.490 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035152069999999998 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827799+0000", 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9048000000000001e-05 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 60.656196700999999, 2024-09-17T06:05:14.491 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035104340000000002, 2024-09-17T06:05:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:05:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:14.492 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1909999999999999e-06 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824237+0000", 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1914e-05 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.493 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824252+0000", 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5071e-05 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824265+0000", 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2748000000000001e-05 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824346+0000", 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0530000000000003e-05 2024-09-17T06:05:14.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824375+0000", 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9805e-05 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827659+0000", 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032838569999999998 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827735+0000", 2024-09-17T06:05:14.495 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5318e-05 2024-09-17T06:05:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 75 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:05:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 60.655999901000001, 2024-09-17T06:05:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003402553, 2024-09-17T06:05:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:14.496 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.497 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824422+0000", 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3399999999999998e-07 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824434+0000", 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1960000000000001e-05 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824771+0000", 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033676799999999998 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.498 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824798+0000", 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7838e-05 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824920+0000", 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012210699999999999 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827824+0000", 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029030459999999998 2024-09-17T06:05:14.499 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 4 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 60.655313393, 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003032833, 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.500 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825108+0000", 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6099999999999999e-07 2024-09-17T06:05:14.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825120+0000", 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1780000000000001e-05 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825136+0000", 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6229999999999999e-05 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825152+0000", 2024-09-17T06:05:14.502 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6104e-05 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825297+0000", 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014498399999999999 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828140+0000", 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002842874 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.503 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 60.650604614000002, 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032580460000000001, 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:05:14.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829817+0000", 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.176e-06 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:14.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0178e-05 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829847+0000", 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9402000000000002e-05 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829858+0000", 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1141000000000001e-05 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.506 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830004+0000", 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014622699999999999 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830027+0000", 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2826000000000001e-05 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833000+0000", 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029729000000000001 2024-09-17T06:05:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833074+0000", 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4196000000000006e-05 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 60.649489832999997, 2024-09-17T06:05:14.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0043957220000000003, 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:05:14.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830933+0000", 2024-09-17T06:05:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5090000000000001e-06 2024-09-17T06:05:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830946+0000", 2024-09-17T06:05:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3018e-05 2024-09-17T06:05:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.510 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830968+0000", 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2558999999999999e-05 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830984+0000", 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5376999999999999e-05 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831072+0000", 2024-09-17T06:05:14.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8745000000000005e-05 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831104+0000", 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1265e-05 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835260+0000", 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0041569559999999998 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835327+0000", 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.6292999999999997e-05 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 60.646386300000003, 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029529399999999998, 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:14.513 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:14.514 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834036+0000", 2024-09-17T06:05:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9999999999999995e-07 2024-09-17T06:05:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834042+0000", 2024-09-17T06:05:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.7240000000000003e-06 2024-09-17T06:05:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834058+0000", 2024-09-17T06:05:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5648e-05 2024-09-17T06:05:14.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834068+0000", 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0383999999999999e-05 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834145+0000", 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.64e-05 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834157+0000", 2024-09-17T06:05:14.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2414e-05 2024-09-17T06:05:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834330+0000", 2024-09-17T06:05:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017272399999999999 2024-09-17T06:05:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:14.517 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:14.517 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:14.518 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:05:14.556 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:14.554+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:14.657 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:14.654+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:14.713 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:14.713 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:14.713 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:14.713 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:14.730 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:05:14.777 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:14.778+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:14.859 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:14.854+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:14.882 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:14.882 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:14.882 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:14.882 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:14.882 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:14.900 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:05:14.946 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T06:05:14.992 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:14.990+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:15.062 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:15.058+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:15.090 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:15.091 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:15.091 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:15.091 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:15.091 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.091 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:15.091 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:15.091 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.267772024999999, 2024-09-17T06:05:15.091 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:05:15.091 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.091 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.091 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.091 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:05:15.094 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.095 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.267659801000001, 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:15.096 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.097 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:05:15.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.267454450999999, 2024-09-17T06:05:15.100 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.101 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.102 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.103 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:05:15.104 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.261313925000003, 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:05:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:05:15.107 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.108 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:15.109 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.261159198999998, 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:15.110 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.111 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.112 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.113 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.114 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.114 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.114 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.114 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:15.116 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:05:15.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.098+0000 7f607df4f640 1 -- 172.21.15.122:0/4219326774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6060003a60 msgr2=0x7f6060003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:15.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.098+0000 7f607df4f640 1 --2- 172.21.15.122:0/4219326774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6060003a60 0x7f6060003ed0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6068001dc0 tx=0x7f606801cad0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.098+0000 7f607df4f640 1 -- 172.21.15.122:0/4219326774 shutdown_connections 2024-09-17T06:05:15.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.098+0000 7f607df4f640 1 --2- 172.21.15.122:0/4219326774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6060003a60 0x7f6060003ed0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.098+0000 7f607df4f640 1 -- 172.21.15.122:0/4219326774 >> 172.21.15.122:0/4219326774 conn(0x7f60780713b0 msgr2=0x7f60780717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:15.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.098+0000 7f607df4f640 1 -- 172.21.15.122:0/4219326774 shutdown_connections 2024-09-17T06:05:15.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.098+0000 7f607df4f640 1 -- 172.21.15.122:0/4219326774 wait complete. 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f607df4f640 1 Processor -- start 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f607df4f640 1 -- start start 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f607df4f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6060003a60 0x7f60781f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f607df4f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f607806d890 0x7f6078143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f607df4f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60781e37f0 0x7f6078142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f607df4f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f60780c8700 con 0x7f60781e37f0 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f607df4f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6078073c70 con 0x7f607806d890 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f607df4f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f607815bb10 con 0x7f6060003a60 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f6077fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60781e37f0 0x7f6078142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f6077fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60781e37f0 0x7f6078142070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52938/0 (socket says 172.21.15.122:52938) 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f6077fff640 1 -- 172.21.15.122:0/960217860 learned_addr learned my addr 172.21.15.122:0/960217860 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f60777fe640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6060003a60 0x7f60781f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f6076ffd640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f607806d890 0x7f6078143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:15.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f6077fff640 1 -- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6060003a60 msgr2=0x7f60781f4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f6077fff640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6060003a60 0x7f60781f4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f6077fff640 1 -- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f607806d890 msgr2=0x7f6078143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f6077fff640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f607806d890 0x7f6078143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f6077fff640 1 -- 172.21.15.122:0/960217860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60781f4dd0 con 0x7f60781e37f0 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f60777fe640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6060003a60 0x7f60781f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f6077fff640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60781e37f0 0x7f6078142070 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f60780c8620 tx=0x7f6070011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f605ffff640 1 -- 172.21.15.122:0/960217860 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6070004230 con 0x7f60781e37f0 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f605ffff640 1 -- 172.21.15.122:0/960217860 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6070016070 con 0x7f60781e37f0 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f607df4f640 1 -- 172.21.15.122:0/960217860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607806dd40 con 0x7f60781e37f0 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f605ffff640 1 -- 172.21.15.122:0/960217860 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607000fb20 con 0x7f60781e37f0 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.102+0000 7f607df4f640 1 -- 172.21.15.122:0/960217860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6078159470 con 0x7f60781e37f0 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.106+0000 7f607df4f640 1 -- 172.21.15.122:0/960217860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60780c3830 con 0x7f60781e37f0 2024-09-17T06:05:15.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.106+0000 7f605ffff640 1 -- 172.21.15.122:0/960217860 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f607000fcc0 con 0x7f60781e37f0 2024-09-17T06:05:15.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.106+0000 7f605ffff640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6064073200 0x7f6064075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:15.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.106+0000 7f605ffff640 1 -- 172.21.15.122:0/960217860 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6775+0+0 (secure 0 0 0) 0x7f6070094c20 con 0x7f60781e37f0 2024-09-17T06:05:15.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.106+0000 7f60777fe640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6064073200 0x7f6064075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:15.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.106+0000 7f60777fe640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6064073200 0x7f6064075710 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60680aa000 tx=0x7f60680198c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:15.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.110+0000 7f605ffff640 1 -- 172.21.15.122:0/960217860 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f607005f930 con 0x7f60781e37f0 2024-09-17T06:05:15.162 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:15.158+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:15.263 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:15.258+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:15.269 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:15.269 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:15.269 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:15.269 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:15.288 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:05:15.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.290+0000 7f607df4f640 1 -- 172.21.15.122:0/960217860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) -- 0x7f60780b2630 con 0x7f60781e37f0 2024-09-17T06:05:15.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.342+0000 7f605ffff640 1 -- 172.21.15.122:0/960217860 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v40) ==== 97+0+0 (secure 0 0 0) 0x7f607005f230 con 0x7f60781e37f0 2024-09-17T06:05:15.345 INFO:teuthology.orchestra.run.smithi122.stderr:nodeep-scrub is set 2024-09-17T06:05:15.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.346+0000 7f607df4f640 1 -- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6064073200 msgr2=0x7f6064075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:15.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.346+0000 7f607df4f640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6064073200 0x7f6064075710 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60680aa000 tx=0x7f60680198c0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.346+0000 7f607df4f640 1 -- 172.21.15.122:0/960217860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60781e37f0 msgr2=0x7f6078142070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:15.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.346+0000 7f607df4f640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60781e37f0 0x7f6078142070 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f60780c8620 tx=0x7f6070011b10 comp rx=0 tx=0).stop 2024-09-17T06:05:15.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.346+0000 7f607df4f640 1 -- 172.21.15.122:0/960217860 shutdown_connections 2024-09-17T06:05:15.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.346+0000 7f607df4f640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60781e37f0 0x7f6078142070 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.346+0000 7f607df4f640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6064073200 0x7f6064075710 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.346+0000 7f607df4f640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f607806d890 0x7f6078143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.346+0000 7f607df4f640 1 --2- 172.21.15.122:0/960217860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6060003a60 0x7f60781f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.346+0000 7f607df4f640 1 -- 172.21.15.122:0/960217860 >> 172.21.15.122:0/960217860 conn(0x7f60780713b0 msgr2=0x7f6078155f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:15.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.346+0000 7f607df4f640 1 -- 172.21.15.122:0/960217860 shutdown_connections 2024-09-17T06:05:15.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.346+0000 7f607df4f640 1 -- 172.21.15.122:0/960217860 wait complete. 2024-09-17T06:05:15.363 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:15.362+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:15.440 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:15.441 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:15.441 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:15.441 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:15.441 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:15.458 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:05:15.464 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:15.462+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:15.570 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:15.570+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:15.605 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.781586390000001, 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.606 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.607 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:05:15.608 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:15.609 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.610 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:15.611 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.781465988000001, 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.612 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.613 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.614 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:05:15.615 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:05:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.781338073999997, 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.617 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:05:15.618 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.619 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:15.620 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:05:15.620 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.620 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.620 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.620 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:05:15.620 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:05:15.620 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.620 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.620 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.621 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:05:15.622 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.780312111000001, 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.623 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:05:15.624 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.625 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.627 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.628 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.780231168, 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.629 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.630 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.631 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:05:15.632 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.633 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.780168766000003, 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.634 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:05:15.635 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.636 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.637 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.638 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.639 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.780096675999999, 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.640 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:05:15.641 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:05:15.642 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.643 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.780054475999997, 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:15.644 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.645 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.646 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:05:15.647 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.777462544000002, 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.648 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.649 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:05:15.650 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:05:15.651 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.777366409000003, 2024-09-17T06:05:15.653 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:05:15.653 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.653 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.653 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.653 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.653 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.653 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.653 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:15.653 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.653 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:05:15.654 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.655 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.768934123000001, 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.657 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:05:15.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:05:15.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.662 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.675344903000003, 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.663 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.664 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.666 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 55.004714538000002, 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.667 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.668 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:05:15.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:05:15.671 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.672 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 53.284043582000002, 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:15.673 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.674 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.675 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:05:15.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:05:15.677 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:15.678 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 53.281359332999997, 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:15.679 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.680 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.681 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.682 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.412156660000001, 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.683 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:05:15.684 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:05:15.685 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.686 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.687 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 31.885715747999999, 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.688 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.689 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.690 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.691 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:05:15.692 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.693 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 31.885486232000002, 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.694 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.695 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.696 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:15.696 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.696 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.696 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.696 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.696 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:05:15.696 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:05:15.696 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.696 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.696 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.696 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.697 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.698 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.699 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 31.883521536, 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.700 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.701 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.702 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.703 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 27.949958648999999, 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:15.704 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.705 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.706 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.707 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:05:15.708 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:15.709 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:15.710 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:15.711 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:05:15.711 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:15.710+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:15.771 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:05:15.824 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:15.822+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:15.912 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:15.910+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:15.914 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:15.915 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:15.915 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:15.915 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.922+0000 7f1077116640 1 -- 172.21.15.122:0/2963916100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10700c9fc0 msgr2=0x7f107015b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.922+0000 7f1077116640 1 --2- 172.21.15.122:0/2963916100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10700c9fc0 0x7f107015b7c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1068009cb0 tx=0x7f106801f5a0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.922+0000 7f1077116640 1 -- 172.21.15.122:0/2963916100 shutdown_connections 2024-09-17T06:05:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.922+0000 7f1077116640 1 --2- 172.21.15.122:0/2963916100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10700c9fc0 0x7f107015b7c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.922+0000 7f1077116640 1 -- 172.21.15.122:0/2963916100 >> 172.21.15.122:0/2963916100 conn(0x7f1070073640 msgr2=0x7f10700cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.922+0000 7f1077116640 1 -- 172.21.15.122:0/2963916100 shutdown_connections 2024-09-17T06:05:15.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.922+0000 7f1077116640 1 -- 172.21.15.122:0/2963916100 wait complete. 2024-09-17T06:05:15.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.922+0000 7f1077116640 1 Processor -- start 2024-09-17T06:05:15.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.922+0000 7f1077116640 1 -- start start 2024-09-17T06:05:15.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f1077116640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10700b3b80 0x7f10701ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:15.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f1077116640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10700c9fc0 0x7f10701588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:15.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f1077116640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10700c6740 0x7f10701475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:15.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f1077116640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f107006f0a0 con 0x7f10700c9fc0 2024-09-17T06:05:15.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f1077116640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f107006edc0 con 0x7f10700b3b80 2024-09-17T06:05:15.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f1077116640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f107015bd00 con 0x7f10700c6740 2024-09-17T06:05:15.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f106ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10700c9fc0 0x7f10701588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:15.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f106ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10700c9fc0 0x7f10701588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52956/0 (socket says 172.21.15.122:52956) 2024-09-17T06:05:15.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f106ffff640 1 -- 172.21.15.122:0/356298444 learned_addr learned my addr 172.21.15.122:0/356298444 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:15.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f1074eb2640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10700b3b80 0x7f10701ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:15.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f10756b3640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10700c6740 0x7f10701475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:15.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f106ffff640 1 -- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10700c6740 msgr2=0x7f10701475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:15.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f106ffff640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10700c6740 0x7f10701475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f106ffff640 1 -- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10700b3b80 msgr2=0x7f10701ef8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:15.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f106ffff640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10700b3b80 0x7f10701ef8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:15.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f106ffff640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10701f25d0 con 0x7f10700c9fc0 2024-09-17T06:05:15.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f106ffff640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10700c9fc0 0x7f10701588d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f105c00c3f0 tx=0x7f105c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:15.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c017070 con 0x7f10700c9fc0 2024-09-17T06:05:15.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f1077116640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10701efe30 con 0x7f10700c9fc0 2024-09-17T06:05:15.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f1077116640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10700cd400 con 0x7f10700c9fc0 2024-09-17T06:05:15.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f105c003600 con 0x7f10700c9fc0 2024-09-17T06:05:15.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c021060 con 0x7f10700c9fc0 2024-09-17T06:05:15.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.926+0000 7f1077116640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f1050005280 con 0x7f10700c9fc0 2024-09-17T06:05:15.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.930+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f105c01a070 con 0x7f10700c9fc0 2024-09-17T06:05:15.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.930+0000 7f106d7fa640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1054073230 0x7f1054075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:15.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.930+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6775+0+0 (secure 0 0 0) 0x7f105c0937e0 con 0x7f10700c9fc0 2024-09-17T06:05:15.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.930+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v40) ==== 54+0+16 (secure 0 0 0) 0x7f10700b1640 con 0x7f10700c9fc0 2024-09-17T06:05:15.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.930+0000 7f1074eb2640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1054073230 0x7f1054075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:15.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.930+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f1048001660 0x7f1048003b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:15.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.930+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1048006c10 con 0x7f1048001660 2024-09-17T06:05:15.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.930+0000 7f10756b3640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f1048001660 0x7f1048003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:15.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.930+0000 7f1074eb2640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1054073230 0x7f1054075740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1064007fd0 tx=0x7f1064009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:15.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.930+0000 7f10756b3640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f1048001660 0x7f1048003b70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:15.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.930+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1048006c10 con 0x7f1048001660 2024-09-17T06:05:15.937 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:05:15.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.958+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f1048005c60 con 0x7f1048001660 2024-09-17T06:05:15.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.962+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f1048005c60 con 0x7f1048001660 2024-09-17T06:05:15.965 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:15.966 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:15.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.962+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f10480041f0 0x7f1048004600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:15.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.962+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f1048004bf0 con 0x7f10480041f0 2024-09-17T06:05:15.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.962+0000 7f1074eb2640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f10480041f0 0x7f1048004600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:15.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.962+0000 7f1074eb2640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f10480041f0 0x7f1048004600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:15.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.962+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1048004bf0 con 0x7f10480041f0 2024-09-17T06:05:15.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.978+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f10480051c0 con 0x7f10480041f0 2024-09-17T06:05:15.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.978+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f10480051c0 con 0x7f10480041f0 2024-09-17T06:05:15.981 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:15.982 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:15.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.978+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f10480093a0 0x7f104800b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:15.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.978+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f104800e770 con 0x7f10480093a0 2024-09-17T06:05:15.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.978+0000 7f106ffff640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f10480093a0 0x7f104800b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:15.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.978+0000 7f106ffff640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f10480093a0 0x7f104800b7c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:15.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.978+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f104800e770 con 0x7f10480093a0 2024-09-17T06:05:15.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.994+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f104800d760 con 0x7f10480093a0 2024-09-17T06:05:15.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.994+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f104800d760 con 0x7f10480093a0 2024-09-17T06:05:15.999 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:15.999 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:16.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.994+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f104800bd50 0x7f104800c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:16.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.994+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f104800c6a0 con 0x7f104800bd50 2024-09-17T06:05:16.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.994+0000 7f10756b3640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f104800bd50 0x7f104800c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:16.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.998+0000 7f10756b3640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f104800bd50 0x7f104800c160 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:16.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:15.998+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f104800c6a0 con 0x7f104800bd50 2024-09-17T06:05:16.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.010+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f104800c700 con 0x7f104800bd50 2024-09-17T06:05:16.014 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:16.014+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:16.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.010+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f104800c700 con 0x7f104800bd50 2024-09-17T06:05:16.015 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:16.015 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:16.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.010+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f1048010930 0x7f1048012d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.010+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f1048015b20 con 0x7f1048010930 2024-09-17T06:05:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.010+0000 7f1074eb2640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f1048010930 0x7f1048012d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:16.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.014+0000 7f1074eb2640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f1048010930 0x7f1048012d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:16.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.014+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1048015b20 con 0x7f1048010930 2024-09-17T06:05:16.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.026+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f1048013290 con 0x7f1048010930 2024-09-17T06:05:16.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.030+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f1048013290 con 0x7f1048010930 2024-09-17T06:05:16.034 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:05:16.034 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:05:16.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.030+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f1048013910 0x7f1048015d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:16.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.030+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f1048018dd0 con 0x7f1048013910 2024-09-17T06:05:16.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.030+0000 7f106ffff640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f1048013910 0x7f1048015d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:16.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.030+0000 7f106ffff640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f1048013910 0x7f1048015d90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:16.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.034+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1048018dd0 con 0x7f1048013910 2024-09-17T06:05:16.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.058+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f10480008e0 con 0x7f1048013910 2024-09-17T06:05:16.067 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.062+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f10480008e0 con 0x7f1048013910 2024-09-17T06:05:16.067 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:16.068 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:16.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.062+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f1048018030 0x7f1048018480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:16.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.062+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f104801c1a0 con 0x7f1048018030 2024-09-17T06:05:16.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.066+0000 7f10756b3640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f1048018030 0x7f1048018480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:16.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.066+0000 7f10756b3640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f1048018030 0x7f1048018480 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:16.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.066+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f104801c1a0 con 0x7f1048018030 2024-09-17T06:05:16.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.078+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f10480163e0 con 0x7f1048018030 2024-09-17T06:05:16.086 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:16.086 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:16.086 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:16.087 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:16.087 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:16.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.082+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f10480163e0 con 0x7f1048018030 2024-09-17T06:05:16.088 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:16.088 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:16.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.086+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f10480168f0 0x7f1048016d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:16.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.086+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f10480172c0 con 0x7f10480168f0 2024-09-17T06:05:16.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.086+0000 7f1074eb2640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f10480168f0 0x7f1048016d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:16.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.086+0000 7f1074eb2640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f10480168f0 0x7f1048016d00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:16.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.086+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10480172c0 con 0x7f10480168f0 2024-09-17T06:05:16.105 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:05:16.114 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:16.110+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:16.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.110+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f1048017500 con 0x7f10480168f0 2024-09-17T06:05:16.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f106d7fa640 1 -- 172.21.15.122:0/356298444 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f1048017500 con 0x7f10480168f0 2024-09-17T06:05:16.118 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:16.120 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:16.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f1048001660 msgr2=0x7f1048003b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:16.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f1048001660 0x7f1048003b70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:16.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f10480041f0 msgr2=0x7f1048004600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:16.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f10480041f0 0x7f1048004600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:16.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f10480093a0 msgr2=0x7f104800b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:16.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f10480093a0 0x7f104800b7c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:16.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f10756b3640 1 -- 172.21.15.122:0/356298444 reap_dead start 2024-09-17T06:05:16.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f104800bd50 msgr2=0x7f104800c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:16.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f104800bd50 0x7f104800c160 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:16.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f1048010930 msgr2=0x7f1048012d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:16.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f1048010930 0x7f1048012d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f1048013910 msgr2=0x7f1048015d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f1048013910 0x7f1048015d90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f1048018030 msgr2=0x7f1048018480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f1048018030 0x7f1048018480 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f10480168f0 msgr2=0x7f1048016d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f10480168f0 0x7f1048016d00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f10756b3640 1 -- 172.21.15.122:0/356298444 reap_dead start 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1054073230 msgr2=0x7f1054075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1054073230 0x7f1054075740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1064007fd0 tx=0x7f1064009040 comp rx=0 tx=0).stop 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10700c9fc0 msgr2=0x7f10701588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10700c9fc0 0x7f10701588d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f105c00c3f0 tx=0x7f105c00c8b0 comp rx=0 tx=0).stop 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 shutdown_connections 2024-09-17T06:05:16.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f10700c9fc0 0x7f10701588d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:16.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 --2- 172.21.15.122:0/356298444 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1054073230 0x7f1054075740 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:16.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 >> 172.21.15.122:0/356298444 conn(0x7f1070073640 msgr2=0x7f10700c2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:16.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 shutdown_connections 2024-09-17T06:05:16.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:16.114+0000 7f105affd640 1 -- 172.21.15.122:0/356298444 wait complete. 2024-09-17T06:05:16.215 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:16.210+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:16.289 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:16.290 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:16.309 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:05:16.356 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:16.354+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:16.417 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:16.414+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:16.490 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:16.490 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:16.513 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:05:16.518 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:16.518+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:16.618 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:16.614+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:16.690 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:16.690 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:16.705 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:05:16.748 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:16.746+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:16.821 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:16.818+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:16.901 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:16.901 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:16.916 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:05:16.922 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:16.922+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:16.936 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-17T06:05:16.936 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T06:05:16.936 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T06:05:16.937 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T06:05:17.022 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:17.018+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:17.099 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:17.099 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:17.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.114+0000 7f1724252640 1 -- 172.21.15.122:0/2916340601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1708004d50 msgr2=0x7f17080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:17.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.114+0000 7f1724252640 1 --2- 172.21.15.122:0/2916340601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1708004d50 0x7f17080051c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f171c0c34c0 tx=0x7f171401f540 comp rx=0 tx=0).stop 2024-09-17T06:05:17.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.114+0000 7f17227ef640 1 -- 172.21.15.122:0/2916340601 reap_dead start 2024-09-17T06:05:17.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.114+0000 7f1724252640 1 -- 172.21.15.122:0/2916340601 shutdown_connections 2024-09-17T06:05:17.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.114+0000 7f1724252640 1 -- 172.21.15.122:0/2916340601 >> 172.21.15.122:0/2916340601 conn(0x7f171c073750 msgr2=0x7f171c0cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:17.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.114+0000 7f1724252640 1 -- 172.21.15.122:0/2916340601 shutdown_connections 2024-09-17T06:05:17.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.114+0000 7f1724252640 1 -- 172.21.15.122:0/2916340601 wait complete. 2024-09-17T06:05:17.121 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:05:17.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.118+0000 7f1724252640 1 Processor -- start 2024-09-17T06:05:17.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.118+0000 7f1724252640 1 -- start start 2024-09-17T06:05:17.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f1724252640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1708004d50 0x7f171c0cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f1724252640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f171c0cb760 0x7f171c0b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f1724252640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f171c146220 0x7f171c146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f1724252640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f171c0c4670 con 0x7f171c146220 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f1724252640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f171c1584e0 con 0x7f171c0cb760 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f1724252640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f171c0c8f10 con 0x7f1708004d50 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17227ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f171c146220 0x7f171c146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17227ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f171c146220 0x7f171c146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52982/0 (socket says 172.21.15.122:52982) 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17227ef640 1 -- 172.21.15.122:0/343220685 learned_addr learned my addr 172.21.15.122:0/343220685 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f1721fee640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1708004d50 0x7f171c0cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17217ed640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f171c0cb760 0x7f171c0b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17227ef640 1 -- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1708004d50 msgr2=0x7f171c0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17227ef640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1708004d50 0x7f171c0cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17227ef640 1 -- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f171c0cb760 msgr2=0x7f171c0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:17.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17227ef640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f171c0cb760 0x7f171c0b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17227ef640 1 -- 172.21.15.122:0/343220685 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171c0cc430 con 0x7f171c146220 2024-09-17T06:05:17.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17217ed640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f171c0cb760 0x7f171c0b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:05:17.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f1721fee640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1708004d50 0x7f171c0cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:05:17.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17227ef640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f171c146220 0x7f171c146630 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f171401dc40 tx=0x7f17140014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:17.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17127fc640 1 -- 172.21.15.122:0/343220685 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714003b80 con 0x7f171c146220 2024-09-17T06:05:17.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f1724252640 1 -- 172.21.15.122:0/343220685 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f171c0b09b0 con 0x7f171c146220 2024-09-17T06:05:17.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f1724252640 1 -- 172.21.15.122:0/343220685 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f171c0b2750 con 0x7f171c146220 2024-09-17T06:05:17.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17127fc640 1 -- 172.21.15.122:0/343220685 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1714003e10 con 0x7f171c146220 2024-09-17T06:05:17.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17127fc640 1 -- 172.21.15.122:0/343220685 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17140c5060 con 0x7f171c146220 2024-09-17T06:05:17.129 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:17.126+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:17.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f1724252640 1 -- 172.21.15.122:0/343220685 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17040052a0 con 0x7f171c146220 2024-09-17T06:05:17.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.122+0000 7f17127fc640 1 -- 172.21.15.122:0/343220685 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1714006240 con 0x7f171c146220 2024-09-17T06:05:17.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.126+0000 7f17127fc640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1700073200 0x7f1700075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:17.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.126+0000 7f17127fc640 1 -- 172.21.15.122:0/343220685 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6775+0+0 (secure 0 0 0) 0x7f1714131bc0 con 0x7f171c146220 2024-09-17T06:05:17.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.130+0000 7f1721fee640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1700073200 0x7f1700075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:17.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.134+0000 7f1721fee640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1700073200 0x7f1700075710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1718009b70 tx=0x7f17180091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:17.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.134+0000 7f17127fc640 1 -- 172.21.15.122:0/343220685 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f17140192a0 con 0x7f171c146220 2024-09-17T06:05:17.226 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:17.222+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:17.322 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:17.322 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:17.328 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:17.322+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:17.343 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:05:17.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.358+0000 7f1724252640 1 -- 172.21.15.122:0/343220685 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f1704005860 con 0x7f171c146220 2024-09-17T06:05:17.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.358+0000 7f17127fc640 1 -- 172.21.15.122:0/343220685 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v40) ==== 81+0+39039 (secure 0 0 0) 0x7f17140fc730 con 0x7f171c146220 2024-09-17T06:05:17.363 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:05:17.363 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:17.363 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 40, 2024-09-17T06:05:17.363 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "5aff0fc3-254a-48aa-be08-0081a34bd09c", 2024-09-17T06:05:17.363 INFO:teuthology.orchestra.run.smithi122.stdout: "created": "2024-09-17T06:03:42.642598+0000", 2024-09-17T06:05:17.363 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-09-17T06:05:15.343464+0000", 2024-09-17T06:05:17.363 INFO:teuthology.orchestra.run.smithi122.stdout: "last_up_change": "2024-09-17T06:03:56.580331+0000", 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: "last_in_change": "2024-09-17T06:03:46.879949+0000", 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_num": 5806080, 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_set": [ 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: "nodeep-scrub", 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: "noscrub", 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: "pglog_hardlimit", 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: "purged_snapdirs", 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_deletes", 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: "sortbitwise" 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_version": 6, 2024-09-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi122.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_snapshot": "", 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_max": 4, 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: "max_osd": 8, 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: "require_min_compat_client": "luminous", 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: "min_compat_client": "luminous", 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: "require_osd_release": "squid", 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: "allow_crimson": false, 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: "pools": [ 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 1, 2024-09-17T06:05:17.365 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": ".mgr", 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:03:57.560955+0000", 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:17.366 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 1, 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 1, 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 1, 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 1, 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 1, 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:17.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "18", 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:17.368 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:17.369 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:17.370 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_max": 32, 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 1 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": {} 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 6.9000000953674316, 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 6.9000000953674316, 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 0.28999999165534973, 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 2, 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 2, 2024-09-17T06:05:17.371 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 0.875, 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 2, 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_metadata", 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:06.110710+0000", 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:05:17.372 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:05:17.373 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:05:17.373 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:17.373 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:17.373 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:17.373 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:17.373 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:17.373 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:17.373 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:17.373 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 32, 2024-09-17T06:05:17.373 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 32, 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 32, 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 32, 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 32, 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "21", 2024-09-17T06:05:17.374 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:17.375 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.376 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_bias": 4, 2024-09-17T06:05:17.377 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 16, 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_priority": 5 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: "metadata": "cephfs" 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 1.5399999618530273, 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 1.5399999618530273, 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 1.1399999856948853, 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 1.75, 2024-09-17T06:05:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 1.75, 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 0.875, 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 3, 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_data", 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:07.186655+0000", 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:05:17.379 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:05:17.380 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:05:17.380 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:17.380 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:17.380 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:17.380 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:17.380 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:17.380 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:17.380 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:17.380 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 64, 2024-09-17T06:05:17.380 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 64, 2024-09-17T06:05:17.380 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 64, 2024-09-17T06:05:17.380 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 64, 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 64, 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "22", 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:17.381 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:17.382 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:17.383 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 64, 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: "target_size_ratio": 0.05000000074505806 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.384 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: "data": "cephfs" 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 1.3200000524520874, 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 1.3200000524520874, 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 1.1399999856948853, 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 1.5, 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 1.5, 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 0.875, 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:05:17.385 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 4, 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_data_ec", 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:10.901448+0000", 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 5, 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool,ec_overwrites", 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 3, 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 4, 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 3, 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 1, 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:17.386 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 32, 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 32, 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 32, 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 32, 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 32, 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:17.387 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "26", 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:17.388 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:17.389 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "cephfs_data_ec", 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:17.390 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 8192, 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 64, 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: "data": "cephfs" 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.391 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: "osds": [ 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 0, 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "b8a621d5-9187-4034-ac89-5adb5b22ca7a", 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:17.392 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6824", 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6825", 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:17.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6826", 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6827", 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:17.394 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6830", 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6831", 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:17.395 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6828", 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6829", 2024-09-17T06:05:17.396 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6825/776463314", 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6827/776463314", 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6831/776463314", 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6829/776463314", 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 1, 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "992e1af1-06d0-4849-93bf-4be8fc437183", 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:17.398 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6800", 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6801", 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.399 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:17.400 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.400 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.400 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6802", 2024-09-17T06:05:17.400 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:17.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.400 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.400 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6803", 2024-09-17T06:05:17.400 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:17.400 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6806", 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6807", 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:17.401 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6804", 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6805", 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:17.402 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6801/2272556556", 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6803/2272556556", 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6807/2272556556", 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6805/2272556556", 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.403 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 2, 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "e3a31b77-d4db-4ee6-af7c-60af7df4bd69", 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 27, 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6816", 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6817", 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6818", 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6819", 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:17.406 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6822", 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6823", 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.407 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6820", 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6821", 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.408 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6817/1205784459", 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6819/1205784459", 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6823/1205784459", 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6821/1205784459", 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 3, 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "9f473452-18cd-44a4-803a-e908e21ab405", 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:17.409 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 0, 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 27, 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6808", 2024-09-17T06:05:17.410 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6809", 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6810", 2024-09-17T06:05:17.412 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:17.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.412 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.412 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6811", 2024-09-17T06:05:17.412 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:17.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.412 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6814", 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6815", 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6812", 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6813", 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.414 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.415 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6809/3198016774", 2024-09-17T06:05:17.415 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6811/3198016774", 2024-09-17T06:05:17.415 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6815/3198016774", 2024-09-17T06:05:17.415 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6813/3198016774", 2024-09-17T06:05:17.415 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:17.415 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:17.415 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:17.415 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.416 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 4, 2024-09-17T06:05:17.416 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "f11201b3-22f8-4b9e-873c-0ed12835e2d3", 2024-09-17T06:05:17.416 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:17.416 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:17.416 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:17.416 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:17.416 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:17.416 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6810", 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6811", 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6812", 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.418 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6813", 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6816", 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.419 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6817", 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6814", 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.420 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6815", 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6811/920798795", 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6813/920798795", 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6817/920798795", 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6815/920798795", 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:17.421 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 5, 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "3f853011-9aea-4f7c-bb97-2c74fba1e33e", 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 14, 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 38, 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:17.422 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6802", 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6803", 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.423 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6804", 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6805", 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.424 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6808", 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6809", 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.425 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6806", 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6807", 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.426 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6803/2576144160", 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6805/2576144160", 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6809/2576144160", 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6807/2576144160", 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 6, 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "445606c9-7e18-44b2-997d-68d280a3a37c", 2024-09-17T06:05:17.427 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.428 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6818", 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6819", 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.429 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6820", 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6821", 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.430 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6824", 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6825", 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.431 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6822", 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6823", 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6819/1877869793", 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6821/1877869793", 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6825/1877869793", 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6823/1877869793", 2024-09-17T06:05:17.432 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 7, 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "ce0b67c6-0618-41b7-87e3-bf2d4c708907", 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:17.433 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6826", 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6827", 2024-09-17T06:05:17.434 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6828", 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6829", 2024-09-17T06:05:17.435 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:17.436 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.436 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.436 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:17.436 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.436 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.436 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6832", 2024-09-17T06:05:17.436 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:17.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.436 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6833", 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6830", 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.437 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6831", 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6827/1719466778", 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6829/1719466778", 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6833/1719466778", 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6831/1719466778", 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:17.438 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_xinfo": [ 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 0, 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.176942+0000", 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 1, 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.431303+0000", 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 2, 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:17.440 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.354201+0000", 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 3, 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:17.441 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.748604+0000", 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 4, 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.473848+0000", 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.442 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 5, 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.458683+0000", 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 6, 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:17.443 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.617928+0000", 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 7, 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.088763+0000", 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:17.444 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap": [ 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.19", 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: "osds": [ 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: 6, 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: 5, 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: 4 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap_items": [ 2024-09-17T06:05:17.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.2", 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 5, 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 1 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.d", 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 7, 2024-09-17T06:05:17.446 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.1d", 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 5, 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.c", 2024-09-17T06:05:17.447 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.d", 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 5 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.448 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.1d", 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 5 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap_primaries": [], 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_temp": [], 2024-09-17T06:05:17.449 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_temp": [], 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "blocklist": {}, 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "range_blocklist": {}, 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profiles": { 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_data_ec": { 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-device-class": "", 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-failure-domain": "osd", 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-num-failure-domains": "0", 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-osds-per-failure-domain": "0", 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-root": "default", 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "jerasure-per-chunk-alignment": "false", 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "k": "2", 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "m": "2", 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "plugin": "jerasure", 2024-09-17T06:05:17.450 INFO:teuthology.orchestra.run.smithi122.stdout: "technique": "reed_sol_van", 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: "w": "8" 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: "default": { 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-failure-domain": "osd", 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: "k": "2", 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: "m": "1", 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: "plugin": "jerasure", 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: "technique": "reed_sol_van" 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps_queue": [], 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: "new_removed_snaps": [], 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: "new_purged_snaps": [], 2024-09-17T06:05:17.451 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_node_flags": {}, 2024-09-17T06:05:17.452 INFO:teuthology.orchestra.run.smithi122.stdout: "device_class_flags": {}, 2024-09-17T06:05:17.452 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode": { 2024-09-17T06:05:17.452 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode_enabled": false, 2024-09-17T06:05:17.452 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_bucket_count": 0, 2024-09-17T06:05:17.452 INFO:teuthology.orchestra.run.smithi122.stdout: "degraded_stretch_mode": 0, 2024-09-17T06:05:17.452 INFO:teuthology.orchestra.run.smithi122.stdout: "recovering_stretch_mode": 0, 2024-09-17T06:05:17.452 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode_bucket": 0 2024-09-17T06:05:17.452 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:17.452 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:17.452 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T06:05:17.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.362+0000 7f1724252640 1 -- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1700073200 msgr2=0x7f1700075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:17.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.362+0000 7f1724252640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1700073200 0x7f1700075710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1718009b70 tx=0x7f17180091e0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.362+0000 7f1724252640 1 -- 172.21.15.122:0/343220685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f171c146220 msgr2=0x7f171c146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:17.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.362+0000 7f1724252640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f171c146220 0x7f171c146630 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f171401dc40 tx=0x7f17140014a0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.362+0000 7f1724252640 1 -- 172.21.15.122:0/343220685 shutdown_connections 2024-09-17T06:05:17.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.362+0000 7f1724252640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f171c146220 0x7f171c146630 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.362+0000 7f1724252640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1700073200 0x7f1700075710 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.362+0000 7f1724252640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f171c0cb760 0x7f171c0b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.362+0000 7f1724252640 1 --2- 172.21.15.122:0/343220685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1708004d50 0x7f171c0cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.362+0000 7f1724252640 1 -- 172.21.15.122:0/343220685 >> 172.21.15.122:0/343220685 conn(0x7f171c073750 msgr2=0x7f171c14ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:17.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.362+0000 7f1724252640 1 -- 172.21.15.122:0/343220685 shutdown_connections 2024-09-17T06:05:17.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.362+0000 7f1724252640 1 -- 172.21.15.122:0/343220685 wait complete. 2024-09-17T06:05:17.456 INFO:tasks.thrashosds.thrasher:j is {'epoch': 40, 'fsid': '5aff0fc3-254a-48aa-be08-0081a34bd09c', 'created': '2024-09-17T06:03:42.642598+0000', 'modified': '2024-09-17T06:05:15.343464+0000', 'last_up_change': '2024-09-17T06:03:56.580331+0000', 'last_in_change': '2024-09-17T06:03:46.879949+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T06:03:57.560955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T06:04:06.110710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T06:04:07.186655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3200000524520874, 'score_stable': 1.3200000524520874, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-17T06:04:10.901448+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}], 'osds': [{'osd': 0, 'uuid': 'b8a621d5-9187-4034-ac89-5adb5b22ca7a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6824', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6825', 'nonce': 776463314}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6826', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6827', 'nonce': 776463314}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6830', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6831', 'nonce': 776463314}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6828', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6829', 'nonce': 776463314}]}, 'public_addr': '172.21.15.122:6825/776463314', 'cluster_addr': '172.21.15.122:6827/776463314', 'heartbeat_back_addr': '172.21.15.122:6831/776463314', 'heartbeat_front_addr': '172.21.15.122:6829/776463314', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '992e1af1-06d0-4849-93bf-4be8fc437183', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6800', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6801', 'nonce': 2272556556}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6802', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6803', 'nonce': 2272556556}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6806', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6807', 'nonce': 2272556556}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6804', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6805', 'nonce': 2272556556}]}, 'public_addr': '172.21.15.122:6801/2272556556', 'cluster_addr': '172.21.15.122:6803/2272556556', 'heartbeat_back_addr': '172.21.15.122:6807/2272556556', 'heartbeat_front_addr': '172.21.15.122:6805/2272556556', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'e3a31b77-d4db-4ee6-af7c-60af7df4bd69', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6816', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6817', 'nonce': 1205784459}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6818', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6819', 'nonce': 1205784459}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6822', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6823', 'nonce': 1205784459}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6820', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6821', 'nonce': 1205784459}]}, 'public_addr': '172.21.15.122:6817/1205784459', 'cluster_addr': '172.21.15.122:6819/1205784459', 'heartbeat_back_addr': '172.21.15.122:6823/1205784459', 'heartbeat_front_addr': '172.21.15.122:6821/1205784459', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '9f473452-18cd-44a4-803a-e908e21ab405', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6808', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6809', 'nonce': 3198016774}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6810', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6811', 'nonce': 3198016774}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6814', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6815', 'nonce': 3198016774}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6812', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6813', 'nonce': 3198016774}]}, 'public_addr': '172.21.15.122:6809/3198016774', 'cluster_addr': '172.21.15.122:6811/3198016774', 'heartbeat_back_addr': '172.21.15.122:6815/3198016774', 'heartbeat_front_addr': '172.21.15.122:6813/3198016774', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'f11201b3-22f8-4b9e-873c-0ed12835e2d3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6810', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6811', 'nonce': 920798795}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6812', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6813', 'nonce': 920798795}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6816', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6817', 'nonce': 920798795}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6814', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6815', 'nonce': 920798795}]}, 'public_addr': '172.21.15.173:6811/920798795', 'cluster_addr': '172.21.15.173:6813/920798795', 'heartbeat_back_addr': '172.21.15.173:6817/920798795', 'heartbeat_front_addr': '172.21.15.173:6815/920798795', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '3f853011-9aea-4f7c-bb97-2c74fba1e33e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 38, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6802', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6803', 'nonce': 2576144160}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6804', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6805', 'nonce': 2576144160}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6808', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6809', 'nonce': 2576144160}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6806', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6807', 'nonce': 2576144160}]}, 'public_addr': '172.21.15.173:6803/2576144160', 'cluster_addr': '172.21.15.173:6805/2576144160', 'heartbeat_back_addr': '172.21.15.173:6809/2576144160', 'heartbeat_front_addr': '172.21.15.173:6807/2576144160', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '445606c9-7e18-44b2-997d-68d280a3a37c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6818', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6819', 'nonce': 1877869793}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6820', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6821', 'nonce': 1877869793}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6824', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6825', 'nonce': 1877869793}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6822', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6823', 'nonce': 1877869793}]}, 'public_addr': '172.21.15.173:6819/1877869793', 'cluster_addr': '172.21.15.173:6821/1877869793', 'heartbeat_back_addr': '172.21.15.173:6825/1877869793', 'heartbeat_front_addr': '172.21.15.173:6823/1877869793', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'ce0b67c6-0618-41b7-87e3-bf2d4c708907', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6826', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6827', 'nonce': 1719466778}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6828', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6829', 'nonce': 1719466778}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 1719466778}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6830', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6831', 'nonce': 1719466778}]}, 'public_addr': '172.21.15.173:6827/1719466778', 'cluster_addr': '172.21.15.173:6829/1719466778', 'heartbeat_back_addr': '172.21.15.173:6833/1719466778', 'heartbeat_front_addr': '172.21.15.173:6831/1719466778', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.176942+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.431303+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.354201+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.748604+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.473848+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.458683+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.617928+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.088763+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.19', 'osds': [6, 5, 0, 4]}], 'pg_upmap_items': [{'pgid': '3.2', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '3.d', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '3.1d', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '4.c', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.d', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.1d', 'mappings': [{'from': 1, 'to': 5}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'cephfs_data_ec': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-num-failure-domains': '0', 'crush-osds-per-failure-domain': '0', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '2', 'plugin': 'jerasure', 'technique': 'reed_sol_van', 'w': '8'}, 'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T06:05:17.456 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:05:17.457 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:17.454+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:17.533 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:17.533 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:17.550 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:05:17.555 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:17.554+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:17.655 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:17.650+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:17.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.686+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/1969074344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c0c6400 msgr2=0x7f8e9c15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:17.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.686+0000 7f8ea0d6b640 1 --2- 172.21.15.122:0/1969074344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c0c6400 0x7f8e9c15b320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009900 tx=0x7f8e8401c880 comp rx=0 tx=0).stop 2024-09-17T06:05:17.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.686+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/1969074344 shutdown_connections 2024-09-17T06:05:17.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.686+0000 7f8ea0d6b640 1 --2- 172.21.15.122:0/1969074344 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e9c163c90 0x7f8e9c1660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.686+0000 7f8ea0d6b640 1 --2- 172.21.15.122:0/1969074344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c0c6400 0x7f8e9c15b320 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.686+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/1969074344 >> 172.21.15.122:0/1969074344 conn(0x7f8e9c06d090 msgr2=0x7f8e9c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:17.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.686+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/1969074344 shutdown_connections 2024-09-17T06:05:17.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.686+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/1969074344 wait complete. 2024-09-17T06:05:17.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.690+0000 7f8ea0d6b640 1 Processor -- start 2024-09-17T06:05:17.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.690+0000 7f8ea0d6b640 1 -- start start 2024-09-17T06:05:17.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.690+0000 7f8ea0d6b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e9c0b6720 0x7f8e9c1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:17.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.690+0000 7f8ea0d6b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c0c6400 0x7f8e9c152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:17.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.690+0000 7f8ea0d6b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e9c163c90 0x7f8e9c153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:17.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.690+0000 7f8ea0d6b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9c0cd230 con 0x7f8e9c0c6400 2024-09-17T06:05:17.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.690+0000 7f8ea0d6b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9c0cc610 con 0x7f8e9c163c90 2024-09-17T06:05:17.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.690+0000 7f8ea0d6b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8e9c0c7490 con 0x7f8e9c0b6720 2024-09-17T06:05:17.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.690+0000 7f8e99d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c0c6400 0x7f8e9c152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:17.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.690+0000 7f8e99d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c0c6400 0x7f8e9c152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53014/0 (socket says 172.21.15.122:53014) 2024-09-17T06:05:17.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.690+0000 7f8e99d9b640 1 -- 172.21.15.122:0/2543451706 learned_addr learned my addr 172.21.15.122:0/2543451706 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:17.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.690+0000 7f8e9a59c640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e9c0b6720 0x7f8e9c1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:17.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e9ad9d640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e9c163c90 0x7f8e9c153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:17.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e99d9b640 1 -- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e9c0b6720 msgr2=0x7f8e9c1472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:17.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e99d9b640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e9c0b6720 0x7f8e9c1472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e99d9b640 1 -- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e9c163c90 msgr2=0x7f8e9c153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:17.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e99d9b640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e9c163c90 0x7f8e9c153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e99d9b640 1 -- 172.21.15.122:0/2543451706 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e9c1477e0 con 0x7f8e9c0c6400 2024-09-17T06:05:17.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e99d9b640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c0c6400 0x7f8e9c152920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009850 tx=0x7f8e840a5740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:17.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e92ffd640 1 -- 172.21.15.122:0/2543451706 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e840b2040 con 0x7f8e9c0c6400 2024-09-17T06:05:17.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e92ffd640 1 -- 172.21.15.122:0/2543451706 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e840044b0 con 0x7f8e9c0c6400 2024-09-17T06:05:17.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/2543451706 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e9c1461c0 con 0x7f8e9c0c6400 2024-09-17T06:05:17.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e92ffd640 1 -- 172.21.15.122:0/2543451706 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e84003860 con 0x7f8e9c0c6400 2024-09-17T06:05:17.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/2543451706 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e9c154b00 con 0x7f8e9c0c6400 2024-09-17T06:05:17.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f71da138640 1 -- 172.21.15.122:0/3122445351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc04b8e0 msgr2=0x7f71cc0dec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:17.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f71da138640 1 --2- 172.21.15.122:0/3122445351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc04b8e0 0x7f71cc0dec10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00eda0 tx=0x7f71d001c890 comp rx=0 tx=0).stop 2024-09-17T06:05:17.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/2543451706 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e9c145ee0 con 0x7f8e9c0c6400 2024-09-17T06:05:17.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e92ffd640 1 -- 172.21.15.122:0/2543451706 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8e84003a00 con 0x7f8e9c0c6400 2024-09-17T06:05:17.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e92ffd640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8e7c073200 0x7f8e7c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:17.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.694+0000 7f8e92ffd640 1 -- 172.21.15.122:0/2543451706 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6775+0+0 (secure 0 0 0) 0x7f8e8412df70 con 0x7f8e9c0c6400 2024-09-17T06:05:17.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 -- 172.21.15.122:0/3122445351 shutdown_connections 2024-09-17T06:05:17.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 --2- 172.21.15.122:0/3122445351 >> v2:172.21.15.173:3300/0 conn(0x7f71cc047120 0x7f71cc046760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 --2- 172.21.15.122:0/3122445351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc04b8e0 0x7f71cc0dec10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 -- 172.21.15.122:0/3122445351 >> 172.21.15.122:0/3122445351 conn(0x7f71cc050f60 msgr2=0x7f71cc051370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:17.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f8e9a59c640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8e7c073200 0x7f8e7c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:17.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 -- 172.21.15.122:0/3122445351 shutdown_connections 2024-09-17T06:05:17.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f8e9a59c640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8e7c073200 0x7f8e7c075710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0098e0 tx=0x7f8e8c009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:17.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 -- 172.21.15.122:0/3122445351 wait complete. 2024-09-17T06:05:17.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 Processor -- start 2024-09-17T06:05:17.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 -- start start 2024-09-17T06:05:17.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc006a40 0x7f71cc0de2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:17.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71cc047120 0x7f71cc0cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:17.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71cc04b8e0 0x7f71cc0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:17.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc046ca0 con 0x7f71cc006a40 2024-09-17T06:05:17.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.698+0000 7f71da138640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc046e20 con 0x7f71cc04b8e0 2024-09-17T06:05:17.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71da138640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f71cc0d7370 con 0x7f71cc047120 2024-09-17T06:05:17.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71d8935640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71cc047120 0x7f71cc0cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:17.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71d9937640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71cc04b8e0 0x7f71cc0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:17.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71d8935640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71cc047120 0x7f71cc0cfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:50550/0 (socket says 172.21.15.122:50550) 2024-09-17T06:05:17.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71d9937640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71cc04b8e0 0x7f71cc0cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:53268/0 (socket says 172.21.15.122:53268) 2024-09-17T06:05:17.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71d8935640 1 -- 172.21.15.122:0/2458136024 learned_addr learned my addr 172.21.15.122:0/2458136024 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:17.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71d9136640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc006a40 0x7f71cc0de2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:17.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f8e92ffd640 1 -- 172.21.15.122:0/2543451706 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8e840bd060 con 0x7f8e9c0c6400 2024-09-17T06:05:17.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71d9136640 1 -- 172.21.15.122:0/2458136024 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71cc047120 msgr2=0x7f71cc0cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:17.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71d9136640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71cc047120 0x7f71cc0cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71d9136640 1 -- 172.21.15.122:0/2458136024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71cc04b8e0 msgr2=0x7f71cc0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:17.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71d9136640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71cc04b8e0 0x7f71cc0cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:17.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71d9136640 1 -- 172.21.15.122:0/2458136024 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc036d10 con 0x7f71cc006a40 2024-09-17T06:05:17.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71d9136640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc006a40 0x7f71cc0de2b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f71d00ac000 tx=0x7f71d0005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:17.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71c9ffb640 1 -- 172.21.15.122:0/2458136024 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d00b2040 con 0x7f71cc006a40 2024-09-17T06:05:17.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71da138640 1 -- 172.21.15.122:0/2458136024 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71cc0de7f0 con 0x7f71cc006a40 2024-09-17T06:05:17.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71da138640 1 -- 172.21.15.122:0/2458136024 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71cc0ddad0 con 0x7f71cc006a40 2024-09-17T06:05:17.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71c9ffb640 1 -- 172.21.15.122:0/2458136024 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71d00a5820 con 0x7f71cc006a40 2024-09-17T06:05:17.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71c9ffb640 1 -- 172.21.15.122:0/2458136024 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d00b2040 con 0x7f71cc006a40 2024-09-17T06:05:17.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.702+0000 7f71bf7fe640 1 -- 172.21.15.122:0/2458136024 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b40052a0 con 0x7f71cc006a40 2024-09-17T06:05:17.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.706+0000 7f71c9ffb640 1 -- 172.21.15.122:0/2458136024 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f71d0004230 con 0x7f71cc006a40 2024-09-17T06:05:17.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.706+0000 7f71c9ffb640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f71b8073400 0x7f71b8075910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:17.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.706+0000 7f71c9ffb640 1 -- 172.21.15.122:0/2458136024 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6775+0+0 (secure 0 0 0) 0x7f71d012c120 con 0x7f71cc006a40 2024-09-17T06:05:17.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.706+0000 7f71d8935640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f71b8073400 0x7f71b8075910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:17.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.710+0000 7f71d8935640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f71b8073400 0x7f71b8075910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0d3b80 tx=0x7f71c40091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:17.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.710+0000 7f71c9ffb640 1 -- 172.21.15.122:0/2458136024 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f71d00164b0 con 0x7f71cc006a40 2024-09-17T06:05:17.756 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:17.754+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:17.769 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:17.769 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:17.791 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:05:17.857 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:17.858+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:17.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:17.922+0000 7f71bf7fe640 1 -- 172.21.15.122:0/2458136024 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7f71b4005860 con 0x7f71cc006a40 2024-09-17T06:05:17.958 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:17.954+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:18.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.010+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/2543451706 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e9c15ab00 con 0x7f8e7c073200 2024-09-17T06:05:18.017 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:18.017 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:18.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.030+0000 7f8e92ffd640 1 -- 172.21.15.122:0/2543451706 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332601 (secure 0 0 0) 0x7f8e9c15ab00 con 0x7f8e7c073200 2024-09-17T06:05:18.036 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:05:18.038 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:05:18.039 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:05:18.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.034+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8e7c073200 msgr2=0x7f8e7c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.034+0000 7f8ea0d6b640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8e7c073200 0x7f8e7c075710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0098e0 tx=0x7f8e8c009060 comp rx=0 tx=0).stop 2024-09-17T06:05:18.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.034+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/2543451706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c0c6400 msgr2=0x7f8e9c152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.034+0000 7f8ea0d6b640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c0c6400 0x7f8e9c152920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009850 tx=0x7f8e840a5740 comp rx=0 tx=0).stop 2024-09-17T06:05:18.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.034+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/2543451706 shutdown_connections 2024-09-17T06:05:18.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.034+0000 7f8ea0d6b640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8e7c073200 0x7f8e7c075710 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.034+0000 7f8ea0d6b640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e9c163c90 0x7f8e9c153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.034+0000 7f8ea0d6b640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e9c0c6400 0x7f8e9c152920 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.034+0000 7f8ea0d6b640 1 --2- 172.21.15.122:0/2543451706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e9c0b6720 0x7f8e9c1472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.034+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/2543451706 >> 172.21.15.122:0/2543451706 conn(0x7f8e9c06d090 msgr2=0x7f8e9c159ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:18.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.034+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/2543451706 shutdown_connections 2024-09-17T06:05:18.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.034+0000 7f8ea0d6b640 1 -- 172.21.15.122:0/2543451706 wait complete. 2024-09-17T06:05:18.059 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:18.058+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:18.062 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-09-17T06:05:17.539931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599134,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":157,"num_write_kb":1654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":321,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220888,"kb_used_data":4664,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753832,"statfs":{"total":773094113280,"available":772867923968,"internally_reserved":0,"allocated":4775936,"data_stored":2815926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002036"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164944+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:05:17.164944+0000","last_peered":"2024-09-17T06:05:17.164944+0000","last_clean":"2024-09-17T06:05:17.164944+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:05:17.164944+0000","last_undegraded":"2024-09-17T06:05:17.164944+0000","last_fullsized":"2024-09-17T06:05:17.164944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.463116+0000","last_change":"2024-09-17T06:05:06.888017+0000","last_active":"2024-09-17T06:05:15.463116+0000","last_peered":"2024-09-17T06:05:15.463116+0000","last_clean":"2024-09-17T06:05:15.463116+0000","last_became_active":"2024-09-17T06:05:06.887122+0000","last_became_peered":"2024-09-17T06:05:06.887122+0000","last_unstale":"2024-09-17T06:05:15.463116+0000","last_undegraded":"2024-09-17T06:05:15.463116+0000","last_fullsized":"2024-09-17T06:05:15.463116+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:00.459343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.462252+0000","last_change":"2024-09-17T06:04:56.093324+0000","last_active":"2024-09-17T06:05:15.462252+0000","last_peered":"2024-09-17T06:05:15.462252+0000","last_clean":"2024-09-17T06:05:15.462252+0000","last_became_active":"2024-09-17T06:04:56.092339+0000","last_became_peered":"2024-09-17T06:04:56.092339+0000","last_unstale":"2024-09-17T06:05:15.462252+0000","last_undegraded":"2024-09-17T06:05:15.462252+0000","last_fullsized":"2024-09-17T06:05:15.462252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:24.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,4],"acting":[6,5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164521+0000","last_change":"2024-09-17T06:05:06.872817+0000","last_active":"2024-09-17T06:05:17.164521+0000","last_peered":"2024-09-17T06:05:17.164521+0000","last_clean":"2024-09-17T06:05:17.164521+0000","last_became_active":"2024-09-17T06:05:06.872442+0000","last_became_peered":"2024-09-17T06:05:06.872442+0000","last_unstale":"2024-09-17T06:05:17.164521+0000","last_undegraded":"2024-09-17T06:05:17.164521+0000","last_fullsized":"2024-09-17T06:05:17.164521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:53.859734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164829+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:05:17.164829+0000","last_peered":"2024-09-17T06:05:17.164829+0000","last_clean":"2024-09-17T06:05:17.164829+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:05:17.164829+0000","last_undegraded":"2024-09-17T06:05:17.164829+0000","last_fullsized":"2024-09-17T06:05:17.164829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.349574+0000","last_change":"2024-09-17T06:04:12.954966+0000","last_active":"2024-09-17T06:05:15.349574+0000","last_peered":"2024-09-17T06:05:15.349574+0000","last_clean":"2024-09-17T06:05:15.349574+0000","last_became_active":"2024-09-17T06:04:12.953915+0000","last_became_peered":"2024-09-17T06:04:12.953915+0000","last_unstale":"2024-09-17T06:05:15.349574+0000","last_undegraded":"2024-09-17T06:05:15.349574+0000","last_fullsized":"2024-09-17T06:05:15.349574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:54.009189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809818+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:05:16.809818+0000","last_peered":"2024-09-17T06:05:16.809818+0000","last_clean":"2024-09-17T06:05:16.809818+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:05:16.809818+0000","last_undegraded":"2024-09-17T06:05:16.809818+0000","last_fullsized":"2024-09-17T06:05:16.809818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836473+0000","last_change":"2024-09-17T06:04:08.847869+0000","last_active":"2024-09-17T06:05:15.836473+0000","last_peered":"2024-09-17T06:05:15.836473+0000","last_clean":"2024-09-17T06:05:15.836473+0000","last_became_active":"2024-09-17T06:04:08.847475+0000","last_became_peered":"2024-09-17T06:04:08.847475+0000","last_unstale":"2024-09-17T06:05:15.836473+0000","last_undegraded":"2024-09-17T06:05:15.836473+0000","last_fullsized":"2024-09-17T06:05:15.836473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:54.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.350295+0000","last_change":"2024-09-17T06:04:12.948833+0000","last_active":"2024-09-17T06:05:15.350295+0000","last_peered":"2024-09-17T06:05:15.350295+0000","last_clean":"2024-09-17T06:05:15.350295+0000","last_became_active":"2024-09-17T06:04:12.947705+0000","last_became_peered":"2024-09-17T06:04:12.947705+0000","last_unstale":"2024-09-17T06:05:15.350295+0000","last_undegraded":"2024-09-17T06:05:15.350295+0000","last_fullsized":"2024-09-17T06:05:15.350295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:46.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.810040+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:05:16.810040+0000","last_peered":"2024-09-17T06:05:16.810040+0000","last_clean":"2024-09-17T06:05:16.810040+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:05:16.810040+0000","last_undegraded":"2024-09-17T06:05:16.810040+0000","last_fullsized":"2024-09-17T06:05:16.810040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.356664+0000","last_change":"2024-09-17T06:04:48.742851+0000","last_active":"2024-09-17T06:05:16.356664+0000","last_peered":"2024-09-17T06:05:16.356664+0000","last_clean":"2024-09-17T06:05:16.356664+0000","last_became_active":"2024-09-17T06:04:48.742473+0000","last_became_peered":"2024-09-17T06:04:48.742473+0000","last_unstale":"2024-09-17T06:05:16.356664+0000","last_undegraded":"2024-09-17T06:05:16.356664+0000","last_fullsized":"2024-09-17T06:05:16.356664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:03.944849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.349866+0000","last_change":"2024-09-17T06:04:12.951144+0000","last_active":"2024-09-17T06:05:15.349866+0000","last_peered":"2024-09-17T06:05:15.349866+0000","last_clean":"2024-09-17T06:05:15.349866+0000","last_became_active":"2024-09-17T06:04:12.950127+0000","last_became_peered":"2024-09-17T06:04:12.950127+0000","last_unstale":"2024-09-17T06:05:15.349866+0000","last_undegraded":"2024-09-17T06:05:15.349866+0000","last_fullsized":"2024-09-17T06:05:15.349866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:52.901835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.462504+0000","last_change":"2024-09-17T06:04:08.847906+0000","last_active":"2024-09-17T06:05:15.462504+0000","last_peered":"2024-09-17T06:05:15.462504+0000","last_clean":"2024-09-17T06:05:15.462504+0000","last_became_active":"2024-09-17T06:04:08.847601+0000","last_became_peered":"2024-09-17T06:04:08.847601+0000","last_unstale":"2024-09-17T06:05:15.462504+0000","last_undegraded":"2024-09-17T06:05:15.462504+0000","last_fullsized":"2024-09-17T06:05:15.462504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809866+0000","last_change":"2024-09-17T06:04:07.851351+0000","last_active":"2024-09-17T06:05:16.809866+0000","last_peered":"2024-09-17T06:05:16.809866+0000","last_clean":"2024-09-17T06:05:16.809866+0000","last_became_active":"2024-09-17T06:04:07.850947+0000","last_became_peered":"2024-09-17T06:04:07.850947+0000","last_unstale":"2024-09-17T06:05:16.809866+0000","last_undegraded":"2024-09-17T06:05:16.809866+0000","last_fullsized":"2024-09-17T06:05:16.809866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:43.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.349950+0000","last_change":"2024-09-17T06:04:49.312386+0000","last_active":"2024-09-17T06:05:15.349950+0000","last_peered":"2024-09-17T06:05:15.349950+0000","last_clean":"2024-09-17T06:05:15.349950+0000","last_became_active":"2024-09-17T06:04:49.310510+0000","last_became_peered":"2024-09-17T06:04:49.310510+0000","last_unstale":"2024-09-17T06:05:15.349950+0000","last_undegraded":"2024-09-17T06:05:15.349950+0000","last_fullsized":"2024-09-17T06:05:15.349950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:18.500551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164036+0000","last_change":"2024-09-17T06:05:06.873182+0000","last_active":"2024-09-17T06:05:17.164036+0000","last_peered":"2024-09-17T06:05:17.164036+0000","last_clean":"2024-09-17T06:05:17.164036+0000","last_became_active":"2024-09-17T06:05:06.872029+0000","last_became_peered":"2024-09-17T06:05:06.872029+0000","last_unstale":"2024-09-17T06:05:17.164036+0000","last_undegraded":"2024-09-17T06:05:17.164036+0000","last_fullsized":"2024-09-17T06:05:17.164036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:40.817231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.968147+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:05:16.968147+0000","last_peered":"2024-09-17T06:05:16.968147+0000","last_clean":"2024-09-17T06:05:16.968147+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:05:16.968147+0000","last_undegraded":"2024-09-17T06:05:16.968147+0000","last_fullsized":"2024-09-17T06:05:16.968147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.350814+0000","last_change":"2024-09-17T06:04:48.746643+0000","last_active":"2024-09-17T06:05:15.350814+0000","last_peered":"2024-09-17T06:05:15.350814+0000","last_clean":"2024-09-17T06:05:15.350814+0000","last_became_active":"2024-09-17T06:04:48.745117+0000","last_became_peered":"2024-09-17T06:04:48.745117+0000","last_unstale":"2024-09-17T06:05:15.350814+0000","last_undegraded":"2024-09-17T06:05:15.350814+0000","last_fullsized":"2024-09-17T06:05:15.350814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:16.669822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.968053+0000","last_change":"2024-09-17T06:05:06.872270+0000","last_active":"2024-09-17T06:05:16.968053+0000","last_peered":"2024-09-17T06:05:16.968053+0000","last_clean":"2024-09-17T06:05:16.968053+0000","last_became_active":"2024-09-17T06:05:06.871970+0000","last_became_peered":"2024-09-17T06:05:06.871970+0000","last_unstale":"2024-09-17T06:05:16.968053+0000","last_undegraded":"2024-09-17T06:05:16.968053+0000","last_fullsized":"2024-09-17T06:05:16.968053+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:51.766378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.967961+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:05:16.967961+0000","last_peered":"2024-09-17T06:05:16.967961+0000","last_clean":"2024-09-17T06:05:16.967961+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:05:16.967961+0000","last_undegraded":"2024-09-17T06:05:16.967961+0000","last_fullsized":"2024-09-17T06:05:16.967961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.969362+0000","last_change":"2024-09-17T06:04:13.048882+0000","last_active":"2024-09-17T06:05:16.969362+0000","last_peered":"2024-09-17T06:05:16.969362+0000","last_clean":"2024-09-17T06:05:16.969362+0000","last_became_active":"2024-09-17T06:04:13.047684+0000","last_became_peered":"2024-09-17T06:04:13.047684+0000","last_unstale":"2024-09-17T06:05:16.969362+0000","last_undegraded":"2024-09-17T06:05:16.969362+0000","last_fullsized":"2024-09-17T06:05:16.969362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:21.270772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.350177+0000","last_change":"2024-09-17T06:04:08.838033+0000","last_active":"2024-09-17T06:05:15.350177+0000","last_peered":"2024-09-17T06:05:15.350177+0000","last_clean":"2024-09-17T06:05:15.350177+0000","last_became_active":"2024-09-17T06:04:08.836402+0000","last_became_peered":"2024-09-17T06:04:08.836402+0000","last_unstale":"2024-09-17T06:05:15.350177+0000","last_undegraded":"2024-09-17T06:05:15.350177+0000","last_fullsized":"2024-09-17T06:05:15.350177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:12.374198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.808634+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:05:16.808634+0000","last_peered":"2024-09-17T06:05:16.808634+0000","last_clean":"2024-09-17T06:05:16.808634+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:05:16.808634+0000","last_undegraded":"2024-09-17T06:05:16.808634+0000","last_fullsized":"2024-09-17T06:05:16.808634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.350424+0000","last_change":"2024-09-17T06:04:12.949288+0000","last_active":"2024-09-17T06:05:15.350424+0000","last_peered":"2024-09-17T06:05:15.350424+0000","last_clean":"2024-09-17T06:05:15.350424+0000","last_became_active":"2024-09-17T06:04:12.947997+0000","last_became_peered":"2024-09-17T06:04:12.947997+0000","last_unstale":"2024-09-17T06:05:15.350424+0000","last_undegraded":"2024-09-17T06:05:15.350424+0000","last_fullsized":"2024-09-17T06:05:15.350424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164628+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:05:17.164628+0000","last_peered":"2024-09-17T06:05:17.164628+0000","last_clean":"2024-09-17T06:05:17.164628+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:05:17.164628+0000","last_undegraded":"2024-09-17T06:05:17.164628+0000","last_fullsized":"2024-09-17T06:05:17.164628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.463557+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:05:15.463557+0000","last_peered":"2024-09-17T06:05:15.463557+0000","last_clean":"2024-09-17T06:05:15.463557+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:05:15.463557+0000","last_undegraded":"2024-09-17T06:05:15.463557+0000","last_fullsized":"2024-09-17T06:05:15.463557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.349712+0000","last_change":"2024-09-17T06:04:13.039804+0000","last_active":"2024-09-17T06:05:15.349712+0000","last_peered":"2024-09-17T06:05:15.349712+0000","last_clean":"2024-09-17T06:05:15.349712+0000","last_became_active":"2024-09-17T06:04:13.038212+0000","last_became_peered":"2024-09-17T06:04:13.038212+0000","last_unstale":"2024-09-17T06:05:15.349712+0000","last_undegraded":"2024-09-17T06:05:15.349712+0000","last_fullsized":"2024-09-17T06:05:15.349712+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:35.798927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809154+0000","last_change":"2024-09-17T06:05:06.893871+0000","last_active":"2024-09-17T06:05:16.809154+0000","last_peered":"2024-09-17T06:05:16.809154+0000","last_clean":"2024-09-17T06:05:16.809154+0000","last_became_active":"2024-09-17T06:05:06.887637+0000","last_became_peered":"2024-09-17T06:05:06.887637+0000","last_unstale":"2024-09-17T06:05:16.809154+0000","last_undegraded":"2024-09-17T06:05:16.809154+0000","last_fullsized":"2024-09-17T06:05:16.809154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:54.871040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"29'3","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.969343+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:05:16.969343+0000","last_peered":"2024-09-17T06:05:16.969343+0000","last_clean":"2024-09-17T06:05:16.969343+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:05:16.969343+0000","last_undegraded":"2024-09-17T06:05:16.969343+0000","last_fullsized":"2024-09-17T06:05:16.969343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.808420+0000","last_change":"2024-09-17T06:05:06.896192+0000","last_active":"2024-09-17T06:05:16.808420+0000","last_peered":"2024-09-17T06:05:16.808420+0000","last_clean":"2024-09-17T06:05:16.808420+0000","last_became_active":"2024-09-17T06:05:06.893344+0000","last_became_peered":"2024-09-17T06:05:06.893344+0000","last_unstale":"2024-09-17T06:05:16.808420+0000","last_undegraded":"2024-09-17T06:05:16.808420+0000","last_fullsized":"2024-09-17T06:05:16.808420+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:44.907263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.968583+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:05:16.968583+0000","last_peered":"2024-09-17T06:05:16.968583+0000","last_clean":"2024-09-17T06:05:16.968583+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:05:16.968583+0000","last_undegraded":"2024-09-17T06:05:16.968583+0000","last_fullsized":"2024-09-17T06:05:16.968583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.810159+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:05:16.810159+0000","last_peered":"2024-09-17T06:05:16.810159+0000","last_clean":"2024-09-17T06:05:16.810159+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:05:16.810159+0000","last_undegraded":"2024-09-17T06:05:16.810159+0000","last_fullsized":"2024-09-17T06:05:16.810159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.162854+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:05:17.162854+0000","last_peered":"2024-09-17T06:05:17.162854+0000","last_clean":"2024-09-17T06:05:17.162854+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:05:17.162854+0000","last_undegraded":"2024-09-17T06:05:17.162854+0000","last_fullsized":"2024-09-17T06:05:17.162854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836534+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:05:15.836534+0000","last_peered":"2024-09-17T06:05:15.836534+0000","last_clean":"2024-09-17T06:05:15.836534+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:05:15.836534+0000","last_undegraded":"2024-09-17T06:05:15.836534+0000","last_fullsized":"2024-09-17T06:05:15.836534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.968682+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:05:16.968682+0000","last_peered":"2024-09-17T06:05:16.968682+0000","last_clean":"2024-09-17T06:05:16.968682+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:05:16.968682+0000","last_undegraded":"2024-09-17T06:05:16.968682+0000","last_fullsized":"2024-09-17T06:05:16.968682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.967621+0000","last_change":"2024-09-17T06:04:12.942301+0000","last_active":"2024-09-17T06:05:16.967621+0000","last_peered":"2024-09-17T06:05:16.967621+0000","last_clean":"2024-09-17T06:05:16.967621+0000","last_became_active":"2024-09-17T06:04:12.941640+0000","last_became_peered":"2024-09-17T06:04:12.941640+0000","last_unstale":"2024-09-17T06:05:16.967621+0000","last_undegraded":"2024-09-17T06:05:16.967621+0000","last_fullsized":"2024-09-17T06:05:16.967621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:31.464700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.350614+0000","last_change":"2024-09-17T06:04:08.838642+0000","last_active":"2024-09-17T06:05:15.350614+0000","last_peered":"2024-09-17T06:05:15.350614+0000","last_clean":"2024-09-17T06:05:15.350614+0000","last_became_active":"2024-09-17T06:04:08.835562+0000","last_became_peered":"2024-09-17T06:04:08.835562+0000","last_unstale":"2024-09-17T06:05:15.350614+0000","last_undegraded":"2024-09-17T06:05:15.350614+0000","last_fullsized":"2024-09-17T06:05:15.350614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:16.900376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836298+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:05:15.836298+0000","last_peered":"2024-09-17T06:05:15.836298+0000","last_clean":"2024-09-17T06:05:15.836298+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:05:15.836298+0000","last_undegraded":"2024-09-17T06:05:15.836298+0000","last_fullsized":"2024-09-17T06:05:15.836298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.967483+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:05:16.967483+0000","last_peered":"2024-09-17T06:05:16.967483+0000","last_clean":"2024-09-17T06:05:16.967483+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:05:16.967483+0000","last_undegraded":"2024-09-17T06:05:16.967483+0000","last_fullsized":"2024-09-17T06:05:16.967483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.968226+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:05:16.968226+0000","last_peered":"2024-09-17T06:05:16.968226+0000","last_clean":"2024-09-17T06:05:16.968226+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:05:16.968226+0000","last_undegraded":"2024-09-17T06:05:16.968226+0000","last_fullsized":"2024-09-17T06:05:16.968226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.356571+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:05:16.356571+0000","last_peered":"2024-09-17T06:05:16.356571+0000","last_clean":"2024-09-17T06:05:16.356571+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:05:16.356571+0000","last_undegraded":"2024-09-17T06:05:16.356571+0000","last_fullsized":"2024-09-17T06:05:16.356571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.967523+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:05:16.967523+0000","last_peered":"2024-09-17T06:05:16.967523+0000","last_clean":"2024-09-17T06:05:16.967523+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:05:16.967523+0000","last_undegraded":"2024-09-17T06:05:16.967523+0000","last_fullsized":"2024-09-17T06:05:16.967523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.163773+0000","last_change":"2024-09-17T06:04:08.840359+0000","last_active":"2024-09-17T06:05:17.163773+0000","last_peered":"2024-09-17T06:05:17.163773+0000","last_clean":"2024-09-17T06:05:17.163773+0000","last_became_active":"2024-09-17T06:04:08.839822+0000","last_became_peered":"2024-09-17T06:04:08.839822+0000","last_unstale":"2024-09-17T06:05:17.163773+0000","last_undegraded":"2024-09-17T06:05:17.163773+0000","last_fullsized":"2024-09-17T06:05:17.163773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.808790+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:05:16.808790+0000","last_peered":"2024-09-17T06:05:16.808790+0000","last_clean":"2024-09-17T06:05:16.808790+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:05:16.808790+0000","last_undegraded":"2024-09-17T06:05:16.808790+0000","last_fullsized":"2024-09-17T06:05:16.808790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.163108+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:05:17.163108+0000","last_peered":"2024-09-17T06:05:17.163108+0000","last_clean":"2024-09-17T06:05:17.163108+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:05:17.163108+0000","last_undegraded":"2024-09-17T06:05:17.163108+0000","last_fullsized":"2024-09-17T06:05:17.163108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.967842+0000","last_change":"2024-09-17T06:05:06.871787+0000","last_active":"2024-09-17T06:05:16.967842+0000","last_peered":"2024-09-17T06:05:16.967842+0000","last_clean":"2024-09-17T06:05:16.967842+0000","last_became_active":"2024-09-17T06:05:06.871397+0000","last_became_peered":"2024-09-17T06:05:06.871397+0000","last_unstale":"2024-09-17T06:05:16.967842+0000","last_undegraded":"2024-09-17T06:05:16.967842+0000","last_fullsized":"2024-09-17T06:05:16.967842+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:12.512457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836123+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:05:15.836123+0000","last_peered":"2024-09-17T06:05:15.836123+0000","last_clean":"2024-09-17T06:05:15.836123+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:05:15.836123+0000","last_undegraded":"2024-09-17T06:05:15.836123+0000","last_fullsized":"2024-09-17T06:05:15.836123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":146,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809196+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:05:16.809196+0000","last_peered":"2024-09-17T06:05:16.809196+0000","last_clean":"2024-09-17T06:05:16.809196+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:05:16.809196+0000","last_undegraded":"2024-09-17T06:05:16.809196+0000","last_fullsized":"2024-09-17T06:05:16.809196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.463531+0000","last_change":"2024-09-17T06:04:13.042118+0000","last_active":"2024-09-17T06:05:15.463531+0000","last_peered":"2024-09-17T06:05:15.463531+0000","last_clean":"2024-09-17T06:05:15.463531+0000","last_became_active":"2024-09-17T06:04:13.040403+0000","last_became_peered":"2024-09-17T06:04:13.040403+0000","last_unstale":"2024-09-17T06:05:15.463531+0000","last_undegraded":"2024-09-17T06:05:15.463531+0000","last_fullsized":"2024-09-17T06:05:15.463531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:25.960320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.356789+0000","last_change":"2024-09-17T06:04:49.135526+0000","last_active":"2024-09-17T06:05:16.356789+0000","last_peered":"2024-09-17T06:05:16.356789+0000","last_clean":"2024-09-17T06:05:16.356789+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:05:16.356789+0000","last_undegraded":"2024-09-17T06:05:16.356789+0000","last_fullsized":"2024-09-17T06:05:16.356789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:45.338884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.357036+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:05:16.357036+0000","last_peered":"2024-09-17T06:05:16.357036+0000","last_clean":"2024-09-17T06:05:16.357036+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:05:16.357036+0000","last_undegraded":"2024-09-17T06:05:16.357036+0000","last_fullsized":"2024-09-17T06:05:16.357036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.462383+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:05:15.462383+0000","last_peered":"2024-09-17T06:05:15.462383+0000","last_clean":"2024-09-17T06:05:15.462383+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:05:15.462383+0000","last_undegraded":"2024-09-17T06:05:15.462383+0000","last_fullsized":"2024-09-17T06:05:15.462383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836514+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:05:15.836514+0000","last_peered":"2024-09-17T06:05:15.836514+0000","last_clean":"2024-09-17T06:05:15.836514+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:05:15.836514+0000","last_undegraded":"2024-09-17T06:05:15.836514+0000","last_fullsized":"2024-09-17T06:05:15.836514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.968998+0000","last_change":"2024-09-17T06:04:07.833230+0000","last_active":"2024-09-17T06:05:16.968998+0000","last_peered":"2024-09-17T06:05:16.968998+0000","last_clean":"2024-09-17T06:05:16.968998+0000","last_became_active":"2024-09-17T06:04:07.832307+0000","last_became_peered":"2024-09-17T06:04:07.832307+0000","last_unstale":"2024-09-17T06:05:16.968998+0000","last_undegraded":"2024-09-17T06:05:16.968998+0000","last_fullsized":"2024-09-17T06:05:16.968998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:15.843465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.162662+0000","last_change":"2024-09-17T06:04:12.934060+0000","last_active":"2024-09-17T06:05:17.162662+0000","last_peered":"2024-09-17T06:05:17.162662+0000","last_clean":"2024-09-17T06:05:17.162662+0000","last_became_active":"2024-09-17T06:04:12.933545+0000","last_became_peered":"2024-09-17T06:04:12.933545+0000","last_unstale":"2024-09-17T06:05:17.162662+0000","last_undegraded":"2024-09-17T06:05:17.162662+0000","last_fullsized":"2024-09-17T06:05:17.162662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:29.393815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809775+0000","last_change":"2024-09-17T06:04:08.851525+0000","last_active":"2024-09-17T06:05:16.809775+0000","last_peered":"2024-09-17T06:05:16.809775+0000","last_clean":"2024-09-17T06:05:16.809775+0000","last_became_active":"2024-09-17T06:04:08.851117+0000","last_became_peered":"2024-09-17T06:04:08.851117+0000","last_unstale":"2024-09-17T06:05:16.809775+0000","last_undegraded":"2024-09-17T06:05:16.809775+0000","last_fullsized":"2024-09-17T06:05:16.809775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:53.071703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.356846+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:05:16.356846+0000","last_peered":"2024-09-17T06:05:16.356846+0000","last_clean":"2024-09-17T06:05:16.356846+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:05:16.356846+0000","last_undegraded":"2024-09-17T06:05:16.356846+0000","last_fullsized":"2024-09-17T06:05:16.356846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.835680+0000","last_change":"2024-09-17T06:04:13.042590+0000","last_active":"2024-09-17T06:05:15.835680+0000","last_peered":"2024-09-17T06:05:15.835680+0000","last_clean":"2024-09-17T06:05:15.835680+0000","last_became_active":"2024-09-17T06:04:13.041078+0000","last_became_peered":"2024-09-17T06:04:13.041078+0000","last_unstale":"2024-09-17T06:05:15.835680+0000","last_undegraded":"2024-09-17T06:05:15.835680+0000","last_fullsized":"2024-09-17T06:05:15.835680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:07:59.532402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809375+0000","last_change":"2024-09-17T06:04:08.848046+0000","last_active":"2024-09-17T06:05:16.809375+0000","last_peered":"2024-09-17T06:05:16.809375+0000","last_clean":"2024-09-17T06:05:16.809375+0000","last_became_active":"2024-09-17T06:04:08.847664+0000","last_became_peered":"2024-09-17T06:04:08.847664+0000","last_unstale":"2024-09-17T06:05:16.809375+0000","last_undegraded":"2024-09-17T06:05:16.809375+0000","last_fullsized":"2024-09-17T06:05:16.809375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:12.579790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.350494+0000","last_change":"2024-09-17T06:04:07.841655+0000","last_active":"2024-09-17T06:05:15.350494+0000","last_peered":"2024-09-17T06:05:15.350494+0000","last_clean":"2024-09-17T06:05:15.350494+0000","last_became_active":"2024-09-17T06:04:07.840432+0000","last_became_peered":"2024-09-17T06:04:07.840432+0000","last_unstale":"2024-09-17T06:05:15.350494+0000","last_undegraded":"2024-09-17T06:05:15.350494+0000","last_fullsized":"2024-09-17T06:05:15.350494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:04.523110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.349588+0000","last_change":"2024-09-17T06:04:12.955760+0000","last_active":"2024-09-17T06:05:15.349588+0000","last_peered":"2024-09-17T06:05:15.349588+0000","last_clean":"2024-09-17T06:05:15.349588+0000","last_became_active":"2024-09-17T06:04:12.954977+0000","last_became_peered":"2024-09-17T06:04:12.954977+0000","last_unstale":"2024-09-17T06:05:15.349588+0000","last_undegraded":"2024-09-17T06:05:15.349588+0000","last_fullsized":"2024-09-17T06:05:15.349588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:19.737903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.808841+0000","last_change":"2024-09-17T06:04:08.849143+0000","last_active":"2024-09-17T06:05:16.808841+0000","last_peered":"2024-09-17T06:05:16.808841+0000","last_clean":"2024-09-17T06:05:16.808841+0000","last_became_active":"2024-09-17T06:04:08.848740+0000","last_became_peered":"2024-09-17T06:04:08.848740+0000","last_unstale":"2024-09-17T06:05:16.808841+0000","last_undegraded":"2024-09-17T06:05:16.808841+0000","last_fullsized":"2024-09-17T06:05:16.808841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:17.570362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.356567+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:05:16.356567+0000","last_peered":"2024-09-17T06:05:16.356567+0000","last_clean":"2024-09-17T06:05:16.356567+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:05:16.356567+0000","last_undegraded":"2024-09-17T06:05:16.356567+0000","last_fullsized":"2024-09-17T06:05:16.356567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.163292+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:05:17.163292+0000","last_peered":"2024-09-17T06:05:17.163292+0000","last_clean":"2024-09-17T06:05:17.163292+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:05:17.163292+0000","last_undegraded":"2024-09-17T06:05:17.163292+0000","last_fullsized":"2024-09-17T06:05:17.163292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.462737+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:05:15.462737+0000","last_peered":"2024-09-17T06:05:15.462737+0000","last_clean":"2024-09-17T06:05:15.462737+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:05:15.462737+0000","last_undegraded":"2024-09-17T06:05:15.462737+0000","last_fullsized":"2024-09-17T06:05:15.462737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.462559+0000","last_change":"2024-09-17T06:04:07.849633+0000","last_active":"2024-09-17T06:05:15.462559+0000","last_peered":"2024-09-17T06:05:15.462559+0000","last_clean":"2024-09-17T06:05:15.462559+0000","last_became_active":"2024-09-17T06:04:07.848323+0000","last_became_peered":"2024-09-17T06:04:07.848323+0000","last_unstale":"2024-09-17T06:05:15.462559+0000","last_undegraded":"2024-09-17T06:05:15.462559+0000","last_fullsized":"2024-09-17T06:05:15.462559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:35.923589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809973+0000","last_change":"2024-09-17T06:05:06.897053+0000","last_active":"2024-09-17T06:05:16.809973+0000","last_peered":"2024-09-17T06:05:16.809973+0000","last_clean":"2024-09-17T06:05:16.809973+0000","last_became_active":"2024-09-17T06:05:06.894822+0000","last_became_peered":"2024-09-17T06:05:06.894822+0000","last_unstale":"2024-09-17T06:05:16.809973+0000","last_undegraded":"2024-09-17T06:05:16.809973+0000","last_fullsized":"2024-09-17T06:05:16.809973+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:39.031197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809535+0000","last_change":"2024-09-17T06:04:08.848113+0000","last_active":"2024-09-17T06:05:16.809535+0000","last_peered":"2024-09-17T06:05:16.809535+0000","last_clean":"2024-09-17T06:05:16.809535+0000","last_became_active":"2024-09-17T06:04:08.847695+0000","last_became_peered":"2024-09-17T06:04:08.847695+0000","last_unstale":"2024-09-17T06:05:16.809535+0000","last_undegraded":"2024-09-17T06:05:16.809535+0000","last_fullsized":"2024-09-17T06:05:16.809535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:21.258775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836205+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:05:15.836205+0000","last_peered":"2024-09-17T06:05:15.836205+0000","last_clean":"2024-09-17T06:05:15.836205+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:05:15.836205+0000","last_undegraded":"2024-09-17T06:05:15.836205+0000","last_fullsized":"2024-09-17T06:05:15.836205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.968434+0000","last_change":"2024-09-17T06:05:07.036279+0000","last_active":"2024-09-17T06:05:16.968434+0000","last_peered":"2024-09-17T06:05:16.968434+0000","last_clean":"2024-09-17T06:05:16.968434+0000","last_became_active":"2024-09-17T06:05:07.035687+0000","last_became_peered":"2024-09-17T06:05:07.035687+0000","last_unstale":"2024-09-17T06:05:16.968434+0000","last_undegraded":"2024-09-17T06:05:16.968434+0000","last_fullsized":"2024-09-17T06:05:16.968434+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:47.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164309+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:05:17.164309+0000","last_peered":"2024-09-17T06:05:17.164309+0000","last_clean":"2024-09-17T06:05:17.164309+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:05:17.164309+0000","last_undegraded":"2024-09-17T06:05:17.164309+0000","last_fullsized":"2024-09-17T06:05:17.164309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164551+0000","last_change":"2024-09-17T06:04:07.837797+0000","last_active":"2024-09-17T06:05:17.164551+0000","last_peered":"2024-09-17T06:05:17.164551+0000","last_clean":"2024-09-17T06:05:17.164551+0000","last_became_active":"2024-09-17T06:04:07.837347+0000","last_became_peered":"2024-09-17T06:04:07.837347+0000","last_unstale":"2024-09-17T06:05:17.164551+0000","last_undegraded":"2024-09-17T06:05:17.164551+0000","last_fullsized":"2024-09-17T06:05:17.164551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836550+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:05:15.836550+0000","last_peered":"2024-09-17T06:05:15.836550+0000","last_clean":"2024-09-17T06:05:15.836550+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:05:15.836550+0000","last_undegraded":"2024-09-17T06:05:15.836550+0000","last_fullsized":"2024-09-17T06:05:15.836550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809519+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:05:16.809519+0000","last_peered":"2024-09-17T06:05:16.809519+0000","last_clean":"2024-09-17T06:05:16.809519+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:05:16.809519+0000","last_undegraded":"2024-09-17T06:05:16.809519+0000","last_fullsized":"2024-09-17T06:05:16.809519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'13","reported_seq":63,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.463110+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:05:15.463110+0000","last_peered":"2024-09-17T06:05:15.463110+0000","last_clean":"2024-09-17T06:05:15.463110+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:05:15.463110+0000","last_undegraded":"2024-09-17T06:05:15.463110+0000","last_fullsized":"2024-09-17T06:05:15.463110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7968,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.967431+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:05:16.967431+0000","last_peered":"2024-09-17T06:05:16.967431+0000","last_clean":"2024-09-17T06:05:16.967431+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:05:16.967431+0000","last_undegraded":"2024-09-17T06:05:16.967431+0000","last_fullsized":"2024-09-17T06:05:16.967431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.351087+0000","last_change":"2024-09-17T06:04:08.842243+0000","last_active":"2024-09-17T06:05:15.351087+0000","last_peered":"2024-09-17T06:05:15.351087+0000","last_clean":"2024-09-17T06:05:15.351087+0000","last_became_active":"2024-09-17T06:04:08.841831+0000","last_became_peered":"2024-09-17T06:04:08.841831+0000","last_unstale":"2024-09-17T06:05:15.351087+0000","last_undegraded":"2024-09-17T06:05:15.351087+0000","last_fullsized":"2024-09-17T06:05:15.351087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:47.589819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.968856+0000","last_change":"2024-09-17T06:04:07.852382+0000","last_active":"2024-09-17T06:05:16.968856+0000","last_peered":"2024-09-17T06:05:16.968856+0000","last_clean":"2024-09-17T06:05:16.968856+0000","last_became_active":"2024-09-17T06:04:07.851954+0000","last_became_peered":"2024-09-17T06:04:07.851954+0000","last_unstale":"2024-09-17T06:05:16.968856+0000","last_undegraded":"2024-09-17T06:05:16.968856+0000","last_fullsized":"2024-09-17T06:05:16.968856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.350447+0000","last_change":"2024-09-17T06:04:12.942425+0000","last_active":"2024-09-17T06:05:15.350447+0000","last_peered":"2024-09-17T06:05:15.350447+0000","last_clean":"2024-09-17T06:05:15.350447+0000","last_became_active":"2024-09-17T06:04:12.937463+0000","last_became_peered":"2024-09-17T06:04:12.937463+0000","last_unstale":"2024-09-17T06:05:15.350447+0000","last_undegraded":"2024-09-17T06:05:15.350447+0000","last_fullsized":"2024-09-17T06:05:15.350447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:21.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164928+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:05:17.164928+0000","last_peered":"2024-09-17T06:05:17.164928+0000","last_clean":"2024-09-17T06:05:17.164928+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:05:17.164928+0000","last_undegraded":"2024-09-17T06:05:17.164928+0000","last_fullsized":"2024-09-17T06:05:17.164928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836898+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:05:15.836898+0000","last_peered":"2024-09-17T06:05:15.836898+0000","last_clean":"2024-09-17T06:05:15.836898+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:05:15.836898+0000","last_undegraded":"2024-09-17T06:05:15.836898+0000","last_fullsized":"2024-09-17T06:05:15.836898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.967914+0000","last_change":"2024-09-17T06:05:06.887337+0000","last_active":"2024-09-17T06:05:16.967914+0000","last_peered":"2024-09-17T06:05:16.967914+0000","last_clean":"2024-09-17T06:05:16.967914+0000","last_became_active":"2024-09-17T06:05:06.886748+0000","last_became_peered":"2024-09-17T06:05:06.886748+0000","last_unstale":"2024-09-17T06:05:16.967914+0000","last_undegraded":"2024-09-17T06:05:16.967914+0000","last_fullsized":"2024-09-17T06:05:16.967914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:11.618155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836753+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:05:15.836753+0000","last_peered":"2024-09-17T06:05:15.836753+0000","last_clean":"2024-09-17T06:05:15.836753+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:05:15.836753+0000","last_undegraded":"2024-09-17T06:05:15.836753+0000","last_fullsized":"2024-09-17T06:05:15.836753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.463407+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:05:15.463407+0000","last_peered":"2024-09-17T06:05:15.463407+0000","last_clean":"2024-09-17T06:05:15.463407+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:05:15.463407+0000","last_undegraded":"2024-09-17T06:05:15.463407+0000","last_fullsized":"2024-09-17T06:05:15.463407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.808402+0000","last_change":"2024-09-17T06:05:06.899365+0000","last_active":"2024-09-17T06:05:16.808402+0000","last_peered":"2024-09-17T06:05:16.808402+0000","last_clean":"2024-09-17T06:05:16.808402+0000","last_became_active":"2024-09-17T06:05:06.895536+0000","last_became_peered":"2024-09-17T06:05:06.895536+0000","last_unstale":"2024-09-17T06:05:16.808402+0000","last_undegraded":"2024-09-17T06:05:16.808402+0000","last_fullsized":"2024-09-17T06:05:16.808402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:39.702360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.163481+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:05:17.163481+0000","last_peered":"2024-09-17T06:05:17.163481+0000","last_clean":"2024-09-17T06:05:17.163481+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:05:17.163481+0000","last_undegraded":"2024-09-17T06:05:17.163481+0000","last_fullsized":"2024-09-17T06:05:17.163481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.967817+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:05:16.967817+0000","last_peered":"2024-09-17T06:05:16.967817+0000","last_clean":"2024-09-17T06:05:16.967817+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:05:16.967817+0000","last_undegraded":"2024-09-17T06:05:16.967817+0000","last_fullsized":"2024-09-17T06:05:16.967817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.835945+0000","last_change":"2024-09-17T06:04:07.857398+0000","last_active":"2024-09-17T06:05:15.835945+0000","last_peered":"2024-09-17T06:05:15.835945+0000","last_clean":"2024-09-17T06:05:15.835945+0000","last_became_active":"2024-09-17T06:04:07.856866+0000","last_became_peered":"2024-09-17T06:04:07.856866+0000","last_unstale":"2024-09-17T06:05:15.835945+0000","last_undegraded":"2024-09-17T06:05:15.835945+0000","last_fullsized":"2024-09-17T06:05:15.835945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:23.028365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.463239+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:05:15.463239+0000","last_peered":"2024-09-17T06:05:15.463239+0000","last_clean":"2024-09-17T06:05:15.463239+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:05:15.463239+0000","last_undegraded":"2024-09-17T06:05:15.463239+0000","last_fullsized":"2024-09-17T06:05:15.463239+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.163442+0000","last_change":"2024-09-17T06:05:06.872366+0000","last_active":"2024-09-17T06:05:17.163442+0000","last_peered":"2024-09-17T06:05:17.163442+0000","last_clean":"2024-09-17T06:05:17.163442+0000","last_became_active":"2024-09-17T06:05:06.872020+0000","last_became_peered":"2024-09-17T06:05:06.872020+0000","last_unstale":"2024-09-17T06:05:17.163442+0000","last_undegraded":"2024-09-17T06:05:17.163442+0000","last_fullsized":"2024-09-17T06:05:17.163442+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:28.126072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.462535+0000","last_change":"2024-09-17T06:05:06.888243+0000","last_active":"2024-09-17T06:05:15.462535+0000","last_peered":"2024-09-17T06:05:15.462535+0000","last_clean":"2024-09-17T06:05:15.462535+0000","last_became_active":"2024-09-17T06:05:06.887315+0000","last_became_peered":"2024-09-17T06:05:06.887315+0000","last_unstale":"2024-09-17T06:05:15.462535+0000","last_undegraded":"2024-09-17T06:05:15.462535+0000","last_fullsized":"2024-09-17T06:05:15.462535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:56.487460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.462637+0000","last_change":"2024-09-17T06:04:07.844255+0000","last_active":"2024-09-17T06:05:15.462637+0000","last_peered":"2024-09-17T06:05:15.462637+0000","last_clean":"2024-09-17T06:05:15.462637+0000","last_became_active":"2024-09-17T06:04:07.843380+0000","last_became_peered":"2024-09-17T06:04:07.843380+0000","last_unstale":"2024-09-17T06:05:15.462637+0000","last_undegraded":"2024-09-17T06:05:15.462637+0000","last_fullsized":"2024-09-17T06:05:15.462637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:28.720792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164446+0000","last_change":"2024-09-17T06:04:08.837656+0000","last_active":"2024-09-17T06:05:17.164446+0000","last_peered":"2024-09-17T06:05:17.164446+0000","last_clean":"2024-09-17T06:05:17.164446+0000","last_became_active":"2024-09-17T06:04:08.837157+0000","last_became_peered":"2024-09-17T06:04:08.837157+0000","last_unstale":"2024-09-17T06:05:17.164446+0000","last_undegraded":"2024-09-17T06:05:17.164446+0000","last_fullsized":"2024-09-17T06:05:17.164446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.356764+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:05:16.356764+0000","last_peered":"2024-09-17T06:05:16.356764+0000","last_clean":"2024-09-17T06:05:16.356764+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:05:16.356764+0000","last_undegraded":"2024-09-17T06:05:16.356764+0000","last_fullsized":"2024-09-17T06:05:16.356764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809764+0000","last_change":"2024-09-17T06:05:06.893564+0000","last_active":"2024-09-17T06:05:16.809764+0000","last_peered":"2024-09-17T06:05:16.809764+0000","last_clean":"2024-09-17T06:05:16.809764+0000","last_became_active":"2024-09-17T06:05:06.886434+0000","last_became_peered":"2024-09-17T06:05:06.886434+0000","last_unstale":"2024-09-17T06:05:16.809764+0000","last_undegraded":"2024-09-17T06:05:16.809764+0000","last_fullsized":"2024-09-17T06:05:16.809764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:27.114766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.350086+0000","last_change":"2024-09-17T06:04:08.831009+0000","last_active":"2024-09-17T06:05:15.350086+0000","last_peered":"2024-09-17T06:05:15.350086+0000","last_clean":"2024-09-17T06:05:15.350086+0000","last_became_active":"2024-09-17T06:04:08.830578+0000","last_became_peered":"2024-09-17T06:04:08.830578+0000","last_unstale":"2024-09-17T06:05:15.350086+0000","last_undegraded":"2024-09-17T06:05:15.350086+0000","last_fullsized":"2024-09-17T06:05:15.350086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:21.761554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836638+0000","last_change":"2024-09-17T06:05:07.037745+0000","last_active":"2024-09-17T06:05:15.836638+0000","last_peered":"2024-09-17T06:05:15.836638+0000","last_clean":"2024-09-17T06:05:15.836638+0000","last_became_active":"2024-09-17T06:05:07.036086+0000","last_became_peered":"2024-09-17T06:05:07.036086+0000","last_unstale":"2024-09-17T06:05:15.836638+0000","last_undegraded":"2024-09-17T06:05:15.836638+0000","last_fullsized":"2024-09-17T06:05:15.836638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:22.414380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.462472+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:05:15.462472+0000","last_peered":"2024-09-17T06:05:15.462472+0000","last_clean":"2024-09-17T06:05:15.462472+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:05:15.462472+0000","last_undegraded":"2024-09-17T06:05:15.462472+0000","last_fullsized":"2024-09-17T06:05:15.462472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.356510+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:05:16.356510+0000","last_peered":"2024-09-17T06:05:16.356510+0000","last_clean":"2024-09-17T06:05:16.356510+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:05:16.356510+0000","last_undegraded":"2024-09-17T06:05:16.356510+0000","last_fullsized":"2024-09-17T06:05:16.356510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836131+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:05:15.836131+0000","last_peered":"2024-09-17T06:05:15.836131+0000","last_clean":"2024-09-17T06:05:15.836131+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:05:15.836131+0000","last_undegraded":"2024-09-17T06:05:15.836131+0000","last_fullsized":"2024-09-17T06:05:15.836131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164339+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:05:17.164339+0000","last_peered":"2024-09-17T06:05:17.164339+0000","last_clean":"2024-09-17T06:05:17.164339+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:05:17.164339+0000","last_undegraded":"2024-09-17T06:05:17.164339+0000","last_fullsized":"2024-09-17T06:05:17.164339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.350905+0000","last_change":"2024-09-17T06:05:06.890673+0000","last_active":"2024-09-17T06:05:15.350905+0000","last_peered":"2024-09-17T06:05:15.350905+0000","last_clean":"2024-09-17T06:05:15.350905+0000","last_became_active":"2024-09-17T06:05:06.889615+0000","last_became_peered":"2024-09-17T06:05:06.889615+0000","last_unstale":"2024-09-17T06:05:15.350905+0000","last_undegraded":"2024-09-17T06:05:15.350905+0000","last_fullsized":"2024-09-17T06:05:15.350905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:07.275203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.968583+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:05:16.968583+0000","last_peered":"2024-09-17T06:05:16.968583+0000","last_clean":"2024-09-17T06:05:16.968583+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:05:16.968583+0000","last_undegraded":"2024-09-17T06:05:16.968583+0000","last_fullsized":"2024-09-17T06:05:16.968583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.463342+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:05:15.463342+0000","last_peered":"2024-09-17T06:05:15.463342+0000","last_clean":"2024-09-17T06:05:15.463342+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:05:15.463342+0000","last_undegraded":"2024-09-17T06:05:15.463342+0000","last_fullsized":"2024-09-17T06:05:15.463342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.350402+0000","last_change":"2024-09-17T06:05:06.888996+0000","last_active":"2024-09-17T06:05:15.350402+0000","last_peered":"2024-09-17T06:05:15.350402+0000","last_clean":"2024-09-17T06:05:15.350402+0000","last_became_active":"2024-09-17T06:05:06.888011+0000","last_became_peered":"2024-09-17T06:05:06.888011+0000","last_unstale":"2024-09-17T06:05:15.350402+0000","last_undegraded":"2024-09-17T06:05:15.350402+0000","last_fullsized":"2024-09-17T06:05:15.350402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:35.467135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.835604+0000","last_change":"2024-09-17T06:05:13.535655+0000","last_active":"2024-09-17T06:05:15.835604+0000","last_peered":"2024-09-17T06:05:15.835604+0000","last_clean":"2024-09-17T06:05:15.835604+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:05:15.835604+0000","last_undegraded":"2024-09-17T06:05:15.835604+0000","last_fullsized":"2024-09-17T06:05:15.835604+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:26.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.349837+0000","last_change":"2024-09-17T06:05:06.882423+0000","last_active":"2024-09-17T06:05:15.349837+0000","last_peered":"2024-09-17T06:05:15.349837+0000","last_clean":"2024-09-17T06:05:15.349837+0000","last_became_active":"2024-09-17T06:05:06.881541+0000","last_became_peered":"2024-09-17T06:05:06.881541+0000","last_unstale":"2024-09-17T06:05:15.349837+0000","last_undegraded":"2024-09-17T06:05:15.349837+0000","last_fullsized":"2024-09-17T06:05:15.349837+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:33.363061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836040+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:05:15.836040+0000","last_peered":"2024-09-17T06:05:15.836040+0000","last_clean":"2024-09-17T06:05:15.836040+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:05:15.836040+0000","last_undegraded":"2024-09-17T06:05:15.836040+0000","last_fullsized":"2024-09-17T06:05:15.836040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164224+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:05:17.164224+0000","last_peered":"2024-09-17T06:05:17.164224+0000","last_clean":"2024-09-17T06:05:17.164224+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:05:17.164224+0000","last_undegraded":"2024-09-17T06:05:17.164224+0000","last_fullsized":"2024-09-17T06:05:17.164224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.462985+0000","last_change":"2024-09-17T06:04:08.847877+0000","last_active":"2024-09-17T06:05:15.462985+0000","last_peered":"2024-09-17T06:05:15.462985+0000","last_clean":"2024-09-17T06:05:15.462985+0000","last_became_active":"2024-09-17T06:04:08.847538+0000","last_became_peered":"2024-09-17T06:04:08.847538+0000","last_unstale":"2024-09-17T06:05:15.462985+0000","last_undegraded":"2024-09-17T06:05:15.462985+0000","last_fullsized":"2024-09-17T06:05:15.462985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809944+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:05:16.809944+0000","last_peered":"2024-09-17T06:05:16.809944+0000","last_clean":"2024-09-17T06:05:16.809944+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:05:16.809944+0000","last_undegraded":"2024-09-17T06:05:16.809944+0000","last_fullsized":"2024-09-17T06:05:16.809944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.356828+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:05:16.356828+0000","last_peered":"2024-09-17T06:05:16.356828+0000","last_clean":"2024-09-17T06:05:16.356828+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:05:16.356828+0000","last_undegraded":"2024-09-17T06:05:16.356828+0000","last_fullsized":"2024-09-17T06:05:16.356828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.837060+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:05:15.837060+0000","last_peered":"2024-09-17T06:05:15.837060+0000","last_clean":"2024-09-17T06:05:15.837060+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:05:15.837060+0000","last_undegraded":"2024-09-17T06:05:15.837060+0000","last_fullsized":"2024-09-17T06:05:15.837060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.835808+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:05:15.835808+0000","last_peered":"2024-09-17T06:05:15.835808+0000","last_clean":"2024-09-17T06:05:15.835808+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:05:15.835808+0000","last_undegraded":"2024-09-17T06:05:15.835808+0000","last_fullsized":"2024-09-17T06:05:15.835808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.967923+0000","last_change":"2024-09-17T06:04:08.824718+0000","last_active":"2024-09-17T06:05:16.967923+0000","last_peered":"2024-09-17T06:05:16.967923+0000","last_clean":"2024-09-17T06:05:16.967923+0000","last_became_active":"2024-09-17T06:04:08.823771+0000","last_became_peered":"2024-09-17T06:04:08.823771+0000","last_unstale":"2024-09-17T06:05:16.967923+0000","last_undegraded":"2024-09-17T06:05:16.967923+0000","last_fullsized":"2024-09-17T06:05:16.967923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:53.735092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164212+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:05:17.164212+0000","last_peered":"2024-09-17T06:05:17.164212+0000","last_clean":"2024-09-17T06:05:17.164212+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:05:17.164212+0000","last_undegraded":"2024-09-17T06:05:17.164212+0000","last_fullsized":"2024-09-17T06:05:17.164212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.462804+0000","last_change":"2024-09-17T06:05:06.890222+0000","last_active":"2024-09-17T06:05:15.462804+0000","last_peered":"2024-09-17T06:05:15.462804+0000","last_clean":"2024-09-17T06:05:15.462804+0000","last_became_active":"2024-09-17T06:05:06.889365+0000","last_became_peered":"2024-09-17T06:05:06.889365+0000","last_unstale":"2024-09-17T06:05:15.462804+0000","last_undegraded":"2024-09-17T06:05:15.462804+0000","last_fullsized":"2024-09-17T06:05:15.462804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:56.140659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.351014+0000","last_change":"2024-09-17T06:04:08.845829+0000","last_active":"2024-09-17T06:05:15.351014+0000","last_peered":"2024-09-17T06:05:15.351014+0000","last_clean":"2024-09-17T06:05:15.351014+0000","last_became_active":"2024-09-17T06:04:08.845441+0000","last_became_peered":"2024-09-17T06:04:08.845441+0000","last_unstale":"2024-09-17T06:05:15.351014+0000","last_undegraded":"2024-09-17T06:05:15.351014+0000","last_fullsized":"2024-09-17T06:05:15.351014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:38.878124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.463058+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:05:15.463058+0000","last_peered":"2024-09-17T06:05:15.463058+0000","last_clean":"2024-09-17T06:05:15.463058+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:05:15.463058+0000","last_undegraded":"2024-09-17T06:05:15.463058+0000","last_fullsized":"2024-09-17T06:05:15.463058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.463330+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:05:15.463330+0000","last_peered":"2024-09-17T06:05:15.463330+0000","last_clean":"2024-09-17T06:05:15.463330+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:05:15.463330+0000","last_undegraded":"2024-09-17T06:05:15.463330+0000","last_fullsized":"2024-09-17T06:05:15.463330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809787+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:05:16.809787+0000","last_peered":"2024-09-17T06:05:16.809787+0000","last_clean":"2024-09-17T06:05:16.809787+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:05:16.809787+0000","last_undegraded":"2024-09-17T06:05:16.809787+0000","last_fullsized":"2024-09-17T06:05:16.809787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.835671+0000","last_change":"2024-09-17T06:05:06.879958+0000","last_active":"2024-09-17T06:05:15.835671+0000","last_peered":"2024-09-17T06:05:15.835671+0000","last_clean":"2024-09-17T06:05:15.835671+0000","last_became_active":"2024-09-17T06:05:06.878960+0000","last_became_peered":"2024-09-17T06:05:06.878960+0000","last_unstale":"2024-09-17T06:05:15.835671+0000","last_undegraded":"2024-09-17T06:05:15.835671+0000","last_fullsized":"2024-09-17T06:05:15.835671+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:01.600278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.808653+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:05:16.808653+0000","last_peered":"2024-09-17T06:05:16.808653+0000","last_clean":"2024-09-17T06:05:16.808653+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:05:16.808653+0000","last_undegraded":"2024-09-17T06:05:16.808653+0000","last_fullsized":"2024-09-17T06:05:16.808653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.835966+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:05:15.835966+0000","last_peered":"2024-09-17T06:05:15.835966+0000","last_clean":"2024-09-17T06:05:15.835966+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:05:15.835966+0000","last_undegraded":"2024-09-17T06:05:15.835966+0000","last_fullsized":"2024-09-17T06:05:15.835966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809178+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:05:16.809178+0000","last_peered":"2024-09-17T06:05:16.809178+0000","last_clean":"2024-09-17T06:05:16.809178+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:05:16.809178+0000","last_undegraded":"2024-09-17T06:05:16.809178+0000","last_fullsized":"2024-09-17T06:05:16.809178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:15.836304+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:05:15.836304+0000","last_peered":"2024-09-17T06:05:15.836304+0000","last_clean":"2024-09-17T06:05:15.836304+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:05:15.836304+0000","last_undegraded":"2024-09-17T06:05:15.836304+0000","last_fullsized":"2024-09-17T06:05:15.836304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:17.164030+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:05:17.164030+0000","last_peered":"2024-09-17T06:05:17.164030+0000","last_clean":"2024-09-17T06:05:17.164030+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:05:17.164030+0000","last_undegraded":"2024-09-17T06:05:17.164030+0000","last_fullsized":"2024-09-17T06:05:17.164030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.969278+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:05:16.969278+0000","last_peered":"2024-09-17T06:05:16.969278+0000","last_clean":"2024-09-17T06:05:16.969278+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:05:16.969278+0000","last_undegraded":"2024-09-17T06:05:16.969278+0000","last_fullsized":"2024-09-17T06:05:16.969278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T06:05:16.809441+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:05:16.809441+0000","last_peered":"2024-09-17T06:05:16.809441+0000","last_clean":"2024-09-17T06:05:16.809441+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:05:16.809441+0000","last_undegraded":"2024-09-17T06:05:16.809441+0000","last_fullsized":"2024-09-17T06:05:16.809441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8766,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":17532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":211919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":203951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1036288,"data_stored":787982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":794901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":211919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":204077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":438272,"data_stored":197136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":204041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:05:18.068 INFO:tasks.thrashosds.thrasher:Setting 2.15 to [5, 0] 2024-09-17T06:05:18.068 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.15', '5', '0'] 2024-09-17T06:05:18.068 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.15 5 0 2024-09-17T06:05:18.137 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:05:18.192 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:18.190+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:18.261 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:18.258+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:18.276 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:18.276 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:18.294 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:05:18.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.298+0000 7fa07d418640 1 -- 172.21.15.122:0/319539551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0780c38c0 msgr2=0x7fa0781534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.298+0000 7fa07d418640 1 --2- 172.21.15.122:0/319539551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0780c38c0 0x7fa0781534d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa068009900 tx=0x7fa06801c8e0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.298+0000 7fa07d418640 1 -- 172.21.15.122:0/319539551 shutdown_connections 2024-09-17T06:05:18.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.298+0000 7fa07d418640 1 --2- 172.21.15.122:0/319539551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0780c38c0 0x7fa0781534d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.298+0000 7fa07d418640 1 -- 172.21.15.122:0/319539551 >> 172.21.15.122:0/319539551 conn(0x7fa078070e40 msgr2=0x7fa078071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:18.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.298+0000 7fa07d418640 1 -- 172.21.15.122:0/319539551 shutdown_connections 2024-09-17T06:05:18.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.298+0000 7fa07d418640 1 -- 172.21.15.122:0/319539551 wait complete. 2024-09-17T06:05:18.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.298+0000 7fa07d418640 1 Processor -- start 2024-09-17T06:05:18.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.298+0000 7fa07d418640 1 -- start start 2024-09-17T06:05:18.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa07d418640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0780c38c0 0x7fa0780ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa07d418640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0780c4330 0x7fa0781f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa07d418640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0780cedf0 0x7fa078070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa07d418640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa07815a160 con 0x7fa0780c4330 2024-09-17T06:05:18.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa07d418640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa0780cf610 con 0x7fa0780c38c0 2024-09-17T06:05:18.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa07d418640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa0780ca2a0 con 0x7fa0780cedf0 2024-09-17T06:05:18.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa0767fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0780c4330 0x7fa0781f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa0767fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0780c4330 0x7fa0781f4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53058/0 (socket says 172.21.15.122:53058) 2024-09-17T06:05:18.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa0767fc640 1 -- 172.21.15.122:0/3226642682 learned_addr learned my addr 172.21.15.122:0/3226642682 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:18.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa076ffd640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0780c38c0 0x7fa0780ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa0777fe640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0780cedf0 0x7fa078070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa0767fc640 1 -- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0780cedf0 msgr2=0x7fa078070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa0767fc640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0780cedf0 0x7fa078070110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa0767fc640 1 -- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0780c38c0 msgr2=0x7fa0780ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa0767fc640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0780c38c0 0x7fa0780ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa0767fc640 1 -- 172.21.15.122:0/3226642682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0781f5200 con 0x7fa0780c4330 2024-09-17T06:05:18.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa0767fc640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0780c4330 0x7fa0781f4cc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c3f0 tx=0x7fa06c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:18.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa05f7fe640 1 -- 172.21.15.122:0/3226642682 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c017070 con 0x7fa0780c4330 2024-09-17T06:05:18.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa05f7fe640 1 -- 172.21.15.122:0/3226642682 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa06c003600 con 0x7fa0780c4330 2024-09-17T06:05:18.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa05f7fe640 1 -- 172.21.15.122:0/3226642682 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c003a50 con 0x7fa0780c4330 2024-09-17T06:05:18.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa07d418640 1 -- 172.21.15.122:0/3226642682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0780b00f0 con 0x7fa0780c4330 2024-09-17T06:05:18.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa07d418640 1 -- 172.21.15.122:0/3226642682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0780b06b0 con 0x7fa0780c4330 2024-09-17T06:05:18.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.302+0000 7fa07d418640 1 -- 172.21.15.122:0/3226642682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0780ae9f0 con 0x7fa0780c4330 2024-09-17T06:05:18.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.306+0000 7fa05f7fe640 1 -- 172.21.15.122:0/3226642682 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa06c01a070 con 0x7fa0780c4330 2024-09-17T06:05:18.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.306+0000 7fa05f7fe640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa064073200 0x7fa064075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.306+0000 7fa05f7fe640 1 -- 172.21.15.122:0/3226642682 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6775+0+0 (secure 0 0 0) 0x7fa06c093bf0 con 0x7fa0780c4330 2024-09-17T06:05:18.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.306+0000 7fa076ffd640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa064073200 0x7fa064075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.306+0000 7fa076ffd640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa064073200 0x7fa064075710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa0680af000 tx=0x7fa06801b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:18.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.310+0000 7fa05f7fe640 1 -- 172.21.15.122:0/3226642682 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa06c021020 con 0x7fa0780c4330 2024-09-17T06:05:18.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.310+0000 7f85f0fef640 1 -- 172.21.15.122:0/1588190397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85ec0c79f0 msgr2=0x7f85ec1533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.310+0000 7f85f0fef640 1 --2- 172.21.15.122:0/1588190397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85ec0c79f0 0x7f85ec1533f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009900 tx=0x7f85dc01c8a0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.310+0000 7f85f0fef640 1 -- 172.21.15.122:0/1588190397 shutdown_connections 2024-09-17T06:05:18.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.310+0000 7f85f0fef640 1 --2- 172.21.15.122:0/1588190397 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85ec0c8a70 0x7f85ec06dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.310+0000 7f85f0fef640 1 --2- 172.21.15.122:0/1588190397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85ec0c79f0 0x7f85ec1533f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.310+0000 7f85f0fef640 1 -- 172.21.15.122:0/1588190397 >> 172.21.15.122:0/1588190397 conn(0x7f85ec070d80 msgr2=0x7f85ec072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:18.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.310+0000 7f85f0fef640 1 -- 172.21.15.122:0/1588190397 shutdown_connections 2024-09-17T06:05:18.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.310+0000 7f85f0fef640 1 -- 172.21.15.122:0/1588190397 wait complete. 2024-09-17T06:05:18.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85f0fef640 1 Processor -- start 2024-09-17T06:05:18.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85f0fef640 1 -- start start 2024-09-17T06:05:18.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85f0fef640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85ec0c79f0 0x7f85ec1f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85f0fef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85ec0c85b0 0x7f85ec1430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85f0fef640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85ec0c8a70 0x7f85ec14ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85f0fef640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec0c5310 con 0x7f85ec0c85b0 2024-09-17T06:05:18.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85f0fef640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec0c5190 con 0x7f85ec0c8a70 2024-09-17T06:05:18.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85f0fef640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f85ec069a90 con 0x7f85ec0c79f0 2024-09-17T06:05:18.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85e9d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85ec0c85b0 0x7f85ec1430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85e9d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85ec0c85b0 0x7f85ec1430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53084/0 (socket says 172.21.15.122:53084) 2024-09-17T06:05:18.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85e9d9b640 1 -- 172.21.15.122:0/2835932960 learned_addr learned my addr 172.21.15.122:0/2835932960 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:18.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85ea59c640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85ec0c79f0 0x7f85ec1f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.314+0000 7f85ead9d640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85ec0c8a70 0x7f85ec14ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.318+0000 7f85e9d9b640 1 -- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85ec0c79f0 msgr2=0x7f85ec1f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.318+0000 7f85e9d9b640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85ec0c79f0 0x7f85ec1f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.318+0000 7f85e9d9b640 1 -- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85ec0c8a70 msgr2=0x7f85ec14ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.318+0000 7f85e9d9b640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85ec0c8a70 0x7f85ec14ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.318+0000 7f85e9d9b640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec1f6d00 con 0x7f85ec0c85b0 2024-09-17T06:05:18.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.318+0000 7f85e9d9b640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85ec0c85b0 0x7f85ec1430d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f85e000d6b0 tx=0x7f85e000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:18.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.318+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0017070 con 0x7f85ec0c85b0 2024-09-17T06:05:18.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.318+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85e0004310 con 0x7f85ec0c85b0 2024-09-17T06:05:18.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.318+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0009a80 con 0x7f85ec0c85b0 2024-09-17T06:05:18.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.318+0000 7f85f0fef640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ec15c400 con 0x7f85ec0c85b0 2024-09-17T06:05:18.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.318+0000 7f85f0fef640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ec15c6a0 con 0x7f85ec0c85b0 2024-09-17T06:05:18.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.318+0000 7f85f0fef640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f85ec1533f0 con 0x7f85ec0c85b0 2024-09-17T06:05:18.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.322+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f85e0009c20 con 0x7f85ec0c85b0 2024-09-17T06:05:18.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.322+0000 7f85daffd640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f85cc073200 0x7f85cc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.322+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6775+0+0 (secure 0 0 0) 0x7f85e00946d0 con 0x7f85ec0c85b0 2024-09-17T06:05:18.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.322+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v40) ==== 54+0+16 (secure 0 0 0) 0x7f85e009a170 con 0x7f85ec0c85b0 2024-09-17T06:05:18.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.322+0000 7f85ea59c640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f85cc073200 0x7f85cc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.322+0000 7f85f0fef640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f85ec0cb730 0x7f85ec150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.322+0000 7f85f0fef640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85ec0c4f70 con 0x7f85ec0cb730 2024-09-17T06:05:18.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.322+0000 7f85ead9d640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f85ec0cb730 0x7f85ec150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.322+0000 7f85ead9d640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f85ec0cb730 0x7f85ec150cb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:18.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.322+0000 7f85ea59c640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f85cc073200 0x7f85cc075710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0af000 tx=0x7f85dc01b140 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:18.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.322+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85ec0c4f70 con 0x7f85ec0cb730 2024-09-17T06:05:18.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.350+0000 7f85f0fef640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f85ec152b30 con 0x7f85ec0cb730 2024-09-17T06:05:18.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.354+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f85ec152b30 con 0x7f85ec0cb730 2024-09-17T06:05:18.358 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:18.359 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:18.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.354+0000 7f85f0fef640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f85ec15a8a0 0x7f85ec15acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.354+0000 7f85f0fef640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f85ec15b1f0 con 0x7f85ec15a8a0 2024-09-17T06:05:18.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.354+0000 7f85ea59c640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f85ec15a8a0 0x7f85ec15acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.354+0000 7f85ea59c640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f85ec15a8a0 0x7f85ec15acb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:18.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.358+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85ec15b1f0 con 0x7f85ec15a8a0 2024-09-17T06:05:18.361 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:18.362+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:18.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.382+0000 7f85f0fef640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f85ec0c68f0 con 0x7f85ec15a8a0 2024-09-17T06:05:18.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.386+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f85ec0c68f0 con 0x7f85ec15a8a0 2024-09-17T06:05:18.389 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:18.390 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:18.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.386+0000 7f85f0fef640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f85ec063dc0 0x7f85ec0641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.386+0000 7f85f0fef640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f85ec0c6330 con 0x7f85ec063dc0 2024-09-17T06:05:18.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.386+0000 7f85e9d9b640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f85ec063dc0 0x7f85ec0641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.386+0000 7f85e9d9b640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f85ec063dc0 0x7f85ec0641d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:18.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.386+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85ec0c6330 con 0x7f85ec063dc0 2024-09-17T06:05:18.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.414+0000 7f85f0fef640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f85ec0c6050 con 0x7f85ec063dc0 2024-09-17T06:05:18.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.418+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f85ec0c6050 con 0x7f85ec063dc0 2024-09-17T06:05:18.422 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:18.422 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:18.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.418+0000 7f85f0fef640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f85ec14b740 0x7f85ec14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.418+0000 7f85f0fef640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f85ec156510 con 0x7f85ec14b740 2024-09-17T06:05:18.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.418+0000 7f85ead9d640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f85ec14b740 0x7f85ec14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.418+0000 7f85ead9d640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f85ec14b740 0x7f85ec14bb50 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:18.423 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.418+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85ec156510 con 0x7f85ec14b740 2024-09-17T06:05:18.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.422+0000 7f71c9ffb640 1 -- 172.21.15.122:0/2458136024 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v41) ==== 91+0+0 (secure 0 0 0) 0x7f71d00164b0 con 0x7f71cc006a40 2024-09-17T06:05:18.425 INFO:teuthology.orchestra.run.smithi122.stderr:noscrub is unset 2024-09-17T06:05:18.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.430+0000 7f71bf7fe640 1 -- 172.21.15.122:0/2458136024 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f71b8073400 msgr2=0x7f71b8075910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.430+0000 7f71bf7fe640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f71b8073400 0x7f71b8075910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0d3b80 tx=0x7f71c40091e0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.430+0000 7f71bf7fe640 1 -- 172.21.15.122:0/2458136024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc006a40 msgr2=0x7f71cc0de2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.430+0000 7f71bf7fe640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc006a40 0x7f71cc0de2b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f71d00ac000 tx=0x7f71d0005700 comp rx=0 tx=0).stop 2024-09-17T06:05:18.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.430+0000 7f71bf7fe640 1 -- 172.21.15.122:0/2458136024 shutdown_connections 2024-09-17T06:05:18.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.430+0000 7f71bf7fe640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f71b8073400 0x7f71b8075910 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.430+0000 7f71bf7fe640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71cc04b8e0 0x7f71cc0cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.430+0000 7f71bf7fe640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71cc047120 0x7f71cc0cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.430+0000 7f71bf7fe640 1 --2- 172.21.15.122:0/2458136024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71cc006a40 0x7f71cc0de2b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.430+0000 7f71bf7fe640 1 -- 172.21.15.122:0/2458136024 >> 172.21.15.122:0/2458136024 conn(0x7f71cc050f60 msgr2=0x7f71cc0d5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:18.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.430+0000 7f71bf7fe640 1 -- 172.21.15.122:0/2458136024 shutdown_connections 2024-09-17T06:05:18.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.430+0000 7f71bf7fe640 1 -- 172.21.15.122:0/2458136024 wait complete. 2024-09-17T06:05:18.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.450+0000 7f85f0fef640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f85ec156510 con 0x7f85ec14b740 2024-09-17T06:05:18.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.450+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f85ec156510 con 0x7f85ec14b740 2024-09-17T06:05:18.456 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:18.456 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:18.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.454+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f85ec205bf0 0x7f85ec208010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.454+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f85ec15cb30 con 0x7f85ec205bf0 2024-09-17T06:05:18.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.458+0000 7f85ea59c640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f85ec205bf0 0x7f85ec208010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.458+0000 7f85ea59c640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f85ec205bf0 0x7f85ec208010 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:18.461 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:18.458+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:18.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.458+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85ec15cb30 con 0x7f85ec205bf0 2024-09-17T06:05:18.486 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:18.487 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:18.487 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-09-17T06:05:18.487 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:18.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.486+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f85ec15cb30 con 0x7f85ec205bf0 2024-09-17T06:05:18.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.490+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f85ec15cb30 con 0x7f85ec205bf0 2024-09-17T06:05:18.493 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:05:18.494 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:05:18.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.490+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f85ec208a60 0x7f85ec20ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.490+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f85ec15cca0 con 0x7f85ec208a60 2024-09-17T06:05:18.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.490+0000 7f85e9d9b640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f85ec208a60 0x7f85ec20ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.490+0000 7f85e9d9b640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f85ec208a60 0x7f85ec20ae80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:18.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.494+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85ec15cca0 con 0x7f85ec208a60 2024-09-17T06:05:18.510 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:05:18.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.518+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f85ec15cca0 con 0x7f85ec208a60 2024-09-17T06:05:18.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.526+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f85ec15cca0 con 0x7f85ec208a60 2024-09-17T06:05:18.528 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:18.528 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:18.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.526+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f85ec20b8d0 0x7f85ec20dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.526+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f85ec210c30 con 0x7f85ec20b8d0 2024-09-17T06:05:18.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.526+0000 7f85ead9d640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f85ec20b8d0 0x7f85ec20dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.526+0000 7f85ead9d640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f85ec20b8d0 0x7f85ec20dcf0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:18.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.526+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85ec210c30 con 0x7f85ec20b8d0 2024-09-17T06:05:18.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.554+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f85ec20f970 con 0x7f85ec20b8d0 2024-09-17T06:05:18.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.558+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f85ec20f970 con 0x7f85ec20b8d0 2024-09-17T06:05:18.562 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:18.562 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:18.563 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:18.558+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:18.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.558+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f85ec210090 0x7f85ec2104a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:18.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.558+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f85ec214000 con 0x7f85ec210090 2024-09-17T06:05:18.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.558+0000 7f85ea59c640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f85ec210090 0x7f85ec2104a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:18.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.558+0000 7f85ea59c640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f85ec210090 0x7f85ec2104a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:18.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.562+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85ec214000 con 0x7f85ec210090 2024-09-17T06:05:18.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.578+0000 7fa07d418640 1 -- 172.21.15.122:0/3226642682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pg-upmap", "pgid": "2.15", "id": [5, 0]} v 0) -- 0x7fa0780c9df0 con 0x7fa0780c4330 2024-09-17T06:05:18.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.582+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f85ec212e80 con 0x7f85ec210090 2024-09-17T06:05:18.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.586+0000 7f85daffd640 1 -- 172.21.15.122:0/2835932960 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f85ec212e80 con 0x7f85ec210090 2024-09-17T06:05:18.591 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:18.592 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.586+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f85ec0cb730 msgr2=0x7f85ec150cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.586+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f85ec0cb730 0x7f85ec150cb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f85ec15a8a0 msgr2=0x7f85ec15acb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f85ec15a8a0 0x7f85ec15acb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f85ec063dc0 msgr2=0x7f85ec0641d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f85ec063dc0 0x7f85ec0641d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f85ec14b740 msgr2=0x7f85ec14bb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f85ec14b740 0x7f85ec14bb50 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f85ec205bf0 msgr2=0x7f85ec208010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f85ec205bf0 0x7f85ec208010 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f85ec208a60 msgr2=0x7f85ec20ae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f85ec208a60 0x7f85ec20ae80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f85ec20b8d0 msgr2=0x7f85ec20dcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f85ec20b8d0 0x7f85ec20dcf0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f85ec210090 msgr2=0x7f85ec2104a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f85ec210090 0x7f85ec2104a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f85cc073200 msgr2=0x7f85cc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f85cc073200 0x7f85cc075710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0af000 tx=0x7f85dc01b140 comp rx=0 tx=0).stop 2024-09-17T06:05:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85ec0c85b0 msgr2=0x7f85ec1430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 --2- 172.21.15.122:0/2835932960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85ec0c85b0 0x7f85ec1430d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f85e000d6b0 tx=0x7f85e000db70 comp rx=0 tx=0).stop 2024-09-17T06:05:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85ead9d640 1 -- 172.21.15.122:0/2835932960 reap_dead start 2024-09-17T06:05:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85ead9d640 1 -- 172.21.15.122:0/2835932960 reap_dead start 2024-09-17T06:05:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85ead9d640 1 -- 172.21.15.122:0/2835932960 reap_dead start 2024-09-17T06:05:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85ead9d640 1 -- 172.21.15.122:0/2835932960 reap_dead start 2024-09-17T06:05:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85ead9d640 1 -- 172.21.15.122:0/2835932960 reap_dead start 2024-09-17T06:05:18.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 shutdown_connections 2024-09-17T06:05:18.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 >> 172.21.15.122:0/2835932960 conn(0x7f85ec070d80 msgr2=0x7f85ec1521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:18.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 shutdown_connections 2024-09-17T06:05:18.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:18.590+0000 7f85d8ff9640 1 -- 172.21.15.122:0/2835932960 wait complete. 2024-09-17T06:05:18.663 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:18.662+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:18.715 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:18.715 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:18.715 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 180, 2024-09-17T06:05:18.715 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-09-17T06:05:18.715 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:18.732 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:05:18.776 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:18.774+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:18.866 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:18.866+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:18.877 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.053330286999994, 2024-09-17T06:05:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044462499999999997, 2024-09-17T06:05:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823264+0000", 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3300000000000001e-06 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823284+0000", 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0132e-05 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823364+0000", 2024-09-17T06:05:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9583e-05 2024-09-17T06:05:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823395+0000", 2024-09-17T06:05:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1171999999999999e-05 2024-09-17T06:05:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823538+0000", 2024-09-17T06:05:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014286600000000001 2024-09-17T06:05:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823594+0000", 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890999999999997e-05 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827597+0000", 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004003665 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827708+0000", 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110611 2024-09-17T06:05:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.053137836000005, 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043686330000000002, 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823455+0000", 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2160000000000001e-06 2024-09-17T06:05:18.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823471+0000", 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5702999999999999e-05 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823492+0000", 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1039e-05 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823512+0000", 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0364999999999999e-05 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824294+0000", 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00078187600000000003 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824350+0000", 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5367e-05 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827719+0000", 2024-09-17T06:05:18.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003368916 2024-09-17T06:05:18.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827823+0000", 2024-09-17T06:05:18.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104151 2024-09-17T06:05:18.886 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.886 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.886 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.052577056999993, 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0094234149999999992, 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824018+0000", 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3629999999999998e-06 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824036+0000", 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7606000000000001e-05 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824065+0000", 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9005000000000001e-05 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824092+0000", 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7396e-05 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826491+0000", 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002398776 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826804+0000", 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000312782 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833438+0000", 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066344869999999997 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.890 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.052507074000005, 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048433540000000002, 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:18.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:18.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824087+0000", 2024-09-17T06:05:18.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1830000000000001e-06 2024-09-17T06:05:18.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824106+0000", 2024-09-17T06:05:18.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8595999999999999e-05 2024-09-17T06:05:18.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824137+0000", 2024-09-17T06:05:18.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1322000000000003e-05 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824164+0000", 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6605e-05 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824807+0000", 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064339900000000001 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824861+0000", 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3687000000000003e-05 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828809+0000", 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039483909999999999 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828928+0000", 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119171 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.895 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.896 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:18.896 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:18.896 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.052426405000006, 2024-09-17T06:05:18.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092145760000000004, 2024-09-17T06:05:18.896 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.896 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.896 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:18.896 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:18.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:18.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824167+0000", 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7540000000000001e-06 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824178+0000", 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0276e-05 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824202+0000", 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4685000000000002e-05 2024-09-17T06:05:18.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824223+0000", 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1036e-05 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825070+0000", 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084684500000000004 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825392+0000", 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032213499999999998 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833380+0000", 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079878450000000004 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:18.900 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.051421473999994, 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038480469999999998, 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825172+0000", 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.967e-06 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825190+0000", 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7866000000000001e-05 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825217+0000", 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6682e-05 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825239+0000", 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1968999999999999e-05 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825632+0000", 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00039355100000000001 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825690+0000", 2024-09-17T06:05:18.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7797000000000002e-05 2024-09-17T06:05:18.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828935+0000", 2024-09-17T06:05:18.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032449449999999999 2024-09-17T06:05:18.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829018+0000", 2024-09-17T06:05:18.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3269999999999994e-05 2024-09-17T06:05:18.905 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.905 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.905 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.905 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.050366971000003, 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002834755, 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826227+0000", 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.906e-06 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826256+0000", 2024-09-17T06:05:18.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8872000000000001e-05 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826399+0000", 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143156 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826453+0000", 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4465000000000001e-05 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826628+0000", 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017420700000000001 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829060+0000", 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024321490000000002 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:18.909 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.048616339999995, 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055191049999999998, 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827978+0000", 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0200000000000001e-06 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827997+0000", 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9836000000000001e-05 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828029+0000", 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1720999999999997e-05 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828055+0000", 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5519000000000001e-05 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828193+0000", 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013821699999999999 2024-09-17T06:05:18.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828232+0000", 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9351000000000003e-05 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833396+0000", 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051640119999999999 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833495+0000", 2024-09-17T06:05:18.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8429000000000002e-05 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.048490799000007, 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054928850000000003, 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828102+0000", 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-06 2024-09-17T06:05:18.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828116+0000", 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3716e-05 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828139+0000", 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3028999999999999e-05 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828156+0000", 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869000000000001e-05 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829124+0000", 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096778700000000001 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829158+0000", 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4671000000000001e-05 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833509+0000", 2024-09-17T06:05:18.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004350802 2024-09-17T06:05:18.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833594+0000", 2024-09-17T06:05:18.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4814999999999993e-05 2024-09-17T06:05:18.918 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.918 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.918 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.043739574, 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064859200000000003, 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832854+0000", 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8330000000000001e-06 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832867+0000", 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.332e-05 2024-09-17T06:05:18.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832906+0000", 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8800999999999997e-05 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6468000000000003e-05 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833094+0000", 2024-09-17T06:05:18.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014082600000000001 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833501+0000", 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040734400000000002 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:18.922 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.043642769000002, 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00050376900000000005, 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:18.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832952+0000", 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4269999999999998e-06 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832965+0000", 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3736e-05 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832998+0000", 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2264999999999997e-05 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833027+0000", 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9658999999999998e-05 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833172+0000", 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014431900000000001 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833453+0000", 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028136300000000002 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.041645833000004, 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00294042, 2024-09-17T06:05:18.926 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834948+0000", 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.21e-06 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834968+0000", 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9443e-05 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835013+0000", 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5324000000000002e-05 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835038+0000", 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5358999999999999e-05 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835255+0000", 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021677600000000001 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835304+0000", 2024-09-17T06:05:18.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9261000000000002e-05 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837761+0000", 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024567230000000001 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837886+0000", 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012532400000000001 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 58.277734477000003, 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001082132, 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598860+0000", 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4569999999999999e-06 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598901+0000", 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1400999999999999e-05 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598934+0000", 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3012000000000002e-05 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598959+0000", 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4839000000000001e-05 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599073+0000", 2024-09-17T06:05:18.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113763 2024-09-17T06:05:18.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599099+0000", 2024-09-17T06:05:18.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6120999999999999e-05 2024-09-17T06:05:18.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599900+0000", 2024-09-17T06:05:18.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00080140099999999998 2024-09-17T06:05:18.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599940+0000", 2024-09-17T06:05:18.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9137999999999997e-05 2024-09-17T06:05:18.935 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.936 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.936 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.936 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-17T06:05:18.936 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:18.936 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.557086566000002, 2024-09-17T06:05:18.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00153148, 2024-09-17T06:05:18.936 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.937 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.937 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.937 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319508+0000", 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5399999999999998e-06 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319533+0000", 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4759000000000001e-05 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319568+0000", 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5305000000000002e-05 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319602+0000", 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3992999999999998e-05 2024-09-17T06:05:18.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319715+0000", 2024-09-17T06:05:18.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113112 2024-09-17T06:05:18.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319745+0000", 2024-09-17T06:05:18.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9580000000000001e-05 2024-09-17T06:05:18.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.320978+0000", 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233165 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.321037+0000", 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9026e-05 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.684915455999999, 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00083231099999999997, 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:18.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191678+0000", 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869999999999999e-06 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191693+0000", 2024-09-17T06:05:18.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4409e-05 2024-09-17T06:05:18.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191713+0000", 2024-09-17T06:05:18.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0523e-05 2024-09-17T06:05:18.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191726+0000", 2024-09-17T06:05:18.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3386e-05 2024-09-17T06:05:18.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191806+0000", 2024-09-17T06:05:18.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9287000000000002e-05 2024-09-17T06:05:18.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191834+0000", 2024-09-17T06:05:18.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8323e-05 2024-09-17T06:05:18.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192473+0000", 2024-09-17T06:05:18.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063865000000000005 2024-09-17T06:05:18.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192509+0000", 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6046e-05 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.158807179999997, 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096842599999999999, 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.948 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717787+0000", 2024-09-17T06:05:18.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.951e-06 2024-09-17T06:05:18.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717801+0000", 2024-09-17T06:05:18.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3973e-05 2024-09-17T06:05:18.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717822+0000", 2024-09-17T06:05:18.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1328e-05 2024-09-17T06:05:18.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717836+0000", 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3944000000000001e-05 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717908+0000", 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1674999999999994e-05 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717940+0000", 2024-09-17T06:05:18.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2728999999999998e-05 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718710+0000", 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076948100000000003 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718753+0000", 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3344999999999999e-05 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.953 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-17T06:05:18.953 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:18.953 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.157726369000002, 2024-09-17T06:05:18.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065812800000000001, 2024-09-17T06:05:18.953 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.953 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.953 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.953 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:18.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:18.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5000000000000001e-07 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718872+0000", 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5130000000000004e-06 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718883+0000", 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1195e-05 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718892+0000", 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5669999999999995e-06 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718931+0000", 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8850000000000002e-05 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718948+0000", 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7425999999999999e-05 2024-09-17T06:05:18.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719496+0000", 2024-09-17T06:05:18.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00054753699999999996 2024-09-17T06:05:18.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719524+0000", 2024-09-17T06:05:18.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.809e-05 2024-09-17T06:05:18.957 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.957 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.957 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:45 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'12, mlcod=26'10)", 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.223360388, 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013449270000000001, 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653233+0000", 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.796e-06 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:18.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653250+0000", 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7025999999999999e-05 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653272+0000", 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1338000000000001e-05 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653287+0000", 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5509999999999999e-05 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653383+0000", 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5904999999999997e-05 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653417+0000", 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3923e-05 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654510+0000", 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001092602 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:18.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:18.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:18.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654576+0000", 2024-09-17T06:05:18.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6827000000000002e-05 2024-09-17T06:05:18.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.962 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:18.962 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:18.962 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:18.963 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T06:05:18.969 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:18.970+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:19.070 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:19.070+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:19.122 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:19.122 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:19.122 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:19.122 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:19.139 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T06:05:19.174 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:19.170+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:19.275 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:19.270+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:19.324 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:19.325 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:19.325 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:19.325 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:19.325 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:19.342 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T06:05:19.385 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:19.386+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:19.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.430+0000 7fa05f7fe640 1 -- 172.21.15.122:0/3226642682 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pg-upmap", "pgid": "2.15", "id": [5, 0]}]=0 set 2.15 pg_upmap mapping to [5,0] v42) ==== 124+0+0 (secure 0 0 0) 0x7fa06c05e950 con 0x7fa0780c4330 2024-09-17T06:05:19.435 INFO:teuthology.orchestra.run.smithi122.stderr:set 2.15 pg_upmap mapping to [5,0] 2024-09-17T06:05:19.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.434+0000 7fa07d418640 1 -- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa064073200 msgr2=0x7fa064075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:19.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.434+0000 7fa07d418640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa064073200 0x7fa064075710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa0680af000 tx=0x7fa06801b120 comp rx=0 tx=0).stop 2024-09-17T06:05:19.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.434+0000 7fa07d418640 1 -- 172.21.15.122:0/3226642682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0780c4330 msgr2=0x7fa0781f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:19.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.434+0000 7fa07d418640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0780c4330 0x7fa0781f4cc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c3f0 tx=0x7fa06c00c8b0 comp rx=0 tx=0).stop 2024-09-17T06:05:19.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.434+0000 7fa07d418640 1 -- 172.21.15.122:0/3226642682 shutdown_connections 2024-09-17T06:05:19.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.434+0000 7fa07d418640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0780cedf0 0x7fa078070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:19.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.434+0000 7fa07d418640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0780c4330 0x7fa0781f4cc0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:19.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.434+0000 7fa07d418640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa064073200 0x7fa064075710 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:19.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.434+0000 7fa07d418640 1 --2- 172.21.15.122:0/3226642682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0780c38c0 0x7fa0780ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:19.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.434+0000 7fa07d418640 1 -- 172.21.15.122:0/3226642682 >> 172.21.15.122:0/3226642682 conn(0x7fa078070e40 msgr2=0x7fa0780ca620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:19.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.434+0000 7fa07d418640 1 -- 172.21.15.122:0/3226642682 shutdown_connections 2024-09-17T06:05:19.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:19.434+0000 7fa07d418640 1 -- 172.21.15.122:0/3226642682 wait complete. 2024-09-17T06:05:19.494 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 65.673856935999993, 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.013495551, 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:19.495 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820815+0000", 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820818+0000", 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.858e-06 2024-09-17T06:05:19.496 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820836+0000", 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7955e-05 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820863+0000", 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7013999999999999e-05 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.820885+0000", 2024-09-17T06:05:19.497 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1695000000000002e-05 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821084+0000", 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019876400000000001 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821305+0000", 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022121099999999999 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:19.498 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821563+0000", 2024-09-17T06:05:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025797100000000001 2024-09-17T06:05:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825504+0000", 2024-09-17T06:05:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039410119999999998 2024-09-17T06:05:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834165+0000", 2024-09-17T06:05:19.499 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086608810000000005 2024-09-17T06:05:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834252+0000", 2024-09-17T06:05:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7276999999999998e-05 2024-09-17T06:05:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834311+0000", 2024-09-17T06:05:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8913000000000003e-05 2024-09-17T06:05:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.500 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 65.670633662, 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037604380000000001, 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.501 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824039+0000", 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824040+0000", 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8649999999999999e-06 2024-09-17T06:05:19.502 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824070+0000", 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9162e-05 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824088+0000", 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8529000000000002e-05 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:19.503 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824103+0000", 2024-09-17T06:05:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5081e-05 2024-09-17T06:05:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824193+0000", 2024-09-17T06:05:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9896999999999997e-05 2024-09-17T06:05:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:05:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1649000000000001e-05 2024-09-17T06:05:19.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827740+0000", 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035152069999999998 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827799+0000", 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9048000000000001e-05 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 65.670448109999995, 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035104340000000002, 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:05:19.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824224+0000", 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824225+0000", 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1909999999999999e-06 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:19.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824237+0000", 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1914e-05 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824252+0000", 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5071e-05 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824265+0000", 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2748000000000001e-05 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824346+0000", 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0530000000000003e-05 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824375+0000", 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9805e-05 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827659+0000", 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032838569999999998 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827735+0000", 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5318e-05 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 75 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 65.670251309999998, 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003402553, 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:19.510 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824421+0000", 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824422+0000", 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3399999999999998e-07 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824434+0000", 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1960000000000001e-05 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824771+0000", 2024-09-17T06:05:19.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033676799999999998 2024-09-17T06:05:19.513 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.513 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.513 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:19.513 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824798+0000", 2024-09-17T06:05:19.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7838e-05 2024-09-17T06:05:19.513 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.513 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.513 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:19.513 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824920+0000", 2024-09-17T06:05:19.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012210699999999999 2024-09-17T06:05:19.513 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.513 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827824+0000", 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029030459999999998 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 4 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 65.669564801999996, 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003032833, 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:19.514 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825107+0000", 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.515 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825108+0000", 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6099999999999999e-07 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825120+0000", 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1780000000000001e-05 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825136+0000", 2024-09-17T06:05:19.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6229999999999999e-05 2024-09-17T06:05:19.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.517 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.517 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:19.517 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825152+0000", 2024-09-17T06:05:19.517 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6104e-05 2024-09-17T06:05:19.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.517 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.517 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:19.517 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825297+0000", 2024-09-17T06:05:19.517 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014498399999999999 2024-09-17T06:05:19.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.517 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.518 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:19.518 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828140+0000", 2024-09-17T06:05:19.518 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002842874 2024-09-17T06:05:19.518 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.518 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:19.518 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.518 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.518 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.518 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:19.518 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:05:19.518 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 65.664856022999999, 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032580460000000001, 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829816+0000", 2024-09-17T06:05:19.519 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.520 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.520 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.520 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:19.520 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829817+0000", 2024-09-17T06:05:19.520 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.176e-06 2024-09-17T06:05:19.520 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.520 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.520 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:19.520 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:19.520 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0178e-05 2024-09-17T06:05:19.520 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.520 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829847+0000", 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9402000000000002e-05 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829858+0000", 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1141000000000001e-05 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830004+0000", 2024-09-17T06:05:19.521 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014622699999999999 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830027+0000", 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2826000000000001e-05 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833000+0000", 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029729000000000001 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.522 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833074+0000", 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4196000000000006e-05 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 65.663741242, 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0043957220000000003, 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:19.523 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:19.524 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:19.524 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:19.524 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.524 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:19.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:05:19.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.524 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.524 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:19.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830931+0000", 2024-09-17T06:05:19.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830933+0000", 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5090000000000001e-06 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830946+0000", 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3018e-05 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:19.525 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830968+0000", 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2558999999999999e-05 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830984+0000", 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5376999999999999e-05 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831072+0000", 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8745000000000005e-05 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.527 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:19.527 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831104+0000", 2024-09-17T06:05:19.527 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1265e-05 2024-09-17T06:05:19.527 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.527 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.527 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:19.527 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835260+0000", 2024-09-17T06:05:19.527 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0041569559999999998 2024-09-17T06:05:19.527 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.527 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.527 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:19.527 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.835327+0000", 2024-09-17T06:05:19.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.6292999999999997e-05 2024-09-17T06:05:19.528 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.528 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:19.528 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.528 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.528 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.528 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-17T06:05:19.528 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:05:19.528 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 65.660637709, 2024-09-17T06:05:19.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029529399999999998, 2024-09-17T06:05:19.528 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:19.528 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:19.529 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:19.529 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:19.529 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.529 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:19.529 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:05:19.529 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.529 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.529 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.529 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:19.529 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834035+0000", 2024-09-17T06:05:19.529 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834036+0000", 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9999999999999995e-07 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834042+0000", 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.7240000000000003e-06 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.530 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:19.531 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834058+0000", 2024-09-17T06:05:19.531 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5648e-05 2024-09-17T06:05:19.531 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.531 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.531 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:19.531 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834068+0000", 2024-09-17T06:05:19.531 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0383999999999999e-05 2024-09-17T06:05:19.531 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.531 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.531 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:19.531 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834145+0000", 2024-09-17T06:05:19.532 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.64e-05 2024-09-17T06:05:19.532 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.532 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.532 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:19.532 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834157+0000", 2024-09-17T06:05:19.532 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2414e-05 2024-09-17T06:05:19.532 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:19.532 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:19.532 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:19.532 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834330+0000", 2024-09-17T06:05:19.532 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017272399999999999 2024-09-17T06:05:19.532 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.533 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:19.533 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.533 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:19.533 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:19.533 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:19.533 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:19.502+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:19.534 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:05:19.621 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:19.622+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:19.681 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:19.682+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:19.731 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:19.731 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:19.732 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:19.732 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:19.749 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:05:19.784 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:19.778+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:19.883 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:19.882+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:19.940 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:19.940 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:19.940 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:19.940 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:19.941 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:19.957 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:05:19.984 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:19.982+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:20.085 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:20.086+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:20.154 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:20.154 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:20.154 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:20.154 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:20.155 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.155 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:20.155 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:20.155 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.331199290000001, 2024-09-17T06:05:20.155 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:05:20.155 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.155 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.155 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.155 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.155 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.155 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.155 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:20.156 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.156 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.156 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.156 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.156 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:20.156 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.156 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.156 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.156 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.156 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:05:20.156 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.157 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:05:20.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.159 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.331087065999995, 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.160 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:05:20.161 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.162 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.163 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:05:20.163 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:05:20.163 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.163 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.163 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.163 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:05:20.163 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:05:20.163 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.163 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.163 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.163 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:20.164 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.330881715999993, 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.165 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:05:20.166 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:05:20.167 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.168 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.169 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.169 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.169 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:20.169 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:20.169 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.324741189999997, 2024-09-17T06:05:20.169 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:05:20.169 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.169 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.169 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.169 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.169 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:05:20.170 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:05:20.171 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:05:20.172 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.324586464000006, 2024-09-17T06:05:20.173 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:05:20.174 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.174 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.174 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.174 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.174 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.174 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.174 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:20.174 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.175 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:05:20.176 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:05:20.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.176 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.176 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.176 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:05:20.176 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:05:20.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.176 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.176 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.176 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:05:20.176 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:05:20.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.177 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.177 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.177 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:05:20.177 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:05:20.177 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.177 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.177 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.177 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:05:20.177 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:05:20.177 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.177 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.178 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:20.180 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:05:20.185 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:20.182+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:20.286 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:20.282+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:20.376 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:20.376 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:20.376 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:20.376 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:20.388 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:20.386+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:20.393 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:05:20.461 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T06:05:20.508 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:20.506+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:20.583 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:20.583 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:20.583 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:20.584 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:20.584 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:20.590 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:20.586+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:20.600 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:05:20.621 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:05:20.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.654+0000 7fc313585640 1 -- 172.21.15.122:0/2178030202 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc30c06dab0 msgr2=0x7fc30c15b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:20.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.654+0000 7fc313585640 1 --2- 172.21.15.122:0/2178030202 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc30c06dab0 0x7fc30c15b470 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc009840 tx=0x7fc2fc01c790 comp rx=0 tx=0).stop 2024-09-17T06:05:20.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.654+0000 7fc313585640 1 -- 172.21.15.122:0/2178030202 shutdown_connections 2024-09-17T06:05:20.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.654+0000 7fc313585640 1 --2- 172.21.15.122:0/2178030202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc30c0cbb40 0x7fc30c15b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:20.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.654+0000 7fc313585640 1 --2- 172.21.15.122:0/2178030202 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc30c06dab0 0x7fc30c15b470 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:20.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.654+0000 7fc313585640 1 -- 172.21.15.122:0/2178030202 >> 172.21.15.122:0/2178030202 conn(0x7fc30c08d450 msgr2=0x7fc30c06ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:20.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.654+0000 7fc313585640 1 -- 172.21.15.122:0/2178030202 shutdown_connections 2024-09-17T06:05:20.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.654+0000 7fc313585640 1 -- 172.21.15.122:0/2178030202 wait complete. 2024-09-17T06:05:20.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.654+0000 7fc313585640 1 Processor -- start 2024-09-17T06:05:20.659 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc313585640 1 -- start start 2024-09-17T06:05:20.662 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc313585640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc30c06dab0 0x7fc30c15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc313585640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc30c0cbb40 0x7fc30c14f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc313585640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc30c0ccdb0 0x7fc30c152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc313585640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c0cca70 con 0x7fc30c0cbb40 2024-09-17T06:05:20.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc313585640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c0cc8f0 con 0x7fc30c0ccdb0 2024-09-17T06:05:20.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc313585640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc30c168510 con 0x7fc30c06dab0 2024-09-17T06:05:20.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc311321640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc30c06dab0 0x7fc30c15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc310b20640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc30c0cbb40 0x7fc30c14f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc311321640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc30c06dab0 0x7fc30c15ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:50592/0 (socket says 172.21.15.122:50592) 2024-09-17T06:05:20.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc311321640 1 -- 172.21.15.122:0/2097383034 learned_addr learned my addr 172.21.15.122:0/2097383034 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:20.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc311b22640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc30c0ccdb0 0x7fc30c152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.663 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc311321640 1 -- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc30c0ccdb0 msgr2=0x7fc30c152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:20.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc311321640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc30c0ccdb0 0x7fc30c152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:20.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc311321640 1 -- 172.21.15.122:0/2097383034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc30c0cbb40 msgr2=0x7fc30c14f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:20.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc311321640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc30c0cbb40 0x7fc30c14f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:20.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc311321640 1 -- 172.21.15.122:0/2097383034 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c15d380 con 0x7fc30c06dab0 2024-09-17T06:05:20.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc311321640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc30c06dab0 0x7fc30c15ce40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc30800c400 tx=0x7fc30800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:20.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc301ffb640 1 -- 172.21.15.122:0/2097383034 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308017070 con 0x7fc30c06dab0 2024-09-17T06:05:20.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc301ffb640 1 -- 172.21.15.122:0/2097383034 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc308003600 con 0x7fc30c06dab0 2024-09-17T06:05:20.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc301ffb640 1 -- 172.21.15.122:0/2097383034 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308003a50 con 0x7fc30c06dab0 2024-09-17T06:05:20.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc313585640 1 -- 172.21.15.122:0/2097383034 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc30c155140 con 0x7fc30c06dab0 2024-09-17T06:05:20.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.658+0000 7fc313585640 1 -- 172.21.15.122:0/2097383034 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc30c151650 con 0x7fc30c06dab0 2024-09-17T06:05:20.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.662+0000 7fc313585640 1 -- 172.21.15.122:0/2097383034 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30c0cc1e0 con 0x7fc30c06dab0 2024-09-17T06:05:20.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.662+0000 7fc301ffb640 1 -- 172.21.15.122:0/2097383034 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc30801a070 con 0x7fc30c06dab0 2024-09-17T06:05:20.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.662+0000 7fc301ffb640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc2f0073200 0x7fc2f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.662+0000 7fc301ffb640 1 -- 172.21.15.122:0/2097383034 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 6804+0+0 (secure 0 0 0) 0x7fc308093d20 con 0x7fc30c06dab0 2024-09-17T06:05:20.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.662+0000 7fc310b20640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc2f0073200 0x7fc2f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.662+0000 7fc310b20640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc2f0073200 0x7fc2f0075710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0af000 tx=0x7fc2fc01afd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:20.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.670+0000 7fc301ffb640 1 -- 172.21.15.122:0/2097383034 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc308021020 con 0x7fc30c06dab0 2024-09-17T06:05:20.691 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:20.686+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:20.753 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:20.753 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:20.753 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:20.753 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:20.753 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.753 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:20.753 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:20.753 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.929120402999999, 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.754 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.755 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:05:20.756 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.757 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.758 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.929000001000006, 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.759 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.760 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:05:20.761 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:05:20.762 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.763 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.764 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.928872087000002, 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.765 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:20.766 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.766 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.766 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.766 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.766 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:20.766 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.766 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.766 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.766 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:05:20.767 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.768 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.768 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.768 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:20.768 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:05:20.768 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.768 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.768 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.768 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:05:20.768 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:05:20.768 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.768 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.768 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:05:20.769 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:05:20.770 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.927846123999998, 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.771 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:05:20.772 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.773 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:05:20.775 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.776 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.776 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.776 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:05:20.776 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:05:20.776 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.776 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.776 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.776 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:05:20.776 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:05:20.776 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.776 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.777 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.777 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.777 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.777 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:20.777 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:20.777 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.927765180999998, 2024-09-17T06:05:20.777 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:05:20.777 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.777 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.777 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.777 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.777 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:05:20.778 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.779 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.780 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:05:20.781 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:05:20.782 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.782 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.782 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.782 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:20.782 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:05:20.782 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.782 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.782 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.782 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.927702779000001, 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.783 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.784 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:05:20.785 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:05:20.786 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.787 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.788 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.927630688999997, 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.789 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.790 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:05:20.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.927588489000001, 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.793 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.794 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.795 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:05:20.796 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:20.797 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.924996557, 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.798 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.799 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:05:20.800 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:05:20.801 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.801 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.801 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.801 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:05:20.801 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:05:20.801 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.801 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.801 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.801 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:05:20.801 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:05:20.801 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.801 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.924900421999993, 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.802 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:05:20.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:05:20.806 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:05:20.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.806 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.806 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.808 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:05:20.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:05:20.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.808 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.808 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:05:20.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:05:20.808 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.809 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.809 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.809 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.809 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.809 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:05:20.809 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:20.809 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.916468136000006, 2024-09-17T06:05:20.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:05:20.809 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.809 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.809 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:05:20.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.822878916000001, 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.815 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:05:20.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:20.819 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 60.152248551, 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.820 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:05:20.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:05:20.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:05:20.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:05:20.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:05:20.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:05:20.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:05:20.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 58.431577595, 2024-09-17T06:05:20.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:05:20.827 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:05:20.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:05:20.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 58.428893346000002, 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:20.831 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:05:20.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.833 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.559690672999999, 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.835 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:05:20.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:05:20.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.838 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:05:20.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:05:20.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.838 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:05:20.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.839 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.033249761, 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.841 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:05:20.844 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.845 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.846 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.033020245000003, 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.847 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.848 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.849 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.849 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:05:20.849 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:05:20.849 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.849 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.849 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.849 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:05:20.849 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:05:20.849 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.849 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.849 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.849 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.850 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:05:20.851 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.852 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.031055549000001, 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:20.853 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.854 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.855 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:05:20.856 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 33.097492662000001, 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:20.857 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:05:20.858 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:20.859 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.860 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.861 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:20.862 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:20.863 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:20.865 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:05:20.865 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:20.862+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.814+0000 7f63f9285640 1 -- 172.21.15.122:0/88574818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63f41522c0 msgr2=0x7f63f415b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.814+0000 7f63f9285640 1 --2- 172.21.15.122:0/88574818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63f41522c0 0x7f63f415b680 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009900 tx=0x7f63e801f090 comp rx=0 tx=0).stop 2024-09-17T06:05:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.814+0000 7f63f9285640 1 -- 172.21.15.122:0/88574818 shutdown_connections 2024-09-17T06:05:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.814+0000 7f63f9285640 1 --2- 172.21.15.122:0/88574818 >> v2:172.21.15.173:3300/0 conn(0x7f63f40c2220 0x7f63f415bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.814+0000 7f63f9285640 1 --2- 172.21.15.122:0/88574818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63f41522c0 0x7f63f415b680 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.814+0000 7f63f9285640 1 -- 172.21.15.122:0/88574818 >> 172.21.15.122:0/88574818 conn(0x7f63f4070d80 msgr2=0x7f63f4072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.814+0000 7f63f9285640 1 -- 172.21.15.122:0/88574818 shutdown_connections 2024-09-17T06:05:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.814+0000 7f63f9285640 1 -- 172.21.15.122:0/88574818 wait complete. 2024-09-17T06:05:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f9285640 1 Processor -- start 2024-09-17T06:05:20.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f9285640 1 -- start start 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f9285640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63f40c2220 0x7f63f41e17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f9285640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63f40c8d30 0x7f63f406d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f9285640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63f41522c0 0x7f63f41467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63f41522c0 0x7f63f41467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63f41522c0 0x7f63f41467c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53130/0 (socket says 172.21.15.122:53130) 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f37fe640 1 -- 172.21.15.122:0/199304808 learned_addr learned my addr 172.21.15.122:0/199304808 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f9285640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f63f40c83b0 con 0x7f63f41522c0 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f9285640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f63f40c3080 con 0x7f63f40c8d30 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f9285640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f63f415c100 con 0x7f63f40c2220 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f2ffd640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63f40c2220 0x7f63f41e17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.818+0000 7f63f27fc640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63f40c8d30 0x7f63f406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63f37fe640 1 -- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63f40c2220 msgr2=0x7f63f41e17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:20.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63f37fe640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63f40c2220 0x7f63f41e17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63f37fe640 1 -- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63f40c8d30 msgr2=0x7f63f406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63f37fe640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63f40c8d30 0x7f63f406d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63f37fe640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f41f5290 con 0x7f63f41522c0 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63f37fe640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63f41522c0 0x7f63f41467c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00cad0 tx=0x7f63ec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec00ae20 con 0x7f63f41522c0 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63ec003a70 con 0x7f63f41522c0 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec004030 con 0x7f63f41522c0 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63f9285640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f41e1d10 con 0x7f63f41522c0 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63f9285640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f415b1e0 con 0x7f63f41522c0 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f63cc005280 con 0x7f63f41522c0 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.822+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f63ec0041d0 con 0x7f63f41522c0 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.826+0000 7f63db7fe640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f63e0073200 0x7f63e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.826+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6804+0+0 (secure 0 0 0) 0x7f63ec094db0 con 0x7f63f41522c0 2024-09-17T06:05:20.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.826+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v43) ==== 54+0+16 (secure 0 0 0) 0x7f63ec014070 con 0x7f63f41522c0 2024-09-17T06:05:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.826+0000 7f63f2ffd640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f63e0073200 0x7f63e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.826+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f63cc0045f0 0x7f63cc004a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.826+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63cc004f40 con 0x7f63cc0045f0 2024-09-17T06:05:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.826+0000 7f63f27fc640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f63cc0045f0 0x7f63cc004a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.826+0000 7f63f27fc640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f63cc0045f0 0x7f63cc004a00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.826+0000 7f63f2ffd640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f63e0073200 0x7f63e0075710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f63e40098e0 tx=0x7f63e4009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.826+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63cc004f40 con 0x7f63cc0045f0 2024-09-17T06:05:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.854+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f63cc0013e0 con 0x7f63cc0045f0 2024-09-17T06:05:20.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.854+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f63cc0013e0 con 0x7f63cc0045f0 2024-09-17T06:05:20.871 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:20.872 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:20.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.854+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f63cc001ea0 0x7f63cc0029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.854+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f63cc002330 con 0x7f63cc001ea0 2024-09-17T06:05:20.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.854+0000 7f63f2ffd640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f63cc001ea0 0x7f63cc0029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.854+0000 7f63f2ffd640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f63cc001ea0 0x7f63cc0029a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:20.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.858+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63cc002330 con 0x7f63cc001ea0 2024-09-17T06:05:20.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.882+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f63cc003210 con 0x7f63cc001ea0 2024-09-17T06:05:20.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.882+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f63cc003210 con 0x7f63cc001ea0 2024-09-17T06:05:20.886 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:20.887 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:20.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.882+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f63cc009c90 0x7f63cc00c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.882+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f63cc00ee80 con 0x7f63cc009c90 2024-09-17T06:05:20.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.882+0000 7f63f27fc640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f63cc009c90 0x7f63cc00c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.882+0000 7f63f27fc640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f63cc009c90 0x7f63cc00c0b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:20.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.886+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63cc00ee80 con 0x7f63cc009c90 2024-09-17T06:05:20.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.910+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f63cc00c920 con 0x7f63cc009c90 2024-09-17T06:05:20.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.910+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f63cc00c920 con 0x7f63cc009c90 2024-09-17T06:05:20.915 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:20.916 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:20.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.910+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f63cc00cad0 0x7f63cc00cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.910+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f63cc00d420 con 0x7f63cc00cad0 2024-09-17T06:05:20.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.914+0000 7f63f37fe640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f63cc00cad0 0x7f63cc00cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.914+0000 7f63f37fe640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f63cc00cad0 0x7f63cc00cee0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:20.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.914+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63cc00d420 con 0x7f63cc00cad0 2024-09-17T06:05:20.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.938+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f63cc00d930 con 0x7f63cc00cad0 2024-09-17T06:05:20.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.942+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f63cc00d930 con 0x7f63cc00cad0 2024-09-17T06:05:20.944 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:20.944 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:20.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.942+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f63cc011040 0x7f63cc013460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.942+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f63cc016230 con 0x7f63cc011040 2024-09-17T06:05:20.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.942+0000 7f63f2ffd640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f63cc011040 0x7f63cc013460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.942+0000 7f63f2ffd640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f63cc011040 0x7f63cc013460 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:20.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.942+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63cc016230 con 0x7f63cc011040 2024-09-17T06:05:20.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.954+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f63cc013c70 con 0x7f63cc011040 2024-09-17T06:05:20.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.958+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f63cc013c70 con 0x7f63cc011040 2024-09-17T06:05:20.962 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:05:20.963 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:05:20.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.958+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f63cc014100 0x7f63cc016520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.958+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f63cc019520 con 0x7f63cc014100 2024-09-17T06:05:20.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.958+0000 7f63f27fc640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f63cc014100 0x7f63cc016520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.962+0000 7f63f27fc640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f63cc014100 0x7f63cc016520 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:20.964 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:20.962+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:20.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.962+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63cc019520 con 0x7f63cc014100 2024-09-17T06:05:20.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.974+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f63cc018240 con 0x7f63cc014100 2024-09-17T06:05:20.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.978+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f63cc018240 con 0x7f63cc014100 2024-09-17T06:05:20.983 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:20.984 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:20.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.978+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f63cc018960 0x7f63cc018d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:20.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.978+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f63cc01c970 con 0x7f63cc018960 2024-09-17T06:05:20.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.982+0000 7f63f37fe640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f63cc018960 0x7f63cc018d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:20.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.982+0000 7f63f37fe640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f63cc018960 0x7f63cc018d70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:20.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.982+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63cc01c970 con 0x7f63cc018960 2024-09-17T06:05:20.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:20.990+0000 7fc313585640 1 -- 172.21.15.122:0/2097383034 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) -- 0x7fc30c158d90 con 0x7fc30c06dab0 2024-09-17T06:05:21.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.006+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f63cc01b770 con 0x7f63cc018960 2024-09-17T06:05:21.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.014+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f63cc01b770 con 0x7f63cc018960 2024-09-17T06:05:21.016 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.014+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f63cc01bdf0 0x7f63cc01c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.014+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f63cc01fd10 con 0x7f63cc01bdf0 2024-09-17T06:05:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.014+0000 7f63f2ffd640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f63cc01bdf0 0x7f63cc01c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:21.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.014+0000 7f63f2ffd640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f63cc01bdf0 0x7f63cc01c200 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:21.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.014+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63cc01fd10 con 0x7f63cc01bdf0 2024-09-17T06:05:21.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.030+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f63cc016b00 con 0x7f63cc01bdf0 2024-09-17T06:05:21.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63db7fe640 1 -- 172.21.15.122:0/199304808 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f63cc016b00 con 0x7f63cc01bdf0 2024-09-17T06:05:21.037 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:21.038 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:21.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f63cc0045f0 msgr2=0x7f63cc004a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:21.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f63cc0045f0 0x7f63cc004a00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f63cc001ea0 msgr2=0x7f63cc0029a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:21.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f63cc001ea0 0x7f63cc0029a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f63cc009c90 msgr2=0x7f63cc00c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:21.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f63cc009c90 0x7f63cc00c0b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63f37fe640 1 -- 172.21.15.122:0/199304808 reap_dead start 2024-09-17T06:05:21.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f63cc00cad0 msgr2=0x7f63cc00cee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:21.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f63cc00cad0 0x7f63cc00cee0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f63cc011040 msgr2=0x7f63cc013460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:21.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7f63cc011040 0x7f63cc013460 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f63cc014100 msgr2=0x7f63cc016520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:21.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f63cc014100 0x7f63cc016520 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f63cc018960 msgr2=0x7f63cc018d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:21.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f63cc018960 0x7f63cc018d70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f63cc01bdf0 msgr2=0x7f63cc01c200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:21.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f63cc01bdf0 0x7f63cc01c200 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63f37fe640 1 -- 172.21.15.122:0/199304808 reap_dead start 2024-09-17T06:05:21.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f63e0073200 msgr2=0x7f63e0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:21.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f63e0073200 0x7f63e0075710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f63e40098e0 tx=0x7f63e4009060 comp rx=0 tx=0).stop 2024-09-17T06:05:21.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63f41522c0 msgr2=0x7f63f41467c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:21.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63f41522c0 0x7f63f41467c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00cad0 tx=0x7f63ec00cf90 comp rx=0 tx=0).stop 2024-09-17T06:05:21.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 shutdown_connections 2024-09-17T06:05:21.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63f41522c0 0x7f63f41467c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 --2- 172.21.15.122:0/199304808 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f63e0073200 0x7f63e0075710 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 >> 172.21.15.122:0/199304808 conn(0x7f63f4070d80 msgr2=0x7f63f414d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:21.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 shutdown_connections 2024-09-17T06:05:21.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.034+0000 7f63d9ffb640 1 -- 172.21.15.122:0/199304808 wait complete. 2024-09-17T06:05:21.064 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:21.064 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:21.065 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:21.062+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:21.081 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:05:21.169 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:21.170+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:21.268 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:21.266+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:21.275 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:21.275 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:21.294 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:05:21.368 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:21.366+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:21.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.454+0000 7fc301ffb640 1 -- 172.21.15.122:0/2097383034 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v44) ==== 101+0+0 (secure 0 0 0) 0x7fc30805e390 con 0x7fc30c06dab0 2024-09-17T06:05:21.457 INFO:teuthology.orchestra.run.smithi122.stderr:nodeep-scrub is unset 2024-09-17T06:05:21.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.458+0000 7fc313585640 1 -- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc2f0073200 msgr2=0x7fc2f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:21.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.458+0000 7fc313585640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc2f0073200 0x7fc2f0075710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0af000 tx=0x7fc2fc01afd0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.458+0000 7fc313585640 1 -- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc30c06dab0 msgr2=0x7fc30c15ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:21.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.458+0000 7fc313585640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc30c06dab0 0x7fc30c15ce40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc30800c400 tx=0x7fc30800c8c0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.458+0000 7fc313585640 1 -- 172.21.15.122:0/2097383034 shutdown_connections 2024-09-17T06:05:21.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.458+0000 7fc313585640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc2f0073200 0x7fc2f0075710 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.458+0000 7fc313585640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc30c0ccdb0 0x7fc30c152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.458+0000 7fc313585640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc30c0cbb40 0x7fc30c14f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.458+0000 7fc313585640 1 --2- 172.21.15.122:0/2097383034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc30c06dab0 0x7fc30c15ce40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:21.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.458+0000 7fc313585640 1 -- 172.21.15.122:0/2097383034 >> 172.21.15.122:0/2097383034 conn(0x7fc30c08d450 msgr2=0x7fc30c0c6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:21.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.458+0000 7fc313585640 1 -- 172.21.15.122:0/2097383034 shutdown_connections 2024-09-17T06:05:21.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:21.458+0000 7fc313585640 1 -- 172.21.15.122:0/2097383034 wait complete. 2024-09-17T06:05:21.469 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:21.466+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:21.492 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:21.492 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:21.509 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:05:21.572 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:21.570+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:21.671 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:21.670+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:21.703 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:21.703 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:21.719 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:05:21.772 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:21.770+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:21.872 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:21.870+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:21.891 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:21.891 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:21.907 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:05:21.992 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:21.990+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:22.073 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:22.074+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:22.079 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:22.079 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:22.095 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:05:22.174 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:22.174+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:22.275 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:22.274+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:22.312 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:22.312 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:22.333 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:05:22.380 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:22.378+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:22.476 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:22.474+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:22.528 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:22.528 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:22.549 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:05:22.592 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:22.590+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:22.679 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:22.678+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:22.779 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:22.774+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:22.794 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:22.795 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:22.820 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:05:22.908 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:22.906+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:22.982 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:22.982+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:23.060 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:05:23.070 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:23.070 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:23.083 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:23.082+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:23.096 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:05:23.184 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:23.182+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:23.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.258+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2942442112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f415baa0 msgr2=0x7fd1f4162a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.258+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2942442112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f415baa0 0x7fd1f4162a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009c80 tx=0x7fd1ec01cd70 comp rx=0 tx=0).stop 2024-09-17T06:05:23.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.258+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2942442112 shutdown_connections 2024-09-17T06:05:23.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.258+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2942442112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f415baa0 0x7fd1f4162a20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.258+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2942442112 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1f406f540 0x7fd1f41521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.258+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2942442112 >> 172.21.15.122:0/2942442112 conn(0x7fd1f4071b60 msgr2=0x7fd1f4072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:23.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.258+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2942442112 shutdown_connections 2024-09-17T06:05:23.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.258+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2942442112 wait complete. 2024-09-17T06:05:23.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f89ea640 1 Processor -- start 2024-09-17T06:05:23.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f89ea640 1 -- start start 2024-09-17T06:05:23.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f89ea640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1f406f540 0x7fd1f4154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f89ea640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1f415b690 0x7fd1f4153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f89ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f415baa0 0x7fd1f41582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f89ea640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f40c8570 con 0x7fd1f415baa0 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f89ea640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f40ca270 con 0x7fd1f415b690 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f2d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f415baa0 0x7fd1f41582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f2d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f415baa0 0x7fd1f41582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53154/0 (socket says 172.21.15.122:53154) 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f2d9d640 1 -- 172.21.15.122:0/2218675883 learned_addr learned my addr 172.21.15.122:0/2218675883 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f89ea640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f40c81e0 con 0x7fd1f406f540 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f259c640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1f406f540 0x7fd1f4154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1ebfff640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1f415b690 0x7fd1f4153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f2d9d640 1 -- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1f406f540 msgr2=0x7fd1f4154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f2d9d640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1f406f540 0x7fd1f4154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f2d9d640 1 -- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1f415b690 msgr2=0x7fd1f4153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f2d9d640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1f415b690 0x7fd1f4153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f2d9d640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f4153a50 con 0x7fd1f415baa0 2024-09-17T06:05:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1ebfff640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1f415b690 0x7fd1f4153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:05:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f2d9d640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f415baa0 0x7fd1f41582e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec01cba0 tx=0x7fd1ec009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0bb070 con 0x7fd1f415baa0 2024-09-17T06:05:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f41f8bc0 con 0x7fd1f415baa0 2024-09-17T06:05:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.262+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1ec004d40 con 0x7fd1f415baa0 2024-09-17T06:05:23.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.266+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0b2040 con 0x7fd1f415baa0 2024-09-17T06:05:23.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.266+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f41f8e80 con 0x7fd1f415baa0 2024-09-17T06:05:23.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.266+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fd1f406f9c0 con 0x7fd1f415baa0 2024-09-17T06:05:23.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.266+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd1ec0ad850 con 0x7fd1f415baa0 2024-09-17T06:05:23.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.266+0000 7fd1eaffd640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd1d4073230 0x7fd1d4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.266+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6804+0+0 (secure 0 0 0) 0x7fd1ec12e3c0 con 0x7fd1f415baa0 2024-09-17T06:05:23.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.266+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v44) ==== 54+0+16 (secure 0 0 0) 0x7fd1ec016990 con 0x7fd1f415baa0 2024-09-17T06:05:23.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.266+0000 7fd1f259c640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd1d4073230 0x7fd1d4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.270+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fd1f40ce210 0x7fd1f40b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.270+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1f4152ea0 con 0x7fd1f40ce210 2024-09-17T06:05:23.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.270+0000 7fd1ebfff640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fd1f40ce210 0x7fd1f40b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.270+0000 7fd1f259c640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd1d4073230 0x7fd1d4075740 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4004630 tx=0x7fd1e400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:23.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.270+0000 7fd1ebfff640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fd1f40ce210 0x7fd1f40b0ce0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:23.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.270+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1dc0099e0 con 0x7fd1f40ce210 2024-09-17T06:05:23.285 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:23.286+0000 7ffa1cd26640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29182) UID: 0 2024-09-17T06:05:23.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.298+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fd1f40c4800 con 0x7fd1f40ce210 2024-09-17T06:05:23.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.302+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd1f40c4800 con 0x7fd1f40ce210 2024-09-17T06:05:23.305 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:23.305 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:23.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.302+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fd1f41475c0 0x7fd1f4148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.302+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fd1f414ce20 con 0x7fd1f41475c0 2024-09-17T06:05:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.302+0000 7fd1f259c640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fd1f41475c0 0x7fd1f4148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.302+0000 7fd1f259c640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fd1f41475c0 0x7fd1f4148d10 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.302+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1f414ce20 con 0x7fd1f41475c0 2024-09-17T06:05:23.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.330+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fd1f414cb40 con 0x7fd1f41475c0 2024-09-17T06:05:23.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.330+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd1f414cb40 con 0x7fd1f41475c0 2024-09-17T06:05:23.336 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:23.336 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:23.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.334+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fd1f41479d0 0x7fd1f4149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.334+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fd1f414c860 con 0x7fd1f41479d0 2024-09-17T06:05:23.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.334+0000 7fd1ebfff640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fd1f41479d0 0x7fd1f4149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.334+0000 7fd1ebfff640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fd1f41479d0 0x7fd1f4149760 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:23.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.334+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1f414c860 con 0x7fd1f41479d0 2024-09-17T06:05:23.347 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:23.347 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:23.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.362+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fd1f414c580 con 0x7fd1f41479d0 2024-09-17T06:05:23.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.362+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd1f414c580 con 0x7fd1f41479d0 2024-09-17T06:05:23.368 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:05:23.369 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:23.369 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:23.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.366+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd1f4064180 0x7fd1f4149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.366+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fd1f4064590 con 0x7fd1f4064180 2024-09-17T06:05:23.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.366+0000 7fd1f2d9d640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd1f4064180 0x7fd1f4149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.366+0000 7fd1f2d9d640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd1f4064180 0x7fd1f4149fe0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:23.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.366+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1f4064590 con 0x7fd1f4064180 2024-09-17T06:05:23.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.390+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fd1f4064590 con 0x7fd1f4064180 2024-09-17T06:05:23.398 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:23.390+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:23.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.394+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd1f4064590 con 0x7fd1f4064180 2024-09-17T06:05:23.398 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:23.399 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:23.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.394+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fd1f414aa30 0x7fd1f402d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.394+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fd1f414aef0 con 0x7fd1f414aa30 2024-09-17T06:05:23.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.394+0000 7fd1f259c640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fd1f414aa30 0x7fd1f402d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.398+0000 7fd1f259c640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fd1f414aa30 0x7fd1f402d4d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:23.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.398+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.4 v2:172.21.15.173:6810/920798795 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1f414aef0 con 0x7fd1f414aa30 2024-09-17T06:05:23.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.426+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fd1f414aef0 con 0x7fd1f414aa30 2024-09-17T06:05:23.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.430+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.4 v2:172.21.15.173:6810/920798795 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd1f414aef0 con 0x7fd1f414aa30 2024-09-17T06:05:23.433 INFO:teuthology.orchestra.run.smithi122.stdout:osd.4: {} 2024-09-17T06:05:23.433 INFO:teuthology.orchestra.run.smithi122.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T06:05:23.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.430+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fd1f402dfd0 0x7fd1f402e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.430+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fd1f420dc50 con 0x7fd1f402dfd0 2024-09-17T06:05:23.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.430+0000 7fd1ebfff640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fd1f402dfd0 0x7fd1f402e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.430+0000 7fd1ebfff640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fd1f402dfd0 0x7fd1f402e3e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:23.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.434+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1f420dc50 con 0x7fd1f402dfd0 2024-09-17T06:05:23.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.458+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fd1f420b3c0 con 0x7fd1f402dfd0 2024-09-17T06:05:23.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.462+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd1f420b3c0 con 0x7fd1f402dfd0 2024-09-17T06:05:23.467 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:23.467 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:23.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.462+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fd1f420bae0 0x7fd1f420bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.462+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fd1f4210ff0 con 0x7fd1f420bae0 2024-09-17T06:05:23.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.466+0000 7fd1f2d9d640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fd1f420bae0 0x7fd1f420bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.466+0000 7fd1f2d9d640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fd1f420bae0 0x7fd1f420bf10 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:23.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.466+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1f4210ff0 con 0x7fd1f420bae0 2024-09-17T06:05:23.486 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T06:05:23.488 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:23.486+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:23.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.494+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fd1f420fe70 con 0x7fd1f420bae0 2024-09-17T06:05:23.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.498+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd1f420fe70 con 0x7fd1f420bae0 2024-09-17T06:05:23.502 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:23.503 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:23.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.498+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd1f4210590 0x7fd1f42109a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.498+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fd1f4214360 con 0x7fd1f4210590 2024-09-17T06:05:23.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.498+0000 7fd1f259c640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd1f4210590 0x7fd1f42109a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.502+0000 7fd1f259c640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd1f4210590 0x7fd1f42109a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:23.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.502+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1f4214360 con 0x7fd1f4210590 2024-09-17T06:05:23.509 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:23.509 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:23.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:23.509 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:23.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.509 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:23.509 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:23.509 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.686763909999996, 2024-09-17T06:05:23.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014374336, 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:23.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821526+0000", 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6859999999999999e-06 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821553+0000", 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6329000000000002e-05 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821592+0000", 2024-09-17T06:05:23.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9588000000000001e-05 2024-09-17T06:05:23.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821624+0000", 2024-09-17T06:05:23.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1814999999999999e-05 2024-09-17T06:05:23.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822106+0000", 2024-09-17T06:05:23.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00048212400000000001 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822852+0000", 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000745303 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823189+0000", 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000337244 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:23.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828285+0000", 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050956680000000002 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835635+0000", 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0073502960000000001 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835771+0000", 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000136219 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835897+0000", 2024-09-17T06:05:23.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126064 2024-09-17T06:05:23.515 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.515 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.515 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.515 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:23.515 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:23.515 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.686466228, 2024-09-17T06:05:23.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014596456000000001, 2024-09-17T06:05:23.516 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.516 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.516 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:23.516 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:23.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:23.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821823+0000", 2024-09-17T06:05:23.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.17e-06 2024-09-17T06:05:23.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821837+0000", 2024-09-17T06:05:23.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3845999999999999e-05 2024-09-17T06:05:23.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821872+0000", 2024-09-17T06:05:23.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5024999999999998e-05 2024-09-17T06:05:23.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821896+0000", 2024-09-17T06:05:23.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4669e-05 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824176+0000", 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022794389999999999 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824408+0000", 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000232258 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824824+0000", 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00041565999999999999 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829781+0000", 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049579250000000002 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836070+0000", 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062883740000000002 2024-09-17T06:05:23.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836286+0000", 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021609299999999999 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836417+0000", 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013099699999999999 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.686347764000004, 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014884692, 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:23.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821941+0000", 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.784e-06 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821990+0000", 2024-09-17T06:05:23.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9481000000000003e-05 2024-09-17T06:05:23.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822015+0000", 2024-09-17T06:05:23.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4552000000000001e-05 2024-09-17T06:05:23.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822062+0000", 2024-09-17T06:05:23.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7351000000000001e-05 2024-09-17T06:05:23.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825585+0000", 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003522458 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825895+0000", 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031071499999999998 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:23.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826221+0000", 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032602400000000001 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829803+0000", 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035817359999999999 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836527+0000", 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067239919999999998 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:23.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836663+0000", 2024-09-17T06:05:23.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013620700000000001 2024-09-17T06:05:23.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836824+0000", 2024-09-17T06:05:23.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016039200000000001 2024-09-17T06:05:23.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.527 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.686193388000007, 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01512869, 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822095+0000", 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9829999999999999e-06 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822105+0000", 2024-09-17T06:05:23.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5130000000000002e-06 2024-09-17T06:05:23.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822125+0000", 2024-09-17T06:05:23.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9953e-05 2024-09-17T06:05:23.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822144+0000", 2024-09-17T06:05:23.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9089e-05 2024-09-17T06:05:23.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826898+0000", 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047542740000000002 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827131+0000", 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023258900000000001 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827568+0000", 2024-09-17T06:05:23.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00043743200000000002 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834712+0000", 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0071437489999999996 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836963+0000", 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022512769999999999 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837108+0000", 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014485 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837222+0000", 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011398100000000001 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.533 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.686117861, 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015488435, 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822171+0000", 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9800000000000001e-06 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822180+0000", 2024-09-17T06:05:23.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7290000000000006e-06 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822198+0000", 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8868999999999998e-05 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822217+0000", 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006163712 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828723+0000", 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034318 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829070+0000", 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034623299999999999 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834728+0000", 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056585519999999999 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837392+0000", 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026634800000000002 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837551+0000", 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015923900000000001 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837657+0000", 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010631799999999999 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.686043139000006, 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015871963999999999, 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.539 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822245+0000", 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5969999999999999e-06 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822263+0000", 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8241999999999999e-05 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822283+0000", 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9466e-05 2024-09-17T06:05:23.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822300+0000", 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6898999999999999e-05 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829910+0000", 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00760979 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.830145+0000", 2024-09-17T06:05:23.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023562100000000001 2024-09-17T06:05:23.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:23.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.830638+0000", 2024-09-17T06:05:23.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00049317000000000002 2024-09-17T06:05:23.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:23.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834742+0000", 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041036470000000002 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837872+0000", 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031295670000000002 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838036+0000", 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016482899999999999 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838116+0000", 2024-09-17T06:05:23.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9135999999999996e-05 2024-09-17T06:05:23.545 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.545 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.545 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.545 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:23.545 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:23.545 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.685946549999997, 2024-09-17T06:05:23.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016065354, 2024-09-17T06:05:23.546 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.546 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.546 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:23.546 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:23.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822342+0000", 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822349+0000", 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6569999999999997e-06 2024-09-17T06:05:23.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822368+0000", 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9074999999999999e-05 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822412+0000", 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4115e-05 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.831389+0000", 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089769659999999994 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.831743+0000", 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035332899999999999 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832133+0000", 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000390221 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834756+0000", 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026229500000000002 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838251+0000", 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034947390000000002 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838336+0000", 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5679000000000004e-05 2024-09-17T06:05:23.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838406+0000", 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9280000000000001e-05 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.685845095000005, 2024-09-17T06:05:23.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016193883999999999, 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822443+0000", 2024-09-17T06:05:23.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7370000000000001e-06 2024-09-17T06:05:23.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822452+0000", 2024-09-17T06:05:23.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5259999999999993e-06 2024-09-17T06:05:23.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822480+0000", 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7781999999999999e-05 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822497+0000", 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7139e-05 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833259+0000", 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010762386000000001 2024-09-17T06:05:23.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833684+0000", 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00042440300000000001 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834089+0000", 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000405556 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:23.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838148+0000", 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040588760000000003 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838479+0000", 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033078399999999998 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838567+0000", 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8661999999999999e-05 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838636+0000", 2024-09-17T06:05:23.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8033000000000004e-05 2024-09-17T06:05:23.557 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.557 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.557 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.557 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:23.557 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:23.557 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.685755838999995, 2024-09-17T06:05:23.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012308227, 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:23.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822532+0000", 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.57e-06 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822541+0000", 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9090000000000006e-06 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822572+0000", 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1099000000000002e-05 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822591+0000", 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8462e-05 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822777+0000", 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018563100000000001 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823110+0000", 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000333574 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823419+0000", 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030839499999999999 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826081+0000", 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026627999999999999 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834551+0000", 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084693679999999997 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834714+0000", 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000162969 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834839+0000", 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012545000000000001 2024-09-17T06:05:23.562 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.563 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.563 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.563 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:23.563 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:23.563 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.685652918000002, 2024-09-17T06:05:23.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012689499, 2024-09-17T06:05:23.563 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.563 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822635+0000", 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.637e-06 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822654+0000", 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8362000000000001e-05 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822678+0000", 2024-09-17T06:05:23.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513000000000001e-05 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822698+0000", 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9468999999999999e-05 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014675910000000001 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824388+0000", 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022300600000000001 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824756+0000", 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036741900000000001 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827411+0000", 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00265526 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:23.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835045+0000", 2024-09-17T06:05:23.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076339290000000002 2024-09-17T06:05:23.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:23.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835197+0000", 2024-09-17T06:05:23.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000151736 2024-09-17T06:05:23.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835323+0000", 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126577 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:22 2.e e25/19 ondisk, result = 0)", 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.673999957999996, 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00058930099999999997, 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.569 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834289+0000", 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.216e-06 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834304+0000", 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5255999999999999e-05 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834335+0000", 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0397999999999999e-05 2024-09-17T06:05:23.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834359+0000", 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4799000000000001e-05 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834505+0000", 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014551700000000001 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834530+0000", 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5128999999999999e-05 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834876+0000", 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000345986 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:23 2.e e25/19 ondisk, result = 0)", 2024-09-17T06:05:23.573 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.673868575, 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093485499999999995, 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834420+0000", 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5099999999999999e-06 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834428+0000", 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7399999999999993e-06 2024-09-17T06:05:23.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834449+0000", 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0738999999999999e-05 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834471+0000", 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1979000000000001e-05 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835003+0000", 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053146400000000005 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835027+0000", 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4681999999999998e-05 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835353+0000", 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000325741 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:6 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.672904715000001, 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053156399999999999, 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835384+0000", 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9700000000000002e-06 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835397+0000", 2024-09-17T06:05:23.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2903e-05 2024-09-17T06:05:23.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835427+0000", 2024-09-17T06:05:23.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9935000000000001e-05 2024-09-17T06:05:23.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835451+0000", 2024-09-17T06:05:23.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4581999999999999e-05 2024-09-17T06:05:23.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835592+0000", 2024-09-17T06:05:23.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0001406 2024-09-17T06:05:23.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835616+0000", 2024-09-17T06:05:23.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4505e-05 2024-09-17T06:05:23.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835914+0000", 2024-09-17T06:05:23.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029706900000000001 2024-09-17T06:05:23.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.582 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.582 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:7 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.672786294000005, 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00094147399999999998, 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835502+0000", 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2729999999999999e-06 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835511+0000", 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1730000000000001e-06 2024-09-17T06:05:23.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835531+0000", 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9769e-05 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835548+0000", 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6878999999999999e-05 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836026+0000", 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00047839999999999997 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836048+0000", 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1886e-05 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836442+0000", 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000394094 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.586 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:8 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.672713037999998, 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001278288, 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:23.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835575+0000", 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.077e-06 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835582+0000", 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835599+0000", 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7235999999999999e-05 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835614+0000", 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5096000000000001e-05 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836506+0000", 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00089209599999999999 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836518+0000", 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-05 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836852+0000", 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033404000000000002 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.590 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:9 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.672649371000006, 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001612018, 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:23.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835638+0000", 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.054e-06 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835646+0000", 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1520000000000003e-06 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835666+0000", 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0795999999999999e-05 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835702+0000", 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5379000000000001e-05 2024-09-17T06:05:23.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836928+0000", 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001225903 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836948+0000", 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0628999999999998e-05 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837249+0000", 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030110500000000002 2024-09-17T06:05:23.594 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:10 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.672551626000001, 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019419420000000001, 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835736+0000", 2024-09-17T06:05:23.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.06e-06 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835743+0000", 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1330000000000001e-06 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835762+0000", 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8839999999999999e-05 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835778+0000", 2024-09-17T06:05:23.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5498999999999998e-05 2024-09-17T06:05:23.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837364+0000", 2024-09-17T06:05:23.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015863190000000001 2024-09-17T06:05:23.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837379+0000", 2024-09-17T06:05:23.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4749000000000001e-05 2024-09-17T06:05:23.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837677+0000", 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298342 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:11 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.672212248999998, 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002079029, 2024-09-17T06:05:23.599 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836077+0000", 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.103e-06 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836092+0000", 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.503e-05 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836123+0000", 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1031000000000002e-05 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836147+0000", 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4019000000000002e-05 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837816+0000", 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001669299 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837847+0000", 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1464999999999998e-05 2024-09-17T06:05:23.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838153+0000", 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000306082 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:12 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.672048556999997, 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021818900000000001, 2024-09-17T06:05:23.603 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836240+0000", 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.59e-06 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836269+0000", 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9275e-05 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836291+0000", 2024-09-17T06:05:23.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1515999999999999e-05 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836308+0000", 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7728999999999999e-05 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838225+0000", 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001916453 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838238+0000", 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2806000000000001e-05 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838420+0000", 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000182521 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:13 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:23.607 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.671001137999994, 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001366047, 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:23.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837287+0000", 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.823e-06 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837301+0000", 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3910000000000001e-05 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837323+0000", 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1379e-05 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837339+0000", 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6762e-05 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838456+0000", 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011162050000000001 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838470+0000", 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.453e-05 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838652+0000", 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018143799999999999 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:23.611 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:23.613 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:05:23.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.526+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fd1f420c560 con 0x7fd1f4210590 2024-09-17T06:05:23.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1eaffd640 1 -- 172.21.15.122:0/2218675883 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fd1f420c560 con 0x7fd1f4210590 2024-09-17T06:05:23.614 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:23.616 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:23.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fd1f40ce210 msgr2=0x7fd1f40b0ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fd1f40ce210 0x7fd1f40b0ce0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fd1f41475c0 msgr2=0x7fd1f4148d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fd1f41475c0 0x7fd1f4148d10 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fd1f41479d0 msgr2=0x7fd1f4149760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fd1f41479d0 0x7fd1f4149760 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f2d9d640 1 -- 172.21.15.122:0/2218675883 reap_dead start 2024-09-17T06:05:23.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd1f4064180 msgr2=0x7fd1f4149fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd1f4064180 0x7fd1f4149fe0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fd1f414aa30 msgr2=0x7fd1f402d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6810/920798795,v1:172.21.15.173:6811/920798795] conn(0x7fd1f414aa30 0x7fd1f402d4d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fd1f402dfd0 msgr2=0x7fd1f402e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fd1f402dfd0 0x7fd1f402e3e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fd1f420bae0 msgr2=0x7fd1f420bf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fd1f420bae0 0x7fd1f420bf10 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd1f4210590 msgr2=0x7fd1f42109a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd1f4210590 0x7fd1f42109a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f2d9d640 1 -- 172.21.15.122:0/2218675883 reap_dead start 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd1d4073230 msgr2=0x7fd1d4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd1d4073230 0x7fd1d4075740 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4004630 tx=0x7fd1e400b2e0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f415baa0 msgr2=0x7fd1f41582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f415baa0 0x7fd1f41582e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec01cba0 tx=0x7fd1ec009350 comp rx=0 tx=0).stop 2024-09-17T06:05:23.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 shutdown_connections 2024-09-17T06:05:23.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1f415baa0 0x7fd1f41582e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 --2- 172.21.15.122:0/2218675883 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd1d4073230 0x7fd1d4075740 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 >> 172.21.15.122:0/2218675883 conn(0x7fd1f4071b60 msgr2=0x7fd1f4157610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:23.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 shutdown_connections 2024-09-17T06:05:23.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.534+0000 7fd1f89ea640 1 -- 172.21.15.122:0/2218675883 wait complete. 2024-09-17T06:05:23.618 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:23.610+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:23.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.690+0000 7fd29422d640 1 -- 172.21.15.122:0/3631017954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28c1534d0 msgr2=0x7fd28c164c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.690+0000 7fd29422d640 1 --2- 172.21.15.122:0/3631017954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28c1534d0 0x7fd28c164c20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd284009bc0 tx=0x7fd28401cb90 comp rx=0 tx=0).stop 2024-09-17T06:05:23.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.690+0000 7fd29422d640 1 -- 172.21.15.122:0/3631017954 shutdown_connections 2024-09-17T06:05:23.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.690+0000 7fd29422d640 1 --2- 172.21.15.122:0/3631017954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28c1534d0 0x7fd28c164c20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.690+0000 7fd29422d640 1 -- 172.21.15.122:0/3631017954 >> 172.21.15.122:0/3631017954 conn(0x7fd28c070e40 msgr2=0x7fd28c071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:23.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.690+0000 7fd29422d640 1 -- 172.21.15.122:0/3631017954 shutdown_connections 2024-09-17T06:05:23.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.690+0000 7fd29422d640 1 -- 172.21.15.122:0/3631017954 wait complete. 2024-09-17T06:05:23.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd29422d640 1 Processor -- start 2024-09-17T06:05:23.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd29422d640 1 -- start start 2024-09-17T06:05:23.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd29422d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28c0c38c0 0x7fd28c0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd29422d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd28c0c4330 0x7fd28c0c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd29422d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd28c1534d0 0x7fd28c1461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd29422d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c1538e0 con 0x7fd28c0c38c0 2024-09-17T06:05:23.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd29422d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c15a160 con 0x7fd28c1534d0 2024-09-17T06:05:23.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd29422d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd28c0ca2a0 con 0x7fd28c0c4330 2024-09-17T06:05:23.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd291fc9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28c0c38c0 0x7fd28c0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd291fc9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28c0c38c0 0x7fd28c0aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53170/0 (socket says 172.21.15.122:53170) 2024-09-17T06:05:23.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd291fc9640 1 -- 172.21.15.122:0/3782372341 learned_addr learned my addr 172.21.15.122:0/3782372341 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:23.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd2927ca640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd28c1534d0 0x7fd28c1461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd291fc9640 1 -- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd28c0c4330 msgr2=0x7fd28c0c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd291fc9640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd28c0c4330 0x7fd28c0c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd291fc9640 1 -- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd28c1534d0 msgr2=0x7fd28c1461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:23.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd291fc9640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd28c1534d0 0x7fd28c1461a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:23.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd291fc9640 1 -- 172.21.15.122:0/3782372341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c0af2e0 con 0x7fd28c0c38c0 2024-09-17T06:05:23.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd291fc9640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28c0c38c0 0x7fd28c0aeda0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd28800c420 tx=0x7fd28800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:23.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd2827fc640 1 -- 172.21.15.122:0/3782372341 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288011790 con 0x7fd28c0c38c0 2024-09-17T06:05:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd2827fc640 1 -- 172.21.15.122:0/3782372341 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd288017070 con 0x7fd28c0c38c0 2024-09-17T06:05:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd2827fc640 1 -- 172.21.15.122:0/3782372341 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288011ce0 con 0x7fd28c0c38c0 2024-09-17T06:05:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd29422d640 1 -- 172.21.15.122:0/3782372341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28c1f7d40 con 0x7fd28c0c38c0 2024-09-17T06:05:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.694+0000 7fd29422d640 1 -- 172.21.15.122:0/3782372341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28c1f8300 con 0x7fd28c0c38c0 2024-09-17T06:05:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.698+0000 7fd26ffff640 1 -- 172.21.15.122:0/3782372341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2680052a0 con 0x7fd28c0c38c0 2024-09-17T06:05:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.698+0000 7fd2827fc640 1 -- 172.21.15.122:0/3782372341 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd28801c460 con 0x7fd28c0c38c0 2024-09-17T06:05:23.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.698+0000 7fd2827fc640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd270073230 0x7fd270075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:23.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.698+0000 7fd2827fc640 1 -- 172.21.15.122:0/3782372341 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6804+0+0 (secure 0 0 0) 0x7fd2880943a0 con 0x7fd28c0c38c0 2024-09-17T06:05:23.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.702+0000 7fd2917c8640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd270073230 0x7fd270075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:23.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.702+0000 7fd2917c8640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd270073230 0x7fd270075740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd27c000f70 tx=0x7fd27c0079c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:23.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:23.706+0000 7fd2827fc640 1 -- 172.21.15.122:0/3782372341 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd28805eff0 con 0x7fd28c0c38c0 2024-09-17T06:05:23.714 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:23.714+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:23.810 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:23.810 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:23.810 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-09-17T06:05:23.810 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:23.815 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:23.814+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:23.825 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:05:23.915 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:23.914+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:24.004 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:24.004 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:24.004 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 180, 2024-09-17T06:05:24.005 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-09-17T06:05:24.005 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:24.016 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:24.014+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:24.020 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:05:24.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.054+0000 7fd26ffff640 1 -- 172.21.15.122:0/3782372341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) -- 0x7fd268005590 con 0x7fd28c0c38c0 2024-09-17T06:05:24.117 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:24.114+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:24.154 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:24.155 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:24.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:24.155 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:24.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.155 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:24.155 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:24.155 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.330910747999994, 2024-09-17T06:05:24.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044462499999999997, 2024-09-17T06:05:24.155 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.155 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.155 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.155 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823264+0000", 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3300000000000001e-06 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823284+0000", 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0132e-05 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823364+0000", 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9583e-05 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823395+0000", 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1171999999999999e-05 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823538+0000", 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014286600000000001 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823594+0000", 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890999999999997e-05 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827597+0000", 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004003665 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827708+0000", 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110611 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.159 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.330718297000004, 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043686330000000002, 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823455+0000", 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2160000000000001e-06 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823471+0000", 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5702999999999999e-05 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823492+0000", 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1039e-05 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823512+0000", 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0364999999999999e-05 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824294+0000", 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00078187600000000003 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824350+0000", 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5367e-05 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827719+0000", 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003368916 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827823+0000", 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104151 2024-09-17T06:05:24.163 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.330157517999993, 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0094234149999999992, 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824018+0000", 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3629999999999998e-06 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824036+0000", 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7606000000000001e-05 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824065+0000", 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9005000000000001e-05 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824092+0000", 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7396e-05 2024-09-17T06:05:24.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826491+0000", 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002398776 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826804+0000", 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000312782 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833438+0000", 2024-09-17T06:05:24.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066344869999999997 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.330087535000004, 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048433540000000002, 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824087+0000", 2024-09-17T06:05:24.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1830000000000001e-06 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824106+0000", 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8595999999999999e-05 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824137+0000", 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1322000000000003e-05 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824164+0000", 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6605e-05 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824807+0000", 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064339900000000001 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824861+0000", 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3687000000000003e-05 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828809+0000", 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039483909999999999 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828928+0000", 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119171 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:24.172 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.330006866000005, 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092145760000000004, 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824167+0000", 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7540000000000001e-06 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824178+0000", 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0276e-05 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824202+0000", 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4685000000000002e-05 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824223+0000", 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1036e-05 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825070+0000", 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084684500000000004 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825392+0000", 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032213499999999998 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833380+0000", 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079878450000000004 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.177 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-17T06:05:24.177 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:24.177 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.329001934999994, 2024-09-17T06:05:24.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038480469999999998, 2024-09-17T06:05:24.177 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.177 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.177 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.177 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:24.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825172+0000", 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.967e-06 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825190+0000", 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7866000000000001e-05 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825217+0000", 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6682e-05 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825239+0000", 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1968999999999999e-05 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825632+0000", 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00039355100000000001 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825690+0000", 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7797000000000002e-05 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828935+0000", 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032449449999999999 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829018+0000", 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3269999999999994e-05 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.327947432000002, 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002834755, 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.181 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826227+0000", 2024-09-17T06:05:24.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.906e-06 2024-09-17T06:05:24.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826256+0000", 2024-09-17T06:05:24.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8872000000000001e-05 2024-09-17T06:05:24.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826399+0000", 2024-09-17T06:05:24.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143156 2024-09-17T06:05:24.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826453+0000", 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4465000000000001e-05 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826628+0000", 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017420700000000001 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829060+0000", 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024321490000000002 2024-09-17T06:05:24.184 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.185 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.185 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:24.185 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:24.185 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.326196800999995, 2024-09-17T06:05:24.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055191049999999998, 2024-09-17T06:05:24.185 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.185 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.185 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.185 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827978+0000", 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0200000000000001e-06 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827997+0000", 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9836000000000001e-05 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828029+0000", 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1720999999999997e-05 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828055+0000", 2024-09-17T06:05:24.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5519000000000001e-05 2024-09-17T06:05:24.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828193+0000", 2024-09-17T06:05:24.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013821699999999999 2024-09-17T06:05:24.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828232+0000", 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9351000000000003e-05 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833396+0000", 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051640119999999999 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833495+0000", 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8429000000000002e-05 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.189 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.326071260000006, 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054928850000000003, 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:24.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828102+0000", 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-06 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828116+0000", 2024-09-17T06:05:24.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3716e-05 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828139+0000", 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3028999999999999e-05 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828156+0000", 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869000000000001e-05 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829124+0000", 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096778700000000001 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829158+0000", 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4671000000000001e-05 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833509+0000", 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004350802 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833594+0000", 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4814999999999993e-05 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.321320034999999, 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064859200000000003, 2024-09-17T06:05:24.194 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832854+0000", 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8330000000000001e-06 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832867+0000", 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.332e-05 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832906+0000", 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8800999999999997e-05 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6468000000000003e-05 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833094+0000", 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014082600000000001 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833501+0000", 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040734400000000002 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.321223230000001, 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00050376900000000005, 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.198 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832952+0000", 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4269999999999998e-06 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832965+0000", 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3736e-05 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832998+0000", 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2264999999999997e-05 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833027+0000", 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9658999999999998e-05 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833172+0000", 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014431900000000001 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833453+0000", 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028136300000000002 2024-09-17T06:05:24.201 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.319226294000003, 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00294042, 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834948+0000", 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.21e-06 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834968+0000", 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9443e-05 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835013+0000", 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5324000000000002e-05 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835038+0000", 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5358999999999999e-05 2024-09-17T06:05:24.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835255+0000", 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021677600000000001 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835304+0000", 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9261000000000002e-05 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837761+0000", 2024-09-17T06:05:24.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024567230000000001 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837886+0000", 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012532400000000001 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 63.555314938000002, 2024-09-17T06:05:24.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001082132, 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598860+0000", 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4569999999999999e-06 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598901+0000", 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1400999999999999e-05 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598934+0000", 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3012000000000002e-05 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598959+0000", 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4839000000000001e-05 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599073+0000", 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113763 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599099+0000", 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6120999999999999e-05 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599900+0000", 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00080140099999999998 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599940+0000", 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9137999999999997e-05 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.210 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.834667027000002, 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00153148, 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319508+0000", 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5399999999999998e-06 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319533+0000", 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4759000000000001e-05 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319568+0000", 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5305000000000002e-05 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319602+0000", 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3992999999999998e-05 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319715+0000", 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113112 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319745+0000", 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9580000000000001e-05 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.320978+0000", 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233165 2024-09-17T06:05:24.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.321037+0000", 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9026e-05 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.962495916999998, 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00083231099999999997, 2024-09-17T06:05:24.215 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191678+0000", 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869999999999999e-06 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191693+0000", 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4409e-05 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191713+0000", 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0523e-05 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191726+0000", 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3386e-05 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191806+0000", 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9287000000000002e-05 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191834+0000", 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8323e-05 2024-09-17T06:05:24.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192473+0000", 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063865000000000005 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192509+0000", 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6046e-05 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.219 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.436387641000003, 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096842599999999999, 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:24.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717787+0000", 2024-09-17T06:05:24.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.951e-06 2024-09-17T06:05:24.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717801+0000", 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3973e-05 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717822+0000", 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1328e-05 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717836+0000", 2024-09-17T06:05:24.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3944000000000001e-05 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717908+0000", 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1674999999999994e-05 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717940+0000", 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2728999999999998e-05 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718710+0000", 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076948100000000003 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718753+0000", 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3344999999999999e-05 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.224 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.435306830000002, 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065812800000000001, 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:24.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:24.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5000000000000001e-07 2024-09-17T06:05:24.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718872+0000", 2024-09-17T06:05:24.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5130000000000004e-06 2024-09-17T06:05:24.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718883+0000", 2024-09-17T06:05:24.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1195e-05 2024-09-17T06:05:24.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718892+0000", 2024-09-17T06:05:24.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5669999999999995e-06 2024-09-17T06:05:24.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718931+0000", 2024-09-17T06:05:24.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8850000000000002e-05 2024-09-17T06:05:24.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718948+0000", 2024-09-17T06:05:24.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7425999999999999e-05 2024-09-17T06:05:24.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719496+0000", 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00054753699999999996 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719524+0000", 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.809e-05 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.232 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:45 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'12, mlcod=26'10)", 2024-09-17T06:05:24.232 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:24.232 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.500940849000003, 2024-09-17T06:05:24.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013449270000000001, 2024-09-17T06:05:24.232 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:24.232 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:24.232 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:24.232 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653233+0000", 2024-09-17T06:05:24.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.796e-06 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653250+0000", 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7025999999999999e-05 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653272+0000", 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1338000000000001e-05 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:24.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653287+0000", 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5509999999999999e-05 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653383+0000", 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5904999999999997e-05 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653417+0000", 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3923e-05 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654510+0000", 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001092602 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654576+0000", 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6827000000000002e-05 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:24.236 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:24.238 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T06:05:24.238 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:24.234+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:24.339 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:24.334+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:24.398 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:24.398 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:24.398 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:24.398 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:24.415 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T06:05:24.440 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:24.438+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:24.463 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-17T06:05:24.463 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T06:05:24.463 INFO:tasks.thrashosds.thrasher:Killing osd 4, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-17T06:05:24.463 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T06:05:24.464 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:05:24.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.478+0000 7fd2827fc640 1 -- 172.21.15.122:0/3782372341 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v45) ==== 87+0+0 (secure 0 0 0) 0x7fd28805e8f0 con 0x7fd28c0c38c0 2024-09-17T06:05:24.480 INFO:teuthology.orchestra.run.smithi122.stderr:noscrub is set 2024-09-17T06:05:24.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.478+0000 7fd26ffff640 1 -- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd270073230 msgr2=0x7fd270075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:24.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.478+0000 7fd26ffff640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd270073230 0x7fd270075740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd27c000f70 tx=0x7fd27c0079c0 comp rx=0 tx=0).stop 2024-09-17T06:05:24.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.478+0000 7fd26ffff640 1 -- 172.21.15.122:0/3782372341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28c0c38c0 msgr2=0x7fd28c0aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:24.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.478+0000 7fd26ffff640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28c0c38c0 0x7fd28c0aeda0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd28800c420 tx=0x7fd28800c8e0 comp rx=0 tx=0).stop 2024-09-17T06:05:24.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.478+0000 7fd26ffff640 1 -- 172.21.15.122:0/3782372341 shutdown_connections 2024-09-17T06:05:24.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.478+0000 7fd26ffff640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd270073230 0x7fd270075740 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:24.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.478+0000 7fd26ffff640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd28c1534d0 0x7fd28c1461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:24.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.478+0000 7fd26ffff640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd28c0c4330 0x7fd28c0c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:24.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.478+0000 7fd26ffff640 1 --2- 172.21.15.122:0/3782372341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd28c0c38c0 0x7fd28c0aeda0 secure :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd28800c420 tx=0x7fd28800c8e0 comp rx=0 tx=0).stop 2024-09-17T06:05:24.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.478+0000 7fd26ffff640 1 -- 172.21.15.122:0/3782372341 >> 172.21.15.122:0/3782372341 conn(0x7fd28c070e40 msgr2=0x7fd28c156ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:24.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.482+0000 7fd26ffff640 1 -- 172.21.15.122:0/3782372341 shutdown_connections 2024-09-17T06:05:24.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:24.482+0000 7fd26ffff640 1 -- 172.21.15.122:0/3782372341 wait complete. 2024-09-17T06:05:24.542 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:24.542+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:24.547 INFO:teuthology.orchestra.run.smithi173.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-17T06:05:24.551 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T06:05:24.551 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.4 2024-09-17T06:05:24.551 INFO:tasks.thrashosds.thrasher:remote for osd 4 is ubuntu@smithi173.front.sepia.ceph.com 2024-09-17T06:05:24.552 DEBUG:teuthology.orchestra.run.smithi173:> type ceph-objectstore-tool 2024-09-17T06:05:24.553 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T06:05:24.554 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T06:05:24.600 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T06:05:24.601 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --op list-pgs 2024-09-17T06:05:24.642 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:24.638+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:24.727 INFO:teuthology.orchestra.run.smithi173.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-17T06:05:24.733 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T06:05:24.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:05:24.743 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:24.738+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:24.843 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:24.838+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:24.881 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:24.881 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:24.881 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:24.881 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:24.899 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:05:24.944 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:24.942+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:25.045 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:25.042+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:25.054 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:25.054 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:25.054 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:25.054 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:25.054 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:25.073 INFO:teuthology.orchestra.run.smithi173.stdout:4.cs0 2024-09-17T06:05:25.073 INFO:teuthology.orchestra.run.smithi173.stdout:4.bs2 2024-09-17T06:05:25.073 INFO:teuthology.orchestra.run.smithi173.stdout:4.9s0 2024-09-17T06:05:25.073 INFO:teuthology.orchestra.run.smithi173.stdout:4.8s1 2024-09-17T06:05:25.073 INFO:teuthology.orchestra.run.smithi173.stdout:4.1ds2 2024-09-17T06:05:25.073 INFO:teuthology.orchestra.run.smithi173.stdout:4.1as0 2024-09-17T06:05:25.073 INFO:teuthology.orchestra.run.smithi173.stdout:4.5s2 2024-09-17T06:05:25.073 INFO:teuthology.orchestra.run.smithi173.stdout:4.1s0 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:4.19s3 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:3.1a 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:3.1 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:3.1b 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:3.14 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:3.a 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:3.13 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:3.11 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:2.b 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:2.f 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:2.d 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:2.18 2024-09-17T06:05:25.074 INFO:teuthology.orchestra.run.smithi173.stdout:3.f 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:4.es0 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:2.11 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:4.1bs0 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:3.34 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:3.29 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:3.24 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:3.27 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:3.1d 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:3.2c 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:2.13 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:3.e 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:3.31 2024-09-17T06:05:25.075 INFO:teuthology.orchestra.run.smithi173.stdout:4.fs2 2024-09-17T06:05:25.076 INFO:teuthology.orchestra.run.smithi173.stdout:3.3 2024-09-17T06:05:25.076 INFO:teuthology.orchestra.run.smithi173.stdout:4.ds0 2024-09-17T06:05:25.076 INFO:teuthology.orchestra.run.smithi173.stdout:3.9 2024-09-17T06:05:25.076 INFO:teuthology.orchestra.run.smithi173.stdout:4.2s2 2024-09-17T06:05:25.076 INFO:teuthology.orchestra.run.smithi173.stdout:4.10s3 2024-09-17T06:05:25.076 INFO:teuthology.orchestra.run.smithi173.stdout:2.1a 2024-09-17T06:05:25.076 INFO:teuthology.orchestra.run.smithi173.stdout:3.1c 2024-09-17T06:05:25.076 INFO:teuthology.orchestra.run.smithi173.stdout:4.13s0 2024-09-17T06:05:25.076 INFO:teuthology.orchestra.run.smithi173.stdout:4.18s0 2024-09-17T06:05:25.077 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:05:25.145 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:25.142+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:25.220 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:25.220 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:25.220 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:25.220 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:25.220 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 71.396119201000005, 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.221 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.222 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.223 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:05:25.224 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.225 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 71.395998798999997, 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:25.227 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.228 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.229 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:25.230 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.231 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 71.395870884999994, 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.232 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:05:25.234 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.235 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.235 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.235 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:25.235 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:05:25.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.235 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.235 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.235 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:05:25.235 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:05:25.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.235 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.235 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.236 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:25.236 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:05:25.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.236 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.236 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:25.236 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:05:25.236 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:05:25.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.236 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.236 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.236 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:05:25.236 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.237 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 71.394844922000004, 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.238 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.239 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:05:25.240 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:05:25.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.241 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.241 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.241 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:05:25.241 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:05:25.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.241 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.241 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.241 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:05:25.241 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:05:25.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.241 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:05:25.242 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:05:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:05:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:05:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:05:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.243 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.244 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:05:25.244 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:05:25.244 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.244 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.244 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.244 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.244 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.244 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:25.244 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:25.244 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 71.394763979000004, 2024-09-17T06:05:25.244 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:05:25.244 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.245 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.245 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.245 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.245 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.245 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:25.245 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.245 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.245 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:25.245 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.246 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.248 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.248 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:05:25.248 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:05:25.248 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.248 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.248 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:25.248 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:05:25.248 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:05:25.248 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:25.250 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 71.394701577000006, 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:25.252 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.252 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.252 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:05:25.252 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:05:25.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.252 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.252 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:05:25.252 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:05:25.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.254 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:05:25.255 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:25.256 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 71.394629487000003, 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.257 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.258 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:05:25.259 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.260 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 71.394587286999993, 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:25.261 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.262 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.263 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:05:25.264 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 71.391995355000006, 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.265 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.266 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.267 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.268 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:05:25.268 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:05:25.268 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.268 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.268 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.268 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:05:25.268 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:05:25.268 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.268 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.268 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.268 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:05:25.268 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.269 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 71.391899219999999, 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:25.270 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.271 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.272 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:05:25.272 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:05:25.272 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.272 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.272 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.272 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:05:25.272 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:05:25.272 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.272 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.272 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.272 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:05:25.272 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.273 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:05:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 71.383466933999998, 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.276 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:05:25.277 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.278 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.279 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.280 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.280 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:05:25.280 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:05:25.280 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.280 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.280 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.280 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.280 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.280 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:05:25.280 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:25.280 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.289877713999999, 2024-09-17T06:05:25.280 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:25.281 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.282 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:05:25.283 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.284 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 64.619247349000005, 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.285 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.286 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:05:25.287 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.288 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.288 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.288 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:05:25.288 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:05:25.288 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.288 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.288 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.288 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:05:25.288 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:05:25.288 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.288 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.288 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:05:25.289 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.290 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:05:25.291 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:05:25.291 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.291 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.291 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.291 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.291 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.291 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:25.291 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:25.291 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.898576392999999, 2024-09-17T06:05:25.291 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:05:25.291 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.291 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.292 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:05:25.293 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.294 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:05:25.295 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.296 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.895892144000001, 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.297 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:25.298 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.298 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.298 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.298 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:25.298 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.298 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.298 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.298 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.298 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:25.298 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.298 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.298 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.299 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.299 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:05:25.299 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:05:25.299 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.299 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.299 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.299 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:05:25.299 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:05:25.299 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.299 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.299 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.299 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.300 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.301 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.026689470999997, 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.302 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.303 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.304 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:05:25.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.306 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:25.307 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:25.308 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.500248558999999, 2024-09-17T06:05:25.308 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:05:25.308 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.308 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.308 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.308 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.308 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.308 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.308 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:25.308 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.308 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:05:25.309 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:05:25.310 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.310 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.310 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.312 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:05:25.312 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:05:25.312 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.312 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.312 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.312 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:05:25.312 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:05:25.312 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.312 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:05:25.313 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.314 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:25.315 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:25.316 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.500019043000002, 2024-09-17T06:05:25.316 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:05:25.316 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.316 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.316 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.316 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.316 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.316 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.316 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:25.316 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.316 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.316 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:05:25.317 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.318 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:05:25.319 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.320 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:25.321 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 41.498054347, 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.322 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.323 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:05:25.324 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.325 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 37.564491459999999, 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.326 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.327 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.328 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:05:25.329 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.330 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:05:25.331 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:05:25.331 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.331 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.331 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.331 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:05:25.331 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:05:25.331 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.331 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.331 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.331 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.331 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.331 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:25.333 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:05:25.334 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:25.330+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:25.373 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --op export --pgid 3.1 --file /var/log/ceph/exp.3.1.4 2024-09-17T06:05:25.434 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:25.430+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:25.489 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:25.489 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:25.489 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:25.489 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:25.518 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:05:25.561 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:25.562+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:25.619 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:05:25.636 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:25.634+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:25.656 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:25.656 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:25.656 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:25.656 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:25.656 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:25.674 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:05:25.736 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:25.734+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:25.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.810+0000 7f0c31c68640 1 -- 172.21.15.122:0/2886429588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c2c06f5c0 msgr2=0x7f0c2c0c2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:25.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.810+0000 7f0c31c68640 1 --2- 172.21.15.122:0/2886429588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c2c06f5c0 0x7f0c2c0c2a20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0c4da0 tx=0x7f0c1c01f0b0 comp rx=0 tx=0).stop 2024-09-17T06:05:25.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.810+0000 7f0c31c68640 1 -- 172.21.15.122:0/2886429588 shutdown_connections 2024-09-17T06:05:25.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.810+0000 7f0c31c68640 1 --2- 172.21.15.122:0/2886429588 >> v2:172.21.15.173:3300/0 conn(0x7f0c2c0b3b80 0x7f0c2c152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:25.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.810+0000 7f0c31c68640 1 --2- 172.21.15.122:0/2886429588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c2c0c9fc0 0x7f0c2c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:25.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.810+0000 7f0c31c68640 1 --2- 172.21.15.122:0/2886429588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c2c06f5c0 0x7f0c2c0c2a20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:25.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.810+0000 7f0c31c68640 1 -- 172.21.15.122:0/2886429588 >> 172.21.15.122:0/2886429588 conn(0x7f0c2c073640 msgr2=0x7f0c2c0cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:25.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.810+0000 7f0c31c68640 1 -- 172.21.15.122:0/2886429588 shutdown_connections 2024-09-17T06:05:25.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.810+0000 7f0c31c68640 1 -- 172.21.15.122:0/2886429588 wait complete. 2024-09-17T06:05:25.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.814+0000 7f0c31c68640 1 Processor -- start 2024-09-17T06:05:25.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.814+0000 7f0c31c68640 1 -- start start 2024-09-17T06:05:25.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c31c68640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c2c0b3b80 0x7f0c2c141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:25.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c31c68640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c2c0c9fc0 0x7f0c2c147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:25.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c31c68640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c2c1f1c50 0x7f0c2c148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:25.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c31c68640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c06f0a0 con 0x7f0c2c1f1c50 2024-09-17T06:05:25.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c31c68640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c0c2f60 con 0x7f0c2c0b3b80 2024-09-17T06:05:25.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c31c68640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c1527c0 con 0x7f0c2c0c9fc0 2024-09-17T06:05:25.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c2c1f1c50 0x7f0c2c148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:25.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2affd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c2c0c9fc0 0x7f0c2c147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:25.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c2c1f1c50 0x7f0c2c148390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55238/0 (socket says 172.21.15.122:55238) 2024-09-17T06:05:25.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2affd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c2c0c9fc0 0x7f0c2c147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:45960/0 (socket says 172.21.15.122:45960) 2024-09-17T06:05:25.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2bfff640 1 -- 172.21.15.122:0/127195447 learned_addr learned my addr 172.21.15.122:0/127195447 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:25.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2b7fe640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c2c0b3b80 0x7f0c2c141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:25.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2affd640 1 -- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c2c0b3b80 msgr2=0x7f0c2c141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:25.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2affd640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c2c0b3b80 0x7f0c2c141670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:25.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2affd640 1 -- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c2c1f1c50 msgr2=0x7f0c2c148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:25.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2affd640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c2c1f1c50 0x7f0c2c148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:25.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2affd640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c0c2bb0 con 0x7f0c2c0c9fc0 2024-09-17T06:05:25.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2bfff640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c2c1f1c50 0x7f0c2c148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:05:25.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c2affd640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c2c0c9fc0 0x7f0c2c147e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000d5c0 tx=0x7f0c2000da80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:25.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20017070 con 0x7f0c2c0c9fc0 2024-09-17T06:05:25.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c20004310 con 0x7f0c2c0c9fc0 2024-09-17T06:05:25.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c200099b0 con 0x7f0c2c0c9fc0 2024-09-17T06:05:25.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c31c68640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c0b0310 con 0x7f0c2c0c9fc0 2024-09-17T06:05:25.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c31c68640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c1f1450 con 0x7f0c2c0c9fc0 2024-09-17T06:05:25.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.818+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f0c04005280 con 0x7f0c2c0c9fc0 2024-09-17T06:05:25.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.822+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0c20009b50 con 0x7f0c2c0c9fc0 2024-09-17T06:05:25.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.822+0000 7f0c13fff640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0c18073200 0x7f0c18075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:25.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.822+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(46..46 src has 1..46) ==== 6804+0+0 (secure 0 0 0) 0x7f0c20094490 con 0x7f0c2c0c9fc0 2024-09-17T06:05:25.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.822+0000 7f0c2b7fe640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0c18073200 0x7f0c18075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:25.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.822+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v46) ==== 54+0+16 (secure 0 0 0) 0x7f0c20096a30 con 0x7f0c2c0c9fc0 2024-09-17T06:05:25.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.822+0000 7f0c11ffb640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f0c040045f0 0x7f0c04004a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:25.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.822+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c04004f40 con 0x7f0c040045f0 2024-09-17T06:05:25.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.822+0000 7f0c2bfff640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f0c040045f0 0x7f0c04004a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:25.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.822+0000 7f0c2b7fe640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0c18073200 0x7f0c18075710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0b2000 tx=0x7f0c1c01d8f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:25.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.822+0000 7f0c2bfff640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f0c040045f0 0x7f0c04004a00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:25.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.822+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c04004f40 con 0x7f0c040045f0 2024-09-17T06:05:25.837 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:25.838+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:25.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.850+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c040013e0 con 0x7f0c040045f0 2024-09-17T06:05:25.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.854+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c040013e0 con 0x7f0c040045f0 2024-09-17T06:05:25.858 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:25.858 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:25.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.854+0000 7f0c11ffb640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f0c04001ea0 0x7f0c040029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:25.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.854+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f0c0400b3a0 con 0x7f0c04001ea0 2024-09-17T06:05:25.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.854+0000 7f0c2b7fe640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f0c04001ea0 0x7f0c040029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:25.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.854+0000 7f0c2b7fe640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f0c04001ea0 0x7f0c040029a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:25.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.858+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c0400b3a0 con 0x7f0c04001ea0 2024-09-17T06:05:25.880 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:25.881 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:25.881 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:25.881 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:25.881 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.881 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.881 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:05:25.881 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 87.242605440000006, 2024-09-17T06:05:25.881 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.55819121299999996, 2024-09-17T06:05:25.881 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.881 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.882 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.882 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.882 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.882 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.882 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 1 2024-09-17T06:05:25.882 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.882 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.882 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.882 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.882 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:05:25.882 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.883 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.883 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.883 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.883 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:05:25.883 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.883 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.883 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.883 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.883 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636958+0000", 2024-09-17T06:05:25.883 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4690000000000002e-06 2024-09-17T06:05:25.883 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.883 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.884 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.884 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636976+0000", 2024-09-17T06:05:25.884 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.802e-05 2024-09-17T06:05:25.884 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.884 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.884 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.884 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637001+0000", 2024-09-17T06:05:25.884 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4552000000000001e-05 2024-09-17T06:05:25.884 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.884 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.884 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.884 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637024+0000", 2024-09-17T06:05:25.885 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3391999999999999e-05 2024-09-17T06:05:25.885 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.885 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.885 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.885 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637134+0000", 2024-09-17T06:05:25.885 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000109715 2024-09-17T06:05:25.885 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.885 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.885 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for peered", 2024-09-17T06:05:25.885 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637157+0000", 2024-09-17T06:05:25.885 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3363999999999999e-05 2024-09-17T06:05:25.885 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.191892+0000", 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.55473470899999999 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.192190+0000", 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029832200000000001 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.192541+0000", 2024-09-17T06:05:25.886 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00035034999999999998 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.194061+0000", 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0015205959999999999 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.194944+0000", 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00088236399999999996 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.887 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.195056+0000", 2024-09-17T06:05:25.888 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011200399999999999 2024-09-17T06:05:25.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.888 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.888 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.888 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.195146+0000", 2024-09-17T06:05:25.888 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0356e-05 2024-09-17T06:05:25.888 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.888 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.888 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.888 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.889 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.889 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:05:25.889 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.538312188999996, 2024-09-17T06:05:25.889 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.01182241, 2024-09-17T06:05:25.889 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.889 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.889 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.889 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.889 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.890 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.890 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 42 2024-09-17T06:05:25.890 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.890 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.890 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.891 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.891 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:05:25.891 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.891 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.891 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.892 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:05:25.892 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.892 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.892 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.892 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.892 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341249+0000", 2024-09-17T06:05:25.893 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0729999999999999e-06 2024-09-17T06:05:25.893 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.893 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.893 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.893 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341257+0000", 2024-09-17T06:05:25.893 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8800000000000008e-06 2024-09-17T06:05:25.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.894 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.894 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.894 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341275+0000", 2024-09-17T06:05:25.894 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7842e-05 2024-09-17T06:05:25.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.894 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.895 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.895 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341292+0000", 2024-09-17T06:05:25.895 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6829000000000001e-05 2024-09-17T06:05:25.895 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.895 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.895 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.895 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346218+0000", 2024-09-17T06:05:25.896 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049260329999999998 2024-09-17T06:05:25.896 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.896 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.896 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.896 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346372+0000", 2024-09-17T06:05:25.896 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015433299999999999 2024-09-17T06:05:25.896 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.896 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.897 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.897 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346635+0000", 2024-09-17T06:05:25.897 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026296700000000002 2024-09-17T06:05:25.897 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.897 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.897 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.898 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351575+0000", 2024-09-17T06:05:25.898 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049397959999999998 2024-09-17T06:05:25.898 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.898 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.898 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.898 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352898+0000", 2024-09-17T06:05:25.899 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013230060000000001 2024-09-17T06:05:25.899 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.899 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.899 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.899 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352994+0000", 2024-09-17T06:05:25.899 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6045000000000006e-05 2024-09-17T06:05:25.900 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.900 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.900 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.900 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353070+0000", 2024-09-17T06:05:25.900 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6606000000000005e-05 2024-09-17T06:05:25.900 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.900 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.900 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.900 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.901 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.901 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.901 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:05:25.901 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.537819839999997, 2024-09-17T06:05:25.901 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011645713, 2024-09-17T06:05:25.901 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.901 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.901 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 43 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.902 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341743+0000", 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.903e-06 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341764+0000", 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0988999999999998e-05 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.904 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.904 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341808+0000", 2024-09-17T06:05:25.904 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3791000000000001e-05 2024-09-17T06:05:25.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.904 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.904 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.904 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341839+0000", 2024-09-17T06:05:25.904 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1216000000000001e-05 2024-09-17T06:05:25.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.904 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.348686+0000", 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068463589999999998 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.348832+0000", 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014631 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.349079+0000", 2024-09-17T06:05:25.905 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024698800000000001 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353095+0000", 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040160869999999998 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353170+0000", 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4976999999999997e-05 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.906 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353259+0000", 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9305e-05 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353386+0000", 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012678799999999999 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.537663107, 2024-09-17T06:05:25.907 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015057846, 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 44 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:05:25.908 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341899+0000", 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9e-06 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.909 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342021+0000", 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012252000000000001 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342055+0000", 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3095000000000001e-05 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342078+0000", 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3456e-05 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.911 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.911 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.349806+0000", 2024-09-17T06:05:25.911 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.007728253 2024-09-17T06:05:25.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.911 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.911 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.911 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.350088+0000", 2024-09-17T06:05:25.911 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00028207900000000002 2024-09-17T06:05:25.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.911 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.911 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.911 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.350527+0000", 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00043892200000000001 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353510+0000", 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029825590000000001 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356661+0000", 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0031514099999999999 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.912 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.913 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.913 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356817+0000", 2024-09-17T06:05:25.913 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015552900000000001 2024-09-17T06:05:25.913 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.913 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.913 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.913 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356955+0000", 2024-09-17T06:05:25.913 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013812300000000001 2024-09-17T06:05:25.913 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.913 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.913 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.913 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.537408213000006, 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015109994, 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 45 2024-09-17T06:05:25.914 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.915 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342154+0000", 2024-09-17T06:05:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9999999999999999e-06 2024-09-17T06:05:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342170+0000", 2024-09-17T06:05:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6506000000000001e-05 2024-09-17T06:05:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342196+0000", 2024-09-17T06:05:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5412e-05 2024-09-17T06:05:25.917 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.917 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.917 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.917 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342216+0000", 2024-09-17T06:05:25.917 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0191999999999999e-05 2024-09-17T06:05:25.917 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.917 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.917 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.917 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351692+0000", 2024-09-17T06:05:25.917 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0094760650000000005 2024-09-17T06:05:25.917 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.918 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.918 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.918 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351849+0000", 2024-09-17T06:05:25.918 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015737600000000001 2024-09-17T06:05:25.918 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.918 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.918 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.918 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352102+0000", 2024-09-17T06:05:25.918 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025282000000000001 2024-09-17T06:05:25.918 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.918 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.918 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.919 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356610+0000", 2024-09-17T06:05:25.919 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045081940000000001 2024-09-17T06:05:25.919 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.919 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.919 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.919 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356984+0000", 2024-09-17T06:05:25.919 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037321899999999999 2024-09-17T06:05:25.919 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.919 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.919 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.919 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357126+0000", 2024-09-17T06:05:25.920 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014265999999999999 2024-09-17T06:05:25.920 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.920 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.920 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.920 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357262+0000", 2024-09-17T06:05:25.920 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013554999999999999 2024-09-17T06:05:25.920 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.920 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.920 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.920 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.920 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.920 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.921 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:05:25.921 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.537307278, 2024-09-17T06:05:25.921 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015392114, 2024-09-17T06:05:25.921 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.921 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.921 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.921 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.921 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.921 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.921 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 46 2024-09-17T06:05:25.921 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.921 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.922 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342254+0000", 2024-09-17T06:05:25.923 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4169999999999999e-06 2024-09-17T06:05:25.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.923 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.923 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342268+0000", 2024-09-17T06:05:25.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4086e-05 2024-09-17T06:05:25.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.924 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.924 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342283+0000", 2024-09-17T06:05:25.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4919000000000001e-05 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342297+0000", 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3993e-05 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353648+0000", 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011350783 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.925 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353815+0000", 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016706499999999999 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.354039+0000", 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022362599999999999 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357286+0000", 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003246882 2024-09-17T06:05:25.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357422+0000", 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000136093 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357521+0000", 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.8876000000000007e-05 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357645+0000", 2024-09-17T06:05:25.927 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012437400000000001 2024-09-17T06:05:25.928 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.928 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.928 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.928 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.928 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.928 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.928 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:05:25.928 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.537212959000001, 2024-09-17T06:05:25.928 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.018409992999999999, 2024-09-17T06:05:25.928 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.928 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.928 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.929 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.929 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.929 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.929 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 47 2024-09-17T06:05:25.929 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.929 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.929 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.929 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.929 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:05:25.929 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.929 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.929 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.930 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.930 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:05:25.930 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.930 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.930 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.930 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.930 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342348+0000", 2024-09-17T06:05:25.930 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.333e-06 2024-09-17T06:05:25.930 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.930 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.931 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.931 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342464+0000", 2024-09-17T06:05:25.931 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011581100000000001 2024-09-17T06:05:25.931 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.931 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.931 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.931 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342485+0000", 2024-09-17T06:05:25.931 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0222000000000001e-05 2024-09-17T06:05:25.931 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.931 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.931 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.931 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342512+0000", 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7158999999999999e-05 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.354773+0000", 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.012261752000000001 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.355011+0000", 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000237982 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.932 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.355427+0000", 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000415234 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357770+0000", 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023435320000000002 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360464+0000", 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026934820000000001 2024-09-17T06:05:25.933 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360614+0000", 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015075900000000001 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360757+0000", 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014272699999999999 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.934 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.536997733000007, 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.020363284999999998, 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 48 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.935 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.936 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.936 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.936 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:05:25.936 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.936 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.936 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.936 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.936 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342564+0000", 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5269999999999999e-06 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342593+0000", 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9261e-05 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.937 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342617+0000", 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4258999999999999e-05 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342644+0000", 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6645999999999999e-05 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357867+0000", 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015222591000000001 2024-09-17T06:05:25.938 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.358013+0000", 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014652299999999999 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.358238+0000", 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000225193 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.939 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362590+0000", 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.004351471 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362643+0000", 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2957000000000001e-05 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362799+0000", 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015606600000000001 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.940 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362926+0000", 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012679100000000001 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.536872836000001, 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.021916326, 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.941 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.942 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.942 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.942 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.942 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.942 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 49 2024-09-17T06:05:25.942 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.942 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.942 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.942 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.943 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:05:25.943 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.943 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.943 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.943 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342689+0000", 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.79e-06 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342703+0000", 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3653e-05 2024-09-17T06:05:25.944 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342740+0000", 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6801000000000002e-05 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342761+0000", 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1713e-05 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.945 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359009+0000", 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.016247663999999998 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359291+0000", 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00028178399999999998 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359738+0000", 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00044704500000000003 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.946 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363113+0000", 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033748150000000002 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364339+0000", 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001226067 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364484+0000", 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014500599999999999 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.947 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364604+0000", 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000119988 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.536702860999995, 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023299408000000001, 2024-09-17T06:05:25.948 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 50 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.949 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342859+0000", 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.663e-06 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342981+0000", 2024-09-17T06:05:25.950 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012199800000000001 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343001+0000", 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0432e-05 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343020+0000", 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8236e-05 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360863+0000", 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.017843741 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.361095+0000", 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00023198199999999999 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.361364+0000", 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026886 2024-09-17T06:05:25.952 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.953 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.953 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.953 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364745+0000", 2024-09-17T06:05:25.953 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033806690000000002 2024-09-17T06:05:25.953 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.953 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.953 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.953 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365860+0000", 2024-09-17T06:05:25.953 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011155679999999999 2024-09-17T06:05:25.953 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.953 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.953 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366017+0000", 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015673299999999999 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366157+0000", 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013952600000000001 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.954 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.536512830000007, 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023463673000000001, 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 51 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.955 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343048+0000", 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0729999999999999e-06 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.956 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343057+0000", 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.2959999999999999e-06 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343068+0000", 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1793e-05 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343094+0000", 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5882000000000001e-05 2024-09-17T06:05:25.957 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.958 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.958 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.958 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363287+0000", 2024-09-17T06:05:25.958 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.020192673000000001 2024-09-17T06:05:25.958 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.958 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.958 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.958 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363457+0000", 2024-09-17T06:05:25.958 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017029600000000001 2024-09-17T06:05:25.958 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363687+0000", 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022974099999999999 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366188+0000", 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025014049999999999 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.959 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366282+0000", 2024-09-17T06:05:25.960 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3992000000000004e-05 2024-09-17T06:05:25.960 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.960 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.960 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.960 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366378+0000", 2024-09-17T06:05:25.960 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5152e-05 2024-09-17T06:05:25.960 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.960 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.960 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.960 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366511+0000", 2024-09-17T06:05:25.960 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013337000000000001 2024-09-17T06:05:25.960 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.961 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.961 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.961 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.961 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.961 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.961 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:05:25.961 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.536447033000002, 2024-09-17T06:05:25.961 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023823882000000001, 2024-09-17T06:05:25.961 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.961 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.962 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.962 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.962 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.962 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.962 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 52 2024-09-17T06:05:25.962 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.962 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.962 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.962 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.962 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:05:25.963 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.963 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.963 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.963 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.963 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:05:25.963 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.963 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.963 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.963 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.963 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343114+0000", 2024-09-17T06:05:25.963 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5700000000000001e-07 2024-09-17T06:05:25.963 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.964 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.964 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.964 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343122+0000", 2024-09-17T06:05:25.964 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4919999999999993e-06 2024-09-17T06:05:25.964 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.964 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.964 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.964 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343134+0000", 2024-09-17T06:05:25.964 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1970000000000001e-05 2024-09-17T06:05:25.965 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.965 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.965 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.965 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343144+0000", 2024-09-17T06:05:25.965 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6690000000000001e-06 2024-09-17T06:05:25.965 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.965 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.965 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.965 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364849+0000", 2024-09-17T06:05:25.965 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.021704826 2024-09-17T06:05:25.966 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.966 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.966 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.966 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365104+0000", 2024-09-17T06:05:25.966 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025510700000000002 2024-09-17T06:05:25.966 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.966 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.966 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.966 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365359+0000", 2024-09-17T06:05:25.966 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025527500000000001 2024-09-17T06:05:25.966 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366737+0000", 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001377739 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366772+0000", 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4629000000000003e-05 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.967 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366865+0000", 2024-09-17T06:05:25.968 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3220999999999994e-05 2024-09-17T06:05:25.968 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.968 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.968 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.968 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366937+0000", 2024-09-17T06:05:25.968 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.2096999999999998e-05 2024-09-17T06:05:25.968 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.968 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.968 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.968 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.968 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.266171239000002, 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010475561, 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 69 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.969 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.970 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.970 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:05:25.970 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.970 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.970 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.970 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.970 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:05:25.970 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.970 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.970 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.970 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.970 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613390+0000", 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.8899999999999998e-07 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613458+0000", 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.8127999999999996e-05 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613467+0000", 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0909999999999999e-06 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.971 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613474+0000", 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.2919999999999998e-06 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.615892+0000", 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002417836 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.615956+0000", 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3380000000000006e-05 2024-09-17T06:05:25.972 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616042+0000", 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6012000000000003e-05 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619165+0000", 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00312321 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.973 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623808+0000", 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0046427339999999999 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623836+0000", 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8839999999999998e-05 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623864+0000", 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8048999999999999e-05 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.974 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.266053486999994, 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010433403000000001, 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 70 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.975 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.8800000000000002e-07 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.976 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613512+0000", 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.2719999999999999e-06 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613518+0000", 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.4350000000000002e-06 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613524+0000", 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5110000000000003e-06 2024-09-17T06:05:25.977 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616673+0000", 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003149102 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616764+0000", 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1290000000000002e-05 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616880+0000", 2024-09-17T06:05:25.978 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011597800000000001 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619172+0000", 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0022917670000000001 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623892+0000", 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.004720391 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.979 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623918+0000", 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6186999999999998e-05 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623940+0000", 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1781999999999999e-05 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:05:25.980 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.265911330999998, 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010700696000000001, 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 71 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:05:25.981 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613650+0000", 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7300000000000005e-07 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.982 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613654+0000", 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6920000000000001e-06 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613662+0000", 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8439999999999998e-06 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613668+0000", 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6400000000000002e-06 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617192+0000", 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035246499999999998 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617294+0000", 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000101259 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617388+0000", 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4228999999999995e-05 2024-09-17T06:05:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620154+0000", 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0027657459999999999 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624067+0000", 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039132730000000001 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.985 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624226+0000", 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015945600000000001 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624349+0000", 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000123034 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.986 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.265881401000001, 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010774550000000001, 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 72 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.987 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.7399999999999998e-07 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.988 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613717+0000", 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7406000000000001e-05 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613723+0000", 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.652e-06 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613728+0000", 2024-09-17T06:05:25.989 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6789999999999996e-06 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617676+0000", 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039476759999999998 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617728+0000", 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2871999999999998e-05 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.990 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617814+0000", 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5463999999999994e-05 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621037+0000", 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032232910000000001 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624400+0000", 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033624240000000001 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.991 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624430+0000", 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0552000000000002e-05 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624453+0000", 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3059999999999999e-05 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.992 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.265808856999996, 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010781999, 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 73 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.993 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613752+0000", 2024-09-17T06:05:25.994 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.61e-07 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613758+0000", 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7209999999999999e-06 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613764+0000", 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3470000000000004e-06 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:25.995 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613769+0000", 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8810000000000004e-06 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618508+0000", 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047387669999999996 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618559+0000", 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1440999999999998e-05 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.996 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618705+0000", 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014593900000000001 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621041+0000", 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023357400000000002 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624482+0000", 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034416999999999998 2024-09-17T06:05:25.997 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624511+0000", 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8070000000000001e-05 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624533+0000", 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2731999999999999e-05 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.998 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.265781047999994, 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010828374999999999, 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 74 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:25.999 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:26.000 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8599999999999999e-07 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613782+0000", 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7010000000000001e-06 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613787+0000", 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3980000000000001e-06 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:26.001 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613790+0000", 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.805e-06 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619344+0000", 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.005553685 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619427+0000", 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.2897000000000003e-05 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.002 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.003 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:26.003 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619562+0000", 2024-09-17T06:05:26.003 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013549699999999999 2024-09-17T06:05:26.003 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.003 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.003 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:26.003 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621581+0000", 2024-09-17T06:05:26.003 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020184719999999999 2024-09-17T06:05:26.003 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.003 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.003 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:26.003 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624559+0000", 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029778230000000001 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624586+0000", 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7093e-05 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624607+0000", 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1617999999999999e-05 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:26.004 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:05:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.265709654999995, 2024-09-17T06:05:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011087911000000001, 2024-09-17T06:05:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 75 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:26.006 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613851+0000", 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.1099999999999995e-07 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613923+0000", 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1439999999999994e-05 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:26.007 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613930+0000", 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9629999999999998e-06 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613936+0000", 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5659999999999997e-06 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620210+0000", 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.006273514 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.008 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620263+0000", 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2982000000000002e-05 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620363+0000", 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000100802 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621596+0000", 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012330329999999999 2024-09-17T06:05:26.009 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624709+0000", 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003112971 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624838+0000", 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012835099999999999 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:26.010 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624938+0000", 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000100678 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.265609486000002, 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011079701000000001, 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:26.011 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 76 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:26.012 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1099999999999996e-07 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613954+0000", 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2009999999999999e-06 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.013 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613959+0000", 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0440000000000003e-06 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613964+0000", 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4329999999999997e-06 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621073+0000", 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0071095209999999997 2024-09-17T06:05:26.014 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621133+0000", 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9740000000000001e-05 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621250+0000", 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000117287 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621908+0000", 2024-09-17T06:05:26.015 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00065739599999999998 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624980+0000", 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0030722039999999998 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.625008+0000", 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8061000000000001e-05 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:26.016 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.625030+0000", 2024-09-17T06:05:26.017 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2303e-05 2024-09-17T06:05:26.017 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:26.017 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:26.017 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:26.017 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:26.017 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:26.017 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:26.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.882+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c040031b0 con 0x7f0c04001ea0 2024-09-17T06:05:26.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.886+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c040031b0 con 0x7f0c04001ea0 2024-09-17T06:05:26.019 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:26.020 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:05:26.020 INFO:teuthology.orchestra.run.smithi173.stderr:Exporting 3.1 info 3.1( empty local-lis/les=20/21 n=0 ec=20/20 lis/c=20/20 les/c/f=21/21/0 sis=20) 2024-09-17T06:05:26.020 INFO:teuthology.orchestra.run.smithi173.stderr:Export successful 2024-09-17T06:05:26.021 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:26.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.886+0000 7f0c11ffb640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f0c04003c30 0x7f0c04009c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:26.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.886+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f0c0400a460 con 0x7f0c04003c30 2024-09-17T06:05:26.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.886+0000 7f0c2affd640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f0c04003c30 0x7f0c04009c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:26.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.886+0000 7f0c2affd640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f0c04003c30 0x7f0c04009c90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:26.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.886+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c0400a460 con 0x7f0c04003c30 2024-09-17T06:05:26.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.914+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c0400a970 con 0x7f0c04003c30 2024-09-17T06:05:26.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.914+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c0400a970 con 0x7f0c04003c30 2024-09-17T06:05:26.022 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:26.023 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:26.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.914+0000 7f0c11ffb640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f0c0400aee0 0x7f0c0400fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:26.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.914+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f0c04012a50 con 0x7f0c0400aee0 2024-09-17T06:05:26.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.914+0000 7f0c2bfff640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f0c0400aee0 0x7f0c0400fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:26.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.918+0000 7f0c2bfff640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f0c0400aee0 0x7f0c0400fa80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:26.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.918+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c04012a50 con 0x7f0c0400aee0 2024-09-17T06:05:26.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.942+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c04011aa0 con 0x7f0c0400aee0 2024-09-17T06:05:26.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.946+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c04011aa0 con 0x7f0c0400aee0 2024-09-17T06:05:26.024 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:26.025 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:26.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.946+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=47}) -- 0x7f0c04011cb0 con 0x7f0c2c0c9fc0 2024-09-17T06:05:26.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.946+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0c04011aa0 con 0x7f0c2c0c9fc0 2024-09-17T06:05:26.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.946+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f0c20020040 con 0x7f0c2c0c9fc0 2024-09-17T06:05:26.025 INFO:teuthology.orchestra.run.smithi122.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-17T06:05:26.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.946+0000 7f0c11ffb640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f0c04012480 0x7f0c04010580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:26.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.946+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 10: {"prefix": "get_command_descriptions"}) -- 0x7f0c04010d90 con 0x7f0c04012480 2024-09-17T06:05:26.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.946+0000 7f0c2b7fe640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f0c04012480 0x7f0c04010580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:26.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.946+0000 7f0c2b7fe640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f0c04012480 0x7f0c04010580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:26.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.950+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 10: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c04010d90 con 0x7f0c04012480 2024-09-17T06:05:26.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.974+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c04010fd0 con 0x7f0c04012480 2024-09-17T06:05:26.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.978+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 11: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c04010fd0 con 0x7f0c04012480 2024-09-17T06:05:26.026 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:26.027 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:26.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.978+0000 7f0c11ffb640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f0c04014ca0 0x7f0c040170c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:26.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.978+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7f0c04019f60 con 0x7f0c04014ca0 2024-09-17T06:05:26.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.978+0000 7f0c2affd640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f0c04014ca0 0x7f0c040170c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:26.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.982+0000 7f0c2affd640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f0c04014ca0 0x7f0c040170c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:26.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:25.982+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c04019f60 con 0x7f0c04014ca0 2024-09-17T06:05:26.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.006+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c04019fc0 con 0x7f0c04014ca0 2024-09-17T06:05:26.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.010+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c04019fc0 con 0x7f0c04014ca0 2024-09-17T06:05:26.028 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:26.028 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:26.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.014+0000 7f0c11ffb640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f0c040192d0 0x7f0c040196e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:26.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.014+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7f0c0401d3b0 con 0x7f0c040192d0 2024-09-17T06:05:26.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.014+0000 7f0c2bfff640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f0c040192d0 0x7f0c040196e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:26.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.014+0000 7f0c2bfff640 1 --2- 172.21.15.122:0/127195447 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f0c040192d0 0x7f0c040196e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:26.029 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:26.014+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:26.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.014+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c0401d3b0 con 0x7f0c040192d0 2024-09-17T06:05:26.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.042+0000 7f0c11ffb640 1 -- 172.21.15.122:0/127195447 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c0401c230 con 0x7f0c040192d0 2024-09-17T06:05:26.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.046+0000 7f0c13fff640 1 -- 172.21.15.122:0/127195447 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c0401c230 con 0x7f0c040192d0 2024-09-17T06:05:26.049 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:26.049 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:26.058 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T06:05:26.058 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T06:05:26.120 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:26.118+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:26.198 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --force --op remove --pgid 3.1 2024-09-17T06:05:26.221 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:26.217+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:26.234 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:26.234 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:26.257 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:05:26.344 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:26.341+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:26.422 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:26.422+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:26.502 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:26.502 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:26.512 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T06:05:26.534 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:05:26.537 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:26.529+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:26.623 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:26.617+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:26.724 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:26.722+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:26.738 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:26.738 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:26.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.733+0000 7f99c9d3c640 1 -- 172.21.15.122:0/449682066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4158150 msgr2=0x7f99c4152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:26.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.733+0000 7f99c9d3c640 1 --2- 172.21.15.122:0/449682066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4158150 0x7f99c4152240 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009900 tx=0x7f99b401c850 comp rx=0 tx=0).stop 2024-09-17T06:05:26.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.733+0000 7f99c9d3c640 1 -- 172.21.15.122:0/449682066 shutdown_connections 2024-09-17T06:05:26.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.733+0000 7f99c9d3c640 1 --2- 172.21.15.122:0/449682066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4158150 0x7f99c4152240 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:26.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.733+0000 7f99c9d3c640 1 -- 172.21.15.122:0/449682066 >> 172.21.15.122:0/449682066 conn(0x7f99c40ca380 msgr2=0x7f99c40ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:26.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.733+0000 7f99c9d3c640 1 -- 172.21.15.122:0/449682066 shutdown_connections 2024-09-17T06:05:26.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.733+0000 7f99c9d3c640 1 -- 172.21.15.122:0/449682066 wait complete. 2024-09-17T06:05:26.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.737+0000 7f99c9d3c640 1 Processor -- start 2024-09-17T06:05:26.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.737+0000 7f99c9d3c640 1 -- start start 2024-09-17T06:05:26.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c9d3c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99c40c29c0 0x7f99c414a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:26.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c9d3c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99c40c2dd0 0x7f99c40c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:26.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c9d3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4158150 0x7f99c40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:26.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c9d3c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99c406ff60 con 0x7f99c4158150 2024-09-17T06:05:26.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4158150 0x7f99c40ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:26.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4158150 0x7f99c40ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55252/0 (socket says 172.21.15.122:55252) 2024-09-17T06:05:26.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c3fff640 1 -- 172.21.15.122:0/1309219585 learned_addr learned my addr 172.21.15.122:0/1309219585 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:26.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c37fe640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99c40c29c0 0x7f99c414a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:26.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99bbfff640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99c40c2dd0 0x7f99c40c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:26.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c9d3c640 1 -- 172.21.15.122:0/1309219585 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f99c4152780 con 0x7f99c40c2dd0 2024-09-17T06:05:26.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c9d3c640 1 -- 172.21.15.122:0/1309219585 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f99c40c7b30 con 0x7f99c40c29c0 2024-09-17T06:05:26.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c3fff640 1 -- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99c40c29c0 msgr2=0x7f99c414a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:26.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c3fff640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99c40c29c0 0x7f99c414a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:26.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c3fff640 1 -- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99c40c2dd0 msgr2=0x7f99c40c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:26.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c3fff640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99c40c2dd0 0x7f99c40c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:26.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c3fff640 1 -- 172.21.15.122:0/1309219585 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c41491a0 con 0x7f99c4158150 2024-09-17T06:05:26.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c3fff640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4158150 0x7f99c40ccab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f99bc002220 tx=0x7f99bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:26.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c0ff9640 1 -- 172.21.15.122:0/1309219585 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc003b80 con 0x7f99c4158150 2024-09-17T06:05:26.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c0ff9640 1 -- 172.21.15.122:0/1309219585 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99bc003d20 con 0x7f99c4158150 2024-09-17T06:05:26.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c9d3c640 1 -- 172.21.15.122:0/1309219585 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c4149480 con 0x7f99c4158150 2024-09-17T06:05:26.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c0ff9640 1 -- 172.21.15.122:0/1309219585 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc00aab0 con 0x7f99c4158150 2024-09-17T06:05:26.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.741+0000 7f99c9d3c640 1 -- 172.21.15.122:0/1309219585 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c40c6950 con 0x7f99c4158150 2024-09-17T06:05:26.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.745+0000 7f99c9d3c640 1 -- 172.21.15.122:0/1309219585 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c40c7960 con 0x7f99c4158150 2024-09-17T06:05:26.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.745+0000 7f99c0ff9640 1 -- 172.21.15.122:0/1309219585 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f99bc00ac50 con 0x7f99c4158150 2024-09-17T06:05:26.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.745+0000 7f99c0ff9640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f99a4073200 0x7f99a4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:26.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.745+0000 7f99c0ff9640 1 -- 172.21.15.122:0/1309219585 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6804+0+0 (secure 0 0 0) 0x7f99bc0980e0 con 0x7f99c4158150 2024-09-17T06:05:26.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.745+0000 7f99c37fe640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f99a4073200 0x7f99a4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:26.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.745+0000 7f99c37fe640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f99a4073200 0x7f99a4075710 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f99b40af000 tx=0x7f99b401b090 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:26.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:26.753+0000 7f99c0ff9640 1 -- 172.21.15.122:0/1309219585 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f99bc0627b0 con 0x7f99c4158150 2024-09-17T06:05:26.761 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:05:26.825 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:26.822+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:26.925 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:26.921+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:27.008 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:27.008 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:27.026 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:27.026+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:27.030 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:05:27.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.097+0000 7f99c9d3c640 1 -- 172.21.15.122:0/1309219585 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) -- 0x7f99c40729a0 con 0x7f99c4158150 2024-09-17T06:05:27.127 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:27.121+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:27.229 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:27.225+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:27.274 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:27.274 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:27.296 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:05:27.340 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:27.337+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:27.431 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:27.425+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:27.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.501+0000 7f99c0ff9640 1 -- 172.21.15.122:0/1309219585 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v48) ==== 97+0+0 (secure 0 0 0) 0x7f99bc0671e0 con 0x7f99c4158150 2024-09-17T06:05:27.507 INFO:teuthology.orchestra.run.smithi122.stderr:nodeep-scrub is set 2024-09-17T06:05:27.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.505+0000 7f99c9d3c640 1 -- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f99a4073200 msgr2=0x7f99a4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:27.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.505+0000 7f99c9d3c640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f99a4073200 0x7f99a4075710 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f99b40af000 tx=0x7f99b401b090 comp rx=0 tx=0).stop 2024-09-17T06:05:27.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.505+0000 7f99c9d3c640 1 -- 172.21.15.122:0/1309219585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4158150 msgr2=0x7f99c40ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:27.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.505+0000 7f99c9d3c640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4158150 0x7f99c40ccab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f99bc002220 tx=0x7f99bc00cbf0 comp rx=0 tx=0).stop 2024-09-17T06:05:27.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.505+0000 7f99c9d3c640 1 -- 172.21.15.122:0/1309219585 shutdown_connections 2024-09-17T06:05:27.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.505+0000 7f99c9d3c640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99c4158150 0x7f99c40ccab0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:27.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.505+0000 7f99c9d3c640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f99a4073200 0x7f99a4075710 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:27.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.505+0000 7f99c9d3c640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99c40c2dd0 0x7f99c40c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:27.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.505+0000 7f99c9d3c640 1 --2- 172.21.15.122:0/1309219585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99c40c29c0 0x7f99c414a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:27.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.505+0000 7f99c9d3c640 1 -- 172.21.15.122:0/1309219585 >> 172.21.15.122:0/1309219585 conn(0x7f99c40ca380 msgr2=0x7f99c4157250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:27.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.505+0000 7f99c9d3c640 1 -- 172.21.15.122:0/1309219585 shutdown_connections 2024-09-17T06:05:27.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:27.505+0000 7f99c9d3c640 1 -- 172.21.15.122:0/1309219585 wait complete. 2024-09-17T06:05:27.532 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:27.530+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:27.542 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:27.543 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:27.564 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:05:27.633 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:27.630+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:27.733 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:27.729+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:27.811 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:27.811 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:27.833 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:05:27.869 INFO:teuthology.orchestra.run.smithi173.stdout: marking collection for removal 2024-09-17T06:05:27.869 INFO:teuthology.orchestra.run.smithi173.stdout:setting '_remove' omap key 2024-09-17T06:05:27.869 INFO:teuthology.orchestra.run.smithi173.stdout:finish_remove_pgs 3.1_head removing 3.1 2024-09-17T06:05:27.869 INFO:teuthology.orchestra.run.smithi173.stdout:Remove successful 2024-09-17T06:05:27.876 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:27.873+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:27.936 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:27.934+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:28.037 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:28.038+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:28.059 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:05:28.077 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:28.078 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:28.103 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:05:28.144 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:28.141+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:28.239 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:28.238+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:28.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.257+0000 7ff6e1c08640 1 -- 172.21.15.122:0/2367285958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6c4005c70 msgr2=0x7ff6c40060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:28.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.257+0000 7ff6e1c08640 1 --2- 172.21.15.122:0/2367285958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6c4005c70 0x7ff6c40060e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00c4a0 tx=0x7ff6cc01f680 comp rx=0 tx=0).stop 2024-09-17T06:05:28.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.257+0000 7ff6dbfff640 1 -- 172.21.15.122:0/2367285958 reap_dead start 2024-09-17T06:05:28.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.257+0000 7ff6e1c08640 1 -- 172.21.15.122:0/2367285958 shutdown_connections 2024-09-17T06:05:28.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.257+0000 7ff6e1c08640 1 -- 172.21.15.122:0/2367285958 >> 172.21.15.122:0/2367285958 conn(0x7ff6dc073640 msgr2=0x7ff6dc0cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:28.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.257+0000 7ff6e1c08640 1 -- 172.21.15.122:0/2367285958 shutdown_connections 2024-09-17T06:05:28.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.257+0000 7ff6e1c08640 1 -- 172.21.15.122:0/2367285958 wait complete. 2024-09-17T06:05:28.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.261+0000 7ff6e1c08640 1 Processor -- start 2024-09-17T06:05:28.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.261+0000 7ff6e1c08640 1 -- start start 2024-09-17T06:05:28.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.261+0000 7ff6e1c08640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6dc157e80 0x7ff6dc144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:28.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6db7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6dc157e80 0x7ff6dc144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:28.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6db7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6dc157e80 0x7ff6dc144fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55276/0 (socket says 172.21.15.122:55276) 2024-09-17T06:05:28.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6db7fe640 1 -- 172.21.15.122:0/3770019063 learned_addr learned my addr 172.21.15.122:0/3770019063 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:28.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6e1c08640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6dc156fc0 0x7ff6dc1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:28.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6e1c08640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6dc14c5c0 0x7ff6dc14c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:28.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc06f0a0 con 0x7ff6dc157e80 2024-09-17T06:05:28.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc06edc0 con 0x7ff6dc156fc0 2024-09-17T06:05:28.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff6dc152280 con 0x7ff6dc14c5c0 2024-09-17T06:05:28.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6daffd640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6dc156fc0 0x7ff6dc1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:28.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6db7fe640 1 -- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6dc14c5c0 msgr2=0x7ff6dc14c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:28.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6db7fe640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6dc14c5c0 0x7ff6dc14c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:28.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6db7fe640 1 -- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6dc156fc0 msgr2=0x7ff6dc1573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:28.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6db7fe640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6dc156fc0 0x7ff6dc1573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:28.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6db7fe640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc0b3880 con 0x7ff6dc157e80 2024-09-17T06:05:28.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6db7fe640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6dc157e80 0x7ff6dc144fb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc01dd80 tx=0x7ff6cc0a8f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:28.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0b3040 con 0x7ff6dc157e80 2024-09-17T06:05:28.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6cc0bd030 con 0x7ff6dc157e80 2024-09-17T06:05:28.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6dc0b35a0 con 0x7ff6dc157e80 2024-09-17T06:05:28.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6dc0b1a30 con 0x7ff6dc157e80 2024-09-17T06:05:28.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.265+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7ff6dc1527e0 con 0x7ff6dc157e80 2024-09-17T06:05:28.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.269+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0036e0 con 0x7ff6dc157e80 2024-09-17T06:05:28.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.269+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff6cc003940 con 0x7ff6dc157e80 2024-09-17T06:05:28.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.269+0000 7ff6c3fff640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff6c8073230 0x7ff6c8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:28.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.269+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6804+0+0 (secure 0 0 0) 0x7ff6cc135c40 con 0x7ff6dc157e80 2024-09-17T06:05:28.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.269+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v48) ==== 54+0+16 (secure 0 0 0) 0x7ff6cc0ab070 con 0x7ff6dc157e80 2024-09-17T06:05:28.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.269+0000 7ff6daffd640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff6c8073230 0x7ff6c8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:28.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.269+0000 7ff6e1c08640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7ff6dc0b2230 0x7ff6dc148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:28.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.269+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6dc14d420 con 0x7ff6dc0b2230 2024-09-17T06:05:28.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.269+0000 7ff6dbfff640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7ff6dc0b2230 0x7ff6dc148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:28.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.269+0000 7ff6daffd640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff6c8073230 0x7ff6c8075740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc151880 tx=0x7ff6d00091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:28.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.269+0000 7ff6dbfff640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7ff6dc0b2230 0x7ff6dc148560 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:28.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.273+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6dc14d420 con 0x7ff6dc0b2230 2024-09-17T06:05:28.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.301+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff6dc0c96b0 con 0x7ff6dc0b2230 2024-09-17T06:05:28.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.301+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff6dc0c96b0 con 0x7ff6dc0b2230 2024-09-17T06:05:28.307 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:28.308 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:28.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.305+0000 7ff6e1c08640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7ff6dc1f0a30 0x7ff6dc1f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:28.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.305+0000 7ff6db7fe640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7ff6dc1f0a30 0x7ff6dc1f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:28.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.305+0000 7ff6db7fe640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7ff6dc1f0a30 0x7ff6dc1f0e40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:28.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.305+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7ff6dc1f1380 con 0x7ff6dc1f0a30 2024-09-17T06:05:28.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.305+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6cc109e50 con 0x7ff6dc1f0a30 2024-09-17T06:05:28.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.333+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff6dc157910 con 0x7ff6dc1f0a30 2024-09-17T06:05:28.339 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:28.333+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:28.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.337+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff6dc157910 con 0x7ff6dc1f0a30 2024-09-17T06:05:28.340 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:28.342 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:28.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.337+0000 7ff6e1c08640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff6dc063dc0 0x7ff6dc0641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:28.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.337+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7ff6dc064710 con 0x7ff6dc063dc0 2024-09-17T06:05:28.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.337+0000 7ff6daffd640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff6dc063dc0 0x7ff6dc0641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:28.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.337+0000 7ff6daffd640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff6dc063dc0 0x7ff6dc0641d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:28.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.337+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6dc064710 con 0x7ff6dc063dc0 2024-09-17T06:05:28.353 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:28.353 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:28.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.365+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff6dc064710 con 0x7ff6dc063dc0 2024-09-17T06:05:28.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.365+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff6dc064710 con 0x7ff6dc063dc0 2024-09-17T06:05:28.371 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:28.372 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:28.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.365+0000 7ff6e1c08640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7ff6dc1440b0 0x7ff6dc1444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:28.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.369+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7ff6dc144a00 con 0x7ff6dc1440b0 2024-09-17T06:05:28.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.369+0000 7ff6dbfff640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7ff6dc1440b0 0x7ff6dc1444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:28.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.369+0000 7ff6dbfff640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7ff6dc1440b0 0x7ff6dc1444c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:28.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.369+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6dc144a00 con 0x7ff6dc1440b0 2024-09-17T06:05:28.376 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:05:28.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.393+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff6dc02d720 con 0x7ff6dc1440b0 2024-09-17T06:05:28.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.397+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff6dc02d720 con 0x7ff6dc1440b0 2024-09-17T06:05:28.402 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:28.403 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:28.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.397+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=49}) -- 0x7ff6dc144a00 con 0x7ff6dc157e80 2024-09-17T06:05:28.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.397+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6dc02d720 con 0x7ff6dc157e80 2024-09-17T06:05:28.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.397+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ff6cc0c7040 con 0x7ff6dc157e80 2024-09-17T06:05:28.404 INFO:teuthology.orchestra.run.smithi122.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-17T06:05:28.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.397+0000 7ff6e1c08640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7ff6dc02e200 0x7ff6dc201830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:28.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.401+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 10: {"prefix": "get_command_descriptions"}) -- 0x7ff6dc02e690 con 0x7ff6dc02e200 2024-09-17T06:05:28.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.401+0000 7ff6db7fe640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7ff6dc02e200 0x7ff6dc201830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:28.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.401+0000 7ff6db7fe640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7ff6dc02e200 0x7ff6dc201830 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:28.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.401+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 10: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6cc109e50 con 0x7ff6dc02e200 2024-09-17T06:05:28.411 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.1.4 2024-09-17T06:05:28.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.425+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff6dc02e8d0 con 0x7ff6dc02e200 2024-09-17T06:05:28.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.429+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 11: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff6dc02e8d0 con 0x7ff6dc02e200 2024-09-17T06:05:28.434 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:28.435 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:28.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.429+0000 7ff6e1c08640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7ff6dc202280 0x7ff6dc2046a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:28.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.429+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7ff6dc207620 con 0x7ff6dc202280 2024-09-17T06:05:28.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.429+0000 7ff6daffd640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7ff6dc202280 0x7ff6dc2046a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:28.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.433+0000 7ff6daffd640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7ff6dc202280 0x7ff6dc2046a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:28.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.433+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6dc207620 con 0x7ff6dc202280 2024-09-17T06:05:28.440 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:28.437+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:28.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.457+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff6dc204c30 con 0x7ff6dc202280 2024-09-17T06:05:28.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.461+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff6dc204c30 con 0x7ff6dc202280 2024-09-17T06:05:28.467 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:28.468 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:28.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.461+0000 7ff6e1c08640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7ff6dc205710 0x7ff6dc205b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:28.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.461+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7ff6dc2072b0 con 0x7ff6dc205710 2024-09-17T06:05:28.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.461+0000 7ff6dbfff640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7ff6dc205710 0x7ff6dc205b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:28.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.465+0000 7ff6dbfff640 1 --2- 172.21.15.122:0/3770019063 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7ff6dc205710 0x7ff6dc205b20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:28.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.465+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6dc2072b0 con 0x7ff6dc205710 2024-09-17T06:05:28.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.489+0000 7ff6e1c08640 1 -- 172.21.15.122:0/3770019063 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff6dc207230 con 0x7ff6dc205710 2024-09-17T06:05:28.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:28.493+0000 7ff6c3fff640 1 -- 172.21.15.122:0/3770019063 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff6dc207230 con 0x7ff6dc205710 2024-09-17T06:05:28.498 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:28.499 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:28.510 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T06:05:28.511 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T06:05:28.552 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:28.549+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:28.604 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:28.605 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:28.605 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-09-17T06:05:28.605 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:28.627 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:05:28.676 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:28.673+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:28.744 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:28.742+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:28.844 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:28.841+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:28.878 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:28.878 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:28.878 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 180, 2024-09-17T06:05:28.878 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-09-17T06:05:28.878 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:28.899 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:05:28.945 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:28.941+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:29.046 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:29.041+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:29.147 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 75.322774713000001, 2024-09-17T06:05:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044462499999999997, 2024-09-17T06:05:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.148 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:29.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823264+0000", 2024-09-17T06:05:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3300000000000001e-06 2024-09-17T06:05:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823284+0000", 2024-09-17T06:05:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0132e-05 2024-09-17T06:05:29.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823364+0000", 2024-09-17T06:05:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9583e-05 2024-09-17T06:05:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823395+0000", 2024-09-17T06:05:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1171999999999999e-05 2024-09-17T06:05:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823538+0000", 2024-09-17T06:05:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014286600000000001 2024-09-17T06:05:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823594+0000", 2024-09-17T06:05:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890999999999997e-05 2024-09-17T06:05:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827597+0000", 2024-09-17T06:05:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004003665 2024-09-17T06:05:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827708+0000", 2024-09-17T06:05:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110611 2024-09-17T06:05:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 75.322582261999997, 2024-09-17T06:05:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043686330000000002, 2024-09-17T06:05:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823455+0000", 2024-09-17T06:05:29.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2160000000000001e-06 2024-09-17T06:05:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823471+0000", 2024-09-17T06:05:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5702999999999999e-05 2024-09-17T06:05:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823492+0000", 2024-09-17T06:05:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1039e-05 2024-09-17T06:05:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823512+0000", 2024-09-17T06:05:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0364999999999999e-05 2024-09-17T06:05:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824294+0000", 2024-09-17T06:05:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00078187600000000003 2024-09-17T06:05:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824350+0000", 2024-09-17T06:05:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5367e-05 2024-09-17T06:05:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827719+0000", 2024-09-17T06:05:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003368916 2024-09-17T06:05:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827823+0000", 2024-09-17T06:05:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104151 2024-09-17T06:05:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 75.322021483, 2024-09-17T06:05:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0094234149999999992, 2024-09-17T06:05:29.159 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824018+0000", 2024-09-17T06:05:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3629999999999998e-06 2024-09-17T06:05:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824036+0000", 2024-09-17T06:05:29.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7606000000000001e-05 2024-09-17T06:05:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824065+0000", 2024-09-17T06:05:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9005000000000001e-05 2024-09-17T06:05:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824092+0000", 2024-09-17T06:05:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7396e-05 2024-09-17T06:05:29.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826491+0000", 2024-09-17T06:05:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002398776 2024-09-17T06:05:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826804+0000", 2024-09-17T06:05:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000312782 2024-09-17T06:05:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833438+0000", 2024-09-17T06:05:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066344869999999997 2024-09-17T06:05:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 75.321951499999997, 2024-09-17T06:05:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048433540000000002, 2024-09-17T06:05:29.164 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824087+0000", 2024-09-17T06:05:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1830000000000001e-06 2024-09-17T06:05:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824106+0000", 2024-09-17T06:05:29.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8595999999999999e-05 2024-09-17T06:05:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824137+0000", 2024-09-17T06:05:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1322000000000003e-05 2024-09-17T06:05:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824164+0000", 2024-09-17T06:05:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6605e-05 2024-09-17T06:05:29.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824807+0000", 2024-09-17T06:05:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064339900000000001 2024-09-17T06:05:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824861+0000", 2024-09-17T06:05:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3687000000000003e-05 2024-09-17T06:05:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828809+0000", 2024-09-17T06:05:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039483909999999999 2024-09-17T06:05:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828928+0000", 2024-09-17T06:05:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119171 2024-09-17T06:05:29.169 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 75.321870830999998, 2024-09-17T06:05:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092145760000000004, 2024-09-17T06:05:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:29.170 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824167+0000", 2024-09-17T06:05:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7540000000000001e-06 2024-09-17T06:05:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824178+0000", 2024-09-17T06:05:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0276e-05 2024-09-17T06:05:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824202+0000", 2024-09-17T06:05:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4685000000000002e-05 2024-09-17T06:05:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824223+0000", 2024-09-17T06:05:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1036e-05 2024-09-17T06:05:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825070+0000", 2024-09-17T06:05:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084684500000000004 2024-09-17T06:05:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825392+0000", 2024-09-17T06:05:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032213499999999998 2024-09-17T06:05:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833380+0000", 2024-09-17T06:05:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079878450000000004 2024-09-17T06:05:29.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-17T06:05:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 75.320865900000001, 2024-09-17T06:05:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038480469999999998, 2024-09-17T06:05:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.175 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825172+0000", 2024-09-17T06:05:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.967e-06 2024-09-17T06:05:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825190+0000", 2024-09-17T06:05:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7866000000000001e-05 2024-09-17T06:05:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825217+0000", 2024-09-17T06:05:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6682e-05 2024-09-17T06:05:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825239+0000", 2024-09-17T06:05:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1968999999999999e-05 2024-09-17T06:05:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825632+0000", 2024-09-17T06:05:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00039355100000000001 2024-09-17T06:05:29.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825690+0000", 2024-09-17T06:05:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7797000000000002e-05 2024-09-17T06:05:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828935+0000", 2024-09-17T06:05:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032449449999999999 2024-09-17T06:05:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829018+0000", 2024-09-17T06:05:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3269999999999994e-05 2024-09-17T06:05:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 75.319811396999995, 2024-09-17T06:05:29.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002834755, 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:29.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826227+0000", 2024-09-17T06:05:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.906e-06 2024-09-17T06:05:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826256+0000", 2024-09-17T06:05:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8872000000000001e-05 2024-09-17T06:05:29.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826399+0000", 2024-09-17T06:05:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143156 2024-09-17T06:05:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826453+0000", 2024-09-17T06:05:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4465000000000001e-05 2024-09-17T06:05:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826628+0000", 2024-09-17T06:05:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017420700000000001 2024-09-17T06:05:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829060+0000", 2024-09-17T06:05:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024321490000000002 2024-09-17T06:05:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 75.318060766000002, 2024-09-17T06:05:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055191049999999998, 2024-09-17T06:05:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827978+0000", 2024-09-17T06:05:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0200000000000001e-06 2024-09-17T06:05:29.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827997+0000", 2024-09-17T06:05:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9836000000000001e-05 2024-09-17T06:05:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828029+0000", 2024-09-17T06:05:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1720999999999997e-05 2024-09-17T06:05:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828055+0000", 2024-09-17T06:05:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5519000000000001e-05 2024-09-17T06:05:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828193+0000", 2024-09-17T06:05:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013821699999999999 2024-09-17T06:05:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828232+0000", 2024-09-17T06:05:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9351000000000003e-05 2024-09-17T06:05:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833396+0000", 2024-09-17T06:05:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051640119999999999 2024-09-17T06:05:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833495+0000", 2024-09-17T06:05:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8429000000000002e-05 2024-09-17T06:05:29.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 75.317935224999999, 2024-09-17T06:05:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054928850000000003, 2024-09-17T06:05:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.190 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828102+0000", 2024-09-17T06:05:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-06 2024-09-17T06:05:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828116+0000", 2024-09-17T06:05:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3716e-05 2024-09-17T06:05:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828139+0000", 2024-09-17T06:05:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3028999999999999e-05 2024-09-17T06:05:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828156+0000", 2024-09-17T06:05:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869000000000001e-05 2024-09-17T06:05:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829124+0000", 2024-09-17T06:05:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096778700000000001 2024-09-17T06:05:29.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829158+0000", 2024-09-17T06:05:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4671000000000001e-05 2024-09-17T06:05:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833509+0000", 2024-09-17T06:05:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004350802 2024-09-17T06:05:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833594+0000", 2024-09-17T06:05:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4814999999999993e-05 2024-09-17T06:05:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-17T06:05:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 75.313184000000007, 2024-09-17T06:05:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064859200000000003, 2024-09-17T06:05:29.195 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:29.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832854+0000", 2024-09-17T06:05:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8330000000000001e-06 2024-09-17T06:05:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832867+0000", 2024-09-17T06:05:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.332e-05 2024-09-17T06:05:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832906+0000", 2024-09-17T06:05:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8800999999999997e-05 2024-09-17T06:05:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6468000000000003e-05 2024-09-17T06:05:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833094+0000", 2024-09-17T06:05:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014082600000000001 2024-09-17T06:05:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833501+0000", 2024-09-17T06:05:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040734400000000002 2024-09-17T06:05:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-17T06:05:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 75.313087194999994, 2024-09-17T06:05:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00050376900000000005, 2024-09-17T06:05:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832952+0000", 2024-09-17T06:05:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4269999999999998e-06 2024-09-17T06:05:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832965+0000", 2024-09-17T06:05:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3736e-05 2024-09-17T06:05:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832998+0000", 2024-09-17T06:05:29.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2264999999999997e-05 2024-09-17T06:05:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833027+0000", 2024-09-17T06:05:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9658999999999998e-05 2024-09-17T06:05:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833172+0000", 2024-09-17T06:05:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014431900000000001 2024-09-17T06:05:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833453+0000", 2024-09-17T06:05:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028136300000000002 2024-09-17T06:05:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-17T06:05:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:29.204 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 75.311090258999997, 2024-09-17T06:05:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00294042, 2024-09-17T06:05:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834948+0000", 2024-09-17T06:05:29.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.21e-06 2024-09-17T06:05:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834968+0000", 2024-09-17T06:05:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9443e-05 2024-09-17T06:05:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835013+0000", 2024-09-17T06:05:29.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5324000000000002e-05 2024-09-17T06:05:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835038+0000", 2024-09-17T06:05:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5358999999999999e-05 2024-09-17T06:05:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835255+0000", 2024-09-17T06:05:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021677600000000001 2024-09-17T06:05:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835304+0000", 2024-09-17T06:05:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9261000000000002e-05 2024-09-17T06:05:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837761+0000", 2024-09-17T06:05:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024567230000000001 2024-09-17T06:05:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837886+0000", 2024-09-17T06:05:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012532400000000001 2024-09-17T06:05:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-17T06:05:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.547178903000002, 2024-09-17T06:05:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001082132, 2024-09-17T06:05:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.211 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598860+0000", 2024-09-17T06:05:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4569999999999999e-06 2024-09-17T06:05:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598901+0000", 2024-09-17T06:05:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1400999999999999e-05 2024-09-17T06:05:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598934+0000", 2024-09-17T06:05:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3012000000000002e-05 2024-09-17T06:05:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598959+0000", 2024-09-17T06:05:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4839000000000001e-05 2024-09-17T06:05:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599073+0000", 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113763 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599099+0000", 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6120999999999999e-05 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599900+0000", 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00080140099999999998 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599940+0000", 2024-09-17T06:05:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9137999999999997e-05 2024-09-17T06:05:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-17T06:05:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:29.216 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 66.826530992000002, 2024-09-17T06:05:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00153148, 2024-09-17T06:05:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319508+0000", 2024-09-17T06:05:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5399999999999998e-06 2024-09-17T06:05:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319533+0000", 2024-09-17T06:05:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4759000000000001e-05 2024-09-17T06:05:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319568+0000", 2024-09-17T06:05:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5305000000000002e-05 2024-09-17T06:05:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319602+0000", 2024-09-17T06:05:29.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3992999999999998e-05 2024-09-17T06:05:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319715+0000", 2024-09-17T06:05:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113112 2024-09-17T06:05:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319745+0000", 2024-09-17T06:05:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9580000000000001e-05 2024-09-17T06:05:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.320978+0000", 2024-09-17T06:05:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233165 2024-09-17T06:05:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.321037+0000", 2024-09-17T06:05:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9026e-05 2024-09-17T06:05:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-17T06:05:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.954359882000006, 2024-09-17T06:05:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00083231099999999997, 2024-09-17T06:05:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191678+0000", 2024-09-17T06:05:29.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869999999999999e-06 2024-09-17T06:05:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191693+0000", 2024-09-17T06:05:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4409e-05 2024-09-17T06:05:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191713+0000", 2024-09-17T06:05:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0523e-05 2024-09-17T06:05:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191726+0000", 2024-09-17T06:05:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3386e-05 2024-09-17T06:05:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191806+0000", 2024-09-17T06:05:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9287000000000002e-05 2024-09-17T06:05:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191834+0000", 2024-09-17T06:05:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8323e-05 2024-09-17T06:05:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192473+0000", 2024-09-17T06:05:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063865000000000005 2024-09-17T06:05:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192509+0000", 2024-09-17T06:05:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6046e-05 2024-09-17T06:05:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-17T06:05:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.428251606000003, 2024-09-17T06:05:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096842599999999999, 2024-09-17T06:05:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.227 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717787+0000", 2024-09-17T06:05:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.951e-06 2024-09-17T06:05:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717801+0000", 2024-09-17T06:05:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3973e-05 2024-09-17T06:05:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717822+0000", 2024-09-17T06:05:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1328e-05 2024-09-17T06:05:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717836+0000", 2024-09-17T06:05:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3944000000000001e-05 2024-09-17T06:05:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717908+0000", 2024-09-17T06:05:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1674999999999994e-05 2024-09-17T06:05:29.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717940+0000", 2024-09-17T06:05:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2728999999999998e-05 2024-09-17T06:05:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718710+0000", 2024-09-17T06:05:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076948100000000003 2024-09-17T06:05:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718753+0000", 2024-09-17T06:05:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3344999999999999e-05 2024-09-17T06:05:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-17T06:05:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.427170795000002, 2024-09-17T06:05:29.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065812800000000001, 2024-09-17T06:05:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5000000000000001e-07 2024-09-17T06:05:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718872+0000", 2024-09-17T06:05:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5130000000000004e-06 2024-09-17T06:05:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718883+0000", 2024-09-17T06:05:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1195e-05 2024-09-17T06:05:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718892+0000", 2024-09-17T06:05:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5669999999999995e-06 2024-09-17T06:05:29.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718931+0000", 2024-09-17T06:05:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8850000000000002e-05 2024-09-17T06:05:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718948+0000", 2024-09-17T06:05:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7425999999999999e-05 2024-09-17T06:05:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719496+0000", 2024-09-17T06:05:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00054753699999999996 2024-09-17T06:05:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719524+0000", 2024-09-17T06:05:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.809e-05 2024-09-17T06:05:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:45 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'12, mlcod=26'10)", 2024-09-17T06:05:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.492804814000003, 2024-09-17T06:05:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013449270000000001, 2024-09-17T06:05:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653233+0000", 2024-09-17T06:05:29.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.796e-06 2024-09-17T06:05:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653250+0000", 2024-09-17T06:05:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7025999999999999e-05 2024-09-17T06:05:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653272+0000", 2024-09-17T06:05:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1338000000000001e-05 2024-09-17T06:05:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653287+0000", 2024-09-17T06:05:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5509999999999999e-05 2024-09-17T06:05:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653383+0000", 2024-09-17T06:05:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5904999999999997e-05 2024-09-17T06:05:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:29.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653417+0000", 2024-09-17T06:05:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3923e-05 2024-09-17T06:05:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654510+0000", 2024-09-17T06:05:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001092602 2024-09-17T06:05:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:29.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654576+0000", 2024-09-17T06:05:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6827000000000002e-05 2024-09-17T06:05:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:29.243 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:29.243 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:29.243 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:29.141+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:29.244 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:05:29.248 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:29.246+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:29.349 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:29.346+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:29.402 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:29.402 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:29.403 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:29.403 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:29.420 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:05:29.462 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:29.462+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:29.536 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T06:05:29.580 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:29.577+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:29.618 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:29.618 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:29.618 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:29.618 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:29.618 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:29.634 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:05:29.652 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:29.649+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:29.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.737+0000 7fc4950f8640 1 -- 172.21.15.122:0/934040721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4900c28a0 msgr2=0x7fc4901629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:29.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.737+0000 7fc4950f8640 1 --2- 172.21.15.122:0/934040721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4900c28a0 0x7fc4901629f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc490074290 tx=0x7fc48801f580 comp rx=0 tx=0).stop 2024-09-17T06:05:29.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.737+0000 7fc4950f8640 1 -- 172.21.15.122:0/934040721 shutdown_connections 2024-09-17T06:05:29.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.737+0000 7fc4950f8640 1 --2- 172.21.15.122:0/934040721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4900c28a0 0x7fc4901629f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:29.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.737+0000 7fc4950f8640 1 --2- 172.21.15.122:0/934040721 >> v2:172.21.15.173:3300/0 conn(0x7fc49006fe00 0x7fc490158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:29.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.737+0000 7fc4950f8640 1 -- 172.21.15.122:0/934040721 >> 172.21.15.122:0/934040721 conn(0x7fc4900ca380 msgr2=0x7fc4900ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:29.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.737+0000 7fc4950f8640 1 -- 172.21.15.122:0/934040721 shutdown_connections 2024-09-17T06:05:29.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.737+0000 7fc4950f8640 1 -- 172.21.15.122:0/934040721 wait complete. 2024-09-17T06:05:29.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc4950f8640 1 Processor -- start 2024-09-17T06:05:29.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc4950f8640 1 -- start start 2024-09-17T06:05:29.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc4950f8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc49006fe00 0x7fc490155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:29.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc48ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc49006fe00 0x7fc490155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:29.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc48ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc49006fe00 0x7fc490155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55292/0 (socket says 172.21.15.122:55292) 2024-09-17T06:05:29.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc4950f8640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4900c28a0 0x7fc49014a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:29.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc48ed9d640 1 -- 172.21.15.122:0/335994286 learned_addr learned my addr 172.21.15.122:0/335994286 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:29.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc4950f8640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc49014eb30 0x7fc490142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:29.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc49006f600 con 0x7fc49006fe00 2024-09-17T06:05:29.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc49006f320 con 0x7fc49014eb30 2024-09-17T06:05:29.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc49006f8e0 con 0x7fc4900c28a0 2024-09-17T06:05:29.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc487fff640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4900c28a0 0x7fc49014a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:29.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.741+0000 7fc48f59e640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc49014eb30 0x7fc490142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:29.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc48ed9d640 1 -- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4900c28a0 msgr2=0x7fc49014a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:29.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc48ed9d640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4900c28a0 0x7fc49014a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:29.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc48ed9d640 1 -- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc49014eb30 msgr2=0x7fc490142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:29.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc48ed9d640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc49014eb30 0x7fc490142fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:29.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc48ed9d640 1 -- 172.21.15.122:0/335994286 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4901f2680 con 0x7fc49006fe00 2024-09-17T06:05:29.749 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc48ed9d640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc49006fe00 0x7fc490155ee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc48000e7d0 tx=0x7fc48000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:29.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc4877fe640 1 -- 172.21.15.122:0/335994286 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48000ccc0 con 0x7fc49006fe00 2024-09-17T06:05:29.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc4877fe640 1 -- 172.21.15.122:0/335994286 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc480010430 con 0x7fc49006fe00 2024-09-17T06:05:29.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc4877fe640 1 -- 172.21.15.122:0/335994286 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480010860 con 0x7fc49006fe00 2024-09-17T06:05:29.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4901f2960 con 0x7fc49006fe00 2024-09-17T06:05:29.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4901f2f20 con 0x7fc49006fe00 2024-09-17T06:05:29.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4900c2cb0 con 0x7fc49006fe00 2024-09-17T06:05:29.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.745+0000 7fc4877fe640 1 -- 172.21.15.122:0/335994286 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc480010a00 con 0x7fc49006fe00 2024-09-17T06:05:29.752 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:29.750+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:29.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.753+0000 7fc4877fe640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc470073280 0x7fc470075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:29.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.753+0000 7fc4877fe640 1 -- 172.21.15.122:0/335994286 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6804+0+0 (secure 0 0 0) 0x7fc480094dd0 con 0x7fc49006fe00 2024-09-17T06:05:29.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.753+0000 7fc487fff640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc470073280 0x7fc470075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:29.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.753+0000 7fc487fff640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc470073280 0x7fc470075790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc49014e4d0 tx=0x7fc478009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:29.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:29.757+0000 7fc4877fe640 1 -- 172.21.15.122:0/335994286 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc48005f550 con 0x7fc49006fe00 2024-09-17T06:05:29.783 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:29.784 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:29.784 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:29.784 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:29.784 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.784 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:29.785 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:29.785 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 75.959837285999996, 2024-09-17T06:05:29.785 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:05:29.785 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:29.785 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:29.786 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.786 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:29.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:29.786 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:29.787 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.787 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.787 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:29.787 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:29.787 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.788 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.788 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:29.788 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:05:29.788 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:05:29.789 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.789 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.789 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:29.789 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:05:29.789 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:05:29.790 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.790 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.790 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:29.790 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:05:29.790 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:05:29.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.791 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.791 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.791 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:05:29.791 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:05:29.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.791 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.791 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:29.791 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:05:29.792 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:05:29.792 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.792 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.792 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:29.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:05:29.792 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:05:29.792 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.793 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.793 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:29.793 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:05:29.793 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:05:29.793 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.793 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.793 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:29.794 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:05:29.794 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:05:29.794 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.794 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:29.794 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.794 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.794 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.794 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:29.795 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:29.795 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 75.959725062000004, 2024-09-17T06:05:29.795 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:05:29.795 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:29.795 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:29.795 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.795 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:29.795 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.795 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:29.795 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:29.795 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.796 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.796 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:29.796 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:29.796 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.796 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.796 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:29.796 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:05:29.796 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:05:29.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.796 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.796 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:29.797 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:05:29.797 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:05:29.797 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.797 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.797 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:29.797 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:05:29.797 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:05:29.797 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.797 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.797 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.797 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:05:29.798 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:05:29.798 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.798 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.798 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:29.798 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:05:29.798 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:05:29.798 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.798 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.798 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:29.798 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:05:29.798 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:05:29.798 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.799 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.799 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:29.799 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:05:29.799 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:05:29.799 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.799 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.799 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:29.799 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:05:29.799 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:05:29.799 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.799 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:29.799 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.800 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.800 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.800 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:29.800 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:29.800 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 75.959519712000002, 2024-09-17T06:05:29.800 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:05:29.800 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:29.800 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:29.800 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.800 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:29.801 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:29.802 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:05:29.802 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.802 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.802 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:29.802 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:05:29.802 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:05:29.802 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.802 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.802 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:29.802 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:05:29.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:05:29.805 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.805 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:29.805 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.805 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.805 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:29.805 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:29.805 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 75.953379186000006, 2024-09-17T06:05:29.805 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:05:29.805 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:29.805 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:29.805 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.806 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.807 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:29.807 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:05:29.807 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:05:29.807 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.807 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.807 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:29.807 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:05:29.807 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:05:29.807 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.807 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.807 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:29.807 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.809 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:29.809 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:05:29.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:05:29.809 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.809 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.809 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:29.809 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:29.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:05:29.809 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.809 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.809 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:29.809 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:05:29.810 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:05:29.810 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.810 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:29.810 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.810 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.810 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:29.810 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:29.810 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 75.953224460000001, 2024-09-17T06:05:29.810 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:05:29.810 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:29.810 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:29.811 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:29.811 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:29.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:29.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:29.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:29.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:29.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:29.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:05:29.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:05:29.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:29.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:05:29.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:05:29.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:29.813 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:05:29.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:05:29.813 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.813 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.813 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.813 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:05:29.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:05:29.813 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.813 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.813 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:29.813 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:05:29.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:05:29.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.814 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.814 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:29.814 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:05:29.814 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:05:29.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.814 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.814 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:29.814 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:05:29.814 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:05:29.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.815 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:29.815 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:05:29.815 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:05:29.815 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.815 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:29.815 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.815 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.815 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "MOSDPGPushReply(2.15 43/42 [PushReplyOp(2:a93a17c2:::604.00000000:head)])", 2024-09-17T06:05:29.815 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:29.815 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 9.1501233989999999, 2024-09-17T06:05:29.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033440999999999999, 2024-09-17T06:05:29.816 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:29.816 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:29.816 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:29.816 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:29.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:29.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:29.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:29.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:29.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:29.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632988+0000", 2024-09-17T06:05:29.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4499999999999996e-07 2024-09-17T06:05:29.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:29.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632997+0000", 2024-09-17T06:05:29.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8349999999999993e-06 2024-09-17T06:05:29.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:29.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633010+0000", 2024-09-17T06:05:29.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2907e-05 2024-09-17T06:05:29.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.819 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.819 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633032+0000", 2024-09-17T06:05:29.819 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2867e-05 2024-09-17T06:05:29.819 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.819 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.819 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:29.820 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633091+0000", 2024-09-17T06:05:29.820 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8504000000000001e-05 2024-09-17T06:05:29.820 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.820 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.820 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:29.820 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633322+0000", 2024-09-17T06:05:29.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000230552 2024-09-17T06:05:29.821 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.821 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:29.821 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.821 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "MOSDPGPushReply(2.15 43/42 [PushReplyOp(2:aa448500:::500.00000000:head)])", 2024-09-17T06:05:29.821 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:29.821 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 9.1479115909999997, 2024-09-17T06:05:29.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000220134, 2024-09-17T06:05:29.822 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:29.822 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:29.822 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:29.822 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:29.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:29.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:29.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8999999999999997e-07 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:29.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635206+0000", 2024-09-17T06:05:29.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2949999999999999e-06 2024-09-17T06:05:29.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:29.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635220+0000", 2024-09-17T06:05:29.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3821e-05 2024-09-17T06:05:29.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:29.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635233+0000", 2024-09-17T06:05:29.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3797e-05 2024-09-17T06:05:29.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:29.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635277+0000", 2024-09-17T06:05:29.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3161000000000002e-05 2024-09-17T06:05:29.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:29.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:29.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:29.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635419+0000", 2024-09-17T06:05:29.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014257000000000001 2024-09-17T06:05:29.825 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.825 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:29.825 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.826 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:29.826 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:29.826 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:29.827 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:05:29.869 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:29.870+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:29.954 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:29.949+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:30.020 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:30.020 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:30.020 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:30.020 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:30.037 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:05:30.055 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:30.049+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:30.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.101+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7fc4901e4fe0 con 0x7fc49006fe00 2024-09-17T06:05:30.157 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:30.158+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:30.187 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:30.188 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:30.188 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:30.188 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:30.188 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:30.204 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:05:30.258 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:30.253+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:30.359 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:30.353+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:30.392 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:30.392 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:30.392 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:30.392 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 76.568498027000004, 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:30.393 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:05:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:05:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.394 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.395 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.395 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:05:30.395 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:05:30.395 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.395 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.395 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.395 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:05:30.395 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:05:30.395 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.395 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.395 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.395 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.396 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:05:30.397 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.398 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.399 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.399 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:30.399 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:30.399 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 76.568377624999997, 2024-09-17T06:05:30.399 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:05:30.399 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.399 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.399 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.399 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.399 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.399 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.399 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:30.400 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.400 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.400 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.400 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.400 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:30.400 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.400 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.400 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.400 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.400 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:05:30.400 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.401 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.402 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:05:30.402 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:05:30.402 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.402 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.402 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.402 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:30.402 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:05:30.402 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.402 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.402 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.402 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:05:30.403 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:05:30.403 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.403 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.403 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:30.403 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:05:30.403 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:05:30.403 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.403 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.403 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.404 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:30.404 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:05:30.404 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.404 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.404 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.404 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:05:30.404 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:05:30.404 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.404 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.404 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.404 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:05:30.405 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:05:30.405 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.405 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.405 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.405 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:05:30.405 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:05:30.405 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.405 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.405 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.405 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.405 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.405 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:30.406 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:30.406 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 76.568249710999993, 2024-09-17T06:05:30.406 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:05:30.406 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.406 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.406 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.406 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.406 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.406 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.406 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:30.406 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.407 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:05:30.408 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:30.409 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.410 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.411 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 76.567223748000004, 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.412 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.413 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.413 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:30.413 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.413 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.413 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.413 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.413 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:05:30.413 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:05:30.413 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.413 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.413 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.414 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:05:30.415 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.416 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:30.417 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 76.567142805000003, 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:30.418 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.419 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.420 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:05:30.420 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:05:30.420 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.420 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.420 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.420 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:05:30.420 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:05:30.420 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.420 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.420 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.420 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:05:30.420 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.421 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:05:30.422 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:05:30.422 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.422 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.422 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.422 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:05:30.422 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:05:30.422 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.422 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.422 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.422 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:30.422 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:05:30.422 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 76.567080403000006, 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:05:30.423 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.424 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:05:30.425 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.426 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.426 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.426 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:05:30.426 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:05:30.426 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.426 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.426 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.426 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:05:30.426 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:05:30.426 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.426 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:05:30.427 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:05:30.428 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.428 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.428 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.428 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:05:30.428 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:05:30.428 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.428 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.428 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.428 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:05:30.428 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:05:30.428 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 76.567008313000002, 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:05:30.429 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.430 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.431 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.431 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:05:30.431 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:05:30.431 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.431 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.431 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.431 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:05:30.431 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:05:30.431 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.431 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.431 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.432 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:05:30.432 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:05:30.432 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.432 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.432 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.432 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:05:30.432 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:05:30.432 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.432 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.432 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.433 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.434 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.434 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.434 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:30.434 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:30.434 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 76.566966113000007, 2024-09-17T06:05:30.434 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:05:30.434 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.434 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.434 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:30.434 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.435 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:05:30.436 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:05:30.436 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.436 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.436 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.436 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:05:30.436 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:05:30.437 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.437 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.437 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.437 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:05:30.437 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:05:30.437 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.438 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.438 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.438 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:05:30.438 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:05:30.438 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.438 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.439 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.439 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:05:30.439 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:05:30.439 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.439 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.440 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.440 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:05:30.440 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:05:30.440 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.440 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.440 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.440 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:05:30.440 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:05:30.440 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 76.564374181000005, 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.441 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.442 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:05:30.443 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:05:30.444 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:05:30.445 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.445 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.445 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.445 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:05:30.445 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:05:30.445 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.445 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.445 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.445 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.445 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.445 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:30.445 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 76.564278045999998, 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.446 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.447 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:30.447 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.447 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.447 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.447 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.447 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:05:30.447 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:05:30.447 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.447 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.448 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.448 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:05:30.448 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:05:30.448 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.448 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.448 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.448 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:05:30.448 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:05:30.448 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.448 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.449 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.449 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:05:30.449 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:05:30.449 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.449 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.449 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.449 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:05:30.449 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:05:30.449 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.449 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.450 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.450 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:05:30.450 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:05:30.450 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.450 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.450 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.450 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:05:30.451 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:05:30.451 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.451 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.451 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.451 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:05:30.451 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:05:30.451 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.451 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.451 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 76.555845759999997, 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.452 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:30.453 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.453 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.453 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.453 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.453 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:30.453 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.453 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.453 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.453 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.453 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:05:30.453 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.454 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:05:30.455 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:05:30.455 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.455 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.455 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.455 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:05:30.455 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:05:30.455 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.455 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.455 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.455 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:05:30.455 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:05:30.456 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.456 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.456 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:30.456 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:05:30.456 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:05:30.456 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.456 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.456 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.456 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:05:30.456 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:05:30.457 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.457 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.457 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.457 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:05:30.457 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:05:30.457 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.457 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.457 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.457 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:05:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:05:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:05:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:05:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.458 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.459 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:05:30.459 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:30.459 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 71.462256539999998, 2024-09-17T06:05:30.459 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:05:30.459 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.459 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.459 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.459 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.459 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.459 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.459 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:05:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:05:30.460 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:05:30.461 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:05:30.462 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.462 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.462 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.462 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:05:30.462 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:05:30.462 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.462 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.462 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.462 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:05:30.462 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:05:30.462 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.462 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.463 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.463 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:05:30.463 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:05:30.463 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.463 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.463 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.463 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:05:30.463 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:05:30.463 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.463 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 69.791626175000005, 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.464 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:05:30.465 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.466 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.466 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.466 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:05:30.466 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:05:30.466 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.466 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.466 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.466 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:05:30.466 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:05:30.466 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.466 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.466 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.467 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:05:30.467 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:05:30.467 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.467 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.467 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.467 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:05:30.467 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:05:30.467 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.468 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:05:30.469 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:05:30.469 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.469 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.469 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.469 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:05:30.469 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:05:30.469 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.469 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.469 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.469 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:05:30.469 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 68.070955218999998, 2024-09-17T06:05:30.470 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.471 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:05:30.472 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.473 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.474 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:05:30.475 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 68.06827097, 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.476 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.477 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.478 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.478 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:05:30.478 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:05:30.478 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.478 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.478 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.478 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:05:30.478 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:05:30.479 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.479 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.479 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.479 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:05:30.479 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:05:30.479 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.479 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.479 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.479 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:05:30.480 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:05:30.480 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.480 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.480 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.480 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:05:30.480 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:05:30.480 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.480 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.480 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.480 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:05:30.481 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:05:30.481 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.481 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.481 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.481 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.481 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.481 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:30.482 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:30.482 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 67.199068296999997, 2024-09-17T06:05:30.482 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:05:30.482 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.482 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.482 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.482 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.482 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.482 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.483 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:30.483 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.483 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.483 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.483 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.483 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:30.483 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.483 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.483 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.483 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.483 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:05:30.483 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:05:30.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.484 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.484 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.484 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:05:30.484 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:05:30.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.484 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.484 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.484 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:05:30.484 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.485 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:05:30.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.487 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.487 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.487 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:05:30.487 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:05:30.487 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.487 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.487 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.487 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:05:30.487 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:05:30.487 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.487 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.488 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.488 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:05:30.488 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:05:30.488 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.488 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.488 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.488 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.488 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:30.488 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:30.489 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 46.672627384999998, 2024-09-17T06:05:30.489 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:05:30.489 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.489 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.489 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.489 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.489 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.489 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.489 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:30.489 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.489 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:05:30.490 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:05:30.491 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.491 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.491 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.491 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:05:30.491 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:05:30.491 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.491 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.491 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.491 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:05:30.491 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:05:30.491 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.491 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:05:30.492 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:05:30.493 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.493 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.493 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.493 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:05:30.493 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:05:30.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.494 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.494 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.494 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:05:30.494 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:05:30.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.495 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.495 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.495 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:05:30.495 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:05:30.495 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.495 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.496 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.496 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:05:30.496 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:05:30.496 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.496 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.497 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.497 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.497 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.497 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:30.497 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:30.497 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 46.672397869000001, 2024-09-17T06:05:30.497 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:05:30.497 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.497 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.498 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.499 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:05:30.499 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:05:30.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.499 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.499 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.499 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:05:30.499 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:05:30.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.501 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:05:30.502 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.503 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.503 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.503 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:05:30.503 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:05:30.503 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.503 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.503 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.503 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.503 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.503 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:30.503 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:30.504 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 46.670433172999999, 2024-09-17T06:05:30.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:05:30.504 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.504 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.504 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:30.504 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.504 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.504 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.504 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:30.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:30.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:05:30.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:05:30.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:05:30.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:05:30.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:05:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 42.736870285999998, 2024-09-17T06:05:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:05:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:30.508 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.510 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:30.510 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:05:30.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:05:30.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.510 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.510 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:30.510 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:05:30.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:05:30.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:05:30.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:30.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:30.513 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:30.514 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:30.514 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:05:30.514 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:05:30.514 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.514 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.514 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.514 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:30.514 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:30.514 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:30.515 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:05:30.516 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:05:30.517 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:30.514+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:30.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.525+0000 7fc4877fe640 1 -- 172.21.15.122:0/335994286 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v49) ==== 91+0+0 (secure 0 0 0) 0x7fc480063f80 con 0x7fc49006fe00 2024-09-17T06:05:30.528 INFO:teuthology.orchestra.run.smithi122.stderr:noscrub is unset 2024-09-17T06:05:30.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.533+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc470073280 msgr2=0x7fc470075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:30.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.533+0000 7fc4950f8640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc470073280 0x7fc470075790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc49014e4d0 tx=0x7fc478009040 comp rx=0 tx=0).stop 2024-09-17T06:05:30.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.533+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc49006fe00 msgr2=0x7fc490155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:30.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.533+0000 7fc4950f8640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc49006fe00 0x7fc490155ee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc48000e7d0 tx=0x7fc48000ec90 comp rx=0 tx=0).stop 2024-09-17T06:05:30.537 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.533+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 shutdown_connections 2024-09-17T06:05:30.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.533+0000 7fc4950f8640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc470073280 0x7fc470075790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:30.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.533+0000 7fc4950f8640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc49014eb30 0x7fc490142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:30.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.533+0000 7fc4950f8640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4900c28a0 0x7fc49014a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:30.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.533+0000 7fc4950f8640 1 --2- 172.21.15.122:0/335994286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc49006fe00 0x7fc490155ee0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:30.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.533+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 >> 172.21.15.122:0/335994286 conn(0x7fc4900ca380 msgr2=0x7fc4901486a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:30.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.533+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 shutdown_connections 2024-09-17T06:05:30.538 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.533+0000 7fc4950f8640 1 -- 172.21.15.122:0/335994286 wait complete. 2024-09-17T06:05:30.586 INFO:teuthology.orchestra.run.smithi173.stdout:get_pg_num_history pg_num_history pg_num_history(e44 pg_nums {1={16=1},2={19=32},3={20=64},4={24=32}} deleted_pools ) 2024-09-17T06:05:30.586 INFO:teuthology.orchestra.run.smithi173.stdout:Importing pgid 3.1 2024-09-17T06:05:30.586 INFO:teuthology.orchestra.run.smithi173.stdout:write_pg epoch 21 info 3.1( empty local-lis/les=20/21 n=0 ec=20/20 lis/c=20/20 les/c/f=21/21/0 sis=20) 2024-09-17T06:05:30.587 INFO:teuthology.orchestra.run.smithi173.stdout:Import successful 2024-09-17T06:05:30.616 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:30.613+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:30.710 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:30.710 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:30.710 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:30.710 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:30.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.709+0000 7f4171e90640 1 -- 172.21.15.122:0/163428302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f416c06f5e0 msgr2=0x7f416c0c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:30.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.709+0000 7f4171e90640 1 --2- 172.21.15.122:0/163428302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f416c06f5e0 0x7f416c0c85b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f415c009900 tx=0x7f415c01c8e0 comp rx=0 tx=0).stop 2024-09-17T06:05:30.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.713+0000 7f4171e90640 1 -- 172.21.15.122:0/163428302 shutdown_connections 2024-09-17T06:05:30.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.713+0000 7f4171e90640 1 --2- 172.21.15.122:0/163428302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f416c06f5e0 0x7f416c0c85b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:30.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.713+0000 7f4171e90640 1 -- 172.21.15.122:0/163428302 >> 172.21.15.122:0/163428302 conn(0x7f416c0cdbf0 msgr2=0x7f416c0ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:30.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.713+0000 7f4171e90640 1 -- 172.21.15.122:0/163428302 shutdown_connections 2024-09-17T06:05:30.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.713+0000 7f4171e90640 1 -- 172.21.15.122:0/163428302 wait complete. 2024-09-17T06:05:30.718 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:30.718+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:30.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.713+0000 7f4171e90640 1 Processor -- start 2024-09-17T06:05:30.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.713+0000 7f4171e90640 1 -- start start 2024-09-17T06:05:30.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f4171e90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f416c06f5e0 0x7f416c1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:30.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f4171e90640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f416c0c7830 0x7f416c149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:30.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f4171e90640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f416c157f30 0x7f416c141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:30.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f4171e90640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f416c0c9410 con 0x7f416c06f5e0 2024-09-17T06:05:30.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f4171e90640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f416c0c9290 con 0x7f416c157f30 2024-09-17T06:05:30.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f4171e90640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f416c0c81f0 con 0x7f416c0c7830 2024-09-17T06:05:30.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f416c06f5e0 0x7f416c1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f416c06f5e0 0x7f416c1530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55318/0 (socket says 172.21.15.122:55318) 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416b7fe640 1 -- 172.21.15.122:0/70634757 learned_addr learned my addr 172.21.15.122:0/70634757 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416bfff640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f416c157f30 0x7f416c141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416affd640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f416c0c7830 0x7f416c149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416b7fe640 1 -- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f416c0c7830 msgr2=0x7f416c149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416b7fe640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f416c0c7830 0x7f416c149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416b7fe640 1 -- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f416c157f30 msgr2=0x7f416c141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416b7fe640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f416c157f30 0x7f416c141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416b7fe640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c153600 con 0x7f416c06f5e0 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416bfff640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f416c157f30 0x7f416c141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416affd640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f416c0c7830 0x7f416c149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f416b7fe640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f416c06f5e0 0x7f416c1530c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f415c009850 tx=0x7f415c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c0bb070 con 0x7f416c06f5e0 2024-09-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f415c003600 con 0x7f416c06f5e0 2024-09-17T06:05:30.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c0b2040 con 0x7f416c06f5e0 2024-09-17T06:05:30.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c147630 con 0x7f416c06f5e0 2024-09-17T06:05:30.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c14a050 con 0x7f416c06f5e0 2024-09-17T06:05:30.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.717+0000 7f4151ffb640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f4144005280 con 0x7f416c06f5e0 2024-09-17T06:05:30.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.721+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f415c0be070 con 0x7f416c06f5e0 2024-09-17T06:05:30.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.721+0000 7f4153fff640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4158075410 0x7f4158077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:30.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.721+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6804+0+0 (secure 0 0 0) 0x7f415c12e0e0 con 0x7f416c06f5e0 2024-09-17T06:05:30.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.721+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v49) ==== 54+0+16 (secure 0 0 0) 0x7f416c153600 con 0x7f416c06f5e0 2024-09-17T06:05:30.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.721+0000 7f416affd640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4158075410 0x7f4158077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:30.726 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.721+0000 7f4171e90640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f416c1424b0 0x7f416c0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:30.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.721+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f416c152e80 con 0x7f416c1424b0 2024-09-17T06:05:30.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.721+0000 7f416bfff640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f416c1424b0 0x7f416c0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:30.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.721+0000 7f416bfff640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f416c1424b0 0x7f416c0ca200 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:30.728 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:05:30.728 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.725+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f416c152e80 con 0x7f416c1424b0 2024-09-17T06:05:30.732 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.729+0000 7f416affd640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4158075410 0x7f4158077920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f416c1586d0 tx=0x7f4160009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:30.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.749+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f416c0c85b0 con 0x7f416c1424b0 2024-09-17T06:05:30.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.753+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f416c0c85b0 con 0x7f416c1424b0 2024-09-17T06:05:30.758 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:30.759 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:30.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.753+0000 7f4171e90640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f416c1f51e0 0x7f416c1f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:30.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.753+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f416c1f5b30 con 0x7f416c1f51e0 2024-09-17T06:05:30.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.753+0000 7f416b7fe640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f416c1f51e0 0x7f416c1f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:30.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.753+0000 7f416b7fe640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f416c1f51e0 0x7f416c1f55f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:30.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.757+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f416c1f5b30 con 0x7f416c1f51e0 2024-09-17T06:05:30.786 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.781+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f416c14e930 con 0x7f416c1f51e0 2024-09-17T06:05:30.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.785+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f416c14e930 con 0x7f416c1f51e0 2024-09-17T06:05:30.789 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:30.790 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:30.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.785+0000 7f4171e90640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f416c06d3a0 0x7f416c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:30.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.785+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f416c06dcf0 con 0x7f416c06d3a0 2024-09-17T06:05:30.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.785+0000 7f416affd640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f416c06d3a0 0x7f416c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:30.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.785+0000 7f416affd640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f416c06d3a0 0x7f416c06d7b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:30.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.785+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f416c06dcf0 con 0x7f416c06d3a0 2024-09-17T06:05:30.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.813+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f416c0ca740 con 0x7f416c06d3a0 2024-09-17T06:05:30.818 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:30.818+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:30.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.817+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f416c0ca740 con 0x7f416c06d3a0 2024-09-17T06:05:30.820 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.817+0000 7f4171e90640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f416c063dc0 0x7f416c0641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.817+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f416c142a30 con 0x7f416c063dc0 2024-09-17T06:05:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.817+0000 7f416bfff640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f416c063dc0 0x7f416c0641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:30.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.817+0000 7f416bfff640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f416c063dc0 0x7f416c0641d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:30.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.817+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f416c142a30 con 0x7f416c063dc0 2024-09-17T06:05:30.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.841+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f416c142a30 con 0x7f416c063dc0 2024-09-17T06:05:30.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.845+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f416c142a30 con 0x7f416c063dc0 2024-09-17T06:05:30.850 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:30.851 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:30.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.845+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=50}) -- 0x7f416c149960 con 0x7f416c06f5e0 2024-09-17T06:05:30.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.845+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f416c142a30 con 0x7f416c06f5e0 2024-09-17T06:05:30.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.845+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f415c135070 con 0x7f416c06f5e0 2024-09-17T06:05:30.851 INFO:teuthology.orchestra.run.smithi122.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-17T06:05:30.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.845+0000 7f4171e90640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f416c1434e0 0x7f416c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:30.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.845+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 10: {"prefix": "get_command_descriptions"}) -- 0x7f416c143e30 con 0x7f416c1434e0 2024-09-17T06:05:30.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.845+0000 7f416b7fe640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f416c1434e0 0x7f416c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:30.852 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.849+0000 7f416b7fe640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f416c1434e0 0x7f416c1438f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:30.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.849+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 10: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f416c143e30 con 0x7f416c1434e0 2024-09-17T06:05:30.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.873+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f416c143e30 con 0x7f416c1434e0 2024-09-17T06:05:30.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.881+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 11: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f416c143e30 con 0x7f416c1434e0 2024-09-17T06:05:30.884 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:30.885 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:30.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.881+0000 7f4171e90640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f416c02d9e0 0x7f416c02ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:30.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.881+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7f416c02e330 con 0x7f416c02d9e0 2024-09-17T06:05:30.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.881+0000 7f416affd640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f416c02d9e0 0x7f416c02ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:30.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.881+0000 7f416affd640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f416c02d9e0 0x7f416c02ddf0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:30.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.885+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f416c02e330 con 0x7f416c02d9e0 2024-09-17T06:05:30.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.909+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f416c02e330 con 0x7f416c02d9e0 2024-09-17T06:05:30.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.913+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f416c02e330 con 0x7f416c02d9e0 2024-09-17T06:05:30.918 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:30.919 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:30.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.913+0000 7f4171e90640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f416c208100 0x7f416c20a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:30.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.913+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7f416c20d2f0 con 0x7f416c208100 2024-09-17T06:05:30.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.913+0000 7f416bfff640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f416c208100 0x7f416c20a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:30.920 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:30.913+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:30.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.913+0000 7f416bfff640 1 --2- 172.21.15.122:0/70634757 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f416c208100 0x7f416c20a520 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:30.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.917+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f416c20d2f0 con 0x7f416c208100 2024-09-17T06:05:30.921 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:30.921 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:30.921 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:30.921 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:30.921 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:30.939 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:05:30.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.941+0000 7f4171e90640 1 -- 172.21.15.122:0/70634757 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f416c20aa60 con 0x7f416c208100 2024-09-17T06:05:30.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:30.945+0000 7f4153fff640 1 -- 172.21.15.122:0/70634757 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f416c20aa60 con 0x7f416c208100 2024-09-17T06:05:30.949 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:30.950 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:30.958 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T06:05:30.958 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T06:05:31.025 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:31.026+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:31.123 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:31.121+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:31.131 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:31.131 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:31.132 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /var/log/ceph/exp.3.1.4 2024-09-17T06:05:31.149 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:05:31.248 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:31.246+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:31.325 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:31.322+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:31.351 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:31.351 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:31.374 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:05:31.426 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:31.421+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:31.527 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:31.521+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:31.575 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:31.575 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:31.596 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:05:31.628 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:31.626+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:31.729 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:31.725+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:31.831 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:31.830+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:31.839 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:31.840 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:31.861 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:05:31.948 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:31.945+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:32.033 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:32.034+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:32.108 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:32.108 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:32.131 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:05:32.176 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:32.173+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:32.234 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:32.234+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:32.335 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:32.334+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:32.378 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:32.378 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:32.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:05:32.448 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:32.445+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:32.537 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:32.533+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:32.565 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T06:05:32.604 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:32.605 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:32.627 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:05:32.668 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:32.665+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:32.739 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:32.733+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:32.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.769+0000 7f6cf2fab640 1 -- 172.21.15.122:0/517360724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cec0c29c0 msgr2=0x7f6cec0c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:32.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.769+0000 7f6cf2fab640 1 --2- 172.21.15.122:0/517360724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cec0c29c0 0x7f6cec0c8af0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0b1440 tx=0x7f6cd801c830 comp rx=0 tx=0).stop 2024-09-17T06:05:32.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.769+0000 7f6cf2fab640 1 -- 172.21.15.122:0/517360724 shutdown_connections 2024-09-17T06:05:32.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.769+0000 7f6cf2fab640 1 --2- 172.21.15.122:0/517360724 >> v2:172.21.15.173:3300/0 conn(0x7f6cec0c2dd0 0x7f6cec0c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:32.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.769+0000 7f6cf2fab640 1 --2- 172.21.15.122:0/517360724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cec0c29c0 0x7f6cec0c8af0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:32.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.769+0000 7f6cf2fab640 1 -- 172.21.15.122:0/517360724 >> 172.21.15.122:0/517360724 conn(0x7f6cec0ca380 msgr2=0x7f6cec0ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:32.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.769+0000 7f6cf2fab640 1 -- 172.21.15.122:0/517360724 shutdown_connections 2024-09-17T06:05:32.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.769+0000 7f6cf2fab640 1 -- 172.21.15.122:0/517360724 wait complete. 2024-09-17T06:05:32.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf2fab640 1 Processor -- start 2024-09-17T06:05:32.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf2fab640 1 -- start start 2024-09-17T06:05:32.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf2fab640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cec0c29c0 0x7f6cec1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:32.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf2fab640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cec0c2dd0 0x7f6cec0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf2fab640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cec158150 0x7f6cec14e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf1548640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cec158150 0x7f6cec14e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf1548640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cec158150 0x7f6cec14e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55328/0 (socket says 172.21.15.122:55328) 2024-09-17T06:05:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf1548640 1 -- 172.21.15.122:0/1559516536 learned_addr learned my addr 172.21.15.122:0/1559516536 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec06ff60 con 0x7f6cec158150 2024-09-17T06:05:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec0c9570 con 0x7f6cec0c2dd0 2024-09-17T06:05:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6cec1470b0 con 0x7f6cec0c29c0 2024-09-17T06:05:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf0d47640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cec0c29c0 0x7f6cec1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:32.779 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cebfff640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cec0c2dd0 0x7f6cec0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:32.780 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf1548640 1 -- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cec0c29c0 msgr2=0x7f6cec1468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:32.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf1548640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cec0c29c0 0x7f6cec1468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:32.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf1548640 1 -- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cec0c2dd0 msgr2=0x7f6cec0c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:32.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf1548640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cec0c2dd0 0x7f6cec0c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:32.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf1548640 1 -- 172.21.15.122:0/1559516536 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cec1f5710 con 0x7f6cec158150 2024-09-17T06:05:32.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf0d47640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cec0c29c0 0x7f6cec1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:05:32.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.773+0000 7f6cf1548640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cec158150 0x7f6cec14e970 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400ea80 tx=0x7f6ce400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:32.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.777+0000 7f6ce97fa640 1 -- 172.21.15.122:0/1559516536 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400dcb0 con 0x7f6cec158150 2024-09-17T06:05:32.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.777+0000 7f6ce97fa640 1 -- 172.21.15.122:0/1559516536 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ce4004b30 con 0x7f6cec158150 2024-09-17T06:05:32.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.777+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cec1f51b0 con 0x7f6cec158150 2024-09-17T06:05:32.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.777+0000 7f6ce97fa640 1 -- 172.21.15.122:0/1559516536 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4005020 con 0x7f6cec158150 2024-09-17T06:05:32.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.777+0000 7f6ce97fa640 1 -- 172.21.15.122:0/1559516536 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6ce401d020 con 0x7f6cec158150 2024-09-17T06:05:32.783 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.777+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cec1f1400 con 0x7f6cec158150 2024-09-17T06:05:32.784 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.781+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cec0728c0 con 0x7f6cec158150 2024-09-17T06:05:32.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.781+0000 7f6ce97fa640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6cd00731b0 0x7f6cd00756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:32.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.781+0000 7f6ce97fa640 1 -- 172.21.15.122:0/1559516536 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6804+0+0 (secure 0 0 0) 0x7f6ce4093ef0 con 0x7f6cec158150 2024-09-17T06:05:32.785 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.781+0000 7f6cf0d47640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6cd00731b0 0x7f6cd00756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:32.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.781+0000 7f6cf0d47640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6cd00731b0 0x7f6cd00756c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0005630 tx=0x7f6ce0007e40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:32.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:32.789+0000 7f6ce97fa640 1 -- 172.21.15.122:0/1559516536 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6cec1f51b0 con 0x7f6cec158150 2024-09-17T06:05:32.840 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:32.837+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:32.873 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:32.873 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:32.894 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:05:32.959 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:05:32.980 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:32.977+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:33.041 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:33.042+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:33.140 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:33.141 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:33.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.137+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) -- 0x7f6cec0c9d80 con 0x7f6cec158150 2024-09-17T06:05:33.142 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:33.142+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:33.163 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:05:33.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.173+0000 7ff23c648640 1 -- 172.21.15.122:0/873792790 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff23415d320 msgr2=0x7ff2340cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:33.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.173+0000 7ff23c648640 1 --2- 172.21.15.122:0/873792790 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff23415d320 0x7ff2340cef50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009bc0 tx=0x7ff22c01cbe0 comp rx=0 tx=0).stop 2024-09-17T06:05:33.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.177+0000 7ff23c648640 1 -- 172.21.15.122:0/873792790 shutdown_connections 2024-09-17T06:05:33.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.177+0000 7ff23c648640 1 --2- 172.21.15.122:0/873792790 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff23415d320 0x7ff2340cef50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:33.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.177+0000 7ff23c648640 1 --2- 172.21.15.122:0/873792790 >> v2:172.21.15.173:3300/0 conn(0x7ff2341536a0 0x7ff2340cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:33.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.177+0000 7ff23c648640 1 -- 172.21.15.122:0/873792790 >> 172.21.15.122:0/873792790 conn(0x7ff2340740c0 msgr2=0x7ff2340744d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:33.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.177+0000 7ff23c648640 1 -- 172.21.15.122:0/873792790 shutdown_connections 2024-09-17T06:05:33.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.177+0000 7ff23c648640 1 -- 172.21.15.122:0/873792790 wait complete. 2024-09-17T06:05:33.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.177+0000 7ff23c648640 1 Processor -- start 2024-09-17T06:05:33.183 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.177+0000 7ff23c648640 1 -- start start 2024-09-17T06:05:33.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23c648640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2340c3f80 0x7ff234145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:33.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23c648640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2341536a0 0x7ff2340b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:33.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23c648640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff23415d320 0x7ff2341573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:33.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23c648640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff2340c9cb0 con 0x7ff23415d320 2024-09-17T06:05:33.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23c648640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff2340c46e0 con 0x7ff2340c3f80 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23c648640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff2340c9e30 con 0x7ff2341536a0 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23abe5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff23415d320 0x7ff2341573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23abe5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff23415d320 0x7ff2341573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55342/0 (socket says 172.21.15.122:55342) 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23abe5640 1 -- 172.21.15.122:0/232865322 learned_addr learned my addr 172.21.15.122:0/232865322 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23a3e4640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2340c3f80 0x7ff234145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff239be3640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2341536a0 0x7ff2340b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23abe5640 1 -- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2341536a0 msgr2=0x7ff2340b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23abe5640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2341536a0 0x7ff2340b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23abe5640 1 -- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2340c3f80 msgr2=0x7ff234145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23abe5640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2340c3f80 0x7ff234145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23abe5640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff234163570 con 0x7ff23415d320 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23abe5640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff23415d320 0x7ff2341573f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0b0040 tx=0x7ff22c003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0b2040 con 0x7ff23415d320 2024-09-17T06:05:33.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff22c0bb070 con 0x7ff23415d320 2024-09-17T06:05:33.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c004370 con 0x7ff23415d320 2024-09-17T06:05:33.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2340b41c0 con 0x7ff23415d320 2024-09-17T06:05:33.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.181+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff234151a00 con 0x7ff23415d320 2024-09-17T06:05:33.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.185+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff22c004510 con 0x7ff23415d320 2024-09-17T06:05:33.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.185+0000 7ff228ff9640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7ff23415cc10 con 0x7ff23415d320 2024-09-17T06:05:33.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.185+0000 7ff22affd640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff218073230 0x7ff218075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:33.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.185+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6804+0+0 (secure 0 0 0) 0x7ff22c12ec40 con 0x7ff23415d320 2024-09-17T06:05:33.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.185+0000 7ff23a3e4640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff218073230 0x7ff218075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:33.191 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.185+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v49) ==== 54+0+16 (secure 0 0 0) 0x7ff234163570 con 0x7ff23415d320 2024-09-17T06:05:33.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.185+0000 7ff23c648640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7ff210001660 0x7ff210003b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:33.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.185+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff210006c10 con 0x7ff210001660 2024-09-17T06:05:33.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.185+0000 7ff239be3640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7ff210001660 0x7ff210003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:33.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.185+0000 7ff23a3e4640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff218073230 0x7ff218075740 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff230009b40 tx=0x7ff2300091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:33.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.189+0000 7ff239be3640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7ff210001660 0x7ff210003b70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:33.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.189+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff210006c10 con 0x7ff210001660 2024-09-17T06:05:33.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.217+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff210005cc0 con 0x7ff210001660 2024-09-17T06:05:33.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.217+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff210005cc0 con 0x7ff210001660 2024-09-17T06:05:33.224 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:33.224 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:33.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.221+0000 7ff23c648640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7ff2100041f0 0x7ff210004600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:33.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.221+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7ff210004c80 con 0x7ff2100041f0 2024-09-17T06:05:33.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.221+0000 7ff23a3e4640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7ff2100041f0 0x7ff210004600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:33.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.221+0000 7ff23a3e4640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7ff2100041f0 0x7ff210004600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:33.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.221+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff210004c80 con 0x7ff2100041f0 2024-09-17T06:05:33.243 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:33.242+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:33.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.249+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff210005250 con 0x7ff2100041f0 2024-09-17T06:05:33.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.249+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff210005250 con 0x7ff2100041f0 2024-09-17T06:05:33.255 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:33.256 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:33.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.253+0000 7ff23c648640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff2100093d0 0x7ff21000b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:33.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.253+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7ff21000e820 con 0x7ff2100093d0 2024-09-17T06:05:33.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.253+0000 7ff239be3640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff2100093d0 0x7ff21000b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:33.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.253+0000 7ff239be3640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff2100093d0 0x7ff21000b7f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:33.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.253+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff21000e820 con 0x7ff2100093d0 2024-09-17T06:05:33.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.281+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff21000d830 con 0x7ff2100093d0 2024-09-17T06:05:33.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.281+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff21000d830 con 0x7ff2100093d0 2024-09-17T06:05:33.289 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:33.290 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.281+0000 7ff23c648640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7ff21000be20 0x7ff21000c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.281+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7ff21000e510 con 0x7ff21000be20 2024-09-17T06:05:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.281+0000 7ff23abe5640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7ff21000be20 0x7ff21000c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.285+0000 7ff23abe5640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7ff21000be20 0x7ff21000c230 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:33.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.285+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff21000e510 con 0x7ff21000be20 2024-09-17T06:05:33.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.309+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff21000c880 con 0x7ff21000be20 2024-09-17T06:05:33.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.313+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff21000c880 con 0x7ff21000be20 2024-09-17T06:05:33.319 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:33.320 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:33.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.313+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=50}) -- 0x7ff21000c850 con 0x7ff23415d320 2024-09-17T06:05:33.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.313+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff21000ccb0 con 0x7ff23415d320 2024-09-17T06:05:33.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.313+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7ff22c0f8b90 con 0x7ff23415d320 2024-09-17T06:05:33.320 INFO:teuthology.orchestra.run.smithi122.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-17T06:05:33.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.317+0000 7ff23c648640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7ff210010c90 0x7ff2100130b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:33.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.317+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 10: {"prefix": "get_command_descriptions"}) -- 0x7ff210015e80 con 0x7ff210010c90 2024-09-17T06:05:33.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.317+0000 7ff23a3e4640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7ff210010c90 0x7ff2100130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:33.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.317+0000 7ff23a3e4640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7ff210010c90 0x7ff2100130b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:33.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.317+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 10: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff210015e80 con 0x7ff210010c90 2024-09-17T06:05:33.344 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:33.341+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:33.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.345+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff210013900 con 0x7ff210010c90 2024-09-17T06:05:33.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.349+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 11: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff210013900 con 0x7ff210010c90 2024-09-17T06:05:33.353 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:33.354 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:33.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.349+0000 7ff23c648640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7ff210014020 0x7ff210014430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:33.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.349+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7ff210015b70 con 0x7ff210014020 2024-09-17T06:05:33.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.349+0000 7ff239be3640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7ff210014020 0x7ff210014430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:33.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.349+0000 7ff239be3640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7ff210014020 0x7ff210014430 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:33.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.353+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff210015b70 con 0x7ff210014020 2024-09-17T06:05:33.372 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:33.372 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:33.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:33.372 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.549214551999995, 2024-09-17T06:05:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014374336, 2024-09-17T06:05:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821526+0000", 2024-09-17T06:05:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6859999999999999e-06 2024-09-17T06:05:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821553+0000", 2024-09-17T06:05:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6329000000000002e-05 2024-09-17T06:05:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821592+0000", 2024-09-17T06:05:33.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9588000000000001e-05 2024-09-17T06:05:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821624+0000", 2024-09-17T06:05:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1814999999999999e-05 2024-09-17T06:05:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822106+0000", 2024-09-17T06:05:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00048212400000000001 2024-09-17T06:05:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822852+0000", 2024-09-17T06:05:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000745303 2024-09-17T06:05:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823189+0000", 2024-09-17T06:05:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000337244 2024-09-17T06:05:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:33.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828285+0000", 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050956680000000002 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835635+0000", 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0073502960000000001 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835771+0000", 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000136219 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835897+0000", 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126064 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.548916869999999, 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014596456000000001, 2024-09-17T06:05:33.379 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:33.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821823+0000", 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.17e-06 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821837+0000", 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3845999999999999e-05 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821872+0000", 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5024999999999998e-05 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821896+0000", 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4669e-05 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824176+0000", 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022794389999999999 2024-09-17T06:05:33.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824408+0000", 2024-09-17T06:05:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000232258 2024-09-17T06:05:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824824+0000", 2024-09-17T06:05:33.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00041565999999999999 2024-09-17T06:05:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829781+0000", 2024-09-17T06:05:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049579250000000002 2024-09-17T06:05:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836070+0000", 2024-09-17T06:05:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062883740000000002 2024-09-17T06:05:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836286+0000", 2024-09-17T06:05:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021609299999999999 2024-09-17T06:05:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836417+0000", 2024-09-17T06:05:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013099699999999999 2024-09-17T06:05:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.385 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.548798406000003, 2024-09-17T06:05:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014884692, 2024-09-17T06:05:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821941+0000", 2024-09-17T06:05:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.784e-06 2024-09-17T06:05:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821990+0000", 2024-09-17T06:05:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9481000000000003e-05 2024-09-17T06:05:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822015+0000", 2024-09-17T06:05:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4552000000000001e-05 2024-09-17T06:05:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822062+0000", 2024-09-17T06:05:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7351000000000001e-05 2024-09-17T06:05:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825585+0000", 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003522458 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825895+0000", 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031071499999999998 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826221+0000", 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032602400000000001 2024-09-17T06:05:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829803+0000", 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035817359999999999 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836527+0000", 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067239919999999998 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836663+0000", 2024-09-17T06:05:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013620700000000001 2024-09-17T06:05:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836824+0000", 2024-09-17T06:05:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016039200000000001 2024-09-17T06:05:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.548644030000006, 2024-09-17T06:05:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01512869, 2024-09-17T06:05:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822095+0000", 2024-09-17T06:05:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9829999999999999e-06 2024-09-17T06:05:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822105+0000", 2024-09-17T06:05:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5130000000000002e-06 2024-09-17T06:05:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822125+0000", 2024-09-17T06:05:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9953e-05 2024-09-17T06:05:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822144+0000", 2024-09-17T06:05:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9089e-05 2024-09-17T06:05:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826898+0000", 2024-09-17T06:05:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047542740000000002 2024-09-17T06:05:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827131+0000", 2024-09-17T06:05:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023258900000000001 2024-09-17T06:05:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827568+0000", 2024-09-17T06:05:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00043743200000000002 2024-09-17T06:05:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834712+0000", 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0071437489999999996 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836963+0000", 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022512769999999999 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837108+0000", 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014485 2024-09-17T06:05:33.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837222+0000", 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011398100000000001 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.548568502999998, 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015488435, 2024-09-17T06:05:33.399 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822171+0000", 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9800000000000001e-06 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822180+0000", 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7290000000000006e-06 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822198+0000", 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8868999999999998e-05 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822217+0000", 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006163712 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828723+0000", 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034318 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829070+0000", 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034623299999999999 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834728+0000", 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056585519999999999 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837392+0000", 2024-09-17T06:05:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026634800000000002 2024-09-17T06:05:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837551+0000", 2024-09-17T06:05:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015923900000000001 2024-09-17T06:05:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837657+0000", 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010631799999999999 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.548493781000005, 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015871963999999999, 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.405 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822245+0000", 2024-09-17T06:05:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5969999999999999e-06 2024-09-17T06:05:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822263+0000", 2024-09-17T06:05:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8241999999999999e-05 2024-09-17T06:05:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822283+0000", 2024-09-17T06:05:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9466e-05 2024-09-17T06:05:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822300+0000", 2024-09-17T06:05:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6898999999999999e-05 2024-09-17T06:05:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829910+0000", 2024-09-17T06:05:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00760979 2024-09-17T06:05:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.830145+0000", 2024-09-17T06:05:33.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023562100000000001 2024-09-17T06:05:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.830638+0000", 2024-09-17T06:05:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00049317000000000002 2024-09-17T06:05:33.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834742+0000", 2024-09-17T06:05:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041036470000000002 2024-09-17T06:05:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837872+0000", 2024-09-17T06:05:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031295670000000002 2024-09-17T06:05:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838036+0000", 2024-09-17T06:05:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016482899999999999 2024-09-17T06:05:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838116+0000", 2024-09-17T06:05:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9135999999999996e-05 2024-09-17T06:05:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.416 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.548397191999996, 2024-09-17T06:05:33.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016065354, 2024-09-17T06:05:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822342+0000", 2024-09-17T06:05:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-09-17T06:05:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822349+0000", 2024-09-17T06:05:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6569999999999997e-06 2024-09-17T06:05:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822368+0000", 2024-09-17T06:05:33.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9074999999999999e-05 2024-09-17T06:05:33.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822412+0000", 2024-09-17T06:05:33.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4115e-05 2024-09-17T06:05:33.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.831389+0000", 2024-09-17T06:05:33.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089769659999999994 2024-09-17T06:05:33.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.831743+0000", 2024-09-17T06:05:33.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035332899999999999 2024-09-17T06:05:33.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:33.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832133+0000", 2024-09-17T06:05:33.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000390221 2024-09-17T06:05:33.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:33.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834756+0000", 2024-09-17T06:05:33.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026229500000000002 2024-09-17T06:05:33.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:33.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838251+0000", 2024-09-17T06:05:33.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034947390000000002 2024-09-17T06:05:33.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:33.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838336+0000", 2024-09-17T06:05:33.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5679000000000004e-05 2024-09-17T06:05:33.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838406+0000", 2024-09-17T06:05:33.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9280000000000001e-05 2024-09-17T06:05:33.430 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.430 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.430 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.431 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:33.431 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:33.431 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.548295737000004, 2024-09-17T06:05:33.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016193883999999999, 2024-09-17T06:05:33.431 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.432 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.432 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:33.432 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:33.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:33.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822443+0000", 2024-09-17T06:05:33.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7370000000000001e-06 2024-09-17T06:05:33.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822452+0000", 2024-09-17T06:05:33.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5259999999999993e-06 2024-09-17T06:05:33.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822480+0000", 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7781999999999999e-05 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822497+0000", 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7139e-05 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833259+0000", 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010762386000000001 2024-09-17T06:05:33.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833684+0000", 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00042440300000000001 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834089+0000", 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000405556 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838148+0000", 2024-09-17T06:05:33.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040588760000000003 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838479+0000", 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033078399999999998 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838567+0000", 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8661999999999999e-05 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838636+0000", 2024-09-17T06:05:33.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8033000000000004e-05 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.548206480999994, 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012308227, 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:33.439 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822532+0000", 2024-09-17T06:05:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.57e-06 2024-09-17T06:05:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822541+0000", 2024-09-17T06:05:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9090000000000006e-06 2024-09-17T06:05:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822572+0000", 2024-09-17T06:05:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1099000000000002e-05 2024-09-17T06:05:33.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822591+0000", 2024-09-17T06:05:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8462e-05 2024-09-17T06:05:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822777+0000", 2024-09-17T06:05:33.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018563100000000001 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823110+0000", 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000333574 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823419+0000", 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030839499999999999 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826081+0000", 2024-09-17T06:05:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026627999999999999 2024-09-17T06:05:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834551+0000", 2024-09-17T06:05:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084693679999999997 2024-09-17T06:05:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:33.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834714+0000", 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000162969 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834839+0000", 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012545000000000001 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:33.445 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.548103560000001, 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012689499, 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822635+0000", 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.637e-06 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822654+0000", 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8362000000000001e-05 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822678+0000", 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513000000000001e-05 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822698+0000", 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9468999999999999e-05 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:33.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014675910000000001 2024-09-17T06:05:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824388+0000", 2024-09-17T06:05:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022300600000000001 2024-09-17T06:05:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824756+0000", 2024-09-17T06:05:33.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036741900000000001 2024-09-17T06:05:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827411+0000", 2024-09-17T06:05:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00265526 2024-09-17T06:05:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835045+0000", 2024-09-17T06:05:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076339290000000002 2024-09-17T06:05:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:33.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835197+0000", 2024-09-17T06:05:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000151736 2024-09-17T06:05:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835323+0000", 2024-09-17T06:05:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126577 2024-09-17T06:05:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.452 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:22 2.e e25/19 ondisk, result = 0)", 2024-09-17T06:05:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.536450599999995, 2024-09-17T06:05:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00058930099999999997, 2024-09-17T06:05:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834289+0000", 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.216e-06 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834304+0000", 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5255999999999999e-05 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834335+0000", 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0397999999999999e-05 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834359+0000", 2024-09-17T06:05:33.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4799000000000001e-05 2024-09-17T06:05:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834505+0000", 2024-09-17T06:05:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014551700000000001 2024-09-17T06:05:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834530+0000", 2024-09-17T06:05:33.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5128999999999999e-05 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834876+0000", 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000345986 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:23 2.e e25/19 ondisk, result = 0)", 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:33.457 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.536319216999999, 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093485499999999995, 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834420+0000", 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5099999999999999e-06 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834428+0000", 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7399999999999993e-06 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834449+0000", 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0738999999999999e-05 2024-09-17T06:05:33.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834471+0000", 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1979000000000001e-05 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835003+0000", 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053146400000000005 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835027+0000", 2024-09-17T06:05:33.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4681999999999998e-05 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835353+0000", 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000325741 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:6 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.535355357, 2024-09-17T06:05:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053156399999999999, 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:33.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835384+0000", 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9700000000000002e-06 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835397+0000", 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2903e-05 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835427+0000", 2024-09-17T06:05:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9935000000000001e-05 2024-09-17T06:05:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835451+0000", 2024-09-17T06:05:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4581999999999999e-05 2024-09-17T06:05:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835592+0000", 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0001406 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835616+0000", 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4505e-05 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835914+0000", 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029706900000000001 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.465 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:7 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.535236936000004, 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00094147399999999998, 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835502+0000", 2024-09-17T06:05:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2729999999999999e-06 2024-09-17T06:05:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835511+0000", 2024-09-17T06:05:33.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1730000000000001e-06 2024-09-17T06:05:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835531+0000", 2024-09-17T06:05:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9769e-05 2024-09-17T06:05:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835548+0000", 2024-09-17T06:05:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6878999999999999e-05 2024-09-17T06:05:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836026+0000", 2024-09-17T06:05:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00047839999999999997 2024-09-17T06:05:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836048+0000", 2024-09-17T06:05:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1886e-05 2024-09-17T06:05:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836442+0000", 2024-09-17T06:05:33.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000394094 2024-09-17T06:05:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.473 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:8 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.535163679999997, 2024-09-17T06:05:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001278288, 2024-09-17T06:05:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.474 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:33.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835575+0000", 2024-09-17T06:05:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.077e-06 2024-09-17T06:05:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835582+0000", 2024-09-17T06:05:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-09-17T06:05:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835599+0000", 2024-09-17T06:05:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7235999999999999e-05 2024-09-17T06:05:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835614+0000", 2024-09-17T06:05:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5096000000000001e-05 2024-09-17T06:05:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836506+0000", 2024-09-17T06:05:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00089209599999999999 2024-09-17T06:05:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836518+0000", 2024-09-17T06:05:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-05 2024-09-17T06:05:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836852+0000", 2024-09-17T06:05:33.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033404000000000002 2024-09-17T06:05:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.483 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:9 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.535100013000005, 2024-09-17T06:05:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001612018, 2024-09-17T06:05:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:33.484 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:33.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:33.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835638+0000", 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.054e-06 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835646+0000", 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1520000000000003e-06 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835666+0000", 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0795999999999999e-05 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835702+0000", 2024-09-17T06:05:33.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5379000000000001e-05 2024-09-17T06:05:33.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836928+0000", 2024-09-17T06:05:33.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001225903 2024-09-17T06:05:33.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836948+0000", 2024-09-17T06:05:33.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0628999999999998e-05 2024-09-17T06:05:33.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837249+0000", 2024-09-17T06:05:33.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030110500000000002 2024-09-17T06:05:33.489 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.489 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.490 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.490 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:10 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:33.490 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:33.490 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.535002268, 2024-09-17T06:05:33.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019419420000000001, 2024-09-17T06:05:33.490 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.490 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.490 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:33.491 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:33.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:33.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835736+0000", 2024-09-17T06:05:33.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.06e-06 2024-09-17T06:05:33.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835743+0000", 2024-09-17T06:05:33.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1330000000000001e-06 2024-09-17T06:05:33.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835762+0000", 2024-09-17T06:05:33.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8839999999999999e-05 2024-09-17T06:05:33.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835778+0000", 2024-09-17T06:05:33.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5498999999999998e-05 2024-09-17T06:05:33.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837364+0000", 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015863190000000001 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837379+0000", 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4749000000000001e-05 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837677+0000", 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298342 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.494 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.495 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:11 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:33.495 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:33.495 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.534662890999996, 2024-09-17T06:05:33.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002079029, 2024-09-17T06:05:33.495 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.495 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.495 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:33.495 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:33.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:33.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836077+0000", 2024-09-17T06:05:33.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.103e-06 2024-09-17T06:05:33.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836092+0000", 2024-09-17T06:05:33.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.503e-05 2024-09-17T06:05:33.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836123+0000", 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1031000000000002e-05 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836147+0000", 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4019000000000002e-05 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837816+0000", 2024-09-17T06:05:33.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001669299 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837847+0000", 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1464999999999998e-05 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838153+0000", 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000306082 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:12 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.534499198999995, 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021818900000000001, 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836240+0000", 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.59e-06 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836269+0000", 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9275e-05 2024-09-17T06:05:33.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836291+0000", 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1515999999999999e-05 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836308+0000", 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7728999999999999e-05 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838225+0000", 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001916453 2024-09-17T06:05:33.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838238+0000", 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2806000000000001e-05 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838420+0000", 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000182521 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.503 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:13 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.533451780000007, 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001366047, 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837287+0000", 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.823e-06 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837301+0000", 2024-09-17T06:05:33.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3910000000000001e-05 2024-09-17T06:05:33.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:33.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837323+0000", 2024-09-17T06:05:33.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1379e-05 2024-09-17T06:05:33.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:33.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837339+0000", 2024-09-17T06:05:33.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6762e-05 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838456+0000", 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011162050000000001 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838470+0000", 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.453e-05 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:33.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:33.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838652+0000", 2024-09-17T06:05:33.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018143799999999999 2024-09-17T06:05:33.508 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.508 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.508 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.508 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:33.508 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:33.508 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:33.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.377+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff21000d000 con 0x7ff210014020 2024-09-17T06:05:33.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.381+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff21000d000 con 0x7ff210014020 2024-09-17T06:05:33.510 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:33.510 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:33.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.385+0000 7ff23c648640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7ff210014eb0 0x7ff2100152c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:33.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.385+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7ff210015a50 con 0x7ff210014eb0 2024-09-17T06:05:33.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.385+0000 7ff23abe5640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7ff210014eb0 0x7ff2100152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:33.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.385+0000 7ff23abe5640 1 --2- 172.21.15.122:0/232865322 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7ff210014eb0 0x7ff2100152c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:33.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.385+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff210015a50 con 0x7ff210014eb0 2024-09-17T06:05:33.512 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:05:33.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.413+0000 7ff23c648640 1 -- 172.21.15.122:0/232865322 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff210013670 con 0x7ff210014eb0 2024-09-17T06:05:33.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.417+0000 7ff22affd640 1 -- 172.21.15.122:0/232865322 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff210013670 con 0x7ff210014eb0 2024-09-17T06:05:33.513 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:33.513 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T06:05:33.514 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:33.514 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T06:05:33.514 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:33.505+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:33.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.545+0000 7f6ce97fa640 1 -- 172.21.15.122:0/1559516536 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v50) ==== 101+0+0 (secure 0 0 0) 0x7f6ce405e690 con 0x7f6cec158150 2024-09-17T06:05:33.551 INFO:teuthology.orchestra.run.smithi122.stderr:nodeep-scrub is unset 2024-09-17T06:05:33.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.549+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6cd00731b0 msgr2=0x7f6cd00756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:33.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.549+0000 7f6cf2fab640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6cd00731b0 0x7f6cd00756c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0005630 tx=0x7f6ce0007e40 comp rx=0 tx=0).stop 2024-09-17T06:05:33.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.549+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cec158150 msgr2=0x7f6cec14e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:33.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.549+0000 7f6cf2fab640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cec158150 0x7f6cec14e970 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400ea80 tx=0x7f6ce400ef40 comp rx=0 tx=0).stop 2024-09-17T06:05:33.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.549+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 shutdown_connections 2024-09-17T06:05:33.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.549+0000 7f6cf2fab640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6cec158150 0x7f6cec14e970 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:33.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.549+0000 7f6cf2fab640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6cd00731b0 0x7f6cd00756c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:33.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.549+0000 7f6cf2fab640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cec0c2dd0 0x7f6cec0c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:33.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.549+0000 7f6cf2fab640 1 --2- 172.21.15.122:0/1559516536 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6cec0c29c0 0x7f6cec1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:33.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.549+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 >> 172.21.15.122:0/1559516536 conn(0x7f6cec0ca380 msgr2=0x7f6cec157110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:33.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.553+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 shutdown_connections 2024-09-17T06:05:33.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:33.553+0000 7f6cf2fab640 1 -- 172.21.15.122:0/1559516536 wait complete. 2024-09-17T06:05:33.611 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:33.610+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:33.712 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:33.710+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:33.756 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:33.756 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:33.756 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-09-17T06:05:33.756 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:33.779 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:05:33.824 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:33.821+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:33.913 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:33.909+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:33.980 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:33.980 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:33.981 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 180, 2024-09-17T06:05:33.981 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-09-17T06:05:33.981 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:34.002 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:05:34.048 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:34.045+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:34.115 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:34.109+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:34.216 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:34.213+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:34.250 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.426339812999998, 2024-09-17T06:05:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044462499999999997, 2024-09-17T06:05:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823264+0000", 2024-09-17T06:05:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3300000000000001e-06 2024-09-17T06:05:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823284+0000", 2024-09-17T06:05:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0132e-05 2024-09-17T06:05:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823364+0000", 2024-09-17T06:05:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9583e-05 2024-09-17T06:05:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823395+0000", 2024-09-17T06:05:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1171999999999999e-05 2024-09-17T06:05:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823538+0000", 2024-09-17T06:05:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014286600000000001 2024-09-17T06:05:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823594+0000", 2024-09-17T06:05:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890999999999997e-05 2024-09-17T06:05:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827597+0000", 2024-09-17T06:05:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004003665 2024-09-17T06:05:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827708+0000", 2024-09-17T06:05:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110611 2024-09-17T06:05:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.426147361999995, 2024-09-17T06:05:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043686330000000002, 2024-09-17T06:05:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823455+0000", 2024-09-17T06:05:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2160000000000001e-06 2024-09-17T06:05:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823471+0000", 2024-09-17T06:05:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5702999999999999e-05 2024-09-17T06:05:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823492+0000", 2024-09-17T06:05:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1039e-05 2024-09-17T06:05:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823512+0000", 2024-09-17T06:05:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0364999999999999e-05 2024-09-17T06:05:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824294+0000", 2024-09-17T06:05:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00078187600000000003 2024-09-17T06:05:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824350+0000", 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5367e-05 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827719+0000", 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003368916 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827823+0000", 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104151 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.425586582999998, 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0094234149999999992, 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824018+0000", 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3629999999999998e-06 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824036+0000", 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7606000000000001e-05 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824065+0000", 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9005000000000001e-05 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824092+0000", 2024-09-17T06:05:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7396e-05 2024-09-17T06:05:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826491+0000", 2024-09-17T06:05:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002398776 2024-09-17T06:05:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826804+0000", 2024-09-17T06:05:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000312782 2024-09-17T06:05:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833438+0000", 2024-09-17T06:05:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066344869999999997 2024-09-17T06:05:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.425516599999995, 2024-09-17T06:05:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048433540000000002, 2024-09-17T06:05:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824087+0000", 2024-09-17T06:05:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1830000000000001e-06 2024-09-17T06:05:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824106+0000", 2024-09-17T06:05:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8595999999999999e-05 2024-09-17T06:05:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824137+0000", 2024-09-17T06:05:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1322000000000003e-05 2024-09-17T06:05:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824164+0000", 2024-09-17T06:05:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6605e-05 2024-09-17T06:05:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824807+0000", 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064339900000000001 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824861+0000", 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3687000000000003e-05 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828809+0000", 2024-09-17T06:05:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039483909999999999 2024-09-17T06:05:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828928+0000", 2024-09-17T06:05:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119171 2024-09-17T06:05:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.425435930999996, 2024-09-17T06:05:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092145760000000004, 2024-09-17T06:05:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824167+0000", 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7540000000000001e-06 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824178+0000", 2024-09-17T06:05:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0276e-05 2024-09-17T06:05:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824202+0000", 2024-09-17T06:05:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4685000000000002e-05 2024-09-17T06:05:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824223+0000", 2024-09-17T06:05:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1036e-05 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825070+0000", 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084684500000000004 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825392+0000", 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032213499999999998 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833380+0000", 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079878450000000004 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.424430999999998, 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038480469999999998, 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825172+0000", 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.967e-06 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825190+0000", 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7866000000000001e-05 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825217+0000", 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6682e-05 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825239+0000", 2024-09-17T06:05:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1968999999999999e-05 2024-09-17T06:05:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825632+0000", 2024-09-17T06:05:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00039355100000000001 2024-09-17T06:05:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825690+0000", 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7797000000000002e-05 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828935+0000", 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032449449999999999 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829018+0000", 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3269999999999994e-05 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.423376497000007, 2024-09-17T06:05:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002834755, 2024-09-17T06:05:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826227+0000", 2024-09-17T06:05:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.906e-06 2024-09-17T06:05:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826256+0000", 2024-09-17T06:05:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8872000000000001e-05 2024-09-17T06:05:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826399+0000", 2024-09-17T06:05:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143156 2024-09-17T06:05:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826453+0000", 2024-09-17T06:05:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4465000000000001e-05 2024-09-17T06:05:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826628+0000", 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017420700000000001 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829060+0000", 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024321490000000002 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.421625865999999, 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055191049999999998, 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827978+0000", 2024-09-17T06:05:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0200000000000001e-06 2024-09-17T06:05:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827997+0000", 2024-09-17T06:05:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9836000000000001e-05 2024-09-17T06:05:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828029+0000", 2024-09-17T06:05:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1720999999999997e-05 2024-09-17T06:05:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828055+0000", 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5519000000000001e-05 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828193+0000", 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013821699999999999 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828232+0000", 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9351000000000003e-05 2024-09-17T06:05:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833396+0000", 2024-09-17T06:05:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051640119999999999 2024-09-17T06:05:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833495+0000", 2024-09-17T06:05:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8429000000000002e-05 2024-09-17T06:05:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.421500324999997, 2024-09-17T06:05:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054928850000000003, 2024-09-17T06:05:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828102+0000", 2024-09-17T06:05:34.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-06 2024-09-17T06:05:34.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828116+0000", 2024-09-17T06:05:34.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3716e-05 2024-09-17T06:05:34.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828139+0000", 2024-09-17T06:05:34.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3028999999999999e-05 2024-09-17T06:05:34.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828156+0000", 2024-09-17T06:05:34.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869000000000001e-05 2024-09-17T06:05:34.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829124+0000", 2024-09-17T06:05:34.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096778700000000001 2024-09-17T06:05:34.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829158+0000", 2024-09-17T06:05:34.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4671000000000001e-05 2024-09-17T06:05:34.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833509+0000", 2024-09-17T06:05:34.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004350802 2024-09-17T06:05:34.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833594+0000", 2024-09-17T06:05:34.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4814999999999993e-05 2024-09-17T06:05:34.308 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.309 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.309 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-17T06:05:34.309 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:34.309 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.416749100000004, 2024-09-17T06:05:34.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064859200000000003, 2024-09-17T06:05:34.309 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.310 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.310 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:34.310 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:34.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:34.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832854+0000", 2024-09-17T06:05:34.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8330000000000001e-06 2024-09-17T06:05:34.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832867+0000", 2024-09-17T06:05:34.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.332e-05 2024-09-17T06:05:34.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832906+0000", 2024-09-17T06:05:34.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8800999999999997e-05 2024-09-17T06:05:34.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:34.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6468000000000003e-05 2024-09-17T06:05:34.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833094+0000", 2024-09-17T06:05:34.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014082600000000001 2024-09-17T06:05:34.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833501+0000", 2024-09-17T06:05:34.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040734400000000002 2024-09-17T06:05:34.314 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.416652295000006, 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00050376900000000005, 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:34.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:34.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832952+0000", 2024-09-17T06:05:34.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4269999999999998e-06 2024-09-17T06:05:34.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832965+0000", 2024-09-17T06:05:34.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3736e-05 2024-09-17T06:05:34.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832998+0000", 2024-09-17T06:05:34.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2264999999999997e-05 2024-09-17T06:05:34.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833027+0000", 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9658999999999998e-05 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833172+0000", 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014431900000000001 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833453+0000", 2024-09-17T06:05:34.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028136300000000002 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 80.414655358999994, 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00294042, 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834948+0000", 2024-09-17T06:05:34.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.21e-06 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834968+0000", 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9443e-05 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835013+0000", 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5324000000000002e-05 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835038+0000", 2024-09-17T06:05:34.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5358999999999999e-05 2024-09-17T06:05:34.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835255+0000", 2024-09-17T06:05:34.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021677600000000001 2024-09-17T06:05:34.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835304+0000", 2024-09-17T06:05:34.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9261000000000002e-05 2024-09-17T06:05:34.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837761+0000", 2024-09-17T06:05:34.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024567230000000001 2024-09-17T06:05:34.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837886+0000", 2024-09-17T06:05:34.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012532400000000001 2024-09-17T06:05:34.324 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.324 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.324 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.324 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-17T06:05:34.324 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:34.324 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.650744003, 2024-09-17T06:05:34.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001082132, 2024-09-17T06:05:34.324 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.324 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.324 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.325 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:34.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:34.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598860+0000", 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4569999999999999e-06 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598901+0000", 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1400999999999999e-05 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598934+0000", 2024-09-17T06:05:34.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3012000000000002e-05 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598959+0000", 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4839000000000001e-05 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599073+0000", 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113763 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599099+0000", 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6120999999999999e-05 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599900+0000", 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00080140099999999998 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599940+0000", 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9137999999999997e-05 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.329 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-17T06:05:34.329 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:34.329 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 71.930096091999999, 2024-09-17T06:05:34.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00153148, 2024-09-17T06:05:34.329 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.329 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.329 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.329 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:34.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:34.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319508+0000", 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5399999999999998e-06 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319533+0000", 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4759000000000001e-05 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319568+0000", 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5305000000000002e-05 2024-09-17T06:05:34.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319602+0000", 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3992999999999998e-05 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319715+0000", 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113112 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319745+0000", 2024-09-17T06:05:34.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9580000000000001e-05 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.320978+0000", 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233165 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.321037+0000", 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9026e-05 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.333 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 71.057924982000003, 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00083231099999999997, 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:34.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191678+0000", 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869999999999999e-06 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191693+0000", 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4409e-05 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191713+0000", 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0523e-05 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191726+0000", 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3386e-05 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191806+0000", 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9287000000000002e-05 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191834+0000", 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8323e-05 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192473+0000", 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063865000000000005 2024-09-17T06:05:34.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192509+0000", 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6046e-05 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.531816706000001, 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096842599999999999, 2024-09-17T06:05:34.338 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717787+0000", 2024-09-17T06:05:34.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.951e-06 2024-09-17T06:05:34.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717801+0000", 2024-09-17T06:05:34.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3973e-05 2024-09-17T06:05:34.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717822+0000", 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1328e-05 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717836+0000", 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3944000000000001e-05 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717908+0000", 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1674999999999994e-05 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717940+0000", 2024-09-17T06:05:34.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2728999999999998e-05 2024-09-17T06:05:34.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718710+0000", 2024-09-17T06:05:34.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076948100000000003 2024-09-17T06:05:34.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718753+0000", 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3344999999999999e-05 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.530735894999999, 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065812800000000001, 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.343 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5000000000000001e-07 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718872+0000", 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5130000000000004e-06 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718883+0000", 2024-09-17T06:05:34.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1195e-05 2024-09-17T06:05:34.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718892+0000", 2024-09-17T06:05:34.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5669999999999995e-06 2024-09-17T06:05:34.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718931+0000", 2024-09-17T06:05:34.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8850000000000002e-05 2024-09-17T06:05:34.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718948+0000", 2024-09-17T06:05:34.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7425999999999999e-05 2024-09-17T06:05:34.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719496+0000", 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00054753699999999996 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719524+0000", 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.809e-05 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:45 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'12, mlcod=26'10)", 2024-09-17T06:05:34.348 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 46.596369914, 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013449270000000001, 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:34.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653233+0000", 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.796e-06 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653250+0000", 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7025999999999999e-05 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653272+0000", 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1338000000000001e-05 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653287+0000", 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5509999999999999e-05 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653383+0000", 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5904999999999997e-05 2024-09-17T06:05:34.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:34.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653417+0000", 2024-09-17T06:05:34.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3923e-05 2024-09-17T06:05:34.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:34.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654510+0000", 2024-09-17T06:05:34.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001092602 2024-09-17T06:05:34.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:34.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:34.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:34.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654576+0000", 2024-09-17T06:05:34.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6827000000000002e-05 2024-09-17T06:05:34.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.353 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.354 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.354 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:34.354 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:34.354 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:34.356 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:05:34.357 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:34.353+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:34.457 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:34.453+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:34.515 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:34.515 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:34.515 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:34.515 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:34.535 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:05:34.557 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:34.553+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:34.658 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:34.653+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:34.724 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:34.725 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:34.725 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:34.725 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:34.725 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:34.742 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:05:34.760 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:34.757+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:34.860 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:34.857+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:34.892 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:34.892 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:34.892 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:34.892 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:34.892 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.892 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.068751855000002, 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.893 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:05:34.894 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:34.895 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.896 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.068639630999996, 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:05:34.897 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:34.898 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:34.898 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.898 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:34.898 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.898 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:34.898 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:34.898 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.898 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.898 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.898 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:34.898 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:34.898 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.899 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.899 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.899 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:34.899 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:05:34.899 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:05:34.899 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.899 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.899 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:34.899 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:05:34.899 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:05:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:05:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:05:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:05:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:05:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.900 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:05:34.901 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.068434280999995, 2024-09-17T06:05:34.902 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:34.904 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.905 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:05:34.906 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.062293754999999, 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.907 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:05:34.908 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.909 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.910 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.911 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.062139028999994, 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.912 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.914 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.914 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:34.914 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:34.915 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.915 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.915 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.915 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:34.915 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:05:34.915 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:05:34.915 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.915 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.915 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:34.915 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:05:34.915 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:05:34.917 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:05:34.917 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.917 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.917 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:34.917 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:05:34.917 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:05:34.917 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.917 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.920 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:34.920 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:05:34.920 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:05:34.920 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "MOSDPGPushReply(2.15 43/42 [PushReplyOp(2:a93a17c2:::604.00000000:head)])", 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 14.259037967999999, 2024-09-17T06:05:34.921 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033440999999999999, 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:34.922 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632988+0000", 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4499999999999996e-07 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632997+0000", 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8349999999999993e-06 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.923 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:34.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633010+0000", 2024-09-17T06:05:34.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2907e-05 2024-09-17T06:05:34.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.924 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.924 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633032+0000", 2024-09-17T06:05:34.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2867e-05 2024-09-17T06:05:34.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.924 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.924 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:34.924 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633091+0000", 2024-09-17T06:05:34.924 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8504000000000001e-05 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633322+0000", 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000230552 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "MOSDPGPushReply(2.15 43/42 [PushReplyOp(2:aa448500:::500.00000000:head)])", 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 14.256826159999999, 2024-09-17T06:05:34.925 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000220134, 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:34.926 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8999999999999997e-07 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635206+0000", 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2949999999999999e-06 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:34.927 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635220+0000", 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3821e-05 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635233+0000", 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3797e-05 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635277+0000", 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3161000000000002e-05 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:34.928 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:34.929 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:34.929 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635419+0000", 2024-09-17T06:05:34.929 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014257000000000001 2024-09-17T06:05:34.929 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.929 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:34.929 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.929 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:34.929 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:34.929 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:34.930 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:05:34.961 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:34.957+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:35.062 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:35.057+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:35.075 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:35.075 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:35.075 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:35.075 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:35.093 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:05:35.163 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:35.157+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:35.240 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:35.240 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:35.240 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:35.240 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:35.240 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:35.257 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:05:35.264 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:35.261+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:35.345 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:05:35.348 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:05:35.392 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:35.389+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:35.411 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.588044339000007, 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.412 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.413 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.413 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:35.413 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.413 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.413 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.413 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.413 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:35.413 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.413 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.413 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.413 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.413 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.414 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:05:35.415 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.416 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.417 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.587923936999999, 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.418 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.419 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:05:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:05:35.421 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.421 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.421 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.421 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:35.421 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:05:35.421 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.421 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.421 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.421 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:05:35.421 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:05:35.422 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.422 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.422 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:35.422 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:05:35.422 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:05:35.422 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.422 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.422 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.422 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:35.422 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:05:35.423 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.423 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.423 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.423 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:05:35.423 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:05:35.423 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.423 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.423 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.423 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:05:35.423 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:05:35.423 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.424 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.424 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.424 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:05:35.424 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:05:35.424 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.424 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.425 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.425 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.425 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.425 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:35.425 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:35.425 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.587796022999996, 2024-09-17T06:05:35.425 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:05:35.425 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.425 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.425 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.425 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.425 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.426 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.426 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:35.426 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.426 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.426 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.426 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.426 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:35.426 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.426 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.426 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.426 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.426 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.427 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:05:35.428 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:05:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:05:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:05:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:05:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.429 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:05:35.430 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.586770060000006, 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.431 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:05:35.432 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:05:35.433 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.434 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:05:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:05:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:05:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:05:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.435 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:05:35.436 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:05:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.586689117000006, 2024-09-17T06:05:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:05:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.437 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.438 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.439 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.440 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:05:35.440 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:05:35.440 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.440 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.440 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.440 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:05:35.440 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:05:35.441 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.441 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.441 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.441 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:05:35.441 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:05:35.441 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.442 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.442 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:35.442 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:05:35.442 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:05:35.442 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.442 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.442 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.442 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:05:35.442 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:05:35.443 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.443 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.443 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.443 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:05:35.443 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:05:35.443 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.444 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.444 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.444 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:35.444 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:05:35.444 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.444 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.444 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.444 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:05:35.444 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:05:35.444 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.444 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.445 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.445 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.445 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.445 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:35.445 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:35.445 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.586626714999994, 2024-09-17T06:05:35.445 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:05:35.445 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.445 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.445 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.446 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.446 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.446 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.446 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:35.446 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.446 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.447 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.447 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.447 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:35.447 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.447 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.447 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.448 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.448 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:05:35.448 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:05:35.448 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.448 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.448 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.449 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:05:35.449 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:05:35.449 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.449 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.449 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.449 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:05:35.450 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:05:35.450 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.450 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.450 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.450 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:05:35.450 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:05:35.451 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.451 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.451 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.451 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:05:35.451 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:05:35.451 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.452 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.452 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.452 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:05:35.452 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:05:35.452 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.452 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.453 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:35.453 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:05:35.453 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:05:35.453 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.453 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.453 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.454 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:05:35.454 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:05:35.454 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.454 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.454 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.454 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:05:35.455 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:05:35.455 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.455 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.455 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.455 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:05:35.455 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:05:35.456 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.456 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.456 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.456 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:05:35.456 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:05:35.457 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.457 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.457 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.457 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.457 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.457 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:35.458 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:35.458 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.586554625000005, 2024-09-17T06:05:35.458 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:05:35.458 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.458 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.458 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:35.459 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.459 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.459 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.459 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:35.459 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.459 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.460 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.460 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.460 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:35.460 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.460 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.460 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.461 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.461 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:05:35.461 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:05:35.461 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.461 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.461 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.462 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:05:35.462 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:05:35.462 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.462 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.462 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.462 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:05:35.463 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:05:35.463 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.463 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.463 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.463 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:05:35.464 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:05:35.464 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.464 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.464 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.464 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:05:35.464 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:05:35.465 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.465 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.465 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.465 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:05:35.465 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:05:35.465 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.466 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.466 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.466 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:05:35.466 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:05:35.466 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.467 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.467 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.467 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.467 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.467 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:35.467 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:35.468 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.586512424999995, 2024-09-17T06:05:35.468 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:05:35.468 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.468 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.468 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:35.468 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.469 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.469 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.469 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:35.469 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.469 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.470 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.470 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.470 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:35.470 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.470 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.470 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.471 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.471 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:05:35.471 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:05:35.471 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.471 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.471 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.472 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:05:35.472 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:05:35.472 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.472 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.472 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.472 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:05:35.473 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:05:35.473 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.473 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.473 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.473 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:05:35.473 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:05:35.474 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.474 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.474 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.474 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:05:35.474 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:05:35.474 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.474 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.474 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.474 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:05:35.475 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:05:35.475 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.475 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.475 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.475 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:05:35.475 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:05:35.475 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.475 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.476 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.476 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.476 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.476 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:35.476 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:35.476 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.583920492999994, 2024-09-17T06:05:35.476 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:05:35.476 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.477 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.477 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.477 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.477 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.477 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.477 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:35.477 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.477 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.478 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.478 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.478 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:35.478 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.478 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.478 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.478 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.478 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:05:35.479 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:05:35.479 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.479 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.479 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.479 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:05:35.479 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:05:35.479 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.479 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.480 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.480 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:05:35.480 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:05:35.480 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.480 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.480 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.480 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:05:35.480 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:05:35.480 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.481 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.481 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.481 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:05:35.481 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:05:35.481 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.481 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.481 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.481 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:05:35.482 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:05:35.482 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.482 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.482 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.482 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:05:35.482 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:05:35.482 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.482 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.482 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.483 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:05:35.483 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:05:35.483 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.483 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.483 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.483 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.483 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.483 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:35.484 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:35.484 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.583824358000001, 2024-09-17T06:05:35.484 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:05:35.484 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.484 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.484 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.484 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.484 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.485 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.485 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:35.485 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.485 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.485 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.485 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.485 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:35.485 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.486 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.486 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.486 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:05:35.486 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:05:35.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.486 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.486 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.487 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:05:35.487 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:05:35.487 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.487 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.487 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.487 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:05:35.487 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:05:35.487 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.488 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.488 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.488 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:05:35.488 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:05:35.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.488 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.488 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.488 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.489 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.490 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.490 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:05:35.490 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:05:35.490 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.490 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.490 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.490 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.490 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.490 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:05:35.490 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:35.490 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.575392072, 2024-09-17T06:05:35.491 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:05:35.491 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.491 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.491 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.491 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.491 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.491 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.491 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:35.491 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.491 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.491 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.492 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.492 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:35.492 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.492 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.492 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.492 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.493 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:05:35.493 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:05:35.493 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.493 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.493 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.493 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:05:35.493 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:05:35.493 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.493 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.493 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.494 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:05:35.494 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:05:35.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.494 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.494 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.494 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:05:35.494 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:05:35.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.494 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.494 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.494 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:05:35.494 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:05:35.495 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.495 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.495 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.495 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:05:35.495 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:05:35.495 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.495 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.495 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:35.495 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:05:35.495 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:05:35.496 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.496 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.496 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.496 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:05:35.496 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:05:35.496 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.496 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.496 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.497 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:05:35.497 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:05:35.497 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.497 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.497 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.498 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:05:35.498 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:05:35.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.498 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.498 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.498 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:05:35.499 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:05:35.499 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.499 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.499 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.499 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.500 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.500 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:05:35.500 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:35.500 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 76.481802852000001, 2024-09-17T06:05:35.500 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:05:35.501 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.501 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.501 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.501 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.501 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.502 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.502 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:35.502 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.502 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.502 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.502 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.503 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:35.503 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.503 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.503 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.503 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.503 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:05:35.503 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:05:35.503 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.503 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.503 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.503 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:05:35.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:05:35.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.504 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.504 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.504 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:05:35.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:05:35.504 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.504 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.504 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.504 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:05:35.504 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.505 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.506 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:35.507 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:35.507 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 74.811172486999993, 2024-09-17T06:05:35.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:05:35.507 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.507 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.507 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.507 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.507 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.507 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.507 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:35.507 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.507 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.508 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.510 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.510 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:05:35.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:05:35.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.510 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.510 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.510 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:05:35.510 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:05:35.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.511 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:35.511 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:05:35.511 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:05:35.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.511 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.512 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:05:35.512 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:05:35.512 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.512 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.512 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.513 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 73.090501531000001, 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.514 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.515 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:35.515 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.515 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.515 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.515 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:35.515 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.515 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.515 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.515 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.515 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:05:35.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:05:35.516 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:05:35.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:05:35.516 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.516 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.516 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.516 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:05:35.516 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.517 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:05:35.518 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.519 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:05:35.520 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:05:35.520 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.520 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.520 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.520 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.520 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.520 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:35.520 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:35.520 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 73.087817282000003, 2024-09-17T06:05:35.520 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:05:35.520 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.520 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.521 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.522 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.522 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:05:35.522 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:05:35.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.522 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.522 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.522 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:05:35.522 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:05:35.522 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.522 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.522 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.523 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:05:35.523 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:05:35.523 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.523 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.523 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.523 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:05:35.523 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:05:35.523 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.523 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.523 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.523 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:05:35.523 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:05:35.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.524 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.524 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:05:35.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:05:35.524 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.524 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.524 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.524 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:05:35.524 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:05:35.525 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.525 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.525 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.525 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.525 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.525 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:35.525 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:35.525 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 72.218614608999999, 2024-09-17T06:05:35.525 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:05:35.525 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.525 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.526 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.527 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:05:35.528 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:05:35.529 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.529 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.529 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:35.529 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:05:35.529 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:05:35.529 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.529 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.529 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.532 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:05:35.532 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:05:35.532 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.533 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.533 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.533 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:05:35.533 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:05:35.533 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.533 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.533 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.533 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:05:35.533 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:05:35.533 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.533 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.692173697000001, 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:05:35.534 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.535 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:05:35.536 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.537 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.538 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:05:35.538 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:05:35.538 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.538 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.538 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:35.538 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:05:35.538 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:05:35.538 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.538 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.538 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.538 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:05:35.538 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.539 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.691944180999997, 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.540 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.541 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.542 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:05:35.543 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.544 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.544 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:35.544 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:05:35.544 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:05:35.544 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.544 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.544 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.544 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:05:35.544 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:05:35.544 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.545 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:05:35.546 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:05:35.546 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.546 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.546 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.546 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.546 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.546 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:35.546 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:35.546 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 51.689979485000002, 2024-09-17T06:05:35.546 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:05:35.547 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.547 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.547 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:35.547 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.547 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.547 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.548 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:35.548 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.548 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.548 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.548 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.548 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:35.548 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.548 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.548 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.548 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.548 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:05:35.548 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.549 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:05:35.550 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:05:35.550 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.550 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.550 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.550 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:05:35.550 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:05:35.550 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.550 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.550 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.550 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:05:35.550 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 47.756416598000001, 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:05:35.551 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:35.552 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:35.552 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:35.552 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:35.552 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.552 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:35.552 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:35.552 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.552 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.552 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.553 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:35.553 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:35.553 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:35.553 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.553 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.553 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:35.554 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:05:35.554 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:05:35.554 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.554 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.554 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:35.554 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:05:35.555 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:05:35.555 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.555 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.555 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:35.555 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:05:35.555 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:05:35.556 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.556 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.556 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:35.556 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:05:35.556 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:05:35.556 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.556 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.556 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:35.556 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:05:35.556 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:05:35.556 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:35.557 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:35.558 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:35.559 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:05:35.559 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:05:35.559 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.559 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.559 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.559 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:35.559 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:35.559 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:35.560 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:05:35.561 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:05:35.562 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:35.557+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:35.586 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T06:05:35.680 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:35.677+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:35.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.757+0000 7f746d501640 1 -- 172.21.15.122:0/3935766442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74680c9fc0 msgr2=0x7f746815b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:35.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.757+0000 7f746d501640 1 --2- 172.21.15.122:0/3935766442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74680c9fc0 0x7f746815b7c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f74680ce2c0 tx=0x7f7460021270 comp rx=0 tx=0).stop 2024-09-17T06:05:35.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.757+0000 7f746d501640 1 -- 172.21.15.122:0/3935766442 shutdown_connections 2024-09-17T06:05:35.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.757+0000 7f746d501640 1 --2- 172.21.15.122:0/3935766442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74680c9fc0 0x7f746815b7c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:35.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.757+0000 7f746d501640 1 --2- 172.21.15.122:0/3935766442 >> v2:172.21.15.173:3300/0 conn(0x7f746806f5c0 0x7f74680c2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:35.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.757+0000 7f746d501640 1 -- 172.21.15.122:0/3935766442 >> 172.21.15.122:0/3935766442 conn(0x7f7468073640 msgr2=0x7f74680cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:35.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.757+0000 7f746d501640 1 -- 172.21.15.122:0/3935766442 shutdown_connections 2024-09-17T06:05:35.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.757+0000 7f746d501640 1 -- 172.21.15.122:0/3935766442 wait complete. 2024-09-17T06:05:35.763 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:35.763 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:35.763 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:35.764 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:35.764 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:35.761+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:35.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f746d501640 1 Processor -- start 2024-09-17T06:05:35.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f746d501640 1 -- start start 2024-09-17T06:05:35.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f746d501640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74680b3b80 0x7f746815a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f746d501640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74680c9fc0 0x7f7468148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f746d501640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7468148770 0x7f74680cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f746d501640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f746806f0a0 con 0x7f74680c9fc0 2024-09-17T06:05:35.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f746d501640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f746806edc0 con 0x7f7468148770 2024-09-17T06:05:35.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f746d501640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f74680c2f60 con 0x7f74680b3b80 2024-09-17T06:05:35.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f745ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74680c9fc0 0x7f7468148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f7466ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74680b3b80 0x7f746815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f745ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74680c9fc0 0x7f7468148230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40370/0 (socket says 172.21.15.122:40370) 2024-09-17T06:05:35.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f745ffff640 1 -- 172.21.15.122:0/2534355008 learned_addr learned my addr 172.21.15.122:0/2534355008 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:35.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f74677fe640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7468148770 0x7f74680cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f745ffff640 1 -- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74680b3b80 msgr2=0x7f746815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:35.770 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f745ffff640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74680b3b80 0x7f746815a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:35.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f745ffff640 1 -- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7468148770 msgr2=0x7f74680cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:35.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f745ffff640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7468148770 0x7f74680cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:35.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f745ffff640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746815a5d0 con 0x7f74680c9fc0 2024-09-17T06:05:35.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.761+0000 7f74677fe640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7468148770 0x7f74680cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:05:35.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.765+0000 7f745ffff640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74680c9fc0 0x7f7468148230 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f745000b410 tx=0x7f745000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:35.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.765+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7450015030 con 0x7f74680c9fc0 2024-09-17T06:05:35.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.765+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7450004020 con 0x7f74680c9fc0 2024-09-17T06:05:35.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.765+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7450004470 con 0x7f74680c9fc0 2024-09-17T06:05:35.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.765+0000 7f746d501640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74681edcc0 con 0x7f74680c9fc0 2024-09-17T06:05:35.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.765+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7450018070 con 0x7f74680c9fc0 2024-09-17T06:05:35.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.765+0000 7f746d501640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74680cbcc0 con 0x7f74680c9fc0 2024-09-17T06:05:35.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.769+0000 7f745f7fe640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7448073200 0x7f7448075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.769+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6804+0+0 (secure 0 0 0) 0x7f7450093490 con 0x7f74680c9fc0 2024-09-17T06:05:35.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.769+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f7440005280 con 0x7f74680c9fc0 2024-09-17T06:05:35.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.769+0000 7f7466ffd640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7448073200 0x7f7448075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.769+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v50) ==== 54+0+16 (secure 0 0 0) 0x7f745005daa0 con 0x7f74680c9fc0 2024-09-17T06:05:35.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.769+0000 7f745d7fa640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f74400018f0 0x7f7440001d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.769+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7440002240 con 0x7f74400018f0 2024-09-17T06:05:35.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.769+0000 7f74677fe640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f74400018f0 0x7f7440001d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.769+0000 7f7466ffd640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7448073200 0x7f7448075710 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7458009b40 tx=0x7f74580091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:35.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.769+0000 7f74677fe640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f74400018f0 0x7f7440001d00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:35.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.769+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7440002240 con 0x7f74400018f0 2024-09-17T06:05:35.781 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:05:35.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.797+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f74400029a0 con 0x7f74400018f0 2024-09-17T06:05:35.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.801+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f74400029a0 con 0x7f74400018f0 2024-09-17T06:05:35.806 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:35.807 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:35.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.801+0000 7f745d7fa640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f7440003460 0x7f7440003870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.801+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f7440004fb0 con 0x7f7440003460 2024-09-17T06:05:35.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.801+0000 7f7466ffd640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f7440003460 0x7f7440003870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.801+0000 7f7466ffd640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f7440003460 0x7f7440003870 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:35.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.805+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7440004fb0 con 0x7f7440003460 2024-09-17T06:05:35.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.809+0000 7faab5700640 1 -- 172.21.15.122:0/2234388048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faab00c29c0 msgr2=0x7faab00c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:35.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.809+0000 7faab5700640 1 --2- 172.21.15.122:0/2234388048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faab00c29c0 0x7faab00c8af0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faab0074290 tx=0x7faaa001c830 comp rx=0 tx=0).stop 2024-09-17T06:05:35.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.813+0000 7faab5700640 1 -- 172.21.15.122:0/2234388048 shutdown_connections 2024-09-17T06:05:35.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.813+0000 7faab5700640 1 --2- 172.21.15.122:0/2234388048 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faab00c2dd0 0x7faab00c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:35.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.813+0000 7faab5700640 1 --2- 172.21.15.122:0/2234388048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faab00c29c0 0x7faab00c8af0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:35.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.813+0000 7faab5700640 1 --2- 172.21.15.122:0/2234388048 >> v2:172.21.15.173:3300/0 conn(0x7faab0158150 0x7faab0152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:35.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.813+0000 7faab5700640 1 -- 172.21.15.122:0/2234388048 >> 172.21.15.122:0/2234388048 conn(0x7faab00ca380 msgr2=0x7faab00ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:35.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.813+0000 7faab5700640 1 -- 172.21.15.122:0/2234388048 shutdown_connections 2024-09-17T06:05:35.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.813+0000 7faab5700640 1 -- 172.21.15.122:0/2234388048 wait complete. 2024-09-17T06:05:35.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.813+0000 7faab5700640 1 Processor -- start 2024-09-17T06:05:35.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.813+0000 7faab5700640 1 -- start start 2024-09-17T06:05:35.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faab5700640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faab00c29c0 0x7faab00b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faab5700640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faab00c2dd0 0x7faab015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaaeffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faab00c29c0 0x7faab00b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaaeffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faab00c29c0 0x7faab00b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:38270/0 (socket says 172.21.15.122:38270) 2024-09-17T06:05:35.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaa7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faab00c2dd0 0x7faab015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaa7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faab00c2dd0 0x7faab015a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40396/0 (socket says 172.21.15.122:40396) 2024-09-17T06:05:35.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaaeffd640 1 -- 172.21.15.122:0/1253468040 learned_addr learned my addr 172.21.15.122:0/1253468040 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:35.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faab5700640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faab0158150 0x7faab00cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faab00c9570 con 0x7faab00c2dd0 2024-09-17T06:05:35.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faab00b0a80 con 0x7faab0158150 2024-09-17T06:05:35.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7faab006ff60 con 0x7faab00c29c0 2024-09-17T06:05:35.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaaf7fe640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faab0158150 0x7faab00cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaaeffd640 1 -- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faab0158150 msgr2=0x7faab00cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:35.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaaeffd640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faab0158150 0x7faab00cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:35.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaaeffd640 1 -- 172.21.15.122:0/1253468040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faab00c2dd0 msgr2=0x7faab015a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:35.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaaeffd640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faab00c2dd0 0x7faab015a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:35.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaaeffd640 1 -- 172.21.15.122:0/1253468040 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab015ae90 con 0x7faab00c29c0 2024-09-17T06:05:35.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaaeffd640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faab00c29c0 0x7faab00b3580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faa9800bcc0 tx=0x7faa98009610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:35.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaa77fe640 1 -- 172.21.15.122:0/1253468040 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa98011250 con 0x7faab00c29c0 2024-09-17T06:05:35.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaa77fe640 1 -- 172.21.15.122:0/1253468040 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa980114e0 con 0x7faab00c29c0 2024-09-17T06:05:35.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab01594b0 con 0x7faab00c29c0 2024-09-17T06:05:35.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faab014def0 con 0x7faab00c29c0 2024-09-17T06:05:35.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.817+0000 7faaa77fe640 1 -- 172.21.15.122:0/1253468040 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa98010940 con 0x7faab00c29c0 2024-09-17T06:05:35.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.821+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faab00728c0 con 0x7faab00c29c0 2024-09-17T06:05:35.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.821+0000 7faaa77fe640 1 -- 172.21.15.122:0/1253468040 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faa98010ae0 con 0x7faab00c29c0 2024-09-17T06:05:35.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.821+0000 7faaa77fe640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7faa90073230 0x7faa90075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.821+0000 7faaa77fe640 1 -- 172.21.15.122:0/1253468040 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(50..50 src has 1..50) ==== 6804+0+0 (secure 0 0 0) 0x7faa98098890 con 0x7faab00c29c0 2024-09-17T06:05:35.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.821+0000 7faaa7fff640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7faa90073230 0x7faa90075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.825+0000 7faaa7fff640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7faa90073230 0x7faa90075740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faaa00af000 tx=0x7faaa001b070 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:35.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.829+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f7440004080 con 0x7f7440003460 2024-09-17T06:05:35.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.833+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f7440004080 con 0x7f7440003460 2024-09-17T06:05:35.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.833+0000 7faaa77fe640 1 -- 172.21.15.122:0/1253468040 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7faa98016070 con 0x7faab00c29c0 2024-09-17T06:05:35.839 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:35.839 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:35.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.833+0000 7f745d7fa640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f7440009c90 0x7f744000c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.833+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f744000ee80 con 0x7f7440009c90 2024-09-17T06:05:35.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.833+0000 7f745ffff640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f7440009c90 0x7f744000c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.837+0000 7f745ffff640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f7440009c90 0x7f744000c0b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:35.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.837+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f744000ee80 con 0x7f7440009c90 2024-09-17T06:05:35.864 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:35.861+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:35.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.865+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f744000c8c0 con 0x7f7440009c90 2024-09-17T06:05:35.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.865+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f744000c8c0 con 0x7f7440009c90 2024-09-17T06:05:35.871 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:35.871 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:35.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.865+0000 7f745d7fa640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f744000d110 0x7f744000d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.865+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f7440012750 con 0x7f744000d110 2024-09-17T06:05:35.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.865+0000 7f74677fe640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f744000d110 0x7f744000d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.869+0000 7f74677fe640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f744000d110 0x7f744000d520 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:35.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.869+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7440012750 con 0x7f744000d110 2024-09-17T06:05:35.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.893+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f744000ded0 con 0x7f744000d110 2024-09-17T06:05:35.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.897+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f744000ded0 con 0x7f744000d110 2024-09-17T06:05:35.902 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:35.903 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:35.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.897+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=51}) -- 0x7f7440012750 con 0x7f74680c9fc0 2024-09-17T06:05:35.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.897+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f744000e140 con 0x7f74680c9fc0 2024-09-17T06:05:35.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.897+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f7450098060 con 0x7f74680c9fc0 2024-09-17T06:05:35.903 INFO:teuthology.orchestra.run.smithi122.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-17T06:05:35.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.897+0000 7f745d7fa640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f7440011040 0x7f7440011450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.897+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 10: {"prefix": "get_command_descriptions"}) -- 0x7f7440011af0 con 0x7f7440011040 2024-09-17T06:05:35.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.897+0000 7f7466ffd640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f7440011040 0x7f7440011450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.901+0000 7f7466ffd640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f7440011040 0x7f7440011450 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:35.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.901+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 10: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7440011af0 con 0x7f7440011040 2024-09-17T06:05:35.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.925+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f7440011d30 con 0x7f7440011040 2024-09-17T06:05:35.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.929+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 11: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f7440011d30 con 0x7f7440011040 2024-09-17T06:05:35.935 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:35.935 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:35.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.929+0000 7f745d7fa640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f74400149a0 0x7f7440016dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.929+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7f7440019c40 con 0x7f74400149a0 2024-09-17T06:05:35.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.933+0000 7f745ffff640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f74400149a0 0x7f7440016dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.933+0000 7f745ffff640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f74400149a0 0x7f7440016dc0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:35.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.933+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7440019c40 con 0x7f74400149a0 2024-09-17T06:05:35.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.961+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f7440017380 con 0x7f74400149a0 2024-09-17T06:05:35.965 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:35.965+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:35.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.965+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f7440017380 con 0x7f74400149a0 2024-09-17T06:05:35.968 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:35.969 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:35.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.965+0000 7f745d7fa640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f7440017aa0 0x7f7440017eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:35.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.965+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7f744001d060 con 0x7f7440017aa0 2024-09-17T06:05:35.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.965+0000 7f74677fe640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f7440017aa0 0x7f7440017eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:35.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.965+0000 7f74677fe640 1 --2- 172.21.15.122:0/2534355008 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f7440017aa0 0x7f7440017eb0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:35.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.969+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f744001d060 con 0x7f7440017aa0 2024-09-17T06:05:35.985 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:35.985 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:35.985 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:35.986 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:35.986 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:36.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.993+0000 7f745d7fa640 1 -- 172.21.15.122:0/2534355008 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f7440018500 con 0x7f7440017aa0 2024-09-17T06:05:36.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:35.997+0000 7f745f7fe640 1 -- 172.21.15.122:0/2534355008 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f7440018500 con 0x7f7440017aa0 2024-09-17T06:05:36.004 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:36.004 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:36.005 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:05:36.012 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T06:05:36.013 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T06:05:36.098 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:36.097+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:36.167 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:36.165+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:36.182 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.177+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) -- 0x7faab0148b90 con 0x7faab00c29c0 2024-09-17T06:05:36.200 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-17T06:05:36.200 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T06:05:36.200 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-17T06:05:36.200 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T06:05:36.200 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T06:05:36.201 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-17T06:05:36.205 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:36.205 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:36.224 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:05:36.268 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:36.265+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:36.359 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:36.359 INFO:teuthology.orchestra.run.smithi173.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T06:05:36.359 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:36.369 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:36.369+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:36.429 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:36.429 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:36.453 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:05:36.496 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:36.493+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:36.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faaa77fe640 1 -- 172.21.15.122:0/1253468040 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v51) ==== 87+0+0 (secure 0 0 0) 0x7faa98062e90 con 0x7faab00c29c0 2024-09-17T06:05:36.572 INFO:teuthology.orchestra.run.smithi122.stderr:noscrub is set 2024-09-17T06:05:36.573 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:36.569+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:36.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7faa90073230 msgr2=0x7faa90075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:36.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faab5700640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7faa90073230 0x7faa90075740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faaa00af000 tx=0x7faaa001b070 comp rx=0 tx=0).stop 2024-09-17T06:05:36.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faab00c29c0 msgr2=0x7faab00b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:36.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faab5700640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faab00c29c0 0x7faab00b3580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faa9800bcc0 tx=0x7faa98009610 comp rx=0 tx=0).stop 2024-09-17T06:05:36.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 shutdown_connections 2024-09-17T06:05:36.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faab5700640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7faa90073230 0x7faa90075740 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:36.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faab5700640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faab0158150 0x7faab00cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:36.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faab5700640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faab00c2dd0 0x7faab015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:36.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faab5700640 1 --2- 172.21.15.122:0/1253468040 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faab00c29c0 0x7faab00b3580 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:36.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 >> 172.21.15.122:0/1253468040 conn(0x7faab00ca380 msgr2=0x7faab00712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:36.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 shutdown_connections 2024-09-17T06:05:36.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:36.569+0000 7faab5700640 1 -- 172.21.15.122:0/1253468040 wait complete. 2024-09-17T06:05:36.673 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:36.669+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:36.702 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:36.703 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:36.726 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:05:36.773 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:36.769+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:36.874 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:36.873+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:36.930 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:36.930 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:36.952 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:05:36.996 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:36.993+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:37.076 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:37.073+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:37.178 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:37.177+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:37.198 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:37.198 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:37.221 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:05:37.278 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:37.277+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:37.379 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:37.377+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:37.466 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:37.466 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:37.480 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:37.477+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:37.488 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:05:37.582 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:37.577+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:37.683 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:37.681+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:37.735 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:37.735 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:37.758 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:05:37.800 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:37.797+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:37.885 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:37.881+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:37.989 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:37.989+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:38.003 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:38.004 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:38.014 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:05:38.027 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:05:38.090 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:38.089+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:38.193 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:38.193+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:38.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.209+0000 7fca3224e640 1 -- 172.21.15.122:0/592417215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c1536a0 msgr2=0x7fca2c0cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:38.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.209+0000 7fca3224e640 1 --2- 172.21.15.122:0/592417215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c1536a0 0x7fca2c0cea10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009900 tx=0x7fca1c01c900 comp rx=0 tx=0).stop 2024-09-17T06:05:38.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.209+0000 7fca3224e640 1 -- 172.21.15.122:0/592417215 shutdown_connections 2024-09-17T06:05:38.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.209+0000 7fca3224e640 1 --2- 172.21.15.122:0/592417215 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca2c0c3f80 0x7fca2c0cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:38.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.209+0000 7fca3224e640 1 --2- 172.21.15.122:0/592417215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c1536a0 0x7fca2c0cea10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:38.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.209+0000 7fca3224e640 1 -- 172.21.15.122:0/592417215 >> 172.21.15.122:0/592417215 conn(0x7fca2c0740c0 msgr2=0x7fca2c0744d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:38.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.209+0000 7fca3224e640 1 -- 172.21.15.122:0/592417215 shutdown_connections 2024-09-17T06:05:38.216 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.209+0000 7fca3224e640 1 -- 172.21.15.122:0/592417215 wait complete. 2024-09-17T06:05:38.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.213+0000 7fca3224e640 1 Processor -- start 2024-09-17T06:05:38.218 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.213+0000 7fca3224e640 1 -- start start 2024-09-17T06:05:38.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca3224e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c0c3f80 0x7fca2c15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca3224e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca2c1536a0 0x7fca2c1436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca3224e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca2c15cc10 0x7fca2c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca2b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c0c3f80 0x7fca2c15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca3224e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c0c9cb0 con 0x7fca2c0c3f80 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca2b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c0c3f80 0x7fca2c15c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40408/0 (socket says 172.21.15.122:40408) 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca2b7fe640 1 -- 172.21.15.122:0/647660532 learned_addr learned my addr 172.21.15.122:0/647660532 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c0c46e0 con 0x7fca2c15cc10 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fca2c0c9e30 con 0x7fca2c1536a0 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca2affd640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca2c1536a0 0x7fca2c1436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca2bfff640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca2c15cc10 0x7fca2c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca2b7fe640 1 -- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca2c1536a0 msgr2=0x7fca2c1436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca2b7fe640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca2c1536a0 0x7fca2c1436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca2b7fe640 1 -- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca2c15cc10 msgr2=0x7fca2c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca2b7fe640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca2c15cc10 0x7fca2c15aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:38.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca2b7fe640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2c1f4330 con 0x7fca2c0c3f80 2024-09-17T06:05:38.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca2b7fe640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca2c0c3f80 0x7fca2c15c020 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009850 tx=0x7fca1c0a5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:38.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0b2040 con 0x7fca2c0c3f80 2024-09-17T06:05:38.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca1c0042c0 con 0x7fca2c0c3f80 2024-09-17T06:05:38.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2c15afa0 con 0x7fca2c0c3f80 2024-09-17T06:05:38.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2c15a540 con 0x7fca2c0c3f80 2024-09-17T06:05:38.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.217+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c005030 con 0x7fca2c0c3f80 2024-09-17T06:05:38.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.221+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fca2c1f47c0 con 0x7fca2c0c3f80 2024-09-17T06:05:38.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.221+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fca1c005210 con 0x7fca2c0c3f80 2024-09-17T06:05:38.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.221+0000 7fca13fff640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fca18073200 0x7fca18075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.221+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6804+0+0 (secure 0 0 0) 0x7fca1c132060 con 0x7fca2c0c3f80 2024-09-17T06:05:38.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.221+0000 7fca2affd640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fca18073200 0x7fca18075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.221+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v51) ==== 54+0+16 (secure 0 0 0) 0x7fca1c0164f0 con 0x7fca2c0c3f80 2024-09-17T06:05:38.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.221+0000 7fca3224e640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fca2c15b170 0x7fca2c157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.221+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca2c070e40 con 0x7fca2c15b170 2024-09-17T06:05:38.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.221+0000 7fca2bfff640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fca2c15b170 0x7fca2c157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.221+0000 7fca2affd640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fca18073200 0x7fca18075710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fca2c163b90 tx=0x7fca200091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:38.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.221+0000 7fca2bfff640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fca2c15b170 0x7fca2c157c10 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:38.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.225+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca2c070e40 con 0x7fca2c15b170 2024-09-17T06:05:38.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.253+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fca2c0ca880 con 0x7fca2c15b170 2024-09-17T06:05:38.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.253+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fca2c0ca880 con 0x7fca2c15b170 2024-09-17T06:05:38.259 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:38.260 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:38.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.253+0000 7fca3224e640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fca2c0b3b80 0x7fca2c0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.253+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fca2c1508b0 con 0x7fca2c0b3b80 2024-09-17T06:05:38.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.257+0000 7fca2b7fe640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fca2c0b3b80 0x7fca2c0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.257+0000 7fca2b7fe640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fca2c0b3b80 0x7fca2c0b3f90 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:38.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.257+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca2c1508b0 con 0x7fca2c0b3b80 2024-09-17T06:05:38.281 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:38.281 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:38.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.285+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fca2c1505d0 con 0x7fca2c0b3b80 2024-09-17T06:05:38.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.285+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fca2c1505d0 con 0x7fca2c0b3b80 2024-09-17T06:05:38.291 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:38.291 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:38.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.285+0000 7fca3224e640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fca2c1f0b80 0x7fca2c0638b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.285+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fca2c1f0f90 con 0x7fca2c1f0b80 2024-09-17T06:05:38.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.289+0000 7fca2affd640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fca2c1f0b80 0x7fca2c0638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.289+0000 7fca2affd640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fca2c1f0b80 0x7fca2c0638b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:38.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.289+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca2c1f0f90 con 0x7fca2c1f0b80 2024-09-17T06:05:38.294 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:38.293+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:38.304 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:05:38.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.313+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fca2c0640c0 con 0x7fca2c1f0b80 2024-09-17T06:05:38.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.321+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fca2c0640c0 con 0x7fca2c1f0b80 2024-09-17T06:05:38.324 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:38.325 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:38.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.321+0000 7fca3224e640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fca2c14e0f0 0x7fca2c14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.321+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fca2c1f1170 con 0x7fca2c14e0f0 2024-09-17T06:05:38.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.321+0000 7fca2bfff640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fca2c14e0f0 0x7fca2c14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.321+0000 7fca2bfff640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fca2c14e0f0 0x7fca2c14e500 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:38.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.321+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca24019350 con 0x7fca2c14e0f0 2024-09-17T06:05:38.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.349+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fca2c064040 con 0x7fca2c14e0f0 2024-09-17T06:05:38.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.353+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fca2c064040 con 0x7fca2c14e0f0 2024-09-17T06:05:38.356 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:38.357 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:38.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.353+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=52}) -- 0x7fca2c064690 con 0x7fca2c0c3f80 2024-09-17T06:05:38.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.353+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca2c064040 con 0x7fca2c0c3f80 2024-09-17T06:05:38.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.353+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fca1c0f7780 con 0x7fca2c0c3f80 2024-09-17T06:05:38.358 INFO:teuthology.orchestra.run.smithi122.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-17T06:05:38.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.353+0000 7fca3224e640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fca2c02dda0 0x7fca2c02e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.353+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 10: {"prefix": "get_command_descriptions"}) -- 0x7fca2c02e6f0 con 0x7fca2c02dda0 2024-09-17T06:05:38.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.353+0000 7fca2b7fe640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fca2c02dda0 0x7fca2c02e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.353+0000 7fca2b7fe640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fca2c02dda0 0x7fca2c02e1b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:38.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.357+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 10: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca2c02e6f0 con 0x7fca2c02dda0 2024-09-17T06:05:38.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.381+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fca2c02e6f0 con 0x7fca2c02dda0 2024-09-17T06:05:38.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.385+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 11: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fca2c02e6f0 con 0x7fca2c02dda0 2024-09-17T06:05:38.391 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:38.392 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:38.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.385+0000 7fca3224e640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fca2c205170 0x7fca2c207590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.385+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7fca2c20a360 con 0x7fca2c205170 2024-09-17T06:05:38.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.389+0000 7fca2affd640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fca2c205170 0x7fca2c207590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.389+0000 7fca2affd640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fca2c205170 0x7fca2c207590 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:38.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.389+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca2c20a360 con 0x7fca2c205170 2024-09-17T06:05:38.395 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:38.389+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:38.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.417+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fca2c207ad0 con 0x7fca2c205170 2024-09-17T06:05:38.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.421+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fca2c207ad0 con 0x7fca2c205170 2024-09-17T06:05:38.425 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:38.426 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:38.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.421+0000 7fca3224e640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fca2c208150 0x7fca2c20a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.421+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7fca2c20d590 con 0x7fca2c208150 2024-09-17T06:05:38.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.421+0000 7fca2bfff640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fca2c208150 0x7fca2c20a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.421+0000 7fca2bfff640 1 --2- 172.21.15.122:0/647660532 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fca2c208150 0x7fca2c20a570 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:38.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.425+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca2c20d590 con 0x7fca2c208150 2024-09-17T06:05:38.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.453+0000 7fca3224e640 1 -- 172.21.15.122:0/647660532 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fca2c20aba0 con 0x7fca2c208150 2024-09-17T06:05:38.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.457+0000 7fca13fff640 1 -- 172.21.15.122:0/647660532 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fca2c20aba0 con 0x7fca2c208150 2024-09-17T06:05:38.461 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:38.462 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:38.471 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T06:05:38.472 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T06:05:38.510 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:38.510 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:38.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:38.510 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:38.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.687353302999995, 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014374336, 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:38.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821526+0000", 2024-09-17T06:05:38.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6859999999999999e-06 2024-09-17T06:05:38.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821553+0000", 2024-09-17T06:05:38.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6329000000000002e-05 2024-09-17T06:05:38.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821592+0000", 2024-09-17T06:05:38.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9588000000000001e-05 2024-09-17T06:05:38.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821624+0000", 2024-09-17T06:05:38.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1814999999999999e-05 2024-09-17T06:05:38.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822106+0000", 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00048212400000000001 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822852+0000", 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000745303 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823189+0000", 2024-09-17T06:05:38.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000337244 2024-09-17T06:05:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828285+0000", 2024-09-17T06:05:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050956680000000002 2024-09-17T06:05:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835635+0000", 2024-09-17T06:05:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0073502960000000001 2024-09-17T06:05:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835771+0000", 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000136219 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835897+0000", 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126064 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.517 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:38.517 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:38.517 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.687055620999999, 2024-09-17T06:05:38.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014596456000000001, 2024-09-17T06:05:38.517 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.517 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.517 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:38.517 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:38.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821823+0000", 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.17e-06 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821837+0000", 2024-09-17T06:05:38.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3845999999999999e-05 2024-09-17T06:05:38.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821872+0000", 2024-09-17T06:05:38.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5024999999999998e-05 2024-09-17T06:05:38.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821896+0000", 2024-09-17T06:05:38.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4669e-05 2024-09-17T06:05:38.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824176+0000", 2024-09-17T06:05:38.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022794389999999999 2024-09-17T06:05:38.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824408+0000", 2024-09-17T06:05:38.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000232258 2024-09-17T06:05:38.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824824+0000", 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00041565999999999999 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829781+0000", 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049579250000000002 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:38.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836070+0000", 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062883740000000002 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836286+0000", 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021609299999999999 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836417+0000", 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013099699999999999 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.686937157000003, 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014884692, 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:38.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:38.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821941+0000", 2024-09-17T06:05:38.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.784e-06 2024-09-17T06:05:38.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821990+0000", 2024-09-17T06:05:38.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9481000000000003e-05 2024-09-17T06:05:38.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822015+0000", 2024-09-17T06:05:38.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4552000000000001e-05 2024-09-17T06:05:38.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822062+0000", 2024-09-17T06:05:38.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7351000000000001e-05 2024-09-17T06:05:38.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825585+0000", 2024-09-17T06:05:38.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003522458 2024-09-17T06:05:38.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825895+0000", 2024-09-17T06:05:38.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031071499999999998 2024-09-17T06:05:38.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:38.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826221+0000", 2024-09-17T06:05:38.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032602400000000001 2024-09-17T06:05:38.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829803+0000", 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035817359999999999 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836527+0000", 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067239919999999998 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836663+0000", 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013620700000000001 2024-09-17T06:05:38.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836824+0000", 2024-09-17T06:05:38.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016039200000000001 2024-09-17T06:05:38.529 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.529 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.529 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.529 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:38.529 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:38.529 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.686782781000005, 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01512869, 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822095+0000", 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9829999999999999e-06 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822105+0000", 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5130000000000002e-06 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822125+0000", 2024-09-17T06:05:38.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9953e-05 2024-09-17T06:05:38.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822144+0000", 2024-09-17T06:05:38.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9089e-05 2024-09-17T06:05:38.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826898+0000", 2024-09-17T06:05:38.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047542740000000002 2024-09-17T06:05:38.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827131+0000", 2024-09-17T06:05:38.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023258900000000001 2024-09-17T06:05:38.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:38.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827568+0000", 2024-09-17T06:05:38.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00043743200000000002 2024-09-17T06:05:38.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:38.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834712+0000", 2024-09-17T06:05:38.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0071437489999999996 2024-09-17T06:05:38.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:38.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836963+0000", 2024-09-17T06:05:38.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022512769999999999 2024-09-17T06:05:38.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:38.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837108+0000", 2024-09-17T06:05:38.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014485 2024-09-17T06:05:38.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837222+0000", 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011398100000000001 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.686707253999998, 2024-09-17T06:05:38.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015488435, 2024-09-17T06:05:38.538 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.538 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.538 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:38.538 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:38.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:38.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822171+0000", 2024-09-17T06:05:38.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9800000000000001e-06 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822180+0000", 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7290000000000006e-06 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822198+0000", 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8868999999999998e-05 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822217+0000", 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006163712 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828723+0000", 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034318 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829070+0000", 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034623299999999999 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834728+0000", 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056585519999999999 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837392+0000", 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026634800000000002 2024-09-17T06:05:38.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:38.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837551+0000", 2024-09-17T06:05:38.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015923900000000001 2024-09-17T06:05:38.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837657+0000", 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010631799999999999 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.686632532000004, 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015871963999999999, 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.544 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:38.545 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:38.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:38.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822245+0000", 2024-09-17T06:05:38.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5969999999999999e-06 2024-09-17T06:05:38.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822263+0000", 2024-09-17T06:05:38.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8241999999999999e-05 2024-09-17T06:05:38.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822283+0000", 2024-09-17T06:05:38.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9466e-05 2024-09-17T06:05:38.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822300+0000", 2024-09-17T06:05:38.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6898999999999999e-05 2024-09-17T06:05:38.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829910+0000", 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00760979 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.830145+0000", 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023562100000000001 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.830638+0000", 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00049317000000000002 2024-09-17T06:05:38.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834742+0000", 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041036470000000002 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837872+0000", 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031295670000000002 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838036+0000", 2024-09-17T06:05:38.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016482899999999999 2024-09-17T06:05:38.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838116+0000", 2024-09-17T06:05:38.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9135999999999996e-05 2024-09-17T06:05:38.550 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.550 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.550 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.686535942999996, 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016065354, 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:38.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:38.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822342+0000", 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822349+0000", 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6569999999999997e-06 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822368+0000", 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9074999999999999e-05 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822412+0000", 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4115e-05 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.831389+0000", 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089769659999999994 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.831743+0000", 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035332899999999999 2024-09-17T06:05:38.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832133+0000", 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000390221 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834756+0000", 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026229500000000002 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838251+0000", 2024-09-17T06:05:38.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034947390000000002 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838336+0000", 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5679000000000004e-05 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838406+0000", 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9280000000000001e-05 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.556 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.557 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:38.557 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:38.557 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.686434488000003, 2024-09-17T06:05:38.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016193883999999999, 2024-09-17T06:05:38.557 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.557 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822443+0000", 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7370000000000001e-06 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822452+0000", 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5259999999999993e-06 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822480+0000", 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7781999999999999e-05 2024-09-17T06:05:38.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822497+0000", 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7139e-05 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833259+0000", 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010762386000000001 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833684+0000", 2024-09-17T06:05:38.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00042440300000000001 2024-09-17T06:05:38.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:38.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834089+0000", 2024-09-17T06:05:38.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000405556 2024-09-17T06:05:38.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:38.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838148+0000", 2024-09-17T06:05:38.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040588760000000003 2024-09-17T06:05:38.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:38.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838479+0000", 2024-09-17T06:05:38.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033078399999999998 2024-09-17T06:05:38.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:38.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838567+0000", 2024-09-17T06:05:38.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8661999999999999e-05 2024-09-17T06:05:38.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838636+0000", 2024-09-17T06:05:38.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8033000000000004e-05 2024-09-17T06:05:38.563 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.563 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.563 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.686345231999994, 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012308227, 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822532+0000", 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.57e-06 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822541+0000", 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9090000000000006e-06 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822572+0000", 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1099000000000002e-05 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822591+0000", 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8462e-05 2024-09-17T06:05:38.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822777+0000", 2024-09-17T06:05:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018563100000000001 2024-09-17T06:05:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823110+0000", 2024-09-17T06:05:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000333574 2024-09-17T06:05:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823419+0000", 2024-09-17T06:05:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030839499999999999 2024-09-17T06:05:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826081+0000", 2024-09-17T06:05:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026627999999999999 2024-09-17T06:05:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834551+0000", 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084693679999999997 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834714+0000", 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000162969 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834839+0000", 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012545000000000001 2024-09-17T06:05:38.569 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.686242311000001, 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012689499, 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822635+0000", 2024-09-17T06:05:38.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.637e-06 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822654+0000", 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8362000000000001e-05 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822678+0000", 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513000000000001e-05 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822698+0000", 2024-09-17T06:05:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9468999999999999e-05 2024-09-17T06:05:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014675910000000001 2024-09-17T06:05:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824388+0000", 2024-09-17T06:05:38.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022300600000000001 2024-09-17T06:05:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824756+0000", 2024-09-17T06:05:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036741900000000001 2024-09-17T06:05:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827411+0000", 2024-09-17T06:05:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00265526 2024-09-17T06:05:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835045+0000", 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076339290000000002 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835197+0000", 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000151736 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835323+0000", 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126577 2024-09-17T06:05:38.575 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:22 2.e e25/19 ondisk, result = 0)", 2024-09-17T06:05:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.674589350999995, 2024-09-17T06:05:38.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00058930099999999997, 2024-09-17T06:05:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834289+0000", 2024-09-17T06:05:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.216e-06 2024-09-17T06:05:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834304+0000", 2024-09-17T06:05:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5255999999999999e-05 2024-09-17T06:05:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834335+0000", 2024-09-17T06:05:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0397999999999999e-05 2024-09-17T06:05:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834359+0000", 2024-09-17T06:05:38.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4799000000000001e-05 2024-09-17T06:05:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834505+0000", 2024-09-17T06:05:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014551700000000001 2024-09-17T06:05:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834530+0000", 2024-09-17T06:05:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5128999999999999e-05 2024-09-17T06:05:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834876+0000", 2024-09-17T06:05:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000345986 2024-09-17T06:05:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.582 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:23 2.e e25/19 ondisk, result = 0)", 2024-09-17T06:05:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.674457967999999, 2024-09-17T06:05:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093485499999999995, 2024-09-17T06:05:38.583 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834420+0000", 2024-09-17T06:05:38.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5099999999999999e-06 2024-09-17T06:05:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834428+0000", 2024-09-17T06:05:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7399999999999993e-06 2024-09-17T06:05:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834449+0000", 2024-09-17T06:05:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0738999999999999e-05 2024-09-17T06:05:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834471+0000", 2024-09-17T06:05:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1979000000000001e-05 2024-09-17T06:05:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835003+0000", 2024-09-17T06:05:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053146400000000005 2024-09-17T06:05:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835027+0000", 2024-09-17T06:05:38.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4681999999999998e-05 2024-09-17T06:05:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835353+0000", 2024-09-17T06:05:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000325741 2024-09-17T06:05:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:6 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.673494108, 2024-09-17T06:05:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053156399999999999, 2024-09-17T06:05:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835384+0000", 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9700000000000002e-06 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835397+0000", 2024-09-17T06:05:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2903e-05 2024-09-17T06:05:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835427+0000", 2024-09-17T06:05:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9935000000000001e-05 2024-09-17T06:05:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835451+0000", 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4581999999999999e-05 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835592+0000", 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0001406 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835616+0000", 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4505e-05 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835914+0000", 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029706900000000001 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:7 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.673375687000004, 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00094147399999999998, 2024-09-17T06:05:38.594 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835502+0000", 2024-09-17T06:05:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2729999999999999e-06 2024-09-17T06:05:38.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835511+0000", 2024-09-17T06:05:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1730000000000001e-06 2024-09-17T06:05:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835531+0000", 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9769e-05 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835548+0000", 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6878999999999999e-05 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836026+0000", 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00047839999999999997 2024-09-17T06:05:38.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836048+0000", 2024-09-17T06:05:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1886e-05 2024-09-17T06:05:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836442+0000", 2024-09-17T06:05:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000394094 2024-09-17T06:05:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.602 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:8 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.673302430999996, 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001278288, 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835575+0000", 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.077e-06 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835582+0000", 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835599+0000", 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7235999999999999e-05 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835614+0000", 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5096000000000001e-05 2024-09-17T06:05:38.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836506+0000", 2024-09-17T06:05:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00089209599999999999 2024-09-17T06:05:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836518+0000", 2024-09-17T06:05:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-05 2024-09-17T06:05:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836852+0000", 2024-09-17T06:05:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033404000000000002 2024-09-17T06:05:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.607 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:9 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.673238764000004, 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001612018, 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835638+0000", 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.054e-06 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835646+0000", 2024-09-17T06:05:38.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1520000000000003e-06 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835666+0000", 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0795999999999999e-05 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835702+0000", 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5379000000000001e-05 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836928+0000", 2024-09-17T06:05:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001225903 2024-09-17T06:05:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836948+0000", 2024-09-17T06:05:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0628999999999998e-05 2024-09-17T06:05:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837249+0000", 2024-09-17T06:05:38.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030110500000000002 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:10 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.673141018999999, 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019419420000000001, 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:38.612 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835736+0000", 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.06e-06 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835743+0000", 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1330000000000001e-06 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835762+0000", 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8839999999999999e-05 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835778+0000", 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5498999999999998e-05 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837364+0000", 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015863190000000001 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837379+0000", 2024-09-17T06:05:38.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4749000000000001e-05 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837677+0000", 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298342 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:11 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.672801641999996, 2024-09-17T06:05:38.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002079029, 2024-09-17T06:05:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836077+0000", 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.103e-06 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836092+0000", 2024-09-17T06:05:38.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.503e-05 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836123+0000", 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1031000000000002e-05 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836147+0000", 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4019000000000002e-05 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837816+0000", 2024-09-17T06:05:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001669299 2024-09-17T06:05:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837847+0000", 2024-09-17T06:05:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1464999999999998e-05 2024-09-17T06:05:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838153+0000", 2024-09-17T06:05:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000306082 2024-09-17T06:05:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:12 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.672637949999995, 2024-09-17T06:05:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021818900000000001, 2024-09-17T06:05:38.621 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:38.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836240+0000", 2024-09-17T06:05:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.59e-06 2024-09-17T06:05:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836269+0000", 2024-09-17T06:05:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9275e-05 2024-09-17T06:05:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836291+0000", 2024-09-17T06:05:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1515999999999999e-05 2024-09-17T06:05:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836308+0000", 2024-09-17T06:05:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7728999999999999e-05 2024-09-17T06:05:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838225+0000", 2024-09-17T06:05:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001916453 2024-09-17T06:05:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838238+0000", 2024-09-17T06:05:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2806000000000001e-05 2024-09-17T06:05:38.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838420+0000", 2024-09-17T06:05:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000182521 2024-09-17T06:05:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:13 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:38.627 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 84.671590531000007, 2024-09-17T06:05:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001366047, 2024-09-17T06:05:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837287+0000", 2024-09-17T06:05:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.823e-06 2024-09-17T06:05:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:38.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837301+0000", 2024-09-17T06:05:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3910000000000001e-05 2024-09-17T06:05:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837323+0000", 2024-09-17T06:05:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1379e-05 2024-09-17T06:05:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837339+0000", 2024-09-17T06:05:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6762e-05 2024-09-17T06:05:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:38.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838456+0000", 2024-09-17T06:05:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011162050000000001 2024-09-17T06:05:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838470+0000", 2024-09-17T06:05:38.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.453e-05 2024-09-17T06:05:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838652+0000", 2024-09-17T06:05:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018143799999999999 2024-09-17T06:05:38.633 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:38.634 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:38.635 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:38.505+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:38.636 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:05:38.636 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T06:05:38.680 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:38.677+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:38.738 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:38.733+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:38.839 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:38.837+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:38.885 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:38.885 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:38.885 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-09-17T06:05:38.885 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:38.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.885+0000 7f3d681c2640 1 -- 172.21.15.122:0/3417660273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d4c003a10 msgr2=0x7f3d4c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:38.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.885+0000 7f3d681c2640 1 --2- 172.21.15.122:0/3417660273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d4c003a10 0x7f3d4c003e80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009b60 tx=0x7f3d5c01d2b0 comp rx=0 tx=0).stop 2024-09-17T06:05:38.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.885+0000 7f3d6675f640 1 -- 172.21.15.122:0/3417660273 reap_dead start 2024-09-17T06:05:38.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.885+0000 7f3d681c2640 1 -- 172.21.15.122:0/3417660273 shutdown_connections 2024-09-17T06:05:38.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.885+0000 7f3d681c2640 1 -- 172.21.15.122:0/3417660273 >> 172.21.15.122:0/3417660273 conn(0x7f3d60073040 msgr2=0x7f3d60073450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:38.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.885+0000 7f3d681c2640 1 -- 172.21.15.122:0/3417660273 shutdown_connections 2024-09-17T06:05:38.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.885+0000 7f3d681c2640 1 -- 172.21.15.122:0/3417660273 wait complete. 2024-09-17T06:05:38.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.889+0000 7f3d681c2640 1 Processor -- start 2024-09-17T06:05:38.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.889+0000 7f3d681c2640 1 -- start start 2024-09-17T06:05:38.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d681c2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d4c003a10 0x7f3d601f0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d681c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d600c6b90 0x7f3d60147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d681c2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d600cce60 0x7f3d60146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d6575d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d600c6b90 0x7f3d60147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d65f5e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d4c003a10 0x7f3d601f0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d6575d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d600c6b90 0x7f3d60147690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40428/0 (socket says 172.21.15.122:40428) 2024-09-17T06:05:38.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d6575d640 1 -- 172.21.15.122:0/989736456 learned_addr learned my addr 172.21.15.122:0/989736456 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:38.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d65f5e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d4c003a10 0x7f3d601f0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:57672/0 (socket says 172.21.15.122:57672) 2024-09-17T06:05:38.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6006d720 con 0x7f3d600c6b90 2024-09-17T06:05:38.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d600c2a40 con 0x7f3d4c003a10 2024-09-17T06:05:38.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3d6006d8a0 con 0x7f3d600cce60 2024-09-17T06:05:38.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d6675f640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d600cce60 0x7f3d60146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d6575d640 1 -- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d600cce60 msgr2=0x7f3d60146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:38.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d6575d640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d600cce60 0x7f3d60146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:38.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d6575d640 1 -- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d4c003a10 msgr2=0x7f3d601f0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:38.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d6575d640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d4c003a10 0x7f3d601f0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:38.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d6575d640 1 -- 172.21.15.122:0/989736456 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d601f3a30 con 0x7f3d600c6b90 2024-09-17T06:05:38.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d6575d640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d600c6b90 0x7f3d60147690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c760 tx=0x7f3d5000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:38.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d567fc640 1 -- 172.21.15.122:0/989736456 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50017070 con 0x7f3d600c6b90 2024-09-17T06:05:38.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d567fc640 1 -- 172.21.15.122:0/989736456 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d5000ce10 con 0x7f3d600c6b90 2024-09-17T06:05:38.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d567fc640 1 -- 172.21.15.122:0/989736456 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000a8a0 con 0x7f3d600c6b90 2024-09-17T06:05:38.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.893+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d601f3cd0 con 0x7f3d600c6b90 2024-09-17T06:05:38.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.897+0000 7f3d567fc640 1 -- 172.21.15.122:0/989736456 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3d5001a070 con 0x7f3d600c6b90 2024-09-17T06:05:38.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.897+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d601f4270 con 0x7f3d600c6b90 2024-09-17T06:05:38.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.897+0000 7f3d567fc640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3d44073200 0x7f3d44075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:38.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.897+0000 7f3d567fc640 1 -- 172.21.15.122:0/989736456 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6804+0+0 (secure 0 0 0) 0x7f3d50098060 con 0x7f3d600c6b90 2024-09-17T06:05:38.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.897+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d60158db0 con 0x7f3d600c6b90 2024-09-17T06:05:38.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.897+0000 7f3d65f5e640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3d44073200 0x7f3d44075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:38.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.901+0000 7f3d65f5e640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3d44073200 0x7f3d44075710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0ae000 tx=0x7f3d5c01a050 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:38.910 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:05:38.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:38.909+0000 7f3d567fc640 1 -- 172.21.15.122:0/989736456 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3d601592f0 con 0x7f3d600c6b90 2024-09-17T06:05:38.956 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:38.953+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:39.041 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:39.037+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:39.115 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 180, 2024-09-17T06:05:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-09-17T06:05:39.115 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:39.138 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:05:39.142 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:39.141+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:39.242 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:39.237+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:39.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.257+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) -- 0x7f3d6006f500 con 0x7f3d600c6b90 2024-09-17T06:05:39.344 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:39.341+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:39.388 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:39.388 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:39.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:39.388 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.564050098999999, 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044462499999999997, 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823264+0000", 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3300000000000001e-06 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823284+0000", 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0132e-05 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823364+0000", 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9583e-05 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823395+0000", 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1171999999999999e-05 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823538+0000", 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014286600000000001 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823594+0000", 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890999999999997e-05 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827597+0000", 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004003665 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827708+0000", 2024-09-17T06:05:39.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110611 2024-09-17T06:05:39.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.393 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.393 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:39.393 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:39.393 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.563857647999995, 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043686330000000002, 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823455+0000", 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2160000000000001e-06 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823471+0000", 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5702999999999999e-05 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823492+0000", 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1039e-05 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823512+0000", 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0364999999999999e-05 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824294+0000", 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00078187600000000003 2024-09-17T06:05:39.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824350+0000", 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5367e-05 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827719+0000", 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003368916 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827823+0000", 2024-09-17T06:05:39.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104151 2024-09-17T06:05:39.398 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.398 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.398 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.398 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:39.398 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:39.398 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.563296868999998, 2024-09-17T06:05:39.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0094234149999999992, 2024-09-17T06:05:39.398 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.398 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.398 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824018+0000", 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3629999999999998e-06 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824036+0000", 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7606000000000001e-05 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824065+0000", 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9005000000000001e-05 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824092+0000", 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7396e-05 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826491+0000", 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002398776 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826804+0000", 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000312782 2024-09-17T06:05:39.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833438+0000", 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066344869999999997 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.563226885999995, 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048433540000000002, 2024-09-17T06:05:39.402 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824087+0000", 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1830000000000001e-06 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824106+0000", 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8595999999999999e-05 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824137+0000", 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1322000000000003e-05 2024-09-17T06:05:39.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824164+0000", 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6605e-05 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824807+0000", 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064339900000000001 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824861+0000", 2024-09-17T06:05:39.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3687000000000003e-05 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828809+0000", 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039483909999999999 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828928+0000", 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119171 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.563146216999996, 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092145760000000004, 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:39.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824167+0000", 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7540000000000001e-06 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824178+0000", 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0276e-05 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824202+0000", 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4685000000000002e-05 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824223+0000", 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1036e-05 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825070+0000", 2024-09-17T06:05:39.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084684500000000004 2024-09-17T06:05:39.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825392+0000", 2024-09-17T06:05:39.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032213499999999998 2024-09-17T06:05:39.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833380+0000", 2024-09-17T06:05:39.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079878450000000004 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.562141285999999, 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038480469999999998, 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825172+0000", 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.967e-06 2024-09-17T06:05:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825190+0000", 2024-09-17T06:05:39.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7866000000000001e-05 2024-09-17T06:05:39.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825217+0000", 2024-09-17T06:05:39.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6682e-05 2024-09-17T06:05:39.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825239+0000", 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1968999999999999e-05 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825632+0000", 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00039355100000000001 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825690+0000", 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7797000000000002e-05 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828935+0000", 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032449449999999999 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829018+0000", 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3269999999999994e-05 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:39.419 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.561086782999993, 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002834755, 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826227+0000", 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.906e-06 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826256+0000", 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8872000000000001e-05 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826399+0000", 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143156 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826453+0000", 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4465000000000001e-05 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826628+0000", 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017420700000000001 2024-09-17T06:05:39.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829060+0000", 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024321490000000002 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.559336152, 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055191049999999998, 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.423 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827978+0000", 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0200000000000001e-06 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827997+0000", 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9836000000000001e-05 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828029+0000", 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1720999999999997e-05 2024-09-17T06:05:39.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828055+0000", 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5519000000000001e-05 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828193+0000", 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013821699999999999 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828232+0000", 2024-09-17T06:05:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9351000000000003e-05 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833396+0000", 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051640119999999999 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833495+0000", 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8429000000000002e-05 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.427 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.559210610999997, 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054928850000000003, 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:39.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828102+0000", 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-06 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828116+0000", 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3716e-05 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828139+0000", 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3028999999999999e-05 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828156+0000", 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869000000000001e-05 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829124+0000", 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096778700000000001 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829158+0000", 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4671000000000001e-05 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833509+0000", 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004350802 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833594+0000", 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4814999999999993e-05 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.554459386000005, 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064859200000000003, 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.432 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832854+0000", 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8330000000000001e-06 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832867+0000", 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.332e-05 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832906+0000", 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8800999999999997e-05 2024-09-17T06:05:39.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6468000000000003e-05 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833094+0000", 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014082600000000001 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833501+0000", 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040734400000000002 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.554362581000007, 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00050376900000000005, 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.436 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832952+0000", 2024-09-17T06:05:39.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4269999999999998e-06 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832965+0000", 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3736e-05 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832998+0000", 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2264999999999997e-05 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833027+0000", 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9658999999999998e-05 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833172+0000", 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014431900000000001 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833453+0000", 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028136300000000002 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.552365644999995, 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00294042, 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834948+0000", 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.21e-06 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834968+0000", 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9443e-05 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835013+0000", 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5324000000000002e-05 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835038+0000", 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5358999999999999e-05 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835255+0000", 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021677600000000001 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835304+0000", 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9261000000000002e-05 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837761+0000", 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024567230000000001 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837886+0000", 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012532400000000001 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.788454289000001, 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001082132, 2024-09-17T06:05:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598860+0000", 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4569999999999999e-06 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598901+0000", 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1400999999999999e-05 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598934+0000", 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3012000000000002e-05 2024-09-17T06:05:39.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598959+0000", 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4839000000000001e-05 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599073+0000", 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113763 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599099+0000", 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6120999999999999e-05 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599900+0000", 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00080140099999999998 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599940+0000", 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9137999999999997e-05 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.448 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.067806378, 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00153148, 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:39.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319508+0000", 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5399999999999998e-06 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319533+0000", 2024-09-17T06:05:39.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4759000000000001e-05 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319568+0000", 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5305000000000002e-05 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319602+0000", 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3992999999999998e-05 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319715+0000", 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113112 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319745+0000", 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9580000000000001e-05 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.320978+0000", 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233165 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.321037+0000", 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9026e-05 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 76.195635268000004, 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00083231099999999997, 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.453 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191678+0000", 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869999999999999e-06 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191693+0000", 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4409e-05 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191713+0000", 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0523e-05 2024-09-17T06:05:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191726+0000", 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3386e-05 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191806+0000", 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9287000000000002e-05 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191834+0000", 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8323e-05 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192473+0000", 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063865000000000005 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192509+0000", 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6046e-05 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.457 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.669526992000002, 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096842599999999999, 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:39.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717787+0000", 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.951e-06 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717801+0000", 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3973e-05 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717822+0000", 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1328e-05 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717836+0000", 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3944000000000001e-05 2024-09-17T06:05:39.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717908+0000", 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1674999999999994e-05 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717940+0000", 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2728999999999998e-05 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718710+0000", 2024-09-17T06:05:39.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076948100000000003 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718753+0000", 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3344999999999999e-05 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:39.462 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 55.668446181, 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065812800000000001, 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:39.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5000000000000001e-07 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718872+0000", 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5130000000000004e-06 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718883+0000", 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1195e-05 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718892+0000", 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5669999999999995e-06 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718931+0000", 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8850000000000002e-05 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718948+0000", 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7425999999999999e-05 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719496+0000", 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00054753699999999996 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719524+0000", 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.809e-05 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.466 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:45 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'12, mlcod=26'10)", 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.734080200000001, 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013449270000000001, 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:39.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653233+0000", 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.796e-06 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:39.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653250+0000", 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7025999999999999e-05 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653272+0000", 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1338000000000001e-05 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653287+0000", 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5509999999999999e-05 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653383+0000", 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5904999999999997e-05 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653417+0000", 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3923e-05 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654510+0000", 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001092602 2024-09-17T06:05:39.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:39.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:39.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:39.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654576+0000", 2024-09-17T06:05:39.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6827000000000002e-05 2024-09-17T06:05:39.471 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.471 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.471 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.471 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:39.471 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:39.471 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:39.473 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:05:39.473 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:39.469+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:39.574 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:39.569+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:39.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.569+0000 7f3d567fc640 1 -- 172.21.15.122:0/989736456 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v52) ==== 97+0+0 (secure 0 0 0) 0x7f3d5005de20 con 0x7f3d600c6b90 2024-09-17T06:05:39.575 INFO:teuthology.orchestra.run.smithi122.stderr:nodeep-scrub is set 2024-09-17T06:05:39.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.573+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3d44073200 msgr2=0x7f3d44075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:39.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.573+0000 7f3d681c2640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3d44073200 0x7f3d44075710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0ae000 tx=0x7f3d5c01a050 comp rx=0 tx=0).stop 2024-09-17T06:05:39.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.573+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d600c6b90 msgr2=0x7f3d60147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:39.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.573+0000 7f3d681c2640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d600c6b90 0x7f3d60147690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c760 tx=0x7f3d5000cc20 comp rx=0 tx=0).stop 2024-09-17T06:05:39.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.573+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 shutdown_connections 2024-09-17T06:05:39.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.573+0000 7f3d681c2640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d600cce60 0x7f3d60146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:39.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.573+0000 7f3d681c2640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d600c6b90 0x7f3d60147690 secure :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c760 tx=0x7f3d5000cc20 comp rx=0 tx=0).stop 2024-09-17T06:05:39.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.573+0000 7f3d681c2640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3d44073200 0x7f3d44075710 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0ae000 tx=0x7f3d5c01a050 comp rx=0 tx=0).stop 2024-09-17T06:05:39.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.573+0000 7f3d681c2640 1 --2- 172.21.15.122:0/989736456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d4c003a10 0x7f3d601f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:39.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.573+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 >> 172.21.15.122:0/989736456 conn(0x7f3d60073040 msgr2=0x7f3d60150830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:39.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.573+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 shutdown_connections 2024-09-17T06:05:39.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:39.573+0000 7f3d681c2640 1 -- 172.21.15.122:0/989736456 wait complete. 2024-09-17T06:05:39.636 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:39.636 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:39.636 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:39.636 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:39.654 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:05:39.702 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:39.701+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:39.775 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:39.773+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:39.799 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:39.800 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:39.800 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:39.800 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:39.800 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:39.818 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:05:39.876 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:39.873+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:39.977 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:39.973+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:40.016 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:40.017 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:40.017 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:40.017 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:40.017 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.017 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:40.017 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:40.017 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.193284249000001, 2024-09-17T06:05:40.017 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:05:40.017 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.017 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.017 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.017 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.018 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.019 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.020 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.020 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:05:40.020 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:05:40.020 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.020 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.020 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.020 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:05:40.020 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:05:40.020 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.020 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.020 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.020 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:05:40.021 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:05:40.021 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.021 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.021 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.021 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:05:40.021 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:05:40.021 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.021 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.021 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.193172024999996, 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.022 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.023 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.024 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:05:40.024 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:05:40.024 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.024 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.024 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.024 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:05:40.024 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:05:40.024 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.024 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.025 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.025 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:05:40.029 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:05:40.029 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.029 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.030 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.030 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:05:40.030 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:05:40.030 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.030 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.031 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.031 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:05:40.031 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:05:40.031 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.031 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.032 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.032 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:05:40.032 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:05:40.032 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.032 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.032 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.033 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:05:40.033 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:05:40.033 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.033 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.033 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.034 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:05:40.034 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:05:40.034 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.034 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.034 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.034 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.035 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.035 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:40.035 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:40.035 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.192966674999994, 2024-09-17T06:05:40.035 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:05:40.036 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.036 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.036 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.036 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.036 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.037 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.037 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:40.037 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.037 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.037 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.037 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.038 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:40.038 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.038 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.038 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.038 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.039 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:40.039 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:05:40.039 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.039 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.039 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.039 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:05:40.040 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:05:40.040 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.040 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.040 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.040 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:05:40.041 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:05:40.041 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.041 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.041 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.041 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:05:40.041 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:05:40.042 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.042 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.042 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.042 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:05:40.042 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:05:40.043 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.043 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.043 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.043 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:05:40.043 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:05:40.043 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.043 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.043 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.044 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:05:40.044 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:05:40.044 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.044 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.044 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.044 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:05:40.044 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:05:40.044 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.186826148999998, 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.045 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:05:40.046 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.047 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:05:40.048 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.049 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.186671423000007, 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.050 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:05:40.051 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.052 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:05:40.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "MOSDPGPushReply(2.15 43/42 [PushReplyOp(2:a93a17c2:::604.00000000:head)])", 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 19.383570362, 2024-09-17T06:05:40.054 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033440999999999999, 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:40.055 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.056 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.056 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.056 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.056 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632988+0000", 2024-09-17T06:05:40.056 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4499999999999996e-07 2024-09-17T06:05:40.056 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.056 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.056 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632997+0000", 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8349999999999993e-06 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633010+0000", 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2907e-05 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633032+0000", 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2867e-05 2024-09-17T06:05:40.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633091+0000", 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8504000000000001e-05 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633322+0000", 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000230552 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.058 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "MOSDPGPushReply(2.15 43/42 [PushReplyOp(2:aa448500:::500.00000000:head)])", 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 19.381358553999998, 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000220134, 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.059 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8999999999999997e-07 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635206+0000", 2024-09-17T06:05:40.060 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2949999999999999e-06 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635220+0000", 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3821e-05 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635233+0000", 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3797e-05 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.061 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635277+0000", 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3161000000000002e-05 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635419+0000", 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014257000000000001 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.062 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:40.064 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:05:40.109 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:40.109+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:40.178 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:40.177+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:40.216 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:40.216 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:40.216 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:40.234 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:05:40.279 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:40.277+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:40.379 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:40.377+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:40.428 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:40.428 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:40.428 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:40.428 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:40.428 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:40.446 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:05:40.473 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:05:40.524 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:40.521+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:40.581 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:40.577+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:40.596 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:40.596 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:40.596 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:40.596 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:40.596 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.596 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.772251874000006, 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.597 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:05:40.598 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.599 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.600 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:05:40.601 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.772131471999998, 2024-09-17T06:05:40.602 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.603 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.605 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:05:40.606 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:05:40.607 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.772003557999994, 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.608 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:05:40.609 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.610 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.611 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:05:40.612 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.613 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.770977595000005, 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:40.614 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.615 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.617 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:05:40.617 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:05:40.617 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.617 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.617 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.617 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:05:40.617 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:05:40.617 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.617 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.617 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:40.617 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:05:40.617 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.618 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:40.619 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.770896652000005, 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.621 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:05:40.622 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:05:40.623 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:05:40.624 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.624 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.624 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.624 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:05:40.624 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:05:40.624 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.624 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.624 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.624 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:40.624 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:05:40.624 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.624 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.770834250000007, 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.625 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.626 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:05:40.627 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:05:40.628 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.629 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.630 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.770762160000004, 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.631 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.632 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:05:40.633 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.634 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.770719959999994, 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.635 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.636 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:05:40.637 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:05:40.637 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.637 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.637 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.637 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:05:40.637 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:05:40.637 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.637 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.637 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.637 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:05:40.642 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:05:40.642 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.642 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.642 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.642 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:05:40.642 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:05:40.642 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.643 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.768128028000007, 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.644 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.645 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.646 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:05:40.647 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.648 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.768031893, 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.649 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.650 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.651 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.652 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.653 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.653 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:05:40.653 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:05:40.653 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.653 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.653 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.653 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.653 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.653 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:05:40.653 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:40.653 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.759599606999998, 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.654 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.655 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:05:40.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:05:40.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 81.666010387, 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.659 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:05:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.662 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.663 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 79.995380022000006, 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.664 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:05:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:05:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.666 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:05:40.667 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:05:40.667 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.667 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.667 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:05:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:05:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:05:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:05:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.668 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:05:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:05:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:05:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:05:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.669 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 78.274709066, 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.671 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:05:40.673 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.674 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:05:40.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:05:40.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 78.272024817000002, 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:40.677 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:05:40.678 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.679 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.680 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 77.402822143999998, 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:05:40.681 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:05:40.683 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.684 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.685 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.686 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.686 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:05:40.686 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:05:40.686 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.686 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.686 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.686 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:05:40.686 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:05:40.686 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.876381232, 2024-09-17T06:05:40.687 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:40.688 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.689 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.690 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:05:40.690 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:05:40.690 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.690 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.690 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.690 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:05:40.690 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:05:40.690 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.690 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.690 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.690 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:05:40.691 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:05:40.691 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.691 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.691 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.691 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:05:40.691 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:05:40.692 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.692 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.692 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:40.692 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:05:40.692 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:05:40.692 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.692 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.692 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.692 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:05:40.692 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:05:40.692 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.693 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.693 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.693 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:05:40.693 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:05:40.693 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.693 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.693 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.693 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:05:40.693 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:05:40.693 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.693 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.693 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.876151716000003, 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.694 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.695 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:05:40.696 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.697 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.698 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:05:40.699 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 56.874187020000001, 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.700 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:05:40.701 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:05:40.702 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.702 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.702 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.702 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:05:40.702 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:05:40.702 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.702 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.702 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.702 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:05:40.702 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:05:40.702 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.702 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:05:40.703 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 52.940624133, 2024-09-17T06:05:40.704 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:05:40.705 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:40.705 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:40.705 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:40.705 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:40.705 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.705 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:40.705 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:40.705 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.705 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.705 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.705 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:05:40.706 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:05:40.707 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:05:40.708 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.708 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.708 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:40.708 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:05:40.708 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:05:40.708 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.708 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.708 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:40.708 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:05:40.708 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:05:40.708 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.708 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:05:40.709 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:05:40.710 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:40.710 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:40.710 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:40.710 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:05:40.710 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:05:40.710 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.710 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.710 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.710 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:40.710 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:40.710 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:40.713 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:05:40.713 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:40.709+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:40.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.665+0000 7f4e09d79640 1 -- 172.21.15.122:0/1368487621 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e040c9fc0 msgr2=0x7f4e0415b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:40.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.665+0000 7f4e09d79640 1 --2- 172.21.15.122:0/1368487621 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e040c9fc0 0x7f4e0415b7c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009bc0 tx=0x7f4dfc01f2d0 comp rx=0 tx=0).stop 2024-09-17T06:05:40.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.665+0000 7f4e09d79640 1 -- 172.21.15.122:0/1368487621 shutdown_connections 2024-09-17T06:05:40.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.665+0000 7f4e09d79640 1 --2- 172.21.15.122:0/1368487621 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e040c9fc0 0x7f4e0415b7c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:40.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.665+0000 7f4e09d79640 1 --2- 172.21.15.122:0/1368487621 >> v2:172.21.15.173:3300/0 conn(0x7f4e040b3b80 0x7f4e04152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.665+0000 7f4e09d79640 1 -- 172.21.15.122:0/1368487621 >> 172.21.15.122:0/1368487621 conn(0x7f4e04073640 msgr2=0x7f4e040cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.665+0000 7f4e09d79640 1 -- 172.21.15.122:0/1368487621 shutdown_connections 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.665+0000 7f4e09d79640 1 -- 172.21.15.122:0/1368487621 wait complete. 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.669+0000 7f4e09d79640 1 Processor -- start 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.669+0000 7f4e09d79640 1 -- start start 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e09d79640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e040b3b80 0x7f4e041f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e09d79640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e040c9fc0 0x7f4e041460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e09d79640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e040caae0 0x7f4e0415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e09d79640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0406f0a0 con 0x7f4e040caae0 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e09d79640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4e041527c0 con 0x7f4e040b3b80 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e09d79640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4e04152940 con 0x7f4e040c9fc0 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4dfaffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e040c9fc0 0x7f4e041460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:40.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e03fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e040caae0 0x7f4e0415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4dfaffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e040c9fc0 0x7f4e041460c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:38318/0 (socket says 172.21.15.122:38318) 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4dfaffd640 1 -- 172.21.15.122:0/570362031 learned_addr learned my addr 172.21.15.122:0/570362031 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e037fe640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e040b3b80 0x7f4e041f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e03fff640 1 -- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e040c9fc0 msgr2=0x7f4e041460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e03fff640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e040c9fc0 0x7f4e041460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e03fff640 1 -- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e040b3b80 msgr2=0x7f4e041f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e03fff640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e040b3b80 0x7f4e041f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e03fff640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e041f5390 con 0x7f4e040caae0 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e03fff640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e040caae0 0x7f4e0415a3c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4e0406e410 tx=0x7f4dfc005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0b4040 con 0x7f4e040caae0 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e09d79640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e040af840 con 0x7f4e040caae0 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e09d79640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e040afe00 con 0x7f4e040caae0 2024-09-17T06:05:40.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dfc0bf070 con 0x7f4e040caae0 2024-09-17T06:05:40.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0afc10 con 0x7f4e040caae0 2024-09-17T06:05:40.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.673+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f4ddc005280 con 0x7f4e040caae0 2024-09-17T06:05:40.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.677+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4dfc0a8d10 con 0x7f4e040caae0 2024-09-17T06:05:40.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.677+0000 7f4e00ff9640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4de4073230 0x7f4de4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:40.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.677+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6804+0+0 (secure 0 0 0) 0x7f4dfc1322d0 con 0x7f4e040caae0 2024-09-17T06:05:40.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.677+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v52) ==== 54+0+16 (secure 0 0 0) 0x7f4dfc018e30 con 0x7f4e040caae0 2024-09-17T06:05:40.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.677+0000 7f4e037fe640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4de4073230 0x7f4de4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:40.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.677+0000 7f4df9ffb640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4ddc0045f0 0x7f4ddc004a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:40.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.677+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ddc004f40 con 0x7f4ddc0045f0 2024-09-17T06:05:40.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.677+0000 7f4dfaffd640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4ddc0045f0 0x7f4ddc004a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:40.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.677+0000 7f4e037fe640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4de4073230 0x7f4de4075740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4df40015e0 tx=0x7f4df4001180 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:40.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.677+0000 7f4dfaffd640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4ddc0045f0 0x7f4ddc004a00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:40.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.681+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ddc004f40 con 0x7f4ddc0045f0 2024-09-17T06:05:40.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.705+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4ddc0013e0 con 0x7f4ddc0045f0 2024-09-17T06:05:40.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.709+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4ddc0013e0 con 0x7f4ddc0045f0 2024-09-17T06:05:40.720 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:40.721 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:40.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.709+0000 7f4df9ffb640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f4ddc001ea0 0x7f4ddc0029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:40.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.709+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f4ddc0023b0 con 0x7f4ddc001ea0 2024-09-17T06:05:40.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.709+0000 7f4e037fe640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f4ddc001ea0 0x7f4ddc0029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:40.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.709+0000 7f4e037fe640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f4ddc001ea0 0x7f4ddc0029a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:40.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.713+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ddc0023b0 con 0x7f4ddc001ea0 2024-09-17T06:05:40.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.737+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4ddc003270 con 0x7f4ddc001ea0 2024-09-17T06:05:40.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.741+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4ddc003270 con 0x7f4ddc001ea0 2024-09-17T06:05:40.745 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:40.745 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:40.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.741+0000 7f4df9ffb640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4ddc009c90 0x7f4ddc00a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:40.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.741+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f4ddc00a5e0 con 0x7f4ddc009c90 2024-09-17T06:05:40.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.741+0000 7f4dfaffd640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4ddc009c90 0x7f4ddc00a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:40.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.741+0000 7f4dfaffd640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f4ddc009c90 0x7f4ddc00a0a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:40.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.741+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ddc00a5e0 con 0x7f4ddc009c90 2024-09-17T06:05:40.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.769+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4ddc00ac10 con 0x7f4ddc009c90 2024-09-17T06:05:40.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.773+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4ddc00ac10 con 0x7f4ddc009c90 2024-09-17T06:05:40.776 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:40.776 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:40.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.773+0000 7f4df9ffb640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f4ddc00d950 0x7f4ddc00fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:40.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.773+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f4ddc012ca0 con 0x7f4ddc00d950 2024-09-17T06:05:40.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.773+0000 7f4e03fff640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f4ddc00d950 0x7f4ddc00fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:40.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.773+0000 7f4e03fff640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f4ddc00d950 0x7f4ddc00fd70 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:40.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.773+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ddc012ca0 con 0x7f4ddc00d950 2024-09-17T06:05:40.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.797+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4ddc010330 con 0x7f4ddc00d950 2024-09-17T06:05:40.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.801+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4ddc010330 con 0x7f4ddc00d950 2024-09-17T06:05:40.806 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:40.807 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:40.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.801+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=53}) -- 0x7f4ddc011f20 con 0x7f4e040caae0 2024-09-17T06:05:40.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.801+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ddc012260 con 0x7f4e040caae0 2024-09-17T06:05:40.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.801+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f4dfc139070 con 0x7f4e040caae0 2024-09-17T06:05:40.807 INFO:teuthology.orchestra.run.smithi122.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-17T06:05:40.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.801+0000 7f4df9ffb640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f4ddc010a50 0x7f4ddc010e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:40.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.801+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 10: {"prefix": "get_command_descriptions"}) -- 0x7f4ddc0113a0 con 0x7f4ddc010a50 2024-09-17T06:05:40.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.801+0000 7f4e037fe640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f4ddc010a50 0x7f4ddc010e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:40.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.801+0000 7f4e037fe640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f4ddc010a50 0x7f4ddc010e60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:40.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.805+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 10: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ddc0113a0 con 0x7f4ddc010a50 2024-09-17T06:05:40.812 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:40.809+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:40.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.829+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4ddc0113a0 con 0x7f4ddc010a50 2024-09-17T06:05:40.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.833+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 11: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4ddc0113a0 con 0x7f4ddc010a50 2024-09-17T06:05:40.837 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.833+0000 7f4df9ffb640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f4ddc014ef0 0x7f4ddc017310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.833+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7f4ddc01a2c0 con 0x7f4ddc014ef0 2024-09-17T06:05:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.833+0000 7f4dfaffd640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f4ddc014ef0 0x7f4ddc017310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:40.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.833+0000 7f4dfaffd640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f4ddc014ef0 0x7f4ddc017310 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:40.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.833+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ddc01a2c0 con 0x7f4ddc014ef0 2024-09-17T06:05:40.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.861+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4ddc01a290 con 0x7f4ddc014ef0 2024-09-17T06:05:40.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.865+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4ddc01a290 con 0x7f4ddc014ef0 2024-09-17T06:05:40.870 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:40.871 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:40.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.865+0000 7f4df9ffb640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f4ddc019540 0x7f4ddc0199f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:40.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.865+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7f4ddc01d690 con 0x7f4ddc019540 2024-09-17T06:05:40.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.865+0000 7f4e03fff640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f4ddc019540 0x7f4ddc0199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:40.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.865+0000 7f4e03fff640 1 --2- 172.21.15.122:0/570362031 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f4ddc019540 0x7f4ddc0199f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:40.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.869+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ddc01d690 con 0x7f4ddc019540 2024-09-17T06:05:40.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.893+0000 7f4df9ffb640 1 -- 172.21.15.122:0/570362031 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4ddc01c510 con 0x7f4ddc019540 2024-09-17T06:05:40.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:40.897+0000 7f4e00ff9640 1 -- 172.21.15.122:0/570362031 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4ddc01c510 con 0x7f4ddc019540 2024-09-17T06:05:40.900 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:40.901 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:40.909 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T06:05:40.910 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T06:05:40.910 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:40.910 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:40.913 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:40.913+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:40.928 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:05:41.015 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:41.013+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:41.116 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:41.113+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:41.121 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:41.121 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:41.139 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:05:41.225 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:41.225+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:41.317 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:41.317+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:41.403 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-17T06:05:41.403 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T06:05:41.403 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-17T06:05:41.404 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T06:05:41.405 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:41.405 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:41.405 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:05:41.452 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:41.449+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:41.519 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:41.513+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:41.605 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T06:05:41.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.605+0000 7f8cfebe1640 1 -- 172.21.15.122:0/99252919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf80c26f0 msgr2=0x7f8cf80c2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:41.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.605+0000 7f8cf77fe640 1 -- 172.21.15.122:0/99252919 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40b0850 con 0x7f8cf80c26f0 2024-09-17T06:05:41.608 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.605+0000 7f8cfebe1640 1 --2- 172.21.15.122:0/99252919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf80c26f0 0x7f8cf80c2c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8073670 tx=0x7f8ce401eff0 comp rx=0 tx=0).stop 2024-09-17T06:05:41.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.605+0000 7f8cfebe1640 1 -- 172.21.15.122:0/99252919 shutdown_connections 2024-09-17T06:05:41.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.605+0000 7f8cfebe1640 1 --2- 172.21.15.122:0/99252919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf80c26f0 0x7f8cf80c2c40 secure :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8073670 tx=0x7f8ce401eff0 comp rx=0 tx=0).stop 2024-09-17T06:05:41.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.605+0000 7f8cfebe1640 1 --2- 172.21.15.122:0/99252919 >> v2:172.21.15.173:3300/0 conn(0x7f8cf806e370 0x7f8cf81522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:41.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.605+0000 7f8cfebe1640 1 -- 172.21.15.122:0/99252919 >> 172.21.15.122:0/99252919 conn(0x7f8cf80cd4f0 msgr2=0x7f8cf80cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:41.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.605+0000 7f8cfebe1640 1 -- 172.21.15.122:0/99252919 shutdown_connections 2024-09-17T06:05:41.609 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.605+0000 7f8cfebe1640 1 -- 172.21.15.122:0/99252919 wait complete. 2024-09-17T06:05:41.610 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:41.610 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:41.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.605+0000 7f8cfebe1640 1 Processor -- start 2024-09-17T06:05:41.611 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.605+0000 7f8cfebe1640 1 -- start start 2024-09-17T06:05:41.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfebe1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8cf806e370 0x7f8cf81f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:41.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfebe1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8cf80c3180 0x7f8cf80c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:41.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfebe1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf80c5d70 0x7f8cf80ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:41.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfebe1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8158af0 con 0x7f8cf80c5d70 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfebe1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8158810 con 0x7f8cf806e370 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfebe1640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf80c4240 con 0x7f8cf80c3180 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfd17e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf80c5d70 0x7f8cf80ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfd17e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf80c5d70 0x7f8cf80ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40458/0 (socket says 172.21.15.122:40458) 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfd17e640 1 -- 172.21.15.122:0/657474899 learned_addr learned my addr 172.21.15.122:0/657474899 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfc97d640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8cf806e370 0x7f8cf81f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cf7fff640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8cf80c3180 0x7f8cf80c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfd17e640 1 -- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8cf80c3180 msgr2=0x7f8cf80c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfd17e640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8cf80c3180 0x7f8cf80c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfd17e640 1 -- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8cf806e370 msgr2=0x7f8cf81f13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfd17e640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8cf806e370 0x7f8cf81f13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfd17e640 1 -- 172.21.15.122:0/657474899 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf81561d0 con 0x7f8cf80c5d70 2024-09-17T06:05:41.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cf7fff640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8cf80c3180 0x7f8cf80c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:05:41.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfd17e640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf80c5d70 0x7f8cf80ae8c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000cad0 tx=0x7f8cf000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:41.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cf57fa640 1 -- 172.21.15.122:0/657474899 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0016020 con 0x7f8cf80c5d70 2024-09-17T06:05:41.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cf57fa640 1 -- 172.21.15.122:0/657474899 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cf000ab60 con 0x7f8cf80c5d70 2024-09-17T06:05:41.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cf57fa640 1 -- 172.21.15.122:0/657474899 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf000ce10 con 0x7f8cf80c5d70 2024-09-17T06:05:41.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfebe1640 1 -- 172.21.15.122:0/657474899 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf814bc40 con 0x7f8cf80c5d70 2024-09-17T06:05:41.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.609+0000 7f8cfebe1640 1 -- 172.21.15.122:0/657474899 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf81f1900 con 0x7f8cf80c5d70 2024-09-17T06:05:41.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.613+0000 7f8cfebe1640 1 -- 172.21.15.122:0/657474899 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf81f1b30 con 0x7f8cf80c5d70 2024-09-17T06:05:41.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.613+0000 7f8cf57fa640 1 -- 172.21.15.122:0/657474899 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8cf0019020 con 0x7f8cf80c5d70 2024-09-17T06:05:41.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.613+0000 7f8cf57fa640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8cdc073250 0x7f8cdc075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:41.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.613+0000 7f8cf57fa640 1 -- 172.21.15.122:0/657474899 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6804+0+0 (secure 0 0 0) 0x7f8cf00946a0 con 0x7f8cf80c5d70 2024-09-17T06:05:41.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.613+0000 7f8cfc97d640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8cdc073250 0x7f8cdc075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:41.619 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:41.613+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:41.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.617+0000 7f8cfc97d640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8cdc073250 0x7f8cdc075760 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00bb50 tx=0x7f8cec00b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:41.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.621+0000 7f8cf57fa640 1 -- 172.21.15.122:0/657474899 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8cf81f1b30 con 0x7f8cf80c5d70 2024-09-17T06:05:41.632 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:05:41.720 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:41.717+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:41.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.805+0000 7fbfac425640 1 -- 172.21.15.122:0/3153829802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfa40c8280 msgr2=0x7fbfa40c3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:41.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.805+0000 7fbfac425640 1 --2- 172.21.15.122:0/3153829802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfa40c8280 0x7fbfa40c3a40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40cb3d0 tx=0x7fbfa001f0d0 comp rx=0 tx=0).stop 2024-09-17T06:05:41.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.805+0000 7fbfac425640 1 -- 172.21.15.122:0/3153829802 shutdown_connections 2024-09-17T06:05:41.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.805+0000 7fbfac425640 1 --2- 172.21.15.122:0/3153829802 >> v2:172.21.15.173:3300/0 conn(0x7fbfa406e620 0x7fbfa415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:41.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.805+0000 7fbfac425640 1 --2- 172.21.15.122:0/3153829802 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfa40c42e0 0x7fbfa406e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:41.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.805+0000 7fbfac425640 1 --2- 172.21.15.122:0/3153829802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfa40c8280 0x7fbfa40c3a40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:41.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.805+0000 7fbfac425640 1 -- 172.21.15.122:0/3153829802 >> 172.21.15.122:0/3153829802 conn(0x7fbfa40ca380 msgr2=0x7fbfa40ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:41.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.805+0000 7fbfac425640 1 -- 172.21.15.122:0/3153829802 shutdown_connections 2024-09-17T06:05:41.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.805+0000 7fbfac425640 1 -- 172.21.15.122:0/3153829802 wait complete. 2024-09-17T06:05:41.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.809+0000 7fbfac425640 1 Processor -- start 2024-09-17T06:05:41.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.809+0000 7fbfac425640 1 -- start start 2024-09-17T06:05:41.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfac425640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfa406e620 0x7fbfa41fe600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:41.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfac425640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfa40c42e0 0x7fbfa40c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:41.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfac425640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfa40c8280 0x7fbfa4146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:41.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfac425640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa4070050 con 0x7fbfa40c42e0 2024-09-17T06:05:41.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfac425640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa40c3240 con 0x7fbfa40c8280 2024-09-17T06:05:41.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfac425640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa40c3f80 con 0x7fbfa406e620 2024-09-17T06:05:41.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfa99c0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfa40c42e0 0x7fbfa40c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:41.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfa99c0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfa40c42e0 0x7fbfa40c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40472/0 (socket says 172.21.15.122:40472) 2024-09-17T06:05:41.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfa99c0640 1 -- 172.21.15.122:0/3004910727 learned_addr learned my addr 172.21.15.122:0/3004910727 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:41.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfaa1c1640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfa406e620 0x7fbfa41fe600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:41.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfaa9c2640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfa40c8280 0x7fbfa4146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:41.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfa99c0640 1 -- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfa406e620 msgr2=0x7fbfa41fe600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:41.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfa99c0640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfa406e620 0x7fbfa41fe600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:41.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfa99c0640 1 -- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfa40c8280 msgr2=0x7fbfa4146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:41.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfa99c0640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfa40c8280 0x7fbfa4146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:41.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfa99c0640 1 -- 172.21.15.122:0/3004910727 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa414d0f0 con 0x7fbfa40c42e0 2024-09-17T06:05:41.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfaa1c1640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfa406e620 0x7fbfa41fe600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:05:41.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfa99c0640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfa40c42e0 0x7fbfa40c7020 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400b3e0 tx=0x7fbf9400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:41.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbf9affd640 1 -- 172.21.15.122:0/3004910727 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94015020 con 0x7fbfa40c42e0 2024-09-17T06:05:41.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbf9affd640 1 -- 172.21.15.122:0/3004910727 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf94011940 con 0x7fbfa40c42e0 2024-09-17T06:05:41.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbf9affd640 1 -- 172.21.15.122:0/3004910727 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94011d90 con 0x7fbfa40c42e0 2024-09-17T06:05:41.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfac425640 1 -- 172.21.15.122:0/3004910727 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa4148120 con 0x7fbfa40c42e0 2024-09-17T06:05:41.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.813+0000 7fbfac425640 1 -- 172.21.15.122:0/3004910727 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa41486e0 con 0x7fbfa40c42e0 2024-09-17T06:05:41.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.817+0000 7fbf9affd640 1 -- 172.21.15.122:0/3004910727 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbf94018020 con 0x7fbfa40c42e0 2024-09-17T06:05:41.820 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:41.817+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:41.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.817+0000 7fbf9affd640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fbf88073230 0x7fbf88075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:41.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.817+0000 7fbf9affd640 1 -- 172.21.15.122:0/3004910727 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6804+0+0 (secure 0 0 0) 0x7fbf94098060 con 0x7fbfa40c42e0 2024-09-17T06:05:41.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.817+0000 7fbfaa1c1640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fbf88073230 0x7fbf88075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:41.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.817+0000 7fbfaa1c1640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fbf88073230 0x7fbf88075740 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00b2000 tx=0x7fbfa001d910 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:41.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.825+0000 7fbfac425640 1 -- 172.21.15.122:0/3004910727 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa40728f0 con 0x7fbfa40c42e0 2024-09-17T06:05:41.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.833+0000 7fbf9affd640 1 -- 172.21.15.122:0/3004910727 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbf9405e390 con 0x7fbfa40c42e0 2024-09-17T06:05:41.866 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:41.867 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:41.888 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:05:41.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.917+0000 7f8cfebe1640 1 -- 172.21.15.122:0/657474899 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f8cf814c3b0 con 0x7f8cf80c5d70 2024-09-17T06:05:41.922 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:41.917+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:41.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.921+0000 7f8cf57fa640 1 -- 172.21.15.122:0/657474899 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) ==== 81+0+38917 (secure 0 0 0) 0x7f8cf0020020 con 0x7f8cf80c5d70 2024-09-17T06:05:41.924 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:05:41.925 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:41.925 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 52, 2024-09-17T06:05:41.925 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "5aff0fc3-254a-48aa-be08-0081a34bd09c", 2024-09-17T06:05:41.925 INFO:teuthology.orchestra.run.smithi122.stdout: "created": "2024-09-17T06:03:42.642598+0000", 2024-09-17T06:05:41.925 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-09-17T06:05:39.567596+0000", 2024-09-17T06:05:41.925 INFO:teuthology.orchestra.run.smithi122.stdout: "last_up_change": "2024-09-17T06:05:25.481552+0000", 2024-09-17T06:05:41.925 INFO:teuthology.orchestra.run.smithi122.stdout: "last_in_change": "2024-09-17T06:03:46.879949+0000", 2024-09-17T06:05:41.925 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_num": 5806080, 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_set": [ 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "nodeep-scrub", 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "noscrub", 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "pglog_hardlimit", 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "purged_snapdirs", 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_deletes", 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "sortbitwise" 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_version": 6, 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T06:05:41.926 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_snapshot": "", 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_max": 4, 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "max_osd": 8, 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "require_min_compat_client": "luminous", 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "min_compat_client": "luminous", 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "require_osd_release": "squid", 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "allow_crimson": false, 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "pools": [ 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 1, 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": ".mgr", 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:03:57.560955+0000", 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:05:41.927 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 1, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 1, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 1, 2024-09-17T06:05:41.928 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 1, 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 1, 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "18", 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:41.929 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:41.930 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:41.931 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_max": 32, 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 1 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": {} 2024-09-17T06:05:41.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 6.9000000953674316, 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 6.9000000953674316, 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 0.28999999165534973, 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 2, 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 2, 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 0.875, 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 2, 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_metadata", 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:06.110710+0000", 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:41.934 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 32, 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 32, 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 32, 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 32, 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 32, 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:41.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "21", 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:41.936 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:41.937 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:41.938 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_bias": 4, 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 16, 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_priority": 5 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: "metadata": "cephfs" 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 1.5299999713897705, 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 1.5299999713897705, 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 1, 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-17T06:05:41.939 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 0.875, 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 3, 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_data", 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:07.186655+0000", 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:05:41.940 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 64, 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 64, 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 64, 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 64, 2024-09-17T06:05:41.941 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 64, 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "22", 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:41.942 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:41.943 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 64, 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: "target_size_ratio": 0.05000000074505806 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: "data": "cephfs" 2024-09-17T06:05:41.945 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: "error_message": "pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.24), read balance score may not be reliable", 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 0, 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 0 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 4, 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_data_ec", 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:10.901448+0000", 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 5, 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool,ec_overwrites", 2024-09-17T06:05:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 3, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 4, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 3, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 1, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 32, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 32, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 32, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 32, 2024-09-17T06:05:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 32, 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "26", 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:41.948 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:41.949 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "cephfs_data_ec", 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:41.950 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 8192, 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 64, 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: "data": "cephfs" 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: "osds": [ 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 0, 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "b8a621d5-9187-4034-ac89-5adb5b22ca7a", 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:41.952 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6824", 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6825", 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.953 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6826", 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6827", 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:41.954 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6830", 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6831", 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:41.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6828", 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6829", 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:41.956 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6825/776463314", 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6827/776463314", 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6831/776463314", 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6829/776463314", 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 1, 2024-09-17T06:05:41.957 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "992e1af1-06d0-4849-93bf-4be8fc437183", 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.958 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6800", 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6801", 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.959 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6802", 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6803", 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6806", 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6807", 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6804", 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6805", 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6801/2272556556", 2024-09-17T06:05:41.962 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6803/2272556556", 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6807/2272556556", 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6805/2272556556", 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 2, 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "e3a31b77-d4db-4ee6-af7c-60af7df4bd69", 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:41.963 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6816", 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6817", 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6818", 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:41.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6819", 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6822", 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:41.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6823", 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6820", 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:41.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6821", 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6817/1205784459", 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6819/1205784459", 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6823/1205784459", 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6821/1205784459", 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:41.968 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 3, 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "9f473452-18cd-44a4-803a-e908e21ab405", 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 0, 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:41.969 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6808", 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6809", 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.970 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6810", 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6811", 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.971 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6814", 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6815", 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:41.972 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6812", 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6813", 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:41.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6809/3198016774", 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6811/3198016774", 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6815/3198016774", 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6813/3198016774", 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 4, 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "f11201b3-22f8-4b9e-873c-0ed12835e2d3", 2024-09-17T06:05:41.974 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 0, 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 46, 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.975 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6810", 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6811", 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.976 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6812", 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6813", 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.977 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6816", 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6817", 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.978 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6814", 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6815", 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6811/920798795", 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6813/920798795", 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6817/920798795", 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6815/920798795", 2024-09-17T06:05:41.979 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: "exists" 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 5, 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "3f853011-9aea-4f7c-bb97-2c74fba1e33e", 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 14, 2024-09-17T06:05:41.980 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6802", 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6803", 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:41.981 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6804", 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6805", 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.982 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6808", 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6809", 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.983 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6806", 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6807", 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.984 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6803/2576144160", 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6805/2576144160", 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6809/2576144160", 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6807/2576144160", 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 6, 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "445606c9-7e18-44b2-997d-68d280a3a37c", 2024-09-17T06:05:41.985 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.986 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6818", 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6819", 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.987 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6820", 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6821", 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6824", 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6825", 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.989 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6822", 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6823", 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6819/1877869793", 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6821/1877869793", 2024-09-17T06:05:41.990 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6825/1877869793", 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6823/1877869793", 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 7, 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "ce0b67c6-0618-41b7-87e3-bf2d4c708907", 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:41.991 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6826", 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6827", 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6828", 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:41.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6829", 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6832", 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:41.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.995 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.995 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6833", 2024-09-17T06:05:41.995 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:41.995 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.995 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.995 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:41.995 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:41.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.995 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:41.995 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6830", 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6831", 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6827/1719466778", 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6829/1719466778", 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6833/1719466778", 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6831/1719466778", 2024-09-17T06:05:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_xinfo": [ 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 0, 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:41.997 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.176942+0000", 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 1, 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.431303+0000", 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.998 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 2, 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.354201+0000", 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 3, 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:41.999 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.748604+0000", 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 4, 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:42.000 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.473848+0000", 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 46 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 5, 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.458683+0000", 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:42.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.002 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 6, 2024-09-17T06:05:42.002 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:42.002 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:42.002 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:42.002 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:42.002 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:42.002 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.617928+0000", 2024-09-17T06:05:42.002 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:42.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:42.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.002 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 7, 2024-09-17T06:05:42.002 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:42.003 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:42.003 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:42.003 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:42.003 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:42.003 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.088763+0000", 2024-09-17T06:05:42.003 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:42.003 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:42.003 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:42.003 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap": [ 2024-09-17T06:05:42.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.003 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "2.15", 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: "osds": [ 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: 5, 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: 0 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.19", 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: "osds": [ 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: 6, 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: 5, 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: 4 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:42.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap_items": [ 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.2", 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 5, 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 1 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.d", 2024-09-17T06:05:42.005 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 7, 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.1d", 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 5, 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:42.006 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.c", 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.d", 2024-09-17T06:05:42.007 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 5 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.1d", 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 5 2024-09-17T06:05:42.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap_primaries": [], 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_temp": [], 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_temp": [], 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: "blocklist": {}, 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: "range_blocklist": {}, 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profiles": { 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_data_ec": { 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-device-class": "", 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-failure-domain": "osd", 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-num-failure-domains": "0", 2024-09-17T06:05:42.009 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-osds-per-failure-domain": "0", 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-root": "default", 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "jerasure-per-chunk-alignment": "false", 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "k": "2", 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "m": "2", 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "plugin": "jerasure", 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "technique": "reed_sol_van", 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "w": "8" 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "default": { 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-failure-domain": "osd", 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "k": "2", 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "m": "1", 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "plugin": "jerasure", 2024-09-17T06:05:42.010 INFO:teuthology.orchestra.run.smithi122.stdout: "technique": "reed_sol_van" 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps_queue": [], 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: "new_removed_snaps": [], 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: "new_purged_snaps": [], 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_node_flags": {}, 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: "device_class_flags": {}, 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode": { 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode_enabled": false, 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_bucket_count": 0, 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: "degraded_stretch_mode": 0, 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: "recovering_stretch_mode": 0, 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode_bucket": 0 2024-09-17T06:05:42.011 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:42.012 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:42.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.925+0000 7f8cfebe1640 1 -- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8cdc073250 msgr2=0x7f8cdc075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:42.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.925+0000 7f8cfebe1640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8cdc073250 0x7f8cdc075760 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00bb50 tx=0x7f8cec00b2e0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.925+0000 7f8cfebe1640 1 -- 172.21.15.122:0/657474899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf80c5d70 msgr2=0x7f8cf80ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:42.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.925+0000 7f8cfebe1640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf80c5d70 0x7f8cf80ae8c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000cad0 tx=0x7f8cf000cbc0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.925+0000 7f8cfebe1640 1 -- 172.21.15.122:0/657474899 shutdown_connections 2024-09-17T06:05:42.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.925+0000 7f8cfebe1640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf80c5d70 0x7f8cf80ae8c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.925+0000 7f8cfebe1640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8cf80c3180 0x7f8cf80c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.925+0000 7f8cfebe1640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8cdc073250 0x7f8cdc075760 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.925+0000 7f8cfebe1640 1 --2- 172.21.15.122:0/657474899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8cf806e370 0x7f8cf81f13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.925+0000 7f8cfebe1640 1 -- 172.21.15.122:0/657474899 >> 172.21.15.122:0/657474899 conn(0x7f8cf80cd4f0 msgr2=0x7f8cf814dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:42.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.925+0000 7f8cfebe1640 1 -- 172.21.15.122:0/657474899 shutdown_connections 2024-09-17T06:05:42.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:41.925+0000 7f8cfebe1640 1 -- 172.21.15.122:0/657474899 wait complete. 2024-09-17T06:05:42.015 INFO:tasks.thrashosds.thrasher:j is {'epoch': 52, 'fsid': '5aff0fc3-254a-48aa-be08-0081a34bd09c', 'created': '2024-09-17T06:03:42.642598+0000', 'modified': '2024-09-17T06:05:39.567596+0000', 'last_up_change': '2024-09-17T06:05:25.481552+0000', 'last_in_change': '2024-09-17T06:03:46.879949+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T06:03:57.560955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T06:04:06.110710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5299999713897705, 'score_stable': 1.5299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T06:04:07.186655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.24), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-17T06:04:10.901448+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}], 'osds': [{'osd': 0, 'uuid': 'b8a621d5-9187-4034-ac89-5adb5b22ca7a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6824', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6825', 'nonce': 776463314}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6826', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6827', 'nonce': 776463314}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6830', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6831', 'nonce': 776463314}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6828', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6829', 'nonce': 776463314}]}, 'public_addr': '172.21.15.122:6825/776463314', 'cluster_addr': '172.21.15.122:6827/776463314', 'heartbeat_back_addr': '172.21.15.122:6831/776463314', 'heartbeat_front_addr': '172.21.15.122:6829/776463314', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '992e1af1-06d0-4849-93bf-4be8fc437183', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6800', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6801', 'nonce': 2272556556}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6802', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6803', 'nonce': 2272556556}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6806', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6807', 'nonce': 2272556556}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6804', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6805', 'nonce': 2272556556}]}, 'public_addr': '172.21.15.122:6801/2272556556', 'cluster_addr': '172.21.15.122:6803/2272556556', 'heartbeat_back_addr': '172.21.15.122:6807/2272556556', 'heartbeat_front_addr': '172.21.15.122:6805/2272556556', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'e3a31b77-d4db-4ee6-af7c-60af7df4bd69', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6816', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6817', 'nonce': 1205784459}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6818', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6819', 'nonce': 1205784459}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6822', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6823', 'nonce': 1205784459}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6820', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6821', 'nonce': 1205784459}]}, 'public_addr': '172.21.15.122:6817/1205784459', 'cluster_addr': '172.21.15.122:6819/1205784459', 'heartbeat_back_addr': '172.21.15.122:6823/1205784459', 'heartbeat_front_addr': '172.21.15.122:6821/1205784459', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '9f473452-18cd-44a4-803a-e908e21ab405', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6808', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6809', 'nonce': 3198016774}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6810', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6811', 'nonce': 3198016774}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6814', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6815', 'nonce': 3198016774}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6812', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6813', 'nonce': 3198016774}]}, 'public_addr': '172.21.15.122:6809/3198016774', 'cluster_addr': '172.21.15.122:6811/3198016774', 'heartbeat_back_addr': '172.21.15.122:6815/3198016774', 'heartbeat_front_addr': '172.21.15.122:6813/3198016774', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'f11201b3-22f8-4b9e-873c-0ed12835e2d3', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 35, 'down_at': 46, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6810', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6811', 'nonce': 920798795}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6812', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6813', 'nonce': 920798795}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6816', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6817', 'nonce': 920798795}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6814', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6815', 'nonce': 920798795}]}, 'public_addr': '172.21.15.173:6811/920798795', 'cluster_addr': '172.21.15.173:6813/920798795', 'heartbeat_back_addr': '172.21.15.173:6817/920798795', 'heartbeat_front_addr': '172.21.15.173:6815/920798795', 'state': ['exists']}, {'osd': 5, 'uuid': '3f853011-9aea-4f7c-bb97-2c74fba1e33e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6802', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6803', 'nonce': 2576144160}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6804', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6805', 'nonce': 2576144160}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6808', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6809', 'nonce': 2576144160}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6806', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6807', 'nonce': 2576144160}]}, 'public_addr': '172.21.15.173:6803/2576144160', 'cluster_addr': '172.21.15.173:6805/2576144160', 'heartbeat_back_addr': '172.21.15.173:6809/2576144160', 'heartbeat_front_addr': '172.21.15.173:6807/2576144160', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '445606c9-7e18-44b2-997d-68d280a3a37c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6818', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6819', 'nonce': 1877869793}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6820', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6821', 'nonce': 1877869793}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6824', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6825', 'nonce': 1877869793}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6822', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6823', 'nonce': 1877869793}]}, 'public_addr': '172.21.15.173:6819/1877869793', 'cluster_addr': '172.21.15.173:6821/1877869793', 'heartbeat_back_addr': '172.21.15.173:6825/1877869793', 'heartbeat_front_addr': '172.21.15.173:6823/1877869793', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'ce0b67c6-0618-41b7-87e3-bf2d4c708907', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6826', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6827', 'nonce': 1719466778}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6828', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6829', 'nonce': 1719466778}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 1719466778}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6830', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6831', 'nonce': 1719466778}]}, 'public_addr': '172.21.15.173:6827/1719466778', 'cluster_addr': '172.21.15.173:6829/1719466778', 'heartbeat_back_addr': '172.21.15.173:6833/1719466778', 'heartbeat_front_addr': '172.21.15.173:6831/1719466778', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.176942+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.431303+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.354201+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.748604+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.473848+0000', 'dead_epoch': 46}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.458683+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.617928+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.088763+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.15', 'osds': [5, 0]}, {'pgid': '4.19', 'osds': [6, 5, 0, 4]}], 'pg_upmap_items': [{'pgid': '3.2', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '3.d', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '3.1d', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '4.c', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.d', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.1d', 'mappings': [{'from': 1, 'to': 5}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'cephfs_data_ec': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-num-failure-domains': '0', 'crush-osds-per-failure-domain': '0', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '2', 'plugin': 'jerasure', 'technique': 'reed_sol_van', 'w': '8'}, 'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T06:05:42.015 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:05:42.023 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:42.021+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:42.043 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:42.044 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:42.064 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:05:42.123 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:42.121+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:42.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.181+0000 7fbfac425640 1 -- 172.21.15.122:0/3004910727 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7fbfa4072360 con 0x7fbfa40c42e0 2024-09-17T06:05:42.224 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:42.221+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:42.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.221+0000 7fc1e9840640 1 -- 172.21.15.122:0/3011625557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e40cb020 msgr2=0x7fc1e41522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:42.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.221+0000 7fc1e9840640 1 --2- 172.21.15.122:0/3011625557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e40cb020 0x7fc1e41522d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4072640 tx=0x7fc1d401c830 comp rx=0 tx=0).stop 2024-09-17T06:05:42.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.221+0000 7fc1e9840640 1 -- 172.21.15.122:0/3011625557 shutdown_connections 2024-09-17T06:05:42.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.221+0000 7fc1e9840640 1 --2- 172.21.15.122:0/3011625557 >> v2:172.21.15.122:3300/0 conn(0x7fc1e4158a70 0x7fc1e40c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.221+0000 7fc1e9840640 1 --2- 172.21.15.122:0/3011625557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e40cb020 0x7fc1e41522d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.221+0000 7fc1e9840640 1 -- 172.21.15.122:0/3011625557 >> 172.21.15.122:0/3011625557 conn(0x7fc1e40cdef0 msgr2=0x7fc1e40ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:42.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.221+0000 7fc1e9840640 1 -- 172.21.15.122:0/3011625557 shutdown_connections 2024-09-17T06:05:42.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.221+0000 7fc1e9840640 1 -- 172.21.15.122:0/3011625557 wait complete. 2024-09-17T06:05:42.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.225+0000 7fc1e9840640 1 Processor -- start 2024-09-17T06:05:42.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.225+0000 7fc1e9840640 1 -- start start 2024-09-17T06:05:42.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e9840640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1e40c8c00 0x7fc1e41f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:42.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e9840640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e40cb020 0x7fc1e414fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:42.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1e40c8c00 0x7fc1e41f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:42.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1e40c8c00 0x7fc1e41f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40500/0 (socket says 172.21.15.122:40500) 2024-09-17T06:05:42.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e2ffd640 1 -- 172.21.15.122:0/130922296 learned_addr learned my addr 172.21.15.122:0/130922296 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:42.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e9840640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1e4158a70 0x7fc1e4150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:42.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e27fc640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e40cb020 0x7fc1e414fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:42.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e40c8470 con 0x7fc1e40c8c00 2024-09-17T06:05:42.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e40c82f0 con 0x7fc1e40cb020 2024-09-17T06:05:42.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e4163110 con 0x7fc1e4158a70 2024-09-17T06:05:42.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e37fe640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1e4158a70 0x7fc1e4150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:42.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e2ffd640 1 -- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1e4158a70 msgr2=0x7fc1e4150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:42.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e2ffd640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1e4158a70 0x7fc1e4150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e2ffd640 1 -- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e40cb020 msgr2=0x7fc1e414fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:42.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e2ffd640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e40cb020 0x7fc1e414fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e2ffd640 1 -- 172.21.15.122:0/130922296 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e41f5370 con 0x7fc1e40c8c00 2024-09-17T06:05:42.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e2ffd640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1e40c8c00 0x7fc1e41f4e30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40b0040 tx=0x7fc1d4005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:42.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1cbfff640 1 -- 172.21.15.122:0/130922296 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40b2040 con 0x7fc1e40c8c00 2024-09-17T06:05:42.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1cbfff640 1 -- 172.21.15.122:0/130922296 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1d4004240 con 0x7fc1e40c8c00 2024-09-17T06:05:42.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1cbfff640 1 -- 172.21.15.122:0/130922296 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4005030 con 0x7fc1e40c8c00 2024-09-17T06:05:42.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e4155890 con 0x7fc1e40c8c00 2024-09-17T06:05:42.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e4162600 con 0x7fc1e40c8c00 2024-09-17T06:05:42.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.229+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e41634d0 con 0x7fc1e40c8c00 2024-09-17T06:05:42.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.233+0000 7fc1cbfff640 1 -- 172.21.15.122:0/130922296 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc1d40051f0 con 0x7fc1e40c8c00 2024-09-17T06:05:42.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.233+0000 7fc1cbfff640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc1d0073230 0x7fc1d0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:42.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.233+0000 7fc1cbfff640 1 -- 172.21.15.122:0/130922296 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6804+0+0 (secure 0 0 0) 0x7fc1d412e260 con 0x7fc1e40c8c00 2024-09-17T06:05:42.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.241+0000 7fc1e27fc640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc1d0073230 0x7fc1d0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:42.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.241+0000 7fc1e27fc640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc1d0073230 0x7fc1d0075740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc1e415b470 tx=0x7fc1d8009060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:42.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.245+0000 7fc1cbfff640 1 -- 172.21.15.122:0/130922296 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc1d40164b0 con 0x7fc1e40c8c00 2024-09-17T06:05:42.299 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:42.299 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:42.323 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:05:42.325 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:42.321+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:42.425 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:42.425+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:42.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.449+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1e40c89e0 con 0x7fc1d0073230 2024-09-17T06:05:42.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.465+0000 7fc1cbfff640 1 -- 172.21.15.122:0/130922296 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333592 (secure 0 0 0) 0x7fc1e40c89e0 con 0x7fc1d0073230 2024-09-17T06:05:42.473 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:05:42.476 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:05:42.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.469+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc1d0073230 msgr2=0x7fc1d0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:42.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.469+0000 7fc1e9840640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc1d0073230 0x7fc1d0075740 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc1e415b470 tx=0x7fc1d8009060 comp rx=0 tx=0).stop 2024-09-17T06:05:42.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.469+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1e40c8c00 msgr2=0x7fc1e41f4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:42.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.469+0000 7fc1e9840640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1e40c8c00 0x7fc1e41f4e30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40b0040 tx=0x7fc1d4005e70 comp rx=0 tx=0).stop 2024-09-17T06:05:42.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.469+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 shutdown_connections 2024-09-17T06:05:42.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.469+0000 7fc1e9840640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1e4158a70 0x7fc1e4150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.469+0000 7fc1e9840640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc1d0073230 0x7fc1d0075740 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.469+0000 7fc1e9840640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e40cb020 0x7fc1e414fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.469+0000 7fc1e9840640 1 --2- 172.21.15.122:0/130922296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1e40c8c00 0x7fc1e41f4e30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.469+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 >> 172.21.15.122:0/130922296 conn(0x7fc1e40cdef0 msgr2=0x7fc1e41512e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:42.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.469+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 shutdown_connections 2024-09-17T06:05:42.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.469+0000 7fc1e9840640 1 -- 172.21.15.122:0/130922296 wait complete. 2024-09-17T06:05:42.493 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-09-17T06:05:41.550346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599134,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":157,"num_write_kb":1654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":296,"acting":296,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221832,"kb_used_data":5600,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752888,"statfs":{"total":773094113280,"available":772866957312,"internally_reserved":0,"allocated":5734400,"data_stored":3369363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.997570"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.555678+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:05:33.555678+0000","last_peered":"2024-09-17T06:05:33.555678+0000","last_clean":"2024-09-17T06:05:33.555678+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:05:33.555678+0000","last_undegraded":"2024-09-17T06:05:33.555678+0000","last_fullsized":"2024-09-17T06:05:33.555678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.351636+0000","last_change":"2024-09-17T06:05:06.888017+0000","last_active":"2024-09-17T06:05:37.351636+0000","last_peered":"2024-09-17T06:05:37.351636+0000","last_clean":"2024-09-17T06:05:37.351636+0000","last_became_active":"2024-09-17T06:05:06.887122+0000","last_became_peered":"2024-09-17T06:05:06.887122+0000","last_unstale":"2024-09-17T06:05:37.351636+0000","last_undegraded":"2024-09-17T06:05:37.351636+0000","last_fullsized":"2024-09-17T06:05:37.351636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:00.459343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.349164+0000","last_change":"2024-09-17T06:05:26.531380+0000","last_active":"2024-09-17T06:05:37.349164+0000","last_peered":"2024-09-17T06:05:37.349164+0000","last_clean":"2024-09-17T06:05:24.484049+0000","last_became_active":"2024-09-17T06:05:26.531380+0000","last_became_peered":"2024-09-17T06:05:26.531380+0000","last_unstale":"2024-09-17T06:05:37.349164+0000","last_undegraded":"2024-09-17T06:05:37.349164+0000","last_fullsized":"2024-09-17T06:05:26.508125+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:43.885567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,2147483647],"acting":[6,5,0,2147483647],"avail_no_missing":["6(0)","0(2)","5(1)"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.557687+0000","last_change":"2024-09-17T06:05:06.872817+0000","last_active":"2024-09-17T06:05:33.557687+0000","last_peered":"2024-09-17T06:05:33.557687+0000","last_clean":"2024-09-17T06:05:33.557687+0000","last_became_active":"2024-09-17T06:05:06.872442+0000","last_became_peered":"2024-09-17T06:05:06.872442+0000","last_unstale":"2024-09-17T06:05:33.557687+0000","last_undegraded":"2024-09-17T06:05:33.557687+0000","last_fullsized":"2024-09-17T06:05:33.557687+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:53.859734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.555388+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:05:33.555388+0000","last_peered":"2024-09-17T06:05:33.555388+0000","last_clean":"2024-09-17T06:05:33.555388+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:05:33.555388+0000","last_undegraded":"2024-09-17T06:05:33.555388+0000","last_fullsized":"2024-09-17T06:05:33.555388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.349089+0000","last_change":"2024-09-17T06:05:26.530849+0000","last_active":"2024-09-17T06:05:37.349089+0000","last_peered":"2024-09-17T06:05:37.349089+0000","last_clean":"2024-09-17T06:04:11.883937+0000","last_became_active":"2024-09-17T06:05:26.530849+0000","last_became_peered":"2024-09-17T06:05:26.530849+0000","last_unstale":"2024-09-17T06:05:37.349089+0000","last_undegraded":"2024-09-17T06:05:37.349089+0000","last_fullsized":"2024-09-17T06:05:26.508662+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:20.217049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,6,1,3],"acting":[2147483647,6,1,3],"avail_no_missing":["6(1)","1(2)","3(3)"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":72,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.022821+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:05:34.022821+0000","last_peered":"2024-09-17T06:05:34.022821+0000","last_clean":"2024-09-17T06:05:34.022821+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:05:34.022821+0000","last_undegraded":"2024-09-17T06:05:34.022821+0000","last_fullsized":"2024-09-17T06:05:34.022821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":75,"reported_epoch":52,"state":"active+undersized","last_fresh":"2024-09-17T06:05:39.583036+0000","last_change":"2024-09-17T06:05:26.520457+0000","last_active":"2024-09-17T06:05:39.583036+0000","last_peered":"2024-09-17T06:05:39.583036+0000","last_clean":"2024-09-17T06:05:25.493385+0000","last_became_active":"2024-09-17T06:05:26.520457+0000","last_became_peered":"2024-09-17T06:05:26.520457+0000","last_unstale":"2024-09-17T06:05:39.583036+0000","last_undegraded":"2024-09-17T06:05:39.583036+0000","last_fullsized":"2024-09-17T06:05:26.506760+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:58.222782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.349871+0000","last_change":"2024-09-17T06:05:26.524570+0000","last_active":"2024-09-17T06:05:37.349871+0000","last_peered":"2024-09-17T06:05:37.349871+0000","last_clean":"2024-09-17T06:04:11.883937+0000","last_became_active":"2024-09-17T06:05:26.524570+0000","last_became_peered":"2024-09-17T06:05:26.524570+0000","last_unstale":"2024-09-17T06:05:37.349871+0000","last_undegraded":"2024-09-17T06:05:37.349871+0000","last_fullsized":"2024-09-17T06:05:26.507035+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:02.791313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,3,6,1],"acting":[2147483647,3,6,1],"avail_no_missing":["6(2)","1(3)","3(1)"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":72,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.020316+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:05:34.020316+0000","last_peered":"2024-09-17T06:05:34.020316+0000","last_clean":"2024-09-17T06:05:34.020316+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:05:34.020316+0000","last_undegraded":"2024-09-17T06:05:34.020316+0000","last_fullsized":"2024-09-17T06:05:34.020316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":60,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.234586+0000","last_change":"2024-09-17T06:05:26.522130+0000","last_active":"2024-09-17T06:05:37.234586+0000","last_peered":"2024-09-17T06:05:37.234586+0000","last_clean":"2024-09-17T06:05:24.486319+0000","last_became_active":"2024-09-17T06:05:26.522130+0000","last_became_peered":"2024-09-17T06:05:26.522130+0000","last_unstale":"2024-09-17T06:05:37.234586+0000","last_undegraded":"2024-09-17T06:05:37.234586+0000","last_fullsized":"2024-09-17T06:05:26.515506+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:33.555455+0000","last_change":"2024-09-17T06:05:26.528827+0000","last_active":"2024-09-17T06:05:33.555455+0000","last_peered":"2024-09-17T06:05:33.555455+0000","last_clean":"2024-09-17T06:04:11.883937+0000","last_became_active":"2024-09-17T06:05:26.528827+0000","last_became_peered":"2024-09-17T06:05:26.528827+0000","last_unstale":"2024-09-17T06:05:33.555455+0000","last_undegraded":"2024-09-17T06:05:33.555455+0000","last_fullsized":"2024-09-17T06:05:26.506890+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:04.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,3,0,5],"acting":[2147483647,3,0,5],"avail_no_missing":["0(2)","3(1)","5(3)"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":72,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.349674+0000","last_change":"2024-09-17T06:05:26.517888+0000","last_active":"2024-09-17T06:05:37.349674+0000","last_peered":"2024-09-17T06:05:37.349674+0000","last_clean":"2024-09-17T06:05:24.484357+0000","last_became_active":"2024-09-17T06:05:26.517888+0000","last_became_peered":"2024-09-17T06:05:26.517888+0000","last_unstale":"2024-09-17T06:05:37.349674+0000","last_undegraded":"2024-09-17T06:05:37.349674+0000","last_fullsized":"2024-09-17T06:05:26.509770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:53.122206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":75,"reported_epoch":50,"state":"active+undersized+degraded","last_fresh":"2024-09-17T06:05:34.020756+0000","last_change":"2024-09-17T06:05:26.527567+0000","last_active":"2024-09-17T06:05:34.020756+0000","last_peered":"2024-09-17T06:05:34.020756+0000","last_clean":"2024-09-17T06:05:25.447019+0000","last_became_active":"2024-09-17T06:05:26.527567+0000","last_became_peered":"2024-09-17T06:05:26.527567+0000","last_unstale":"2024-09-17T06:05:34.020756+0000","last_undegraded":"2024-09-17T06:05:26.521057+0000","last_fullsized":"2024-09-17T06:05:26.520764+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:17.186965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":1}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":33,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:33.554414+0000","last_change":"2024-09-17T06:05:26.526520+0000","last_active":"2024-09-17T06:05:33.554414+0000","last_peered":"2024-09-17T06:05:33.554414+0000","last_clean":"2024-09-17T06:04:13.919492+0000","last_became_active":"2024-09-17T06:05:26.526520+0000","last_became_peered":"2024-09-17T06:05:26.526520+0000","last_unstale":"2024-09-17T06:05:33.554414+0000","last_undegraded":"2024-09-17T06:05:33.554414+0000","last_fullsized":"2024-09-17T06:05:26.506306+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:07.577198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,0,2,5],"acting":[2147483647,0,2,5],"avail_no_missing":["0(1)","2(2)","5(3)"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.555979+0000","last_change":"2024-09-17T06:05:06.873182+0000","last_active":"2024-09-17T06:05:33.555979+0000","last_peered":"2024-09-17T06:05:33.555979+0000","last_clean":"2024-09-17T06:05:33.555979+0000","last_became_active":"2024-09-17T06:05:06.872029+0000","last_became_peered":"2024-09-17T06:05:06.872029+0000","last_unstale":"2024-09-17T06:05:33.555979+0000","last_undegraded":"2024-09-17T06:05:33.555979+0000","last_fullsized":"2024-09-17T06:05:33.555979+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:40.817231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.870950+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:05:33.870950+0000","last_peered":"2024-09-17T06:05:33.870950+0000","last_clean":"2024-09-17T06:05:33.870950+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:05:33.870950+0000","last_undegraded":"2024-09-17T06:05:33.870950+0000","last_fullsized":"2024-09-17T06:05:33.870950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":35,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.349843+0000","last_change":"2024-09-17T06:05:26.532600+0000","last_active":"2024-09-17T06:05:37.349843+0000","last_peered":"2024-09-17T06:05:37.349843+0000","last_clean":"2024-09-17T06:04:13.918756+0000","last_became_active":"2024-09-17T06:05:26.532600+0000","last_became_peered":"2024-09-17T06:05:26.532600+0000","last_unstale":"2024-09-17T06:05:37.349843+0000","last_undegraded":"2024-09-17T06:05:37.349843+0000","last_fullsized":"2024-09-17T06:05:26.510132+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:30.337482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,3,6,2],"acting":[2147483647,3,6,2],"avail_no_missing":["6(2)","2(3)","3(1)"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.869796+0000","last_change":"2024-09-17T06:05:06.872270+0000","last_active":"2024-09-17T06:05:33.869796+0000","last_peered":"2024-09-17T06:05:33.869796+0000","last_clean":"2024-09-17T06:05:33.869796+0000","last_became_active":"2024-09-17T06:05:06.871970+0000","last_became_peered":"2024-09-17T06:05:06.871970+0000","last_unstale":"2024-09-17T06:05:33.869796+0000","last_undegraded":"2024-09-17T06:05:33.869796+0000","last_fullsized":"2024-09-17T06:05:33.869796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:51.766378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.870171+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:05:33.870171+0000","last_peered":"2024-09-17T06:05:33.870171+0000","last_clean":"2024-09-17T06:05:33.870171+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:05:33.870171+0000","last_undegraded":"2024-09-17T06:05:33.870171+0000","last_fullsized":"2024-09-17T06:05:33.870171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:33.871504+0000","last_change":"2024-09-17T06:05:26.530244+0000","last_active":"2024-09-17T06:05:33.871504+0000","last_peered":"2024-09-17T06:05:33.871504+0000","last_clean":"2024-09-17T06:05:25.503078+0000","last_became_active":"2024-09-17T06:05:26.530244+0000","last_became_peered":"2024-09-17T06:05:26.530244+0000","last_unstale":"2024-09-17T06:05:33.871504+0000","last_undegraded":"2024-09-17T06:05:33.871504+0000","last_fullsized":"2024-09-17T06:05:26.504585+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:41.630985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2147483647,7],"acting":[1,3,2147483647,7],"avail_no_missing":["1(0)","3(1)","7(3)"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.233579+0000","last_change":"2024-09-17T06:05:26.519525+0000","last_active":"2024-09-17T06:05:37.233579+0000","last_peered":"2024-09-17T06:05:37.233579+0000","last_clean":"2024-09-17T06:04:07.793905+0000","last_became_active":"2024-09-17T06:05:26.519525+0000","last_became_peered":"2024-09-17T06:05:26.519525+0000","last_unstale":"2024-09-17T06:05:37.233579+0000","last_undegraded":"2024-09-17T06:05:37.233579+0000","last_fullsized":"2024-09-17T06:05:26.514224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":70,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.018359+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:05:34.018359+0000","last_peered":"2024-09-17T06:05:34.018359+0000","last_clean":"2024-09-17T06:05:34.018359+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:05:34.018359+0000","last_undegraded":"2024-09-17T06:05:34.018359+0000","last_fullsized":"2024-09-17T06:05:34.018359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.350995+0000","last_change":"2024-09-17T06:05:26.524578+0000","last_active":"2024-09-17T06:05:37.350995+0000","last_peered":"2024-09-17T06:05:37.350995+0000","last_clean":"2024-09-17T06:04:11.883937+0000","last_became_active":"2024-09-17T06:05:26.524578+0000","last_became_peered":"2024-09-17T06:05:26.524578+0000","last_unstale":"2024-09-17T06:05:37.350995+0000","last_undegraded":"2024-09-17T06:05:37.350995+0000","last_fullsized":"2024-09-17T06:05:26.506922+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:26.929823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,3,6,1],"acting":[2147483647,3,6,1],"avail_no_missing":["6(2)","1(3)","3(1)"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.557800+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:05:33.557800+0000","last_peered":"2024-09-17T06:05:33.557800+0000","last_clean":"2024-09-17T06:05:33.557800+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:05:33.557800+0000","last_undegraded":"2024-09-17T06:05:33.557800+0000","last_fullsized":"2024-09-17T06:05:33.557800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":73,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.352195+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:05:37.352195+0000","last_peered":"2024-09-17T06:05:37.352195+0000","last_clean":"2024-09-17T06:05:37.352195+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:05:37.352195+0000","last_undegraded":"2024-09-17T06:05:37.352195+0000","last_fullsized":"2024-09-17T06:05:37.352195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":52,"state":"active+undersized","last_fresh":"2024-09-17T06:05:39.580377+0000","last_change":"2024-09-17T06:05:26.531647+0000","last_active":"2024-09-17T06:05:39.580377+0000","last_peered":"2024-09-17T06:05:39.580377+0000","last_clean":"2024-09-17T06:04:11.883937+0000","last_became_active":"2024-09-17T06:05:26.531647+0000","last_became_peered":"2024-09-17T06:05:26.531647+0000","last_unstale":"2024-09-17T06:05:39.580377+0000","last_undegraded":"2024-09-17T06:05:39.580377+0000","last_fullsized":"2024-09-17T06:05:26.504730+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:07.774492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,5,6,7],"acting":[2147483647,5,6,7],"avail_no_missing":["5(1)","6(2)","7(3)"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.018963+0000","last_change":"2024-09-17T06:05:06.893871+0000","last_active":"2024-09-17T06:05:34.018963+0000","last_peered":"2024-09-17T06:05:34.018963+0000","last_clean":"2024-09-17T06:05:34.018963+0000","last_became_active":"2024-09-17T06:05:06.887637+0000","last_became_peered":"2024-09-17T06:05:06.887637+0000","last_unstale":"2024-09-17T06:05:34.018963+0000","last_undegraded":"2024-09-17T06:05:34.018963+0000","last_fullsized":"2024-09-17T06:05:34.018963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:54.871040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"29'3","reported_seq":72,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.871484+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:05:33.871484+0000","last_peered":"2024-09-17T06:05:33.871484+0000","last_clean":"2024-09-17T06:05:33.871484+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:05:33.871484+0000","last_undegraded":"2024-09-17T06:05:33.871484+0000","last_fullsized":"2024-09-17T06:05:33.871484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.018125+0000","last_change":"2024-09-17T06:05:06.896192+0000","last_active":"2024-09-17T06:05:34.018125+0000","last_peered":"2024-09-17T06:05:34.018125+0000","last_clean":"2024-09-17T06:05:34.018125+0000","last_became_active":"2024-09-17T06:05:06.893344+0000","last_became_peered":"2024-09-17T06:05:06.893344+0000","last_unstale":"2024-09-17T06:05:34.018125+0000","last_undegraded":"2024-09-17T06:05:34.018125+0000","last_fullsized":"2024-09-17T06:05:34.018125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:44.907263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.870821+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:05:33.870821+0000","last_peered":"2024-09-17T06:05:33.870821+0000","last_clean":"2024-09-17T06:05:33.870821+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:05:33.870821+0000","last_undegraded":"2024-09-17T06:05:33.870821+0000","last_fullsized":"2024-09-17T06:05:33.870821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.023095+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:05:34.023095+0000","last_peered":"2024-09-17T06:05:34.023095+0000","last_clean":"2024-09-17T06:05:34.023095+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:05:34.023095+0000","last_undegraded":"2024-09-17T06:05:34.023095+0000","last_fullsized":"2024-09-17T06:05:34.023095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":63,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.556248+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:05:33.556248+0000","last_peered":"2024-09-17T06:05:33.556248+0000","last_clean":"2024-09-17T06:05:33.556248+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:05:33.556248+0000","last_undegraded":"2024-09-17T06:05:33.556248+0000","last_fullsized":"2024-09-17T06:05:33.556248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.583951+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:05:39.583951+0000","last_peered":"2024-09-17T06:05:39.583951+0000","last_clean":"2024-09-17T06:05:39.583951+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:05:39.583951+0000","last_undegraded":"2024-09-17T06:05:39.583951+0000","last_fullsized":"2024-09-17T06:05:39.583951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.870911+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:05:33.870911+0000","last_peered":"2024-09-17T06:05:33.870911+0000","last_clean":"2024-09-17T06:05:33.870911+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:05:33.870911+0000","last_undegraded":"2024-09-17T06:05:33.870911+0000","last_fullsized":"2024-09-17T06:05:33.870911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:33.870325+0000","last_change":"2024-09-17T06:05:26.530428+0000","last_active":"2024-09-17T06:05:33.870325+0000","last_peered":"2024-09-17T06:05:33.870325+0000","last_clean":"2024-09-17T06:05:25.504842+0000","last_became_active":"2024-09-17T06:05:26.530428+0000","last_became_peered":"2024-09-17T06:05:26.530428+0000","last_unstale":"2024-09-17T06:05:33.870325+0000","last_undegraded":"2024-09-17T06:05:33.870325+0000","last_fullsized":"2024-09-17T06:05:26.500976+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:22.636702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2147483647,0],"acting":[1,5,2147483647,0],"avail_no_missing":["1(0)","0(3)","5(1)"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:33.556075+0000","last_change":"2024-09-17T06:05:26.527684+0000","last_active":"2024-09-17T06:05:33.556075+0000","last_peered":"2024-09-17T06:05:33.556075+0000","last_clean":"2024-09-17T06:04:07.793905+0000","last_became_active":"2024-09-17T06:05:26.527684+0000","last_became_peered":"2024-09-17T06:05:26.527684+0000","last_unstale":"2024-09-17T06:05:33.556075+0000","last_undegraded":"2024-09-17T06:05:33.556075+0000","last_fullsized":"2024-09-17T06:05:26.508667+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:29.456405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.582183+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:05:39.582183+0000","last_peered":"2024-09-17T06:05:39.582183+0000","last_clean":"2024-09-17T06:05:39.582183+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:05:39.582183+0000","last_undegraded":"2024-09-17T06:05:39.582183+0000","last_fullsized":"2024-09-17T06:05:39.582183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.870722+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:05:33.870722+0000","last_peered":"2024-09-17T06:05:33.870722+0000","last_clean":"2024-09-17T06:05:33.870722+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:05:33.870722+0000","last_undegraded":"2024-09-17T06:05:33.870722+0000","last_fullsized":"2024-09-17T06:05:33.870722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.870019+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:05:33.870019+0000","last_peered":"2024-09-17T06:05:33.870019+0000","last_clean":"2024-09-17T06:05:33.870019+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:05:33.870019+0000","last_undegraded":"2024-09-17T06:05:33.870019+0000","last_fullsized":"2024-09-17T06:05:33.870019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.233779+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:05:37.233779+0000","last_peered":"2024-09-17T06:05:37.233779+0000","last_clean":"2024-09-17T06:05:37.233779+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:05:37.233779+0000","last_undegraded":"2024-09-17T06:05:37.233779+0000","last_fullsized":"2024-09-17T06:05:37.233779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.871600+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:05:33.871600+0000","last_peered":"2024-09-17T06:05:33.871600+0000","last_clean":"2024-09-17T06:05:33.871600+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:05:33.871600+0000","last_undegraded":"2024-09-17T06:05:33.871600+0000","last_fullsized":"2024-09-17T06:05:33.871600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":72,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:33.555046+0000","last_change":"2024-09-17T06:05:26.523374+0000","last_active":"2024-09-17T06:05:33.555046+0000","last_peered":"2024-09-17T06:05:33.555046+0000","last_clean":"2024-09-17T06:05:24.615294+0000","last_became_active":"2024-09-17T06:05:26.523374+0000","last_became_peered":"2024-09-17T06:05:26.523374+0000","last_unstale":"2024-09-17T06:05:33.555046+0000","last_undegraded":"2024-09-17T06:05:33.555046+0000","last_fullsized":"2024-09-17T06:05:26.507203+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:53.768156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":70,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.018695+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:05:34.018695+0000","last_peered":"2024-09-17T06:05:34.018695+0000","last_clean":"2024-09-17T06:05:34.018695+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:05:34.018695+0000","last_undegraded":"2024-09-17T06:05:34.018695+0000","last_fullsized":"2024-09-17T06:05:34.018695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":63,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.557517+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:05:33.557517+0000","last_peered":"2024-09-17T06:05:33.557517+0000","last_clean":"2024-09-17T06:05:33.557517+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:05:33.557517+0000","last_undegraded":"2024-09-17T06:05:33.557517+0000","last_fullsized":"2024-09-17T06:05:33.557517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.870159+0000","last_change":"2024-09-17T06:05:06.871787+0000","last_active":"2024-09-17T06:05:33.870159+0000","last_peered":"2024-09-17T06:05:33.870159+0000","last_clean":"2024-09-17T06:05:33.870159+0000","last_became_active":"2024-09-17T06:05:06.871397+0000","last_became_peered":"2024-09-17T06:05:06.871397+0000","last_unstale":"2024-09-17T06:05:33.870159+0000","last_undegraded":"2024-09-17T06:05:33.870159+0000","last_fullsized":"2024-09-17T06:05:33.870159+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:12.512457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.583462+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:05:39.583462+0000","last_peered":"2024-09-17T06:05:39.583462+0000","last_clean":"2024-09-17T06:05:39.583462+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:05:39.583462+0000","last_undegraded":"2024-09-17T06:05:39.583462+0000","last_fullsized":"2024-09-17T06:05:39.583462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":166,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.018997+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:05:34.018997+0000","last_peered":"2024-09-17T06:05:34.018997+0000","last_clean":"2024-09-17T06:05:34.018997+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:05:34.018997+0000","last_undegraded":"2024-09-17T06:05:34.018997+0000","last_fullsized":"2024-09-17T06:05:34.018997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":69,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.350330+0000","last_change":"2024-09-17T06:05:26.530457+0000","last_active":"2024-09-17T06:05:37.350330+0000","last_peered":"2024-09-17T06:05:37.350330+0000","last_clean":"2024-09-17T06:05:24.484979+0000","last_became_active":"2024-09-17T06:05:26.530457+0000","last_became_peered":"2024-09-17T06:05:26.530457+0000","last_unstale":"2024-09-17T06:05:37.350330+0000","last_undegraded":"2024-09-17T06:05:37.350330+0000","last_fullsized":"2024-09-17T06:05:26.510074+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:22.288303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2147483647,7],"acting":[6,3,2147483647,7],"avail_no_missing":["6(0)","3(1)","7(3)"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":57,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.233450+0000","last_change":"2024-09-17T06:04:49.135526+0000","last_active":"2024-09-17T06:05:37.233450+0000","last_peered":"2024-09-17T06:05:37.233450+0000","last_clean":"2024-09-17T06:05:37.233450+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:05:37.233450+0000","last_undegraded":"2024-09-17T06:05:37.233450+0000","last_fullsized":"2024-09-17T06:05:37.233450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:45.338884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":73,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.234433+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:05:37.234433+0000","last_peered":"2024-09-17T06:05:37.234433+0000","last_clean":"2024-09-17T06:05:37.234433+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:05:37.234433+0000","last_undegraded":"2024-09-17T06:05:37.234433+0000","last_fullsized":"2024-09-17T06:05:37.234433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.349530+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:05:37.349530+0000","last_peered":"2024-09-17T06:05:37.349530+0000","last_clean":"2024-09-17T06:05:37.349530+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:05:37.349530+0000","last_undegraded":"2024-09-17T06:05:37.349530+0000","last_fullsized":"2024-09-17T06:05:37.349530+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.583250+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:05:39.583250+0000","last_peered":"2024-09-17T06:05:39.583250+0000","last_clean":"2024-09-17T06:05:39.583250+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:05:39.583250+0000","last_undegraded":"2024-09-17T06:05:39.583250+0000","last_fullsized":"2024-09-17T06:05:39.583250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":73,"reported_epoch":50,"state":"active+undersized+degraded","last_fresh":"2024-09-17T06:05:33.871116+0000","last_change":"2024-09-17T06:05:26.514923+0000","last_active":"2024-09-17T06:05:33.871116+0000","last_peered":"2024-09-17T06:05:33.871116+0000","last_clean":"2024-09-17T06:05:25.498590+0000","last_became_active":"2024-09-17T06:05:26.514923+0000","last_became_peered":"2024-09-17T06:05:26.514923+0000","last_unstale":"2024-09-17T06:05:33.871116+0000","last_undegraded":"2024-09-17T06:05:26.504387+0000","last_fullsized":"2024-09-17T06:05:26.504286+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:47:25.589409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:33.556474+0000","last_change":"2024-09-17T06:05:26.529579+0000","last_active":"2024-09-17T06:05:33.556474+0000","last_peered":"2024-09-17T06:05:33.556474+0000","last_clean":"2024-09-17T06:05:24.615798+0000","last_became_active":"2024-09-17T06:05:26.529579+0000","last_became_peered":"2024-09-17T06:05:26.529579+0000","last_unstale":"2024-09-17T06:05:33.556474+0000","last_undegraded":"2024-09-17T06:05:33.556474+0000","last_fullsized":"2024-09-17T06:05:26.508117+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:14.953721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2147483647,5],"acting":[0,1,2147483647,5],"avail_no_missing":["0(0)","1(1)","5(3)"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":71,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:34.023542+0000","last_change":"2024-09-17T06:05:26.528753+0000","last_active":"2024-09-17T06:05:34.023542+0000","last_peered":"2024-09-17T06:05:34.023542+0000","last_clean":"2024-09-17T06:05:25.447932+0000","last_became_active":"2024-09-17T06:05:26.528753+0000","last_became_peered":"2024-09-17T06:05:26.528753+0000","last_unstale":"2024-09-17T06:05:34.023542+0000","last_undegraded":"2024-09-17T06:05:34.023542+0000","last_fullsized":"2024-09-17T06:05:26.525940+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:39.795535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":75,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.234908+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:05:37.234908+0000","last_peered":"2024-09-17T06:05:37.234908+0000","last_clean":"2024-09-17T06:05:37.234908+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:05:37.234908+0000","last_undegraded":"2024-09-17T06:05:37.234908+0000","last_fullsized":"2024-09-17T06:05:37.234908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":71,"reported_epoch":52,"state":"active+undersized","last_fresh":"2024-09-17T06:05:39.579936+0000","last_change":"2024-09-17T06:05:26.530626+0000","last_active":"2024-09-17T06:05:39.579936+0000","last_peered":"2024-09-17T06:05:39.579936+0000","last_clean":"2024-09-17T06:05:25.492683+0000","last_became_active":"2024-09-17T06:05:26.530626+0000","last_became_peered":"2024-09-17T06:05:26.530626+0000","last_unstale":"2024-09-17T06:05:39.579936+0000","last_undegraded":"2024-09-17T06:05:39.579936+0000","last_fullsized":"2024-09-17T06:05:26.503773+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:24.411754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2147483647,7,6],"acting":[5,2147483647,7,6],"avail_no_missing":["5(0)","6(3)","7(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":71,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:34.020672+0000","last_change":"2024-09-17T06:05:26.528846+0000","last_active":"2024-09-17T06:05:34.020672+0000","last_peered":"2024-09-17T06:05:34.020672+0000","last_clean":"2024-09-17T06:05:25.447356+0000","last_became_active":"2024-09-17T06:05:26.528846+0000","last_became_peered":"2024-09-17T06:05:26.528846+0000","last_unstale":"2024-09-17T06:05:34.020672+0000","last_undegraded":"2024-09-17T06:05:34.020672+0000","last_fullsized":"2024-09-17T06:05:26.524609+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:10.863689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":35,"reported_epoch":50,"state":"active+undersized+degraded","last_fresh":"2024-09-17T06:05:33.555178+0000","last_change":"2024-09-17T06:05:26.523979+0000","last_active":"2024-09-17T06:05:33.555178+0000","last_peered":"2024-09-17T06:05:33.555178+0000","last_clean":"2024-09-17T06:04:12.915021+0000","last_became_active":"2024-09-17T06:05:26.523979+0000","last_became_peered":"2024-09-17T06:05:26.523979+0000","last_unstale":"2024-09-17T06:05:33.555178+0000","last_undegraded":"2024-09-17T06:05:26.507755+0000","last_fullsized":"2024-09-17T06:05:26.507663+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:37.388698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:33.869635+0000","last_change":"2024-09-17T06:05:26.527644+0000","last_active":"2024-09-17T06:05:33.869635+0000","last_peered":"2024-09-17T06:05:33.869635+0000","last_clean":"2024-09-17T06:04:11.883937+0000","last_became_active":"2024-09-17T06:05:26.527644+0000","last_became_peered":"2024-09-17T06:05:26.527644+0000","last_unstale":"2024-09-17T06:05:33.869635+0000","last_undegraded":"2024-09-17T06:05:33.869635+0000","last_fullsized":"2024-09-17T06:05:26.500937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:35.145148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,1,3,6],"acting":[2147483647,1,3,6],"avail_no_missing":["1(1)","3(2)","6(3)"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":71,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:34.019305+0000","last_change":"2024-09-17T06:05:26.526801+0000","last_active":"2024-09-17T06:05:34.019305+0000","last_peered":"2024-09-17T06:05:34.019305+0000","last_clean":"2024-09-17T06:05:25.446436+0000","last_became_active":"2024-09-17T06:05:26.526801+0000","last_became_peered":"2024-09-17T06:05:26.526801+0000","last_unstale":"2024-09-17T06:05:34.019305+0000","last_undegraded":"2024-09-17T06:05:34.019305+0000","last_fullsized":"2024-09-17T06:05:26.519613+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:24.261950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":81,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.233677+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:05:37.233677+0000","last_peered":"2024-09-17T06:05:37.233677+0000","last_clean":"2024-09-17T06:05:37.233677+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:05:37.233677+0000","last_undegraded":"2024-09-17T06:05:37.233677+0000","last_fullsized":"2024-09-17T06:05:37.233677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":63,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.557416+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:05:33.557416+0000","last_peered":"2024-09-17T06:05:33.557416+0000","last_clean":"2024-09-17T06:05:33.557416+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:05:33.557416+0000","last_undegraded":"2024-09-17T06:05:33.557416+0000","last_fullsized":"2024-09-17T06:05:33.557416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.349855+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:05:37.349855+0000","last_peered":"2024-09-17T06:05:37.349855+0000","last_clean":"2024-09-17T06:05:37.349855+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:05:37.349855+0000","last_undegraded":"2024-09-17T06:05:37.349855+0000","last_fullsized":"2024-09-17T06:05:37.349855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":74,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.350356+0000","last_change":"2024-09-17T06:05:26.530450+0000","last_active":"2024-09-17T06:05:37.350356+0000","last_peered":"2024-09-17T06:05:37.350356+0000","last_clean":"2024-09-17T06:05:24.484597+0000","last_became_active":"2024-09-17T06:05:26.530450+0000","last_became_peered":"2024-09-17T06:05:26.530450+0000","last_unstale":"2024-09-17T06:05:37.350356+0000","last_undegraded":"2024-09-17T06:05:37.350356+0000","last_fullsized":"2024-09-17T06:05:26.520556+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:23.250644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":43,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.023618+0000","last_change":"2024-09-17T06:05:06.897053+0000","last_active":"2024-09-17T06:05:34.023618+0000","last_peered":"2024-09-17T06:05:34.023618+0000","last_clean":"2024-09-17T06:05:34.023618+0000","last_became_active":"2024-09-17T06:05:06.894822+0000","last_became_peered":"2024-09-17T06:05:06.894822+0000","last_unstale":"2024-09-17T06:05:34.023618+0000","last_undegraded":"2024-09-17T06:05:34.023618+0000","last_fullsized":"2024-09-17T06:05:34.023618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:39.031197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":71,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:34.019902+0000","last_change":"2024-09-17T06:05:26.526743+0000","last_active":"2024-09-17T06:05:34.019902+0000","last_peered":"2024-09-17T06:05:34.019902+0000","last_clean":"2024-09-17T06:05:25.446897+0000","last_became_active":"2024-09-17T06:05:26.526743+0000","last_became_peered":"2024-09-17T06:05:26.526743+0000","last_unstale":"2024-09-17T06:05:34.019902+0000","last_undegraded":"2024-09-17T06:05:34.019902+0000","last_fullsized":"2024-09-17T06:05:26.520471+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:16.127017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.581913+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:05:39.581913+0000","last_peered":"2024-09-17T06:05:39.581913+0000","last_clean":"2024-09-17T06:05:39.581913+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:05:39.581913+0000","last_undegraded":"2024-09-17T06:05:39.581913+0000","last_fullsized":"2024-09-17T06:05:39.581913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.870615+0000","last_change":"2024-09-17T06:05:07.036279+0000","last_active":"2024-09-17T06:05:33.870615+0000","last_peered":"2024-09-17T06:05:33.870615+0000","last_clean":"2024-09-17T06:05:33.870615+0000","last_became_active":"2024-09-17T06:05:07.035687+0000","last_became_peered":"2024-09-17T06:05:07.035687+0000","last_unstale":"2024-09-17T06:05:33.870615+0000","last_undegraded":"2024-09-17T06:05:33.870615+0000","last_fullsized":"2024-09-17T06:05:33.870615+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:47.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.555842+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:05:33.555842+0000","last_peered":"2024-09-17T06:05:33.555842+0000","last_clean":"2024-09-17T06:05:33.555842+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:05:33.555842+0000","last_undegraded":"2024-09-17T06:05:33.555842+0000","last_fullsized":"2024-09-17T06:05:33.555842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":76,"reported_epoch":50,"state":"active+undersized+degraded","last_fresh":"2024-09-17T06:05:33.556984+0000","last_change":"2024-09-17T06:05:26.527942+0000","last_active":"2024-09-17T06:05:33.556984+0000","last_peered":"2024-09-17T06:05:33.556984+0000","last_clean":"2024-09-17T06:05:24.616051+0000","last_became_active":"2024-09-17T06:05:26.527942+0000","last_became_peered":"2024-09-17T06:05:26.527942+0000","last_unstale":"2024-09-17T06:05:33.556984+0000","last_undegraded":"2024-09-17T06:05:26.520586+0000","last_fullsized":"2024-09-17T06:05:26.520487+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:28.489070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.583653+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:05:39.583653+0000","last_peered":"2024-09-17T06:05:39.583653+0000","last_clean":"2024-09-17T06:05:39.583653+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:05:39.583653+0000","last_undegraded":"2024-09-17T06:05:39.583653+0000","last_fullsized":"2024-09-17T06:05:39.583653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.022183+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:05:34.022183+0000","last_peered":"2024-09-17T06:05:34.022183+0000","last_clean":"2024-09-17T06:05:34.022183+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:05:34.022183+0000","last_undegraded":"2024-09-17T06:05:34.022183+0000","last_fullsized":"2024-09-17T06:05:34.022183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'13","reported_seq":84,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.351036+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:05:37.351036+0000","last_peered":"2024-09-17T06:05:37.351036+0000","last_clean":"2024-09-17T06:05:37.351036+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:05:37.351036+0000","last_undegraded":"2024-09-17T06:05:37.351036+0000","last_fullsized":"2024-09-17T06:05:37.351036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7968,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.870617+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:05:33.870617+0000","last_peered":"2024-09-17T06:05:33.870617+0000","last_clean":"2024-09-17T06:05:33.870617+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:05:33.870617+0000","last_undegraded":"2024-09-17T06:05:33.870617+0000","last_fullsized":"2024-09-17T06:05:33.870617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:34.019780+0000","last_change":"2024-09-17T06:05:26.528251+0000","last_active":"2024-09-17T06:05:34.019780+0000","last_peered":"2024-09-17T06:05:34.019780+0000","last_clean":"2024-09-17T06:04:07.793905+0000","last_became_active":"2024-09-17T06:05:26.528251+0000","last_became_peered":"2024-09-17T06:05:26.528251+0000","last_unstale":"2024-09-17T06:05:34.019780+0000","last_undegraded":"2024-09-17T06:05:34.019780+0000","last_fullsized":"2024-09-17T06:05:26.521397+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:38.536938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":54,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.584906+0000","last_change":"2024-09-17T06:05:20.635633+0000","last_active":"2024-09-17T06:05:39.584906+0000","last_peered":"2024-09-17T06:05:39.584906+0000","last_clean":"2024-09-17T06:05:39.584906+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:05:39.584906+0000","last_undegraded":"2024-09-17T06:05:39.584906+0000","last_fullsized":"2024-09-17T06:05:39.584906+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:42.262918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":52,"state":"active+undersized","last_fresh":"2024-09-17T06:05:39.582898+0000","last_change":"2024-09-17T06:05:26.522466+0000","last_active":"2024-09-17T06:05:39.582898+0000","last_peered":"2024-09-17T06:05:39.582898+0000","last_clean":"2024-09-17T06:04:11.883937+0000","last_became_active":"2024-09-17T06:05:26.522466+0000","last_became_peered":"2024-09-17T06:05:26.522466+0000","last_unstale":"2024-09-17T06:05:39.582898+0000","last_undegraded":"2024-09-17T06:05:39.582898+0000","last_fullsized":"2024-09-17T06:05:26.505455+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:15.966010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,5,6,1],"acting":[2147483647,5,6,1],"avail_no_missing":["5(1)","1(3)","6(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.555562+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:05:33.555562+0000","last_peered":"2024-09-17T06:05:33.555562+0000","last_clean":"2024-09-17T06:05:33.555562+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:05:33.555562+0000","last_undegraded":"2024-09-17T06:05:33.555562+0000","last_fullsized":"2024-09-17T06:05:33.555562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.583927+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:05:39.583927+0000","last_peered":"2024-09-17T06:05:39.583927+0000","last_clean":"2024-09-17T06:05:39.583927+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:05:39.583927+0000","last_undegraded":"2024-09-17T06:05:39.583927+0000","last_fullsized":"2024-09-17T06:05:39.583927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:33.869466+0000","last_change":"2024-09-17T06:05:26.526715+0000","last_active":"2024-09-17T06:05:33.869466+0000","last_peered":"2024-09-17T06:05:33.869466+0000","last_clean":"2024-09-17T06:05:25.498675+0000","last_became_active":"2024-09-17T06:05:26.526715+0000","last_became_peered":"2024-09-17T06:05:26.526715+0000","last_unstale":"2024-09-17T06:05:33.869466+0000","last_undegraded":"2024-09-17T06:05:33.869466+0000","last_fullsized":"2024-09-17T06:05:26.500302+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:56.445304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,2147483647],"acting":[3,1,6,2147483647],"avail_no_missing":["1(1)","3(0)","6(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.583836+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:05:39.583836+0000","last_peered":"2024-09-17T06:05:39.583836+0000","last_clean":"2024-09-17T06:05:39.583836+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:05:39.583836+0000","last_undegraded":"2024-09-17T06:05:39.583836+0000","last_fullsized":"2024-09-17T06:05:39.583836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.352041+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:05:37.352041+0000","last_peered":"2024-09-17T06:05:37.352041+0000","last_clean":"2024-09-17T06:05:37.352041+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:05:37.352041+0000","last_undegraded":"2024-09-17T06:05:37.352041+0000","last_fullsized":"2024-09-17T06:05:37.352041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":43,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.018411+0000","last_change":"2024-09-17T06:05:06.899365+0000","last_active":"2024-09-17T06:05:34.018411+0000","last_peered":"2024-09-17T06:05:34.018411+0000","last_clean":"2024-09-17T06:05:34.018411+0000","last_became_active":"2024-09-17T06:05:06.895536+0000","last_became_peered":"2024-09-17T06:05:06.895536+0000","last_unstale":"2024-09-17T06:05:34.018411+0000","last_undegraded":"2024-09-17T06:05:34.018411+0000","last_fullsized":"2024-09-17T06:05:34.018411+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:39.702360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":63,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.557298+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:05:33.557298+0000","last_peered":"2024-09-17T06:05:33.557298+0000","last_clean":"2024-09-17T06:05:33.557298+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:05:33.557298+0000","last_undegraded":"2024-09-17T06:05:33.557298+0000","last_fullsized":"2024-09-17T06:05:33.557298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.869894+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:05:33.869894+0000","last_peered":"2024-09-17T06:05:33.869894+0000","last_clean":"2024-09-17T06:05:33.869894+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:05:33.869894+0000","last_undegraded":"2024-09-17T06:05:33.869894+0000","last_fullsized":"2024-09-17T06:05:33.869894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":77,"reported_epoch":52,"state":"active+undersized","last_fresh":"2024-09-17T06:05:39.580802+0000","last_change":"2024-09-17T06:05:26.527007+0000","last_active":"2024-09-17T06:05:39.580802+0000","last_peered":"2024-09-17T06:05:39.580802+0000","last_clean":"2024-09-17T06:05:25.493903+0000","last_became_active":"2024-09-17T06:05:26.527007+0000","last_became_peered":"2024-09-17T06:05:26.527007+0000","last_unstale":"2024-09-17T06:05:39.580802+0000","last_undegraded":"2024-09-17T06:05:39.580802+0000","last_fullsized":"2024-09-17T06:05:26.504611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:37.834862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.351792+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:05:37.351792+0000","last_peered":"2024-09-17T06:05:37.351792+0000","last_clean":"2024-09-17T06:05:37.351792+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:05:37.351792+0000","last_undegraded":"2024-09-17T06:05:37.351792+0000","last_fullsized":"2024-09-17T06:05:37.351792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.554716+0000","last_change":"2024-09-17T06:05:06.872366+0000","last_active":"2024-09-17T06:05:33.554716+0000","last_peered":"2024-09-17T06:05:33.554716+0000","last_clean":"2024-09-17T06:05:33.554716+0000","last_became_active":"2024-09-17T06:05:06.872020+0000","last_became_peered":"2024-09-17T06:05:06.872020+0000","last_unstale":"2024-09-17T06:05:33.554716+0000","last_undegraded":"2024-09-17T06:05:33.554716+0000","last_fullsized":"2024-09-17T06:05:33.554716+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:28.126072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":42,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.350148+0000","last_change":"2024-09-17T06:05:06.888243+0000","last_active":"2024-09-17T06:05:37.350148+0000","last_peered":"2024-09-17T06:05:37.350148+0000","last_clean":"2024-09-17T06:05:37.350148+0000","last_became_active":"2024-09-17T06:05:06.887315+0000","last_became_peered":"2024-09-17T06:05:06.887315+0000","last_unstale":"2024-09-17T06:05:37.350148+0000","last_undegraded":"2024-09-17T06:05:37.350148+0000","last_fullsized":"2024-09-17T06:05:37.350148+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:56.487460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":75,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.350056+0000","last_change":"2024-09-17T06:05:26.517757+0000","last_active":"2024-09-17T06:05:37.350056+0000","last_peered":"2024-09-17T06:05:37.350056+0000","last_clean":"2024-09-17T06:05:24.484591+0000","last_became_active":"2024-09-17T06:05:26.517757+0000","last_became_peered":"2024-09-17T06:05:26.517757+0000","last_unstale":"2024-09-17T06:05:37.350056+0000","last_undegraded":"2024-09-17T06:05:37.350056+0000","last_fullsized":"2024-09-17T06:05:26.512181+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:39.291980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":72,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:33.556810+0000","last_change":"2024-09-17T06:05:26.528194+0000","last_active":"2024-09-17T06:05:33.556810+0000","last_peered":"2024-09-17T06:05:33.556810+0000","last_clean":"2024-09-17T06:05:24.615991+0000","last_became_active":"2024-09-17T06:05:26.528194+0000","last_became_peered":"2024-09-17T06:05:26.528194+0000","last_unstale":"2024-09-17T06:05:33.556810+0000","last_undegraded":"2024-09-17T06:05:33.556810+0000","last_fullsized":"2024-09-17T06:05:26.520952+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:20.071237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.234207+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:05:37.234207+0000","last_peered":"2024-09-17T06:05:37.234207+0000","last_clean":"2024-09-17T06:05:37.234207+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:05:37.234207+0000","last_undegraded":"2024-09-17T06:05:37.234207+0000","last_fullsized":"2024-09-17T06:05:37.234207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.020433+0000","last_change":"2024-09-17T06:05:06.893564+0000","last_active":"2024-09-17T06:05:34.020433+0000","last_peered":"2024-09-17T06:05:34.020433+0000","last_clean":"2024-09-17T06:05:34.020433+0000","last_became_active":"2024-09-17T06:05:06.886434+0000","last_became_peered":"2024-09-17T06:05:06.886434+0000","last_unstale":"2024-09-17T06:05:34.020433+0000","last_undegraded":"2024-09-17T06:05:34.020433+0000","last_fullsized":"2024-09-17T06:05:34.020433+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:27.114766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:33.870725+0000","last_change":"2024-09-17T06:05:26.515650+0000","last_active":"2024-09-17T06:05:33.870725+0000","last_peered":"2024-09-17T06:05:33.870725+0000","last_clean":"2024-09-17T06:04:07.793905+0000","last_became_active":"2024-09-17T06:05:26.515650+0000","last_became_peered":"2024-09-17T06:05:26.515650+0000","last_unstale":"2024-09-17T06:05:33.870725+0000","last_undegraded":"2024-09-17T06:05:33.870725+0000","last_fullsized":"2024-09-17T06:05:26.501576+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:43.274224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+undersized","last_fresh":"2024-09-17T06:05:39.584238+0000","last_change":"2024-09-17T06:05:26.527278+0000","last_active":"2024-09-17T06:05:39.584238+0000","last_peered":"2024-09-17T06:05:39.584238+0000","last_clean":"2024-09-17T06:05:25.493868+0000","last_became_active":"2024-09-17T06:05:26.527278+0000","last_became_peered":"2024-09-17T06:05:26.527278+0000","last_unstale":"2024-09-17T06:05:39.584238+0000","last_undegraded":"2024-09-17T06:05:39.584238+0000","last_fullsized":"2024-09-17T06:05:26.508383+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:09.430406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2147483647,2],"acting":[3,5,2147483647,2],"avail_no_missing":["5(1)","2(3)","3(0)"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.349332+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:05:37.349332+0000","last_peered":"2024-09-17T06:05:37.349332+0000","last_clean":"2024-09-17T06:05:37.349332+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:05:37.349332+0000","last_undegraded":"2024-09-17T06:05:37.349332+0000","last_fullsized":"2024-09-17T06:05:37.349332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.233440+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:05:37.233440+0000","last_peered":"2024-09-17T06:05:37.233440+0000","last_clean":"2024-09-17T06:05:37.233440+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:05:37.233440+0000","last_undegraded":"2024-09-17T06:05:37.233440+0000","last_fullsized":"2024-09-17T06:05:37.233440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.581654+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:05:39.581654+0000","last_peered":"2024-09-17T06:05:39.581654+0000","last_clean":"2024-09-17T06:05:39.581654+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:05:39.581654+0000","last_undegraded":"2024-09-17T06:05:39.581654+0000","last_fullsized":"2024-09-17T06:05:39.581654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.556705+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:05:33.556705+0000","last_peered":"2024-09-17T06:05:33.556705+0000","last_clean":"2024-09-17T06:05:33.556705+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:05:33.556705+0000","last_undegraded":"2024-09-17T06:05:33.556705+0000","last_fullsized":"2024-09-17T06:05:33.556705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":51,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:36.569242+0000","last_change":"2024-09-17T06:05:26.524697+0000","last_active":"2024-09-17T06:05:36.569242+0000","last_peered":"2024-09-17T06:05:36.569242+0000","last_clean":"2024-09-17T06:04:07.793905+0000","last_became_active":"2024-09-17T06:05:26.524697+0000","last_became_peered":"2024-09-17T06:05:26.524697+0000","last_unstale":"2024-09-17T06:05:36.569242+0000","last_undegraded":"2024-09-17T06:05:36.569242+0000","last_fullsized":"2024-09-17T06:05:26.518105+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:26.247450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.871012+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:05:33.871012+0000","last_peered":"2024-09-17T06:05:33.871012+0000","last_clean":"2024-09-17T06:05:33.871012+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:05:33.871012+0000","last_undegraded":"2024-09-17T06:05:33.871012+0000","last_fullsized":"2024-09-17T06:05:33.871012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.352130+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:05:37.352130+0000","last_peered":"2024-09-17T06:05:37.352130+0000","last_clean":"2024-09-17T06:05:37.352130+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:05:37.352130+0000","last_undegraded":"2024-09-17T06:05:37.352130+0000","last_fullsized":"2024-09-17T06:05:37.352130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":51,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:36.569351+0000","last_change":"2024-09-17T06:05:26.524795+0000","last_active":"2024-09-17T06:05:36.569351+0000","last_peered":"2024-09-17T06:05:36.569351+0000","last_clean":"2024-09-17T06:04:07.793905+0000","last_became_active":"2024-09-17T06:05:26.524795+0000","last_became_peered":"2024-09-17T06:05:26.524795+0000","last_unstale":"2024-09-17T06:05:36.569351+0000","last_undegraded":"2024-09-17T06:05:36.569351+0000","last_fullsized":"2024-09-17T06:05:26.518494+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:14.594204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.579895+0000","last_change":"2024-09-17T06:05:13.535655+0000","last_active":"2024-09-17T06:05:39.579895+0000","last_peered":"2024-09-17T06:05:39.579895+0000","last_clean":"2024-09-17T06:05:39.579895+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:05:39.579895+0000","last_undegraded":"2024-09-17T06:05:39.579895+0000","last_fullsized":"2024-09-17T06:05:39.579895+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:26.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":51,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:36.567144+0000","last_change":"2024-09-17T06:05:26.524804+0000","last_active":"2024-09-17T06:05:36.567144+0000","last_peered":"2024-09-17T06:05:36.567144+0000","last_clean":"2024-09-17T06:04:07.793905+0000","last_became_active":"2024-09-17T06:05:26.524804+0000","last_became_peered":"2024-09-17T06:05:26.524804+0000","last_unstale":"2024-09-17T06:05:36.567144+0000","last_undegraded":"2024-09-17T06:05:36.567144+0000","last_fullsized":"2024-09-17T06:05:26.518037+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:38.536938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.581391+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:05:39.581391+0000","last_peered":"2024-09-17T06:05:39.581391+0000","last_clean":"2024-09-17T06:05:39.581391+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:05:39.581391+0000","last_undegraded":"2024-09-17T06:05:39.581391+0000","last_fullsized":"2024-09-17T06:05:39.581391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.556348+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:05:33.556348+0000","last_peered":"2024-09-17T06:05:33.556348+0000","last_clean":"2024-09-17T06:05:33.556348+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:05:33.556348+0000","last_undegraded":"2024-09-17T06:05:33.556348+0000","last_fullsized":"2024-09-17T06:05:33.556348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":72,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.350643+0000","last_change":"2024-09-17T06:05:26.516957+0000","last_active":"2024-09-17T06:05:37.350643+0000","last_peered":"2024-09-17T06:05:37.350643+0000","last_clean":"2024-09-17T06:05:24.485101+0000","last_became_active":"2024-09-17T06:05:26.516957+0000","last_became_peered":"2024-09-17T06:05:26.516957+0000","last_unstale":"2024-09-17T06:05:37.350643+0000","last_undegraded":"2024-09-17T06:05:37.350643+0000","last_fullsized":"2024-09-17T06:05:26.511228+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:08.441371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.022808+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:05:34.022808+0000","last_peered":"2024-09-17T06:05:34.022808+0000","last_clean":"2024-09-17T06:05:34.022808+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:05:34.022808+0000","last_undegraded":"2024-09-17T06:05:34.022808+0000","last_fullsized":"2024-09-17T06:05:34.022808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.234806+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:05:37.234806+0000","last_peered":"2024-09-17T06:05:37.234806+0000","last_clean":"2024-09-17T06:05:37.234806+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:05:37.234806+0000","last_undegraded":"2024-09-17T06:05:37.234806+0000","last_fullsized":"2024-09-17T06:05:37.234806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.584354+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:05:39.584354+0000","last_peered":"2024-09-17T06:05:39.584354+0000","last_clean":"2024-09-17T06:05:39.584354+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:05:39.584354+0000","last_undegraded":"2024-09-17T06:05:39.584354+0000","last_fullsized":"2024-09-17T06:05:39.584354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.580591+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:05:39.580591+0000","last_peered":"2024-09-17T06:05:39.580591+0000","last_clean":"2024-09-17T06:05:39.580591+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:05:39.580591+0000","last_undegraded":"2024-09-17T06:05:39.580591+0000","last_fullsized":"2024-09-17T06:05:39.580591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":70,"reported_epoch":50,"state":"active+undersized","last_fresh":"2024-09-17T06:05:33.869996+0000","last_change":"2024-09-17T06:05:26.514533+0000","last_active":"2024-09-17T06:05:33.869996+0000","last_peered":"2024-09-17T06:05:33.869996+0000","last_clean":"2024-09-17T06:05:25.507061+0000","last_became_active":"2024-09-17T06:05:26.514533+0000","last_became_peered":"2024-09-17T06:05:26.514533+0000","last_unstale":"2024-09-17T06:05:33.869996+0000","last_undegraded":"2024-09-17T06:05:33.869996+0000","last_fullsized":"2024-09-17T06:05:26.501498+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:26.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.555749+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:05:33.555749+0000","last_peered":"2024-09-17T06:05:33.555749+0000","last_clean":"2024-09-17T06:05:33.555749+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:05:33.555749+0000","last_undegraded":"2024-09-17T06:05:33.555749+0000","last_fullsized":"2024-09-17T06:05:33.555749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":41,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.349756+0000","last_change":"2024-09-17T06:05:06.890222+0000","last_active":"2024-09-17T06:05:37.349756+0000","last_peered":"2024-09-17T06:05:37.349756+0000","last_clean":"2024-09-17T06:05:37.349756+0000","last_became_active":"2024-09-17T06:05:06.889365+0000","last_became_peered":"2024-09-17T06:05:06.889365+0000","last_unstale":"2024-09-17T06:05:37.349756+0000","last_undegraded":"2024-09-17T06:05:37.349756+0000","last_fullsized":"2024-09-17T06:05:37.349756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:56.140659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":51,"state":"active+undersized","last_fresh":"2024-09-17T06:05:37.350052+0000","last_change":"2024-09-17T06:05:26.516184+0000","last_active":"2024-09-17T06:05:37.350052+0000","last_peered":"2024-09-17T06:05:37.350052+0000","last_clean":"2024-09-17T06:04:07.793905+0000","last_became_active":"2024-09-17T06:05:26.516184+0000","last_became_peered":"2024-09-17T06:05:26.516184+0000","last_unstale":"2024-09-17T06:05:37.350052+0000","last_undegraded":"2024-09-17T06:05:37.350052+0000","last_fullsized":"2024-09-17T06:05:26.510271+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:47.691985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.349019+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:05:37.349019+0000","last_peered":"2024-09-17T06:05:37.349019+0000","last_clean":"2024-09-17T06:05:37.349019+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:05:37.349019+0000","last_undegraded":"2024-09-17T06:05:37.349019+0000","last_fullsized":"2024-09-17T06:05:37.349019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T06:05:37.349019+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:05:37.349019+0000","last_peered":"2024-09-17T06:05:37.349019+0000","last_clean":"2024-09-17T06:05:37.349019+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:05:37.349019+0000","last_undegraded":"2024-09-17T06:05:37.349019+0000","last_fullsized":"2024-09-17T06:05:37.349019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.023444+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:05:34.023444+0000","last_peered":"2024-09-17T06:05:34.023444+0000","last_clean":"2024-09-17T06:05:34.023444+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:05:34.023444+0000","last_undegraded":"2024-09-17T06:05:34.023444+0000","last_fullsized":"2024-09-17T06:05:34.023444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":43,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.580283+0000","last_change":"2024-09-17T06:05:06.879958+0000","last_active":"2024-09-17T06:05:39.580283+0000","last_peered":"2024-09-17T06:05:39.580283+0000","last_clean":"2024-09-17T06:05:39.580283+0000","last_became_active":"2024-09-17T06:05:06.878960+0000","last_became_peered":"2024-09-17T06:05:06.878960+0000","last_unstale":"2024-09-17T06:05:39.580283+0000","last_undegraded":"2024-09-17T06:05:39.580283+0000","last_fullsized":"2024-09-17T06:05:39.580283+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:01.600278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.018995+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:05:34.018995+0000","last_peered":"2024-09-17T06:05:34.018995+0000","last_clean":"2024-09-17T06:05:34.018995+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:05:34.018995+0000","last_undegraded":"2024-09-17T06:05:34.018995+0000","last_fullsized":"2024-09-17T06:05:34.018995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.581115+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:05:39.581115+0000","last_peered":"2024-09-17T06:05:39.581115+0000","last_clean":"2024-09-17T06:05:39.581115+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:05:39.581115+0000","last_undegraded":"2024-09-17T06:05:39.581115+0000","last_fullsized":"2024-09-17T06:05:39.581115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.019390+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:05:34.019390+0000","last_peered":"2024-09-17T06:05:34.019390+0000","last_clean":"2024-09-17T06:05:34.019390+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:05:34.019390+0000","last_undegraded":"2024-09-17T06:05:34.019390+0000","last_fullsized":"2024-09-17T06:05:34.019390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T06:05:39.582913+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:05:39.582913+0000","last_peered":"2024-09-17T06:05:39.582913+0000","last_clean":"2024-09-17T06:05:39.582913+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:05:39.582913+0000","last_undegraded":"2024-09-17T06:05:39.582913+0000","last_fullsized":"2024-09-17T06:05:39.582913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":69,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.554800+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:05:33.554800+0000","last_peered":"2024-09-17T06:05:33.554800+0000","last_clean":"2024-09-17T06:05:33.554800+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:05:33.554800+0000","last_undegraded":"2024-09-17T06:05:33.554800+0000","last_fullsized":"2024-09-17T06:05:33.554800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:33.871376+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:05:33.871376+0000","last_peered":"2024-09-17T06:05:33.871376+0000","last_clean":"2024-09-17T06:05:33.871376+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:05:33.871376+0000","last_undegraded":"2024-09-17T06:05:33.871376+0000","last_fullsized":"2024-09-17T06:05:33.871376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T06:05:34.023245+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:05:34.023245+0000","last_peered":"2024-09-17T06:05:34.023245+0000","last_clean":"2024-09-17T06:05:34.023245+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:05:34.023245+0000","last_undegraded":"2024-09-17T06:05:34.023245+0000","last_fullsized":"2024-09-17T06:05:34.023245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":109,"acting":109,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8766,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":17532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":57,"acting":57,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":581632,"data_stored":282984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":565248,"data_stored":275016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1175552,"data_stored":866112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1163264,"data_stored":865966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":581632,"data_stored":282984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":503808,"data_stored":232101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":569344,"data_stored":275086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542168,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":289114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:05:42.549 INFO:tasks.thrashosds.thrasher:Setting 4.c to [0, 7, 6, 1, 2, 4, 5, 3] 2024-09-17T06:05:42.549 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.c', '0', '7', '6', '1', '2', '4', '5', '3'] 2024-09-17T06:05:42.549 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.c 0 7 6 1 2 4 5 3 2024-09-17T06:05:42.551 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:42.551 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:42.551 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:05:42.552 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:42.549+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:42.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.593+0000 7fbf9affd640 1 -- 172.21.15.122:0/3004910727 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v53) ==== 91+0+0 (secure 0 0 0) 0x7fbf9405dc90 con 0x7fbfa40c42e0 2024-09-17T06:05:42.596 INFO:teuthology.orchestra.run.smithi122.stderr:noscrub is unset 2024-09-17T06:05:42.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.597+0000 7fbfac425640 1 -- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fbf88073230 msgr2=0x7fbf88075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:42.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.597+0000 7fbfac425640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fbf88073230 0x7fbf88075740 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00b2000 tx=0x7fbfa001d910 comp rx=0 tx=0).stop 2024-09-17T06:05:42.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.597+0000 7fbfac425640 1 -- 172.21.15.122:0/3004910727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfa40c42e0 msgr2=0x7fbfa40c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:42.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.597+0000 7fbfac425640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfa40c42e0 0x7fbfa40c7020 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400b3e0 tx=0x7fbf9400b8a0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.597+0000 7fbfac425640 1 -- 172.21.15.122:0/3004910727 shutdown_connections 2024-09-17T06:05:42.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.597+0000 7fbfac425640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fbf88073230 0x7fbf88075740 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.597+0000 7fbfac425640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfa40c8280 0x7fbfa4146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.597+0000 7fbfac425640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbfa40c42e0 0x7fbfa40c7020 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.597+0000 7fbfac425640 1 --2- 172.21.15.122:0/3004910727 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbfa406e620 0x7fbfa41fe600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.597+0000 7fbfac425640 1 -- 172.21.15.122:0/3004910727 >> 172.21.15.122:0/3004910727 conn(0x7fbfa40ca380 msgr2=0x7fbfa414d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:42.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.597+0000 7fbfac425640 1 -- 172.21.15.122:0/3004910727 shutdown_connections 2024-09-17T06:05:42.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.597+0000 7fbfac425640 1 -- 172.21.15.122:0/3004910727 wait complete. 2024-09-17T06:05:42.676 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:42.673+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:42.753 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:42.749+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:42.811 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:42.811 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.817+0000 7fe03e75e640 1 -- 172.21.15.122:0/29283808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0380c3ad0 msgr2=0x7fe03814fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.817+0000 7fe03e75e640 1 --2- 172.21.15.122:0/29283808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0380c3ad0 0x7fe03814fb30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe03806d020 tx=0x7fe02801c720 comp rx=0 tx=0).stop 2024-09-17T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.817+0000 7fe03e75e640 1 -- 172.21.15.122:0/29283808 shutdown_connections 2024-09-17T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.817+0000 7fe03e75e640 1 --2- 172.21.15.122:0/29283808 >> v2:172.21.15.122:3300/0 conn(0x7fe0380b2c70 0x7fe038072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.817+0000 7fe03e75e640 1 --2- 172.21.15.122:0/29283808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0380c3ad0 0x7fe03814fb30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.817+0000 7fe03e75e640 1 -- 172.21.15.122:0/29283808 >> 172.21.15.122:0/29283808 conn(0x7fe0380ccb60 msgr2=0x7fe0380ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.817+0000 7fe03e75e640 1 -- 172.21.15.122:0/29283808 shutdown_connections 2024-09-17T06:05:42.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.817+0000 7fe03e75e640 1 -- 172.21.15.122:0/29283808 wait complete. 2024-09-17T06:05:42.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.817+0000 7fe03e75e640 1 Processor -- start 2024-09-17T06:05:42.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe03e75e640 1 -- start start 2024-09-17T06:05:42.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe03e75e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe038072980 0x7fe0381e2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe03e75e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0380b2c70 0x7fe038148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe037fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe038072980 0x7fe0381e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe037fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe038072980 0x7fe0381e2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40514/0 (socket says 172.21.15.122:40514) 2024-09-17T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe037fff640 1 -- 172.21.15.122:0/3057015789 learned_addr learned my addr 172.21.15.122:0/3057015789 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe03e75e640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0380c3ad0 0x7fe0381e0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe03e75e640 1 -- 172.21.15.122:0/3057015789 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe038153650 con 0x7fe038072980 2024-09-17T06:05:42.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe03e75e640 1 -- 172.21.15.122:0/3057015789 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe038159d70 con 0x7fe0380b2c70 2024-09-17T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe03e75e640 1 -- 172.21.15.122:0/3057015789 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe0380c6980 con 0x7fe0380c3ad0 2024-09-17T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe02ffff640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0380b2c70 0x7fe038148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe03ccfb640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0380c3ad0 0x7fe0381e0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe037fff640 1 -- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0380c3ad0 msgr2=0x7fe0381e0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe037fff640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0380c3ad0 0x7fe0381e0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe037fff640 1 -- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0380b2c70 msgr2=0x7fe038148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe037fff640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0380b2c70 0x7fe038148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe037fff640 1 -- 172.21.15.122:0/3057015789 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe038149110 con 0x7fe038072980 2024-09-17T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe037fff640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe038072980 0x7fe0381e2570 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe02801add0 tx=0x7fe0280045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe0357fa640 1 -- 172.21.15.122:0/3057015789 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028005440 con 0x7fe038072980 2024-09-17T06:05:42.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe0357fa640 1 -- 172.21.15.122:0/3057015789 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0280b9030 con 0x7fe038072980 2024-09-17T06:05:42.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe0357fa640 1 -- 172.21.15.122:0/3057015789 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028004930 con 0x7fe038072980 2024-09-17T06:05:42.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.821+0000 7fe03e75e640 1 -- 172.21.15.122:0/3057015789 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0381493f0 con 0x7fe038072980 2024-09-17T06:05:42.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.825+0000 7fe0357fa640 1 -- 172.21.15.122:0/3057015789 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe028004ad0 con 0x7fe038072980 2024-09-17T06:05:42.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.825+0000 7fe0357fa640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe018073200 0x7fe018075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:42.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.825+0000 7fe03e75e640 1 -- 172.21.15.122:0/3057015789 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0381499b0 con 0x7fe038072980 2024-09-17T06:05:42.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.825+0000 7fe02ffff640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe018073200 0x7fe018075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:42.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.829+0000 7fe02ffff640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe018073200 0x7fe018075710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe0381e2330 tx=0x7fe0200091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:42.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.829+0000 7fe02e7fc640 1 -- 172.21.15.122:0/3057015789 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0100052a0 con 0x7fe038072980 2024-09-17T06:05:42.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.829+0000 7fe0357fa640 1 -- 172.21.15.122:0/3057015789 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6804+0+0 (secure 0 0 0) 0x7fe028004dc0 con 0x7fe038072980 2024-09-17T06:05:42.835 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:05:42.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:42.837+0000 7fe0357fa640 1 -- 172.21.15.122:0/3057015789 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe028016310 con 0x7fe038072980 2024-09-17T06:05:42.888 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:42.885+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:42.910 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:05:42.956 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:42.953+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:43.048 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:43.048 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:43.056 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:43.053+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:43.071 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:05:43.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.105+0000 7f0a73104640 1 -- 172.21.15.122:0/1264466738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a6c14e9b0 msgr2=0x7f0a6c0c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:43.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.105+0000 7f0a73104640 1 --2- 172.21.15.122:0/1264466738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a6c14e9b0 0x7f0a6c0c88e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0b3cb0 tx=0x7f0a5801f0d0 comp rx=0 tx=0).stop 2024-09-17T06:05:43.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.105+0000 7f0a73104640 1 -- 172.21.15.122:0/1264466738 shutdown_connections 2024-09-17T06:05:43.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.105+0000 7f0a73104640 1 --2- 172.21.15.122:0/1264466738 >> v2:172.21.15.173:3300/0 conn(0x7f0a6c0c8e20 0x7f0a6c162960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:43.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.105+0000 7f0a73104640 1 --2- 172.21.15.122:0/1264466738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a6c14e9b0 0x7f0a6c0c88e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:43.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.105+0000 7f0a73104640 1 -- 172.21.15.122:0/1264466738 >> 172.21.15.122:0/1264466738 conn(0x7f0a6c0739c0 msgr2=0x7f0a6c0ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:43.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.105+0000 7f0a73104640 1 -- 172.21.15.122:0/1264466738 shutdown_connections 2024-09-17T06:05:43.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.105+0000 7f0a73104640 1 -- 172.21.15.122:0/1264466738 wait complete. 2024-09-17T06:05:43.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.109+0000 7f0a73104640 1 Processor -- start 2024-09-17T06:05:43.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.109+0000 7f0a73104640 1 -- start start 2024-09-17T06:05:43.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a73104640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a6c0c40e0 0x7f0a6c1e0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:43.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a73104640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a6c0c8e20 0x7f0a6c1de350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:43.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a73104640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a6c14e9b0 0x7f0a6c145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:43.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a73104640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c0c9ec0 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a73104640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c1583d0 con 0x7f0a6c0c8e20 2024-09-17T06:05:43.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a73104640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0a6c14edc0 con 0x7f0a6c14e9b0 2024-09-17T06:05:43.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a70ea0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a6c0c40e0 0x7f0a6c1e0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:43.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a70ea0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a6c0c40e0 0x7f0a6c1e0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40530/0 (socket says 172.21.15.122:40530) 2024-09-17T06:05:43.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a70ea0640 1 -- 172.21.15.122:0/3612401245 learned_addr learned my addr 172.21.15.122:0/3612401245 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:43.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a6bfff640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a6c0c8e20 0x7f0a6c1de350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:43.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a716a1640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a6c14e9b0 0x7f0a6c145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:43.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a70ea0640 1 -- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a6c14e9b0 msgr2=0x7f0a6c145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:43.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a70ea0640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a6c14e9b0 0x7f0a6c145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:43.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a70ea0640 1 -- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a6c0c8e20 msgr2=0x7f0a6c1de350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:43.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a70ea0640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a6c0c8e20 0x7f0a6c1de350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:43.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a70ea0640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6c1e05c0 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a716a1640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a6c14e9b0 0x7f0a6c145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:05:43.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a70ea0640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a6c0c40e0 0x7f0a6c1e0080 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000b440 tx=0x7f0a6000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:43.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60015020 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a60011980 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60011dd0 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6c1dee60 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.113+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a6c1e2f80 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.117+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0a60018020 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.117+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f0a6c1525f0 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.117+0000 7f0a697fa640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0a50073200 0x7f0a50075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:43.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.117+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6804+0+0 (secure 0 0 0) 0x7f0a600948d0 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.117+0000 7f0a6bfff640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0a50073200 0x7f0a50075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:43.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.117+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v53) ==== 54+0+16 (secure 0 0 0) 0x7f0a6001f020 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.117+0000 7f0a73104640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f0a6c1ee710 0x7f0a6c156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:43.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.117+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a6c1f6fa0 con 0x7f0a6c1ee710 2024-09-17T06:05:43.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.121+0000 7f0a6bfff640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0a50073200 0x7f0a50075710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a580b2000 tx=0x7f0a5801d910 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:43.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.121+0000 7f0a716a1640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f0a6c1ee710 0x7f0a6c156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:43.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.121+0000 7f0a716a1640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f0a6c1ee710 0x7f0a6c156e40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:43.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.121+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a6c1f6fa0 con 0x7f0a6c1ee710 2024-09-17T06:05:43.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.149+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f0a6c1e3ed0 con 0x7f0a6c1ee710 2024-09-17T06:05:43.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.153+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0a6c1e3ed0 con 0x7f0a6c1ee710 2024-09-17T06:05:43.157 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:43.157 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:43.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.153+0000 7f0a73104640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f0a6c1f2190 0x7f0a6c1f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:43.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.153+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f0a6c1f2ae0 con 0x7f0a6c1f2190 2024-09-17T06:05:43.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.153+0000 7f0a70ea0640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f0a6c1f2190 0x7f0a6c1f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:43.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.153+0000 7f0a70ea0640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f0a6c1f2190 0x7f0a6c1f25a0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:43.158 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:43.153+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:43.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.153+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a6c1f2ae0 con 0x7f0a6c1f2190 2024-09-17T06:05:43.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.181+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f0a6c1dfeb0 con 0x7f0a6c1f2190 2024-09-17T06:05:43.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.185+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0a6c1dfeb0 con 0x7f0a6c1f2190 2024-09-17T06:05:43.188 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:43.189 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:43.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.185+0000 7f0a73104640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f0a6c063dc0 0x7f0a6c0641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:43.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.185+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f0a6c1e3910 con 0x7f0a6c063dc0 2024-09-17T06:05:43.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.185+0000 7f0a6bfff640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f0a6c063dc0 0x7f0a6c0641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:43.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.185+0000 7f0a6bfff640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f0a6c063dc0 0x7f0a6c0641d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:43.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.185+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a6c1e3910 con 0x7f0a6c063dc0 2024-09-17T06:05:43.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.189+0000 7fe02e7fc640 1 -- 172.21.15.122:0/3057015789 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pg-upmap-items", "pgid": "4.c", "id": [0, 7, 6, 1, 2, 4, 5, 3]} v 0) -- 0x7fe010005860 con 0x7fe038072980 2024-09-17T06:05:43.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.213+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f0a6c1e3910 con 0x7f0a6c063dc0 2024-09-17T06:05:43.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.217+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0a6c1e3910 con 0x7f0a6c063dc0 2024-09-17T06:05:43.224 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:43.224 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:43.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.221+0000 7f0a73104640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f0a6c02d9e0 0x7f0a6c02ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:43.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.221+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f0a6c1e36b0 con 0x7f0a6c02d9e0 2024-09-17T06:05:43.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.221+0000 7f0a716a1640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f0a6c02d9e0 0x7f0a6c02ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:43.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.221+0000 7f0a716a1640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f0a6c02d9e0 0x7f0a6c02ddf0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:43.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.221+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a64012ba0 con 0x7f0a6c02d9e0 2024-09-17T06:05:43.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.249+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f0a6c1de940 con 0x7f0a6c02d9e0 2024-09-17T06:05:43.255 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.249+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0a6c1de940 con 0x7f0a6c02d9e0 2024-09-17T06:05:43.255 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:43.256 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:43.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.253+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=54}) -- 0x7f0a6c1de940 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.253+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a6c0cbc90 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.253+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f0a6005e810 con 0x7f0a6c0c40e0 2024-09-17T06:05:43.257 INFO:teuthology.orchestra.run.smithi122.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-17T06:05:43.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.253+0000 7f0a73104640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f0a6c1e3150 0x7f0a6c209df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:43.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.253+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 10: {"prefix": "get_command_descriptions"}) -- 0x7f0a6c02e8f0 con 0x7f0a6c1e3150 2024-09-17T06:05:43.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.253+0000 7f0a70ea0640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f0a6c1e3150 0x7f0a6c209df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:43.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.253+0000 7f0a70ea0640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f0a6c1e3150 0x7f0a6c209df0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:43.258 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:43.253+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:43.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.257+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 10: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a6c02e8f0 con 0x7f0a6c1e3150 2024-09-17T06:05:43.280 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 180, 2024-09-17T06:05:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-09-17T06:05:43.281 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:43.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.281+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f0a6c06d530 con 0x7f0a6c1e3150 2024-09-17T06:05:43.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.285+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 11: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0a6c06d530 con 0x7f0a6c1e3150 2024-09-17T06:05:43.291 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:43.291 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:43.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.285+0000 7f0a73104640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f0a6c20a840 0x7f0a6c20cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:43.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.285+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7f0a6c1ff410 con 0x7f0a6c20a840 2024-09-17T06:05:43.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.289+0000 7f0a6bfff640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f0a6c20a840 0x7f0a6c20cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:43.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.289+0000 7f0a6bfff640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f0a6c20a840 0x7f0a6c20cc60 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:43.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.289+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a580043e0 con 0x7f0a6c20a840 2024-09-17T06:05:43.297 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:05:43.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.317+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f0a6c1e2690 con 0x7f0a6c20a840 2024-09-17T06:05:43.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.321+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0a6c1e2690 con 0x7f0a6c20a840 2024-09-17T06:05:43.324 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:43.325 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:43.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.321+0000 7f0a73104640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f0a6c20d6b0 0x7f0a6c20fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:43.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.321+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7f0a6c212a50 con 0x7f0a6c20d6b0 2024-09-17T06:05:43.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.321+0000 7f0a716a1640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f0a6c20d6b0 0x7f0a6c20fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:43.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.321+0000 7f0a716a1640 1 --2- 172.21.15.122:0/3612401245 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f0a6c20d6b0 0x7f0a6c20fad0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:43.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.325+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a6c212a50 con 0x7f0a6c20d6b0 2024-09-17T06:05:43.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.337+0000 7f0a73104640 1 -- 172.21.15.122:0/3612401245 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f0a6c1e2a10 con 0x7f0a6c20d6b0 2024-09-17T06:05:43.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.341+0000 7f0a697fa640 1 -- 172.21.15.122:0/3612401245 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0a6c1e2a10 con 0x7f0a6c20d6b0 2024-09-17T06:05:43.347 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:43.347 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:43.354 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T06:05:43.355 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T06:05:43.400 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:43.397+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:43.460 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:43.457+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:43.530 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:43.530 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:43.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:43.530 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.707463693999998, 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014374336, 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:43.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:43.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821526+0000", 2024-09-17T06:05:43.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6859999999999999e-06 2024-09-17T06:05:43.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821553+0000", 2024-09-17T06:05:43.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6329000000000002e-05 2024-09-17T06:05:43.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821592+0000", 2024-09-17T06:05:43.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9588000000000001e-05 2024-09-17T06:05:43.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821624+0000", 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1814999999999999e-05 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822106+0000", 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00048212400000000001 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822852+0000", 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000745303 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:43.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823189+0000", 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000337244 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828285+0000", 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050956680000000002 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835635+0000", 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0073502960000000001 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835771+0000", 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000136219 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835897+0000", 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126064 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.536 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.707166012000002, 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014596456000000001, 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:43.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821823+0000", 2024-09-17T06:05:43.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.17e-06 2024-09-17T06:05:43.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821837+0000", 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3845999999999999e-05 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821872+0000", 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5024999999999998e-05 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821896+0000", 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4669e-05 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824176+0000", 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022794389999999999 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824408+0000", 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000232258 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824824+0000", 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00041565999999999999 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829781+0000", 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049579250000000002 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836070+0000", 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062883740000000002 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836286+0000", 2024-09-17T06:05:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021609299999999999 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836417+0000", 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013099699999999999 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.707047548000006, 2024-09-17T06:05:43.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014884692, 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:43.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821941+0000", 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.784e-06 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821990+0000", 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9481000000000003e-05 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822015+0000", 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4552000000000001e-05 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822062+0000", 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7351000000000001e-05 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825585+0000", 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003522458 2024-09-17T06:05:43.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825895+0000", 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031071499999999998 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826221+0000", 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032602400000000001 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829803+0000", 2024-09-17T06:05:43.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035817359999999999 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836527+0000", 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067239919999999998 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836663+0000", 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013620700000000001 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836824+0000", 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016039200000000001 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.706893171999994, 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01512869, 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.548 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822095+0000", 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9829999999999999e-06 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822105+0000", 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5130000000000002e-06 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822125+0000", 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9953e-05 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822144+0000", 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9089e-05 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826898+0000", 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047542740000000002 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827131+0000", 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023258900000000001 2024-09-17T06:05:43.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827568+0000", 2024-09-17T06:05:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00043743200000000002 2024-09-17T06:05:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834712+0000", 2024-09-17T06:05:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0071437489999999996 2024-09-17T06:05:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836963+0000", 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022512769999999999 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837108+0000", 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014485 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837222+0000", 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011398100000000001 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.553 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.706817645000001, 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015488435, 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822171+0000", 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9800000000000001e-06 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822180+0000", 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7290000000000006e-06 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822198+0000", 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8868999999999998e-05 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822217+0000", 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006163712 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828723+0000", 2024-09-17T06:05:43.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034318 2024-09-17T06:05:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829070+0000", 2024-09-17T06:05:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034623299999999999 2024-09-17T06:05:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:43.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834728+0000", 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056585519999999999 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837392+0000", 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026634800000000002 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837551+0000", 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015923900000000001 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837657+0000", 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010631799999999999 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.706742922999993, 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015871963999999999, 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.560 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822245+0000", 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5969999999999999e-06 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822263+0000", 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8241999999999999e-05 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822283+0000", 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9466e-05 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822300+0000", 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6898999999999999e-05 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829910+0000", 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00760979 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.830145+0000", 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023562100000000001 2024-09-17T06:05:43.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.830638+0000", 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00049317000000000002 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834742+0000", 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041036470000000002 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837872+0000", 2024-09-17T06:05:43.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031295670000000002 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838036+0000", 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016482899999999999 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838116+0000", 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9135999999999996e-05 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.706646333999998, 2024-09-17T06:05:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016065354, 2024-09-17T06:05:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822342+0000", 2024-09-17T06:05:43.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-09-17T06:05:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822349+0000", 2024-09-17T06:05:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6569999999999997e-06 2024-09-17T06:05:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822368+0000", 2024-09-17T06:05:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9074999999999999e-05 2024-09-17T06:05:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822412+0000", 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4115e-05 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.831389+0000", 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089769659999999994 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.831743+0000", 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035332899999999999 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832133+0000", 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000390221 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834756+0000", 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026229500000000002 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838251+0000", 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034947390000000002 2024-09-17T06:05:43.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838336+0000", 2024-09-17T06:05:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5679000000000004e-05 2024-09-17T06:05:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838406+0000", 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9280000000000001e-05 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.706544879000006, 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016193883999999999, 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.572 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822443+0000", 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7370000000000001e-06 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822452+0000", 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5259999999999993e-06 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822480+0000", 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7781999999999999e-05 2024-09-17T06:05:43.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822497+0000", 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7139e-05 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833259+0000", 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010762386000000001 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833684+0000", 2024-09-17T06:05:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00042440300000000001 2024-09-17T06:05:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834089+0000", 2024-09-17T06:05:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000405556 2024-09-17T06:05:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838148+0000", 2024-09-17T06:05:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040588760000000003 2024-09-17T06:05:43.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838479+0000", 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033078399999999998 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838567+0000", 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8661999999999999e-05 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838636+0000", 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8033000000000004e-05 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.706455622999997, 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012308227, 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.578 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822532+0000", 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.57e-06 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822541+0000", 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9090000000000006e-06 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822572+0000", 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1099000000000002e-05 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822591+0000", 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8462e-05 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822777+0000", 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018563100000000001 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823110+0000", 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000333574 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823419+0000", 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030839499999999999 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826081+0000", 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026627999999999999 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834551+0000", 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084693679999999997 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834714+0000", 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000162969 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834839+0000", 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012545000000000001 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.706352702000004, 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012689499, 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822635+0000", 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.637e-06 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822654+0000", 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8362000000000001e-05 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822678+0000", 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513000000000001e-05 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822698+0000", 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9468999999999999e-05 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014675910000000001 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824388+0000", 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022300600000000001 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824756+0000", 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036741900000000001 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827411+0000", 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00265526 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835045+0000", 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076339290000000002 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835197+0000", 2024-09-17T06:05:43.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000151736 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835323+0000", 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126577 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:22 2.e e25/19 ondisk, result = 0)", 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.694699741999997, 2024-09-17T06:05:43.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00058930099999999997, 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:43.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834289+0000", 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.216e-06 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834304+0000", 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5255999999999999e-05 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834335+0000", 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0397999999999999e-05 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834359+0000", 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4799000000000001e-05 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834505+0000", 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014551700000000001 2024-09-17T06:05:43.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834530+0000", 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5128999999999999e-05 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834876+0000", 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000345986 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:23 2.e e25/19 ondisk, result = 0)", 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.694568359000002, 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093485499999999995, 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834420+0000", 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5099999999999999e-06 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834428+0000", 2024-09-17T06:05:43.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7399999999999993e-06 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834449+0000", 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0738999999999999e-05 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834471+0000", 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1979000000000001e-05 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835003+0000", 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053146400000000005 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835027+0000", 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4681999999999998e-05 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835353+0000", 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000325741 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.597 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:6 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.693604499000003, 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053156399999999999, 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835384+0000", 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9700000000000002e-06 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835397+0000", 2024-09-17T06:05:43.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2903e-05 2024-09-17T06:05:43.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835427+0000", 2024-09-17T06:05:43.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9935000000000001e-05 2024-09-17T06:05:43.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835451+0000", 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4581999999999999e-05 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835592+0000", 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0001406 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835616+0000", 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4505e-05 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835914+0000", 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029706900000000001 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:7 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.693486078000007, 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00094147399999999998, 2024-09-17T06:05:43.602 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835502+0000", 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2729999999999999e-06 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835511+0000", 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1730000000000001e-06 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835531+0000", 2024-09-17T06:05:43.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9769e-05 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835548+0000", 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6878999999999999e-05 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836026+0000", 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00047839999999999997 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836048+0000", 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1886e-05 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836442+0000", 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000394094 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.606 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:8 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.693412821999999, 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001278288, 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835575+0000", 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.077e-06 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835582+0000", 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-09-17T06:05:43.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835599+0000", 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7235999999999999e-05 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835614+0000", 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5096000000000001e-05 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836506+0000", 2024-09-17T06:05:43.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00089209599999999999 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836518+0000", 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-05 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836852+0000", 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033404000000000002 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:9 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.693349155000007, 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001612018, 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835638+0000", 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.054e-06 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835646+0000", 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1520000000000003e-06 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835666+0000", 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0795999999999999e-05 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835702+0000", 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5379000000000001e-05 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836928+0000", 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001225903 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836948+0000", 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0628999999999998e-05 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837249+0000", 2024-09-17T06:05:43.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030110500000000002 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:10 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.693251410000002, 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019419420000000001, 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:43.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:43.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835736+0000", 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.06e-06 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835743+0000", 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1330000000000001e-06 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835762+0000", 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8839999999999999e-05 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835778+0000", 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5498999999999998e-05 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837364+0000", 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015863190000000001 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837379+0000", 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4749000000000001e-05 2024-09-17T06:05:43.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837677+0000", 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298342 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:11 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.692912032999999, 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002079029, 2024-09-17T06:05:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836077+0000", 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.103e-06 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836092+0000", 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.503e-05 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836123+0000", 2024-09-17T06:05:43.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1031000000000002e-05 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836147+0000", 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4019000000000002e-05 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837816+0000", 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001669299 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837847+0000", 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1464999999999998e-05 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838153+0000", 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000306082 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:12 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:43.623 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.692748340999998, 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021818900000000001, 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836240+0000", 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.59e-06 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836269+0000", 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9275e-05 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836291+0000", 2024-09-17T06:05:43.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1515999999999999e-05 2024-09-17T06:05:43.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836308+0000", 2024-09-17T06:05:43.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7728999999999999e-05 2024-09-17T06:05:43.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838225+0000", 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001916453 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838238+0000", 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2806000000000001e-05 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838420+0000", 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000182521 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.627 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:13 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.691700921999995, 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001366047, 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:43.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837287+0000", 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.823e-06 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:43.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837301+0000", 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3910000000000001e-05 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837323+0000", 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1379e-05 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837339+0000", 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6762e-05 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838456+0000", 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011162050000000001 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838470+0000", 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.453e-05 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838652+0000", 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018143799999999999 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.631 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.632 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.632 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:43.632 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:43.632 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:43.633 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:05:43.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.601+0000 7fe0357fa640 1 -- 172.21.15.122:0/3057015789 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pg-upmap-items", "pgid": "4.c", "id": [0, 7, 6, 1, 2, 4, 5, 3]}]=0 set 4.c pg_upmap_items mapping to [0->7,6->1,2->4,5->3] v54) ==== 168+0+0 (secure 0 0 0) 0x7fe0280fcad0 con 0x7fe038072980 2024-09-17T06:05:43.634 INFO:teuthology.orchestra.run.smithi122.stderr:set 4.c pg_upmap_items mapping to [0->7,6->1,2->4,5->3] 2024-09-17T06:05:43.634 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.601+0000 7fe02e7fc640 1 -- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe018073200 msgr2=0x7fe018075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:43.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.601+0000 7fe02e7fc640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe018073200 0x7fe018075710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe0381e2330 tx=0x7fe0200091e0 comp rx=0 tx=0).stop 2024-09-17T06:05:43.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.601+0000 7fe02e7fc640 1 -- 172.21.15.122:0/3057015789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe038072980 msgr2=0x7fe0381e2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:43.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.601+0000 7fe02e7fc640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe038072980 0x7fe0381e2570 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe02801add0 tx=0x7fe0280045f0 comp rx=0 tx=0).stop 2024-09-17T06:05:43.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.601+0000 7fe02e7fc640 1 -- 172.21.15.122:0/3057015789 shutdown_connections 2024-09-17T06:05:43.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.601+0000 7fe02e7fc640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0380c3ad0 0x7fe0381e0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:43.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.601+0000 7fe02e7fc640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe018073200 0x7fe018075710 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:43.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.601+0000 7fe02e7fc640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0380b2c70 0x7fe038148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:43.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.601+0000 7fe02e7fc640 1 --2- 172.21.15.122:0/3057015789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe038072980 0x7fe0381e2570 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:43.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.601+0000 7fe02e7fc640 1 -- 172.21.15.122:0/3057015789 >> 172.21.15.122:0/3057015789 conn(0x7fe0380ccb60 msgr2=0x7fe0380ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:43.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.605+0000 7fe02e7fc640 1 -- 172.21.15.122:0/3057015789 shutdown_connections 2024-09-17T06:05:43.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:43.605+0000 7fe02e7fc640 1 -- 172.21.15.122:0/3057015789 wait complete. 2024-09-17T06:05:43.635 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:43.629+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:43.734 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:43.733+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:43.834 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:43.829+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:43.881 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:43.882 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:43.882 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-09-17T06:05:43.882 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:43.903 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:05:43.936 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:43.933+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:44.037 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:44.037+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:44.138 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:44.133+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:44.149 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:44.149 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:44.150 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 180, 2024-09-17T06:05:44.150 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-09-17T06:05:44.150 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:44.172 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:05:44.240 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:44.237+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:44.340 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:44.337+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:44.420 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:44.420 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:44.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:44.420 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:44.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.420 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.595896187999998, 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044462499999999997, 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823264+0000", 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3300000000000001e-06 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823284+0000", 2024-09-17T06:05:44.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0132e-05 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823364+0000", 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9583e-05 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823395+0000", 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1171999999999999e-05 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823538+0000", 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014286600000000001 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823594+0000", 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890999999999997e-05 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827597+0000", 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004003665 2024-09-17T06:05:44.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827708+0000", 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110611 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.595703736999994, 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043686330000000002, 2024-09-17T06:05:44.425 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823455+0000", 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2160000000000001e-06 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823471+0000", 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5702999999999999e-05 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823492+0000", 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1039e-05 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823512+0000", 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0364999999999999e-05 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824294+0000", 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00078187600000000003 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824350+0000", 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5367e-05 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827719+0000", 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003368916 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827823+0000", 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104151 2024-09-17T06:05:44.429 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.595142957999997, 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0094234149999999992, 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824018+0000", 2024-09-17T06:05:44.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3629999999999998e-06 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824036+0000", 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7606000000000001e-05 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824065+0000", 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9005000000000001e-05 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824092+0000", 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7396e-05 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826491+0000", 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002398776 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826804+0000", 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000312782 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833438+0000", 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066344869999999997 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.595072974999994, 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048433540000000002, 2024-09-17T06:05:44.434 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824087+0000", 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1830000000000001e-06 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824106+0000", 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8595999999999999e-05 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824137+0000", 2024-09-17T06:05:44.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1322000000000003e-05 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824164+0000", 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6605e-05 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824807+0000", 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064339900000000001 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824861+0000", 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3687000000000003e-05 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828809+0000", 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039483909999999999 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828928+0000", 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119171 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.438 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.439 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.439 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:44.439 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:44.439 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.594992305999995, 2024-09-17T06:05:44.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092145760000000004, 2024-09-17T06:05:44.439 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.439 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.439 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824167+0000", 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7540000000000001e-06 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824178+0000", 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0276e-05 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824202+0000", 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4685000000000002e-05 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824223+0000", 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1036e-05 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825070+0000", 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084684500000000004 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825392+0000", 2024-09-17T06:05:44.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032213499999999998 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833380+0000", 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079878450000000004 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.593987374999998, 2024-09-17T06:05:44.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038480469999999998, 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:44.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825172+0000", 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.967e-06 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825190+0000", 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7866000000000001e-05 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825217+0000", 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6682e-05 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825239+0000", 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1968999999999999e-05 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825632+0000", 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00039355100000000001 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825690+0000", 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7797000000000002e-05 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828935+0000", 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032449449999999999 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829018+0000", 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3269999999999994e-05 2024-09-17T06:05:44.447 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.592932872000006, 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002834755, 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826227+0000", 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.906e-06 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826256+0000", 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8872000000000001e-05 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826399+0000", 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143156 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826453+0000", 2024-09-17T06:05:44.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4465000000000001e-05 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826628+0000", 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017420700000000001 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829060+0000", 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024321490000000002 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.591182240999998, 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055191049999999998, 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:44.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827978+0000", 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0200000000000001e-06 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827997+0000", 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9836000000000001e-05 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828029+0000", 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1720999999999997e-05 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828055+0000", 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5519000000000001e-05 2024-09-17T06:05:44.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828193+0000", 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013821699999999999 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828232+0000", 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9351000000000003e-05 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833396+0000", 2024-09-17T06:05:44.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051640119999999999 2024-09-17T06:05:44.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833495+0000", 2024-09-17T06:05:44.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8429000000000002e-05 2024-09-17T06:05:44.456 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.456 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.456 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.456 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:44.456 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.591056699999996, 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054928850000000003, 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828102+0000", 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-06 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828116+0000", 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3716e-05 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828139+0000", 2024-09-17T06:05:44.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3028999999999999e-05 2024-09-17T06:05:44.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828156+0000", 2024-09-17T06:05:44.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869000000000001e-05 2024-09-17T06:05:44.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829124+0000", 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096778700000000001 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829158+0000", 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4671000000000001e-05 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833509+0000", 2024-09-17T06:05:44.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004350802 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833594+0000", 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4814999999999993e-05 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.586305475000003, 2024-09-17T06:05:44.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064859200000000003, 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832854+0000", 2024-09-17T06:05:44.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8330000000000001e-06 2024-09-17T06:05:44.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832867+0000", 2024-09-17T06:05:44.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.332e-05 2024-09-17T06:05:44.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832906+0000", 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8800999999999997e-05 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6468000000000003e-05 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833094+0000", 2024-09-17T06:05:44.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014082600000000001 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833501+0000", 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040734400000000002 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:44.465 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.586208670000005, 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00050376900000000005, 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:44.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832952+0000", 2024-09-17T06:05:44.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4269999999999998e-06 2024-09-17T06:05:44.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832965+0000", 2024-09-17T06:05:44.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3736e-05 2024-09-17T06:05:44.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832998+0000", 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2264999999999997e-05 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833027+0000", 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9658999999999998e-05 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833172+0000", 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014431900000000001 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833453+0000", 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028136300000000002 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-17T06:05:44.469 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.584211733999993, 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00294042, 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834948+0000", 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.21e-06 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834968+0000", 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9443e-05 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835013+0000", 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5324000000000002e-05 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835038+0000", 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5358999999999999e-05 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835255+0000", 2024-09-17T06:05:44.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021677600000000001 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835304+0000", 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9261000000000002e-05 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837761+0000", 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024567230000000001 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837886+0000", 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012532400000000001 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 83.820300377999999, 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001082132, 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.474 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598860+0000", 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4569999999999999e-06 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598901+0000", 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1400999999999999e-05 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598934+0000", 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3012000000000002e-05 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598959+0000", 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4839000000000001e-05 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599073+0000", 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113763 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599099+0000", 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6120999999999999e-05 2024-09-17T06:05:44.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599900+0000", 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00080140099999999998 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599940+0000", 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9137999999999997e-05 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.099652466999999, 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00153148, 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:44.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319508+0000", 2024-09-17T06:05:44.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5399999999999998e-06 2024-09-17T06:05:44.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319533+0000", 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4759000000000001e-05 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319568+0000", 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5305000000000002e-05 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319602+0000", 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3992999999999998e-05 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319715+0000", 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113112 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319745+0000", 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9580000000000001e-05 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.320978+0000", 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233165 2024-09-17T06:05:44.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.321037+0000", 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9026e-05 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.227481357000002, 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00083231099999999997, 2024-09-17T06:05:44.483 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191678+0000", 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869999999999999e-06 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191693+0000", 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4409e-05 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191713+0000", 2024-09-17T06:05:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0523e-05 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191726+0000", 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3386e-05 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191806+0000", 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9287000000000002e-05 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191834+0000", 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8323e-05 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192473+0000", 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063865000000000005 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192509+0000", 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6046e-05 2024-09-17T06:05:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.701373081, 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096842599999999999, 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717787+0000", 2024-09-17T06:05:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.951e-06 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717801+0000", 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3973e-05 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717822+0000", 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1328e-05 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717836+0000", 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3944000000000001e-05 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717908+0000", 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1674999999999994e-05 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717940+0000", 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2728999999999998e-05 2024-09-17T06:05:44.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718710+0000", 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076948100000000003 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718753+0000", 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3344999999999999e-05 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.700292269999998, 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065812800000000001, 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5000000000000001e-07 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718872+0000", 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5130000000000004e-06 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718883+0000", 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1195e-05 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718892+0000", 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5669999999999995e-06 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718931+0000", 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8850000000000002e-05 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718948+0000", 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7425999999999999e-05 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719496+0000", 2024-09-17T06:05:44.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00054753699999999996 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719524+0000", 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.809e-05 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:45 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'12, mlcod=26'10)", 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.765926288999999, 2024-09-17T06:05:44.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013449270000000001, 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:44.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653233+0000", 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.796e-06 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653250+0000", 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7025999999999999e-05 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:44.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653272+0000", 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1338000000000001e-05 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653287+0000", 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5509999999999999e-05 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653383+0000", 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5904999999999997e-05 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653417+0000", 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3923e-05 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654510+0000", 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001092602 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654576+0000", 2024-09-17T06:05:44.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6827000000000002e-05 2024-09-17T06:05:44.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.502 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:44.502 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:44.502 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:44.503 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:05:44.504 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:44.501+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:44.604 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:44.601+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:44.634 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T06:05:44.666 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:44.666 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:44.666 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:44.666 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:44.684 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:05:44.733 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:44.733+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:44.806 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:44.801+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:44.833 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:44.833 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:44.833 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:44.833 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:44.833 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:44.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.833+0000 7fe60d0e6640 1 -- 172.21.15.122:0/2061376777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5f0004810 msgr2=0x7fe5f0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:44.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.833+0000 7fe60d0e6640 1 --2- 172.21.15.122:0/2061376777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5f0004810 0x7fe5f0004c20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc006fa0 tx=0x7fe5fc01cee0 comp rx=0 tx=0).stop 2024-09-17T06:05:44.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.833+0000 7fe60759e640 1 -- 172.21.15.122:0/2061376777 reap_dead start 2024-09-17T06:05:44.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.833+0000 7fe60d0e6640 1 -- 172.21.15.122:0/2061376777 shutdown_connections 2024-09-17T06:05:44.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.833+0000 7fe60d0e6640 1 -- 172.21.15.122:0/2061376777 >> 172.21.15.122:0/2061376777 conn(0x7fe608070c10 msgr2=0x7fe608072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:44.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.833+0000 7fe60d0e6640 1 -- 172.21.15.122:0/2061376777 shutdown_connections 2024-09-17T06:05:44.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.833+0000 7fe60d0e6640 1 -- 172.21.15.122:0/2061376777 wait complete. 2024-09-17T06:05:44.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.837+0000 7fe60d0e6640 1 Processor -- start 2024-09-17T06:05:44.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.837+0000 7fe60d0e6640 1 -- start start 2024-09-17T06:05:44.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe60d0e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe608151880 0x7fe60815b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:44.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe60d0e6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe608156d10 0x7fe6081e25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:44.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe606d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe608151880 0x7fe60815b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:44.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe606d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe608151880 0x7fe60815b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57942/0 (socket says 172.21.15.122:57942) 2024-09-17T06:05:44.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe606d9d640 1 -- 172.21.15.122:0/4053271451 learned_addr learned my addr 172.21.15.122:0/4053271451 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:44.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe60d0e6640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe6081e2ae0 0x7fe6081f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:44.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe608072eb0 con 0x7fe608151880 2024-09-17T06:05:44.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe608072d30 con 0x7fe608156d10 2024-09-17T06:05:44.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe60815a070 con 0x7fe6081e2ae0 2024-09-17T06:05:44.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe60659c640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe608156d10 0x7fe6081e25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:44.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe60759e640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe6081e2ae0 0x7fe6081f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:44.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe606d9d640 1 -- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe6081e2ae0 msgr2=0x7fe6081f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:44.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe606d9d640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe6081e2ae0 0x7fe6081f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:44.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe606d9d640 1 -- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe608156d10 msgr2=0x7fe6081e25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:44.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe606d9d640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe608156d10 0x7fe6081e25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:44.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe606d9d640 1 -- 172.21.15.122:0/4053271451 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60814fc50 con 0x7fe608151880 2024-09-17T06:05:44.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe606d9d640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe608151880 0x7fe60815b7b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009ec0 tx=0x7fe5f8011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:44.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe5ef7fe640 1 -- 172.21.15.122:0/4053271451 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800fdb0 con 0x7fe608151880 2024-09-17T06:05:44.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60814ff30 con 0x7fe608151880 2024-09-17T06:05:44.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe5ef7fe640 1 -- 172.21.15.122:0/4053271451 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5f8016860 con 0x7fe608151880 2024-09-17T06:05:44.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.841+0000 7fe5ef7fe640 1 -- 172.21.15.122:0/4053271451 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8016cb0 con 0x7fe608151880 2024-09-17T06:05:44.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.845+0000 7fe5ef7fe640 1 -- 172.21.15.122:0/4053271451 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe5f8005020 con 0x7fe608151880 2024-09-17T06:05:44.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.845+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6081504f0 con 0x7fe608151880 2024-09-17T06:05:44.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.845+0000 7fe5ef7fe640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe5f4073200 0x7fe5f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:44.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.845+0000 7fe5ef7fe640 1 -- 172.21.15.122:0/4053271451 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6804+0+0 (secure 0 0 0) 0x7fe5f8099650 con 0x7fe608151880 2024-09-17T06:05:44.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.845+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6080c53b0 con 0x7fe608151880 2024-09-17T06:05:44.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.845+0000 7fe60659c640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe5f4073200 0x7fe5f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:44.851 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.845+0000 7fe60659c640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe5f4073200 0x7fe5f4075710 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0ac000 tx=0x7fe5fc019d20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:44.852 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:05:44.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:44.853+0000 7fe5ef7fe640 1 -- 172.21.15.122:0/4053271451 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe5f80642c0 con 0x7fe608151880 2024-09-17T06:05:44.938 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:44.937+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:45.008 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:45.005+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:45.041 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:45.041 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.218202485999996, 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.042 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.043 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:45.043 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.043 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.043 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.043 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.043 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:45.043 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.043 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.043 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.043 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.043 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:05:45.043 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:05:45.044 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.044 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.044 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.044 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:05:45.044 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:05:45.044 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.044 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.044 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.044 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:05:45.044 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:05:45.044 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.044 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:05:45.045 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.046 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.218090262000004, 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.047 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:05:45.048 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.049 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.050 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.217884912000002, 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.051 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.052 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:05:45.053 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.054 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.055 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.211744386000007, 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:45.056 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.057 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.058 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:05:45.059 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.211589660000001, 2024-09-17T06:05:45.060 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:05:45.062 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.063 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:05:45.064 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "MOSDPGPushReply(2.15 43/42 [PushReplyOp(2:a93a17c2:::604.00000000:head)])", 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 24.408488599000002, 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033440999999999999, 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.065 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632988+0000", 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4499999999999996e-07 2024-09-17T06:05:45.066 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632997+0000", 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8349999999999993e-06 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633010+0000", 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2907e-05 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633032+0000", 2024-09-17T06:05:45.067 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2867e-05 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633091+0000", 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8504000000000001e-05 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633322+0000", 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000230552 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.068 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "MOSDPGPushReply(2.15 43/42 [PushReplyOp(2:aa448500:::500.00000000:head)])", 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 24.406276791, 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000220134, 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:45.069 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8999999999999997e-07 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.070 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635206+0000", 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2949999999999999e-06 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635220+0000", 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3821e-05 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635233+0000", 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3797e-05 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.071 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635277+0000", 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3161000000000002e-05 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635419+0000", 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014257000000000001 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.072 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.073 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:45.074 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:05:45.121 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:45.121+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:45.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.197+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) -- 0x7fe60806d7d0 con 0x7fe608151880 2024-09-17T06:05:45.209 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:45.205+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:45.273 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:45.273 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:45.273 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:45.273 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:45.291 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:05:45.334 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:45.333+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:45.356 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:05:45.410 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:45.405+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:45.480 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:45.480 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:45.480 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:45.480 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:45.480 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:45.497 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:05:45.511 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:45.505+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:45.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.549+0000 7f237689a640 1 -- 172.21.15.122:0/3000188813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23700c8d30 msgr2=0x7f237006e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:45.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.549+0000 7f237689a640 1 --2- 172.21.15.122:0/3000188813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23700c8d30 0x7f237006e1c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f23700755f0 tx=0x7f236001eff0 comp rx=0 tx=0).stop 2024-09-17T06:05:45.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.549+0000 7f237689a640 1 -- 172.21.15.122:0/3000188813 shutdown_connections 2024-09-17T06:05:45.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.549+0000 7f237689a640 1 --2- 172.21.15.122:0/3000188813 >> v2:172.21.15.122:3300/0 conn(0x7f2370152260 0x7f237015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:45.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.549+0000 7f237689a640 1 --2- 172.21.15.122:0/3000188813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23700c8d30 0x7f237006e1c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:45.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.549+0000 7f237689a640 1 -- 172.21.15.122:0/3000188813 >> 172.21.15.122:0/3000188813 conn(0x7f2370070d80 msgr2=0x7f2370072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:45.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.549+0000 7f237689a640 1 -- 172.21.15.122:0/3000188813 shutdown_connections 2024-09-17T06:05:45.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.549+0000 7f237689a640 1 -- 172.21.15.122:0/3000188813 wait complete. 2024-09-17T06:05:45.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f237689a640 1 Processor -- start 2024-09-17T06:05:45.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f237689a640 1 -- start start 2024-09-17T06:05:45.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f237689a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23700c2220 0x7f23700cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:45.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f237689a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23700c8d30 0x7f237013ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:45.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f237689a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2370152260 0x7f23701f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:45.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f237689a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f23700c2ac0 con 0x7f2370152260 2024-09-17T06:05:45.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f2374e37640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2370152260 0x7f23701f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:45.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f2374e37640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2370152260 0x7f23701f2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57960/0 (socket says 172.21.15.122:57960) 2024-09-17T06:05:45.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f2374e37640 1 -- 172.21.15.122:0/3882937172 learned_addr learned my addr 172.21.15.122:0/3882937172 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:45.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f236ffff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23700c2220 0x7f23700cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:45.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f2367fff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23700c8d30 0x7f237013ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:45.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f237689a640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23700c89c0 con 0x7f23700c2220 2024-09-17T06:05:45.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.553+0000 7f237689a640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f23700c2da0 con 0x7f23700c8d30 2024-09-17T06:05:45.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f236ffff640 1 -- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23700c8d30 msgr2=0x7f237013ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:45.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f236ffff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23700c8d30 0x7f237013ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:45.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f236ffff640 1 -- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2370152260 msgr2=0x7f23701f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:45.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f236ffff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2370152260 0x7f23701f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:45.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f236ffff640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23700cc350 con 0x7f23700c2220 2024-09-17T06:05:45.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f2367fff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23700c8d30 0x7f237013ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:05:45.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f236ffff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23700c2220 0x7f23700cbe10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23600af000 tx=0x7f2360005d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:45.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23600b5040 con 0x7f23700c2220 2024-09-17T06:05:45.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2360005340 con 0x7f23700c2220 2024-09-17T06:05:45.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f237689a640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23700cb410 con 0x7f23700c2220 2024-09-17T06:05:45.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f237689a640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2370145b30 con 0x7f23700c2220 2024-09-17T06:05:45.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23600046d0 con 0x7f23700c2220 2024-09-17T06:05:45.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f2348005280 con 0x7f23700c2220 2024-09-17T06:05:45.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.557+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2360004870 con 0x7f23700c2220 2024-09-17T06:05:45.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.561+0000 7f236d7fa640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2350073200 0x7f2350075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:45.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.561+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6804+0+0 (secure 0 0 0) 0x7f2360135fb0 con 0x7f23700c2220 2024-09-17T06:05:45.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.561+0000 7f2367fff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2350073200 0x7f2350075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:45.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.561+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v55) ==== 54+0+16 (secure 0 0 0) 0x7f2360018b50 con 0x7f23700c2220 2024-09-17T06:05:45.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.561+0000 7f23667fc640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f23480045f0 0x7f2348004a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:45.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.561+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2348004f40 con 0x7f23480045f0 2024-09-17T06:05:45.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.561+0000 7f2367fff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2350073200 0x7f2350075710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23700cb190 tx=0x7f2358001790 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:45.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.561+0000 7f2374e37640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f23480045f0 0x7f2348004a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:45.565 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.561+0000 7f2374e37640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f23480045f0 0x7f2348004a00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:45.566 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.561+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2348004f40 con 0x7f23480045f0 2024-09-17T06:05:45.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.589+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f23480013e0 con 0x7f23480045f0 2024-09-17T06:05:45.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.593+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f23480013e0 con 0x7f23480045f0 2024-09-17T06:05:45.597 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:45.598 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:45.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.593+0000 7f23667fc640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f2348001ea0 0x7f23480029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:45.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.593+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f234800b3a0 con 0x7f2348001ea0 2024-09-17T06:05:45.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.593+0000 7f236ffff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f2348001ea0 0x7f23480029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:45.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.593+0000 7f236ffff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f2348001ea0 0x7f23480029a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:45.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.593+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f234800b3a0 con 0x7f2348001ea0 2024-09-17T06:05:45.612 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:45.609+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:45.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.621+0000 7fe5ef7fe640 1 -- 172.21.15.122:0/4053271451 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v56) ==== 101+0+0 (secure 0 0 0) 0x7fe5f8063bc0 con 0x7fe608151880 2024-09-17T06:05:45.624 INFO:teuthology.orchestra.run.smithi122.stderr:nodeep-scrub is unset 2024-09-17T06:05:45.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.621+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe5f4073200 msgr2=0x7fe5f4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:45.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.621+0000 7fe60d0e6640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe5f4073200 0x7fe5f4075710 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0ac000 tx=0x7fe5fc019d20 comp rx=0 tx=0).stop 2024-09-17T06:05:45.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.621+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe608151880 msgr2=0x7fe60815b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:45.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.621+0000 7fe60d0e6640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe608151880 0x7fe60815b7b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009ec0 tx=0x7fe5f8011e00 comp rx=0 tx=0).stop 2024-09-17T06:05:45.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.625+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 shutdown_connections 2024-09-17T06:05:45.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.625+0000 7fe60d0e6640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe6081e2ae0 0x7fe6081f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:45.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.625+0000 7fe60d0e6640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe5f4073200 0x7fe5f4075710 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:45.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.625+0000 7fe60d0e6640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe608156d10 0x7fe6081e25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:45.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.625+0000 7fe60d0e6640 1 --2- 172.21.15.122:0/4053271451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe608151880 0x7fe60815b7b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:45.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.625+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 >> 172.21.15.122:0/4053271451 conn(0x7fe608070c10 msgr2=0x7fe60806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:45.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.625+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 shutdown_connections 2024-09-17T06:05:45.629 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.625+0000 7fe60d0e6640 1 -- 172.21.15.122:0/4053271451 wait complete. 2024-09-17T06:05:45.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.625+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f23480031b0 con 0x7f2348001ea0 2024-09-17T06:05:45.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.629+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f23480031b0 con 0x7f2348001ea0 2024-09-17T06:05:45.635 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:45.635 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:45.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.629+0000 7f23667fc640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f2348003c30 0x7f2348009c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:45.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.629+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f234800a440 con 0x7f2348003c30 2024-09-17T06:05:45.635 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.629+0000 7f2367fff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f2348003c30 0x7f2348009c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:45.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.633+0000 7f2367fff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f2348003c30 0x7f2348009c90 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:45.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.633+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f234800a440 con 0x7f2348003c30 2024-09-17T06:05:45.649 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:45.649 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:45.649 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:45.649 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:45.649 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.649 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:45.649 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:45.650 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.824943981000004, 2024-09-17T06:05:45.650 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:05:45.650 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.650 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.650 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.650 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.650 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.650 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.650 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.651 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:05:45.652 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:05:45.653 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.653 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.653 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.653 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:05:45.653 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:05:45.653 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.653 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.653 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.653 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:05:45.653 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:05:45.653 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.653 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:05:45.654 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.656 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:45.656 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:45.656 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.824823578999997, 2024-09-17T06:05:45.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:05:45.656 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.656 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.656 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.656 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.656 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:45.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:05:45.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:05:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:05:45.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.660 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:45.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:05:45.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.660 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:05:45.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:05:45.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:05:45.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:05:45.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:05:45.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:05:45.661 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.661 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.661 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.824695664999993, 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:45.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.663 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:05:45.664 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:05:45.664 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.664 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.664 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.664 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:05:45.664 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:05:45.664 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.664 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.664 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.664 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:45.664 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:05:45.664 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:45.665 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:05:45.666 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:05:45.666 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.666 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.666 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.666 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:05:45.666 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:05:45.666 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.666 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.666 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.666 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:05:45.666 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:05:45.666 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.667 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.668 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:45.668 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:45.668 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.823669702000004, 2024-09-17T06:05:45.668 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:05:45.668 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.668 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.668 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.668 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.668 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.668 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.668 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:05:45.670 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:45.671 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.672 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.673 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.823588759000003, 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.674 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:05:45.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.676 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.677 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:45.678 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.823526357000006, 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.680 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.681 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.682 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:05:45.683 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:05:45.684 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.685 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.685 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.685 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.685 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.685 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:45.685 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:45.685 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.823454267000002, 2024-09-17T06:05:45.685 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:05:45.685 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.685 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.685 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:45.685 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.686 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.687 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.688 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:05:45.688 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:05:45.688 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.688 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.688 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.688 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:05:45.688 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:05:45.688 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.688 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.688 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.688 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:45.689 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.823412067000007, 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.690 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.691 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:05:45.692 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.693 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.820820135000005, 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:45.694 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.695 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.696 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:05:45.697 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:45.698 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.820723999999998, 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.699 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.700 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:05:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:05:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:05:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:05:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:05:45.702 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:05:45.702 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.702 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.702 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.702 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:05:45.702 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:05:45.702 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.702 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.702 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.702 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:05:45.702 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:05:45.703 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.703 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.703 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.703 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:05:45.703 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:05:45.703 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.703 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.703 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.703 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.703 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.703 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:05:45.703 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:45.704 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.812291713999997, 2024-09-17T06:05:45.704 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:05:45.704 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.704 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.704 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.704 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.704 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.704 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.704 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:45.704 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.704 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.705 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.706 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:05:45.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.708 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.708 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.708 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:05:45.708 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:05:45.708 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.708 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.708 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.708 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:05:45.708 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:05:45.708 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.708 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.708 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.709 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.718702493999999, 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.710 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:05:45.711 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.712 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.713 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 85.048072129000005, 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.714 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.715 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.716 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:05:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:05:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:05:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:05:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:05:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:05:45.717 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:45.718 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.719 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.720 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 83.327401172999998, 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.721 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:05:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:05:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.722 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.723 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.724 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.724 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:05:45.724 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:05:45.724 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.724 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.724 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.724 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:05:45.724 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:05:45.724 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.724 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.724 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.725 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.726 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 83.324716924000001, 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.727 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:05:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:05:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:05:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:05:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.729 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.730 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.731 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.731 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.731 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.731 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:45.731 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:45.731 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 82.455514250999997, 2024-09-17T06:05:45.731 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:05:45.731 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.731 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.731 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.731 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.732 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.732 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.732 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:45.732 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.732 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.732 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.732 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.732 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:45.732 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.732 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.732 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.732 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.733 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:05:45.733 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:05:45.733 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.733 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.733 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.733 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:05:45.733 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:05:45.733 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.733 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.733 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.733 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:05:45.733 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:05:45.734 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.734 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.734 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.734 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:05:45.734 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:05:45.734 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.734 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.734 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.734 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:05:45.734 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:05:45.735 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.735 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.735 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.735 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:05:45.735 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:05:45.735 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.735 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.735 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:45.735 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:05:45.735 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:05:45.735 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.735 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.736 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.736 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:05:45.736 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:05:45.736 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.736 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.736 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.736 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:05:45.736 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:05:45.736 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.736 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.736 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.737 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:05:45.737 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:05:45.737 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.737 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.737 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.737 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:05:45.737 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:05:45.737 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.737 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.737 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.737 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.737 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.738 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:45.738 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:45.738 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.929073338999999, 2024-09-17T06:05:45.738 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:05:45.738 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.738 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.738 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.738 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.738 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.738 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.738 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:45.738 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.739 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.739 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.739 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.739 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:45.739 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.739 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.739 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.739 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.739 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:05:45.739 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:05:45.739 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.739 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.740 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.740 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:05:45.740 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:05:45.740 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.740 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.740 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.740 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:05:45.740 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:05:45.740 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.740 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.740 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:05:45.741 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.742 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.742 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:45.742 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:05:45.742 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:05:45.742 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.742 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.742 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.742 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:05:45.742 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:05:45.742 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.742 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.742 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.743 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.928843823000001, 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.744 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.745 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:45.745 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.745 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.745 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.745 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.749 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:45.749 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.749 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.749 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.749 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.749 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:05:45.750 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:05:45.750 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.750 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.750 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.750 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:05:45.750 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:05:45.750 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.750 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.750 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.750 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:05:45.750 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:05:45.750 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.751 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.751 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.751 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:05:45.751 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:05:45.751 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.751 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.751 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.751 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:05:45.751 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:05:45.751 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.751 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.751 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.752 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:05:45.752 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:05:45.752 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.752 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.752 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:45.752 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:05:45.752 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:05:45.752 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.752 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.752 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.752 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:05:45.752 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:05:45.753 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.753 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.753 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.753 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:05:45.753 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:05:45.753 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.753 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.753 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.753 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:05:45.753 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:05:45.753 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.753 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 61.926879126999999, 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:05:45.754 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.755 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.756 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.756 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:05:45.756 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:05:45.756 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.756 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.756 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.756 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:05:45.756 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:05:45.756 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.756 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.756 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.756 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:05:45.757 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:05:45.757 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.757 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.757 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.757 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:05:45.757 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:05:45.757 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.757 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.757 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.757 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:05:45.757 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:05:45.757 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.758 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.758 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.758 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:05:45.758 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:05:45.758 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.758 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.758 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.758 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:05:45.758 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:05:45.758 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.758 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.758 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 57.993316239999999, 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:45.759 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.760 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:45.761 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:05:45.761 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:05:45.761 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.761 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.761 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:45.761 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:05:45.761 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:05:45.761 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.761 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.761 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:45.761 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:05:45.761 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:05:45.762 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.762 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:45.762 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:05:45.762 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:05:45.762 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.762 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:45.762 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:05:45.762 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:05:45.762 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:05:45.763 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:05:45.764 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.764 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.764 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:45.764 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:05:45.764 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:05:45.764 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:45.764 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:45.764 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:45.764 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:05:45.764 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:05:45.764 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.764 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.765 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.765 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:45.765 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:45.765 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:45.767 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:05:45.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.657+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f234800a950 con 0x7f2348003c30 2024-09-17T06:05:45.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.661+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f234800a950 con 0x7f2348003c30 2024-09-17T06:05:45.768 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:45.769 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:45.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.661+0000 7f23667fc640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f234800da70 0x7f234800fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:45.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.661+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f2348012c60 con 0x7f234800da70 2024-09-17T06:05:45.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.661+0000 7f2374e37640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f234800da70 0x7f234800fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:45.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.661+0000 7f2374e37640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f234800da70 0x7f234800fe90 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:45.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.665+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2348012c60 con 0x7f234800da70 2024-09-17T06:05:45.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.689+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f23480106a0 con 0x7f234800da70 2024-09-17T06:05:45.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.693+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f23480106a0 con 0x7f234800da70 2024-09-17T06:05:45.770 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:45.771 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:45.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.693+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=56}) -- 0x7f2348012eb0 con 0x7f23700c2220 2024-09-17T06:05:45.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.693+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2348013280 con 0x7f23700c2220 2024-09-17T06:05:45.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.693+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== mon.1 v2:172.21.15.173:3300/0 7 ==== osd_map(56..56 src has 1..56) ==== 288+0+0 (secure 0 0 0) 0x7f2360134100 con 0x7f23700c2220 2024-09-17T06:05:45.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.693+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== mon.1 v2:172.21.15.173:3300/0 8 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f23600c7040 con 0x7f23700c2220 2024-09-17T06:05:45.771 INFO:teuthology.orchestra.run.smithi122.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-17T06:05:45.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.693+0000 7f23667fc640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f2348010ef0 0x7f23480113b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:45.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.693+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 10: {"prefix": "get_command_descriptions"}) -- 0x7f2348016c10 con 0x7f2348010ef0 2024-09-17T06:05:45.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.693+0000 7f236ffff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f2348010ef0 0x7f23480113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:45.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.693+0000 7f236ffff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f2348010ef0 0x7f23480113b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:45.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.697+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 10: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2348016c10 con 0x7f2348010ef0 2024-09-17T06:05:45.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.721+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f2348011a60 con 0x7f2348010ef0 2024-09-17T06:05:45.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.725+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 11: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f2348011a60 con 0x7f2348010ef0 2024-09-17T06:05:45.772 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:45.773 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:45.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.725+0000 7f23667fc640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f2348012180 0x7f2348012590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:45.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.725+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7f2348019ea0 con 0x7f2348012180 2024-09-17T06:05:45.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.725+0000 7f2367fff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f2348012180 0x7f2348012590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:45.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.725+0000 7f2367fff640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f2348012180 0x7f2348012590 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:45.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.729+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2348019ea0 con 0x7f2348012180 2024-09-17T06:05:45.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.753+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f2348019e20 con 0x7f2348012180 2024-09-17T06:05:45.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.757+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f2348019e20 con 0x7f2348012180 2024-09-17T06:05:45.774 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:45.775 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:45.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.757+0000 7f23667fc640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f2348019160 0x7f2348019570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:45.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.757+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7f234801d2c0 con 0x7f2348019160 2024-09-17T06:05:45.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.757+0000 7f2374e37640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f2348019160 0x7f2348019570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:45.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.757+0000 7f2374e37640 1 --2- 172.21.15.122:0/3882937172 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f2348019160 0x7f2348019570 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:45.775 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.761+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f234801d2c0 con 0x7f2348019160 2024-09-17T06:05:45.775 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:45.761+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:45.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.785+0000 7f23667fc640 1 -- 172.21.15.122:0/3882937172 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f2348017510 con 0x7f2348019160 2024-09-17T06:05:45.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:45.789+0000 7f236d7fa640 1 -- 172.21.15.122:0/3882937172 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f2348017510 con 0x7f2348019160 2024-09-17T06:05:45.797 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:45.797 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:45.803 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T06:05:45.803 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T06:05:45.867 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:45.865+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:45.966 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:45.966 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:45.968 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:45.965+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:45.983 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:05:46.073 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:46.073+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:46.170 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:46.169+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:46.171 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:46.171 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:46.189 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:05:46.281 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:46.281+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:46.371 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:46.369+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:46.379 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:46.379 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:46.400 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:05:46.472 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:46.469+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:46.542 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:46.542 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:46.568 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:05:46.573 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:46.573+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:46.674 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:46.669+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:46.752 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:46.752 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:46.769 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:05:46.812 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:46.809+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:46.877 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:46.873+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:46.951 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:46.951 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:46.967 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:05:47.012 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:47.009+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:47.077 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:47.077+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:47.110 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:47.110 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:47.127 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:05:47.216 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:47.213+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:47.279 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:47.277+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:47.325 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:47.325 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:47.343 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:05:47.388 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:47.385+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:47.481 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:47.481+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:47.528 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:47.528 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:47.546 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:05:47.592 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:47.589+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:47.683 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:47.681+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:47.700 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:47.701 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:47.720 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:05:47.767 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T06:05:47.804 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:05:47.808 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:47.805+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:47.885 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:47.881+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:47.917 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:47.917 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:47.937 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:05:47.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.945+0000 7fad467e7640 1 -- 172.21.15.122:0/854247466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad28003a10 msgr2=0x7fad28003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:47.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.945+0000 7fad467e7640 1 --2- 172.21.15.122:0/854247466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad28003a10 0x7fad28003ea0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fad3000c290 tx=0x7fad3001f790 comp rx=0 tx=0).stop 2024-09-17T06:05:47.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.945+0000 7fad44d84640 1 -- 172.21.15.122:0/854247466 reap_dead start 2024-09-17T06:05:47.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.945+0000 7fad467e7640 1 -- 172.21.15.122:0/854247466 shutdown_connections 2024-09-17T06:05:47.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.945+0000 7fad467e7640 1 -- 172.21.15.122:0/854247466 >> 172.21.15.122:0/854247466 conn(0x7fad4006ce90 msgr2=0x7fad4006d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:47.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.945+0000 7fad467e7640 1 -- 172.21.15.122:0/854247466 shutdown_connections 2024-09-17T06:05:47.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.945+0000 7fad467e7640 1 -- 172.21.15.122:0/854247466 wait complete. 2024-09-17T06:05:47.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.949+0000 7fb93fb96640 1 -- 172.21.15.122:0/610326432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb938159240 msgr2=0x7fb938142640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:47.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.949+0000 7fb93fb96640 1 --2- 172.21.15.122:0/610326432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb938159240 0x7fb938142640 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb934009840 tx=0x7fb93401f010 comp rx=0 tx=0).stop 2024-09-17T06:05:47.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.949+0000 7fad467e7640 1 Processor -- start 2024-09-17T06:05:47.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.949+0000 7fad467e7640 1 -- start start 2024-09-17T06:05:47.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.949+0000 7fb93fb96640 1 -- 172.21.15.122:0/610326432 shutdown_connections 2024-09-17T06:05:47.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.949+0000 7fb93fb96640 1 --2- 172.21.15.122:0/610326432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb938159240 0x7fb938142640 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:47.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.949+0000 7fb93fb96640 1 -- 172.21.15.122:0/610326432 >> 172.21.15.122:0/610326432 conn(0x7fb9380ca380 msgr2=0x7fb9380ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:47.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.949+0000 7fb93fb96640 1 -- 172.21.15.122:0/610326432 shutdown_connections 2024-09-17T06:05:47.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.949+0000 7fb93fb96640 1 -- 172.21.15.122:0/610326432 wait complete. 2024-09-17T06:05:47.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.949+0000 7fb93fb96640 1 Processor -- start 2024-09-17T06:05:47.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.949+0000 7fb93fb96640 1 -- start start 2024-09-17T06:05:47.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad467e7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad28003a10 0x7fad4014dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:47.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad467e7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad40156060 0x7fad4014b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:47.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad467e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad4014bec0 0x7fad400caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:47.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad467e7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fad40153780 con 0x7fad4014bec0 2024-09-17T06:05:47.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad467e7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fad4014ffa0 con 0x7fad40156060 2024-09-17T06:05:47.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad467e7640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fad4006d9b0 con 0x7fad28003a10 2024-09-17T06:05:47.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3ffff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad28003a10 0x7fad4014dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:47.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3ffff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad28003a10 0x7fad4014dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:49846/0 (socket says 172.21.15.122:49846) 2024-09-17T06:05:47.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3ffff640 1 -- 172.21.15.122:0/435394111 learned_addr learned my addr 172.21.15.122:0/435394111 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:47.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3f7fe640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad40156060 0x7fad4014b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:47.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93fb96640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb938159240 0x7fb9380c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:47.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93fb96640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb93815d240 0x7fb9380c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:47.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93fb96640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9380cd3e0 0x7fb9381417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:47.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93fb96640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb93806dff0 con 0x7fb9380cd3e0 2024-09-17T06:05:47.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93fb96640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb93806de70 con 0x7fb93815d240 2024-09-17T06:05:47.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93fb96640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb93806e170 con 0x7fb938159240 2024-09-17T06:05:47.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3ffff640 1 -- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad40156060 msgr2=0x7fad4014b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:47.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3ffff640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad40156060 0x7fad4014b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:47.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3ffff640 1 -- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad4014bec0 msgr2=0x7fad400caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:47.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3ffff640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad4014bec0 0x7fad400caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:47.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3ffff640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad40153b90 con 0x7fad28003a10 2024-09-17T06:05:47.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93e133640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9380cd3e0 0x7fb9381417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:47.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93e133640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9380cd3e0 0x7fb9381417f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57986/0 (socket says 172.21.15.122:57986) 2024-09-17T06:05:47.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93e133640 1 -- 172.21.15.122:0/3258760116 learned_addr learned my addr 172.21.15.122:0/3258760116 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:47.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93d932640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb938159240 0x7fb9380c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:47.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3ffff640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad28003a10 0x7fad4014dea0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fad3001de90 tx=0x7fad30000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:47.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93d131640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb93815d240 0x7fb9380c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:47.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93e133640 1 -- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb938159240 msgr2=0x7fb9380c2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:47.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93e133640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb938159240 0x7fb9380c2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:47.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93e133640 1 -- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb93815d240 msgr2=0x7fb9380c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:47.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93e133640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb93815d240 0x7fb9380c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:47.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93e133640 1 -- 172.21.15.122:0/3258760116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9380c4c80 con 0x7fb9380cd3e0 2024-09-17T06:05:47.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93e133640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9380cd3e0 0x7fb9381417f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb93000c760 tx=0x7fb93000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:47.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30006150 con 0x7fad28003a10 2024-09-17T06:05:47.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb92e7fc640 1 -- 172.21.15.122:0/3258760116 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930003b80 con 0x7fb9380cd3e0 2024-09-17T06:05:47.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad300bc020 con 0x7fad28003a10 2024-09-17T06:05:47.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad40153e70 con 0x7fad28003a10 2024-09-17T06:05:47.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb92e7fc640 1 -- 172.21.15.122:0/3258760116 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb930003d20 con 0x7fb9380cd3e0 2024-09-17T06:05:47.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93fb96640 1 -- 172.21.15.122:0/3258760116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9380c3510 con 0x7fb9380cd3e0 2024-09-17T06:05:47.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb92e7fc640 1 -- 172.21.15.122:0/3258760116 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93000aab0 con 0x7fb9380cd3e0 2024-09-17T06:05:47.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93fb96640 1 -- 172.21.15.122:0/3258760116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9380c6340 con 0x7fb9380cd3e0 2024-09-17T06:05:47.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fad400ccdc0 con 0x7fad28003a10 2024-09-17T06:05:47.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fb93fb96640 1 -- 172.21.15.122:0/3258760116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9380c4e50 con 0x7fb9380cd3e0 2024-09-17T06:05:47.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30003600 con 0x7fad28003a10 2024-09-17T06:05:47.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.953+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fad20005280 con 0x7fad28003a10 2024-09-17T06:05:47.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fb92e7fc640 1 -- 172.21.15.122:0/3258760116 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb93000ac50 con 0x7fb9380cd3e0 2024-09-17T06:05:47.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fad300ab070 con 0x7fad28003a10 2024-09-17T06:05:47.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fb92e7fc640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb91c073200 0x7fb91c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:47.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fad3cff9640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fad2c073230 0x7fad2c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:47.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fb93d932640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb91c073200 0x7fb91c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:47.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(56..56 src has 1..56) ==== 6804+0+0 (secure 0 0 0) 0x7fad30132a10 con 0x7fad28003a10 2024-09-17T06:05:47.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fad3f7fe640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fad2c073230 0x7fad2c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:47.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v56) ==== 54+0+16 (secure 0 0 0) 0x7fad300c6030 con 0x7fad28003a10 2024-09-17T06:05:47.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fad467e7640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fad200045f0 0x7fad20004a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:47.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fb93d932640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb91c073200 0x7fb91c075710 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb9340b2000 tx=0x7fb93401d850 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:47.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad20005560 con 0x7fad200045f0 2024-09-17T06:05:47.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fad44d84640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fad200045f0 0x7fad20004a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:47.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fad3f7fe640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fad2c073230 0x7fad2c075740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad40159880 tx=0x7fad340091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:47.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.957+0000 7fad44d84640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fad200045f0 0x7fad20004a00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:47.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.961+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad20005560 con 0x7fad200045f0 2024-09-17T06:05:47.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.961+0000 7fb92e7fc640 1 -- 172.21.15.122:0/3258760116 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6804+0+0 (secure 0 0 0) 0x7fb930091c70 con 0x7fb9380cd3e0 2024-09-17T06:05:47.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.961+0000 7fb92e7fc640 1 -- 172.21.15.122:0/3258760116 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb930098020 con 0x7fb9380cd3e0 2024-09-17T06:05:47.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.981+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fad20001280 con 0x7fad200045f0 2024-09-17T06:05:47.985 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:47.981+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:47.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.981+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fad20001280 con 0x7fad200045f0 2024-09-17T06:05:47.986 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:47.987 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:47.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.981+0000 7fad467e7640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fad20001bd0 0x7fad20001fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:47.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.981+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fad20003d60 con 0x7fad20001bd0 2024-09-17T06:05:47.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.981+0000 7fad3ffff640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fad20001bd0 0x7fad20001fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:47.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.981+0000 7fad3ffff640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fad20001bd0 0x7fad20001fe0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:47.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.985+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad20003d60 con 0x7fad20001bd0 2024-09-17T06:05:48.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:47.997+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fad20002db0 con 0x7fad20001bd0 2024-09-17T06:05:48.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.001+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fad20002db0 con 0x7fad20001bd0 2024-09-17T06:05:48.005 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:48.005 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:48.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.001+0000 7fad467e7640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fad20003830 0x7fad2000bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:48.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.001+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fad2000ecc0 con 0x7fad20003830 2024-09-17T06:05:48.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.001+0000 7fad3f7fe640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fad20003830 0x7fad2000bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:48.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.001+0000 7fad3f7fe640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fad20003830 0x7fad2000bca0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:48.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.001+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad2000ecc0 con 0x7fad20003830 2024-09-17T06:05:48.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.017+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fad2000c660 con 0x7fad20003830 2024-09-17T06:05:48.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.017+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fad2000c660 con 0x7fad20003830 2024-09-17T06:05:48.022 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:48.022 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:48.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.017+0000 7fad467e7640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fad2000c810 0x7fad2000cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:48.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.017+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fad2000d1e0 con 0x7fad2000c810 2024-09-17T06:05:48.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.017+0000 7fad44d84640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fad2000c810 0x7fad2000cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:48.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.017+0000 7fad44d84640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fad2000c810 0x7fad2000cc20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:48.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.021+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad2000d1e0 con 0x7fad2000c810 2024-09-17T06:05:48.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.033+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fad2000d4a0 con 0x7fad2000c810 2024-09-17T06:05:48.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.037+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fad2000d4a0 con 0x7fad2000c810 2024-09-17T06:05:48.040 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:48.041 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:48.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.037+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=57}) -- 0x7fad2000d7e0 con 0x7fad28003a10 2024-09-17T06:05:48.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.037+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad2000dba0 con 0x7fad28003a10 2024-09-17T06:05:48.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.037+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fad300fc9e0 con 0x7fad28003a10 2024-09-17T06:05:48.041 INFO:teuthology.orchestra.run.smithi122.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-17T06:05:48.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.037+0000 7fad467e7640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fad20011670 0x7fad20013ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:48.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.037+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 10: {"prefix": "get_command_descriptions"}) -- 0x7fad20016bb0 con 0x7fad20011670 2024-09-17T06:05:48.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.037+0000 7fad3ffff640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fad20011670 0x7fad20013ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:48.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.037+0000 7fad3ffff640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fad20011670 0x7fad20013ad0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:48.044 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.041+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 10: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad20016bb0 con 0x7fad20011670 2024-09-17T06:05:48.057 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.053+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fad20015890 con 0x7fad20011670 2024-09-17T06:05:48.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.057+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 11: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fad20015890 con 0x7fad20011670 2024-09-17T06:05:48.062 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:48.062 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:48.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.057+0000 7fad467e7640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fad20015fb0 0x7fad200163c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:48.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.057+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7fad20019f80 con 0x7fad20015fb0 2024-09-17T06:05:48.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.057+0000 7fad3f7fe640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fad20015fb0 0x7fad200163c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:48.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.057+0000 7fad3f7fe640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fad20015fb0 0x7fad200163c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:48.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.061+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad20019f80 con 0x7fad20015fb0 2024-09-17T06:05:48.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.073+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fad20018e80 con 0x7fad20015fb0 2024-09-17T06:05:48.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.077+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fad20018e80 con 0x7fad20015fb0 2024-09-17T06:05:48.083 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:48.084 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:48.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.081+0000 7fad467e7640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fad20019590 0x7fad200199a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:48.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.081+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7fad2001d350 con 0x7fad20019590 2024-09-17T06:05:48.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.081+0000 7fad44d84640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fad20019590 0x7fad200199a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:48.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.081+0000 7fad44d84640 1 --2- 172.21.15.122:0/435394111 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fad20019590 0x7fad200199a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:48.085 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:48.085+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:48.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.081+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad2001d350 con 0x7fad20019590 2024-09-17T06:05:48.089 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:48.089 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:48.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:48.089 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:48.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.089 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:48.089 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:48.089 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.266527965999998, 2024-09-17T06:05:48.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014374336, 2024-09-17T06:05:48.090 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.090 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.090 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.090 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:48.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821523+0000", 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821526+0000", 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6859999999999999e-06 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821553+0000", 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6329000000000002e-05 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821592+0000", 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9588000000000001e-05 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821624+0000", 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1814999999999999e-05 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822106+0000", 2024-09-17T06:05:48.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00048212400000000001 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822852+0000", 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000745303 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823189+0000", 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000337244 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:48.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828285+0000", 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050956680000000002 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835635+0000", 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0073502960000000001 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835771+0000", 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000136219 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835897+0000", 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126064 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.266230284000002, 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014596456000000001, 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.095 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821820+0000", 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821823+0000", 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.17e-06 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821837+0000", 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3845999999999999e-05 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821872+0000", 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5024999999999998e-05 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821896+0000", 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4669e-05 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824176+0000", 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022794389999999999 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824408+0000", 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000232258 2024-09-17T06:05:48.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824824+0000", 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00041565999999999999 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829781+0000", 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049579250000000002 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836070+0000", 2024-09-17T06:05:48.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062883740000000002 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836286+0000", 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021609299999999999 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836417+0000", 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013099699999999999 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.100 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.266111820000006, 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014884692, 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821941+0000", 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.784e-06 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.821990+0000", 2024-09-17T06:05:48.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9481000000000003e-05 2024-09-17T06:05:48.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822015+0000", 2024-09-17T06:05:48.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4552000000000001e-05 2024-09-17T06:05:48.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822062+0000", 2024-09-17T06:05:48.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7351000000000001e-05 2024-09-17T06:05:48.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825585+0000", 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003522458 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825895+0000", 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031071499999999998 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826221+0000", 2024-09-17T06:05:48.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032602400000000001 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829803+0000", 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035817359999999999 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836527+0000", 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067239919999999998 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836663+0000", 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013620700000000001 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836824+0000", 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016039200000000001 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.265957443999994, 2024-09-17T06:05:48.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01512869, 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822093+0000", 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822095+0000", 2024-09-17T06:05:48.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9829999999999999e-06 2024-09-17T06:05:48.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822105+0000", 2024-09-17T06:05:48.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5130000000000002e-06 2024-09-17T06:05:48.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822125+0000", 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9953e-05 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822144+0000", 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9089e-05 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826898+0000", 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047542740000000002 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827131+0000", 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023258900000000001 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827568+0000", 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00043743200000000002 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834712+0000", 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0071437489999999996 2024-09-17T06:05:48.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836963+0000", 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022512769999999999 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837108+0000", 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014485 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837222+0000", 2024-09-17T06:05:48.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011398100000000001 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.265881917000002, 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015488435, 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822169+0000", 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822171+0000", 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9800000000000001e-06 2024-09-17T06:05:48.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822180+0000", 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7290000000000006e-06 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822198+0000", 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8868999999999998e-05 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822217+0000", 2024-09-17T06:05:48.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006163712 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828723+0000", 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034318 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829070+0000", 2024-09-17T06:05:48.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034623299999999999 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834728+0000", 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056585519999999999 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837392+0000", 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026634800000000002 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837551+0000", 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015923900000000001 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837657+0000", 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010631799999999999 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:48.117 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.265807194999994, 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015871963999999999, 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822245+0000", 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5969999999999999e-06 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822263+0000", 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8241999999999999e-05 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822283+0000", 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9466e-05 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822300+0000", 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6898999999999999e-05 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829910+0000", 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00760979 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.830145+0000", 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00023562100000000001 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.830638+0000", 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00049317000000000002 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834742+0000", 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041036470000000002 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837872+0000", 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031295670000000002 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838036+0000", 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016482899999999999 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838116+0000", 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9135999999999996e-05 2024-09-17T06:05:48.122 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.265710605999999, 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016065354, 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822340+0000", 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822342+0000", 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822349+0000", 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6569999999999997e-06 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822368+0000", 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9074999999999999e-05 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822412+0000", 2024-09-17T06:05:48.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4115e-05 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.831389+0000", 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089769659999999994 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.831743+0000", 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035332899999999999 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832133+0000", 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000390221 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834756+0000", 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026229500000000002 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838251+0000", 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034947390000000002 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838336+0000", 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5679000000000004e-05 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838406+0000", 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9280000000000001e-05 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.128 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.265609151000007, 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016193883999999999, 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822442+0000", 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822443+0000", 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7370000000000001e-06 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822452+0000", 2024-09-17T06:05:48.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5259999999999993e-06 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822480+0000", 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7781999999999999e-05 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822497+0000", 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7139e-05 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833259+0000", 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010762386000000001 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833684+0000", 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00042440300000000001 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834089+0000", 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000405556 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838148+0000", 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040588760000000003 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838479+0000", 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033078399999999998 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838567+0000", 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8661999999999999e-05 2024-09-17T06:05:48.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838636+0000", 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8033000000000004e-05 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.265519894999997, 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012308227, 2024-09-17T06:05:48.134 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822531+0000", 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822532+0000", 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.57e-06 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822541+0000", 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9090000000000006e-06 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822572+0000", 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1099000000000002e-05 2024-09-17T06:05:48.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822591+0000", 2024-09-17T06:05:48.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8462e-05 2024-09-17T06:05:48.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822777+0000", 2024-09-17T06:05:48.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018563100000000001 2024-09-17T06:05:48.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823110+0000", 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000333574 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823419+0000", 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030839499999999999 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826081+0000", 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026627999999999999 2024-09-17T06:05:48.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834551+0000", 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084693679999999997 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834714+0000", 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000162969 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834839+0000", 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012545000000000001 2024-09-17T06:05:48.139 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.265416974000004, 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012689499, 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822634+0000", 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822635+0000", 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.637e-06 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822654+0000", 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8362000000000001e-05 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822678+0000", 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4513000000000001e-05 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.822698+0000", 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9468999999999999e-05 2024-09-17T06:05:48.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014675910000000001 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824388+0000", 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022300600000000001 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824756+0000", 2024-09-17T06:05:48.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036741900000000001 2024-09-17T06:05:48.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-09-17T06:05:48.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827411+0000", 2024-09-17T06:05:48.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00265526 2024-09-17T06:05:48.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:48.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835045+0000", 2024-09-17T06:05:48.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076339290000000002 2024-09-17T06:05:48.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835197+0000", 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000151736 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835323+0000", 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126577 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.145 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:22 2.e e25/19 ondisk, result = 0)", 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.253764013999998, 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00058930099999999997, 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834287+0000", 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834289+0000", 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.216e-06 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834304+0000", 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5255999999999999e-05 2024-09-17T06:05:48.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834335+0000", 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0397999999999999e-05 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834359+0000", 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4799000000000001e-05 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834505+0000", 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014551700000000001 2024-09-17T06:05:48.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834530+0000", 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5128999999999999e-05 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834876+0000", 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000345986 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:23 2.e e25/19 ondisk, result = 0)", 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.253632631000002, 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093485499999999995, 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834418+0000", 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834420+0000", 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5099999999999999e-06 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834428+0000", 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7399999999999993e-06 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834449+0000", 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0738999999999999e-05 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834471+0000", 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1979000000000001e-05 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835003+0000", 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053146400000000005 2024-09-17T06:05:48.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835027+0000", 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4681999999999998e-05 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835353+0000", 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000325741 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.153 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:6 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.252668771000003, 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053156399999999999, 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835382+0000", 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835384+0000", 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9700000000000002e-06 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835397+0000", 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2903e-05 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835427+0000", 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9935000000000001e-05 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835451+0000", 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4581999999999999e-05 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835592+0000", 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0001406 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835616+0000", 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4505e-05 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835914+0000", 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029706900000000001 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:7 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:48.157 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.252550350000007, 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00094147399999999998, 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835500+0000", 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835502+0000", 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2729999999999999e-06 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835511+0000", 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1730000000000001e-06 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835531+0000", 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9769e-05 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835548+0000", 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6878999999999999e-05 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836026+0000", 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00047839999999999997 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836048+0000", 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1886e-05 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836442+0000", 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000394094 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:8 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.252477094, 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001278288, 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835574+0000", 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835575+0000", 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.077e-06 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835582+0000", 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7830000000000001e-06 2024-09-17T06:05:48.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835599+0000", 2024-09-17T06:05:48.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7235999999999999e-05 2024-09-17T06:05:48.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835614+0000", 2024-09-17T06:05:48.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5096000000000001e-05 2024-09-17T06:05:48.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836506+0000", 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00089209599999999999 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836518+0000", 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-05 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836852+0000", 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033404000000000002 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:9 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.252413426999993, 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001612018, 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:48.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835637+0000", 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835638+0000", 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.054e-06 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835646+0000", 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1520000000000003e-06 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835666+0000", 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0795999999999999e-05 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835702+0000", 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5379000000000001e-05 2024-09-17T06:05:48.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836928+0000", 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001225903 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836948+0000", 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0628999999999998e-05 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837249+0000", 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030110500000000002 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:10 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.252315682000003, 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019419420000000001, 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.170 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835735+0000", 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835736+0000", 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.06e-06 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835743+0000", 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1330000000000001e-06 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835762+0000", 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8839999999999999e-05 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835778+0000", 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5498999999999998e-05 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837364+0000", 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015863190000000001 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837379+0000", 2024-09-17T06:05:48.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4749000000000001e-05 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837677+0000", 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298342 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:11 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.251976304999999, 2024-09-17T06:05:48.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002079029, 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836074+0000", 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836077+0000", 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.103e-06 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836092+0000", 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.503e-05 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836123+0000", 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1031000000000002e-05 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836147+0000", 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4019000000000002e-05 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837816+0000", 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001669299 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837847+0000", 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1464999999999998e-05 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838153+0000", 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000306082 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.178 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:12 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.251812612999998, 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021818900000000001, 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836238+0000", 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836240+0000", 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.59e-06 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836269+0000", 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9275e-05 2024-09-17T06:05:48.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836291+0000", 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1515999999999999e-05 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.836308+0000", 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7728999999999999e-05 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838225+0000", 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001916453 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838238+0000", 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2806000000000001e-05 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838420+0000", 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000182521 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.182 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.4:13 2.10 e25/19 ondisk, result = 0)", 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.250765193999996, 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001366047, 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837286+0000", 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837287+0000", 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.823e-06 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837301+0000", 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3910000000000001e-05 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837323+0000", 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1379e-05 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837339+0000", 2024-09-17T06:05:48.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6762e-05 2024-09-17T06:05:48.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838456+0000", 2024-09-17T06:05:48.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011162050000000001 2024-09-17T06:05:48.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838470+0000", 2024-09-17T06:05:48.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.453e-05 2024-09-17T06:05:48.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.838652+0000", 2024-09-17T06:05:48.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018143799999999999 2024-09-17T06:05:48.187 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.187 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.187 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.187 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.187 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.188 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:48.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.097+0000 7fad467e7640 1 -- 172.21.15.122:0/435394111 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fad2001c1d0 con 0x7fad20019590 2024-09-17T06:05:48.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.101+0000 7fad3cff9640 1 -- 172.21.15.122:0/435394111 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fad2001c1d0 con 0x7fad20019590 2024-09-17T06:05:48.189 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:48.189 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:48.190 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:05:48.191 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T06:05:48.191 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T06:05:48.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.157+0000 7fb93fb96640 1 -- 172.21.15.122:0/3258760116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) -- 0x7fb938142640 con 0x7fb9380cd3e0 2024-09-17T06:05:48.192 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:48.185+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:48.290 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:48.289+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:48.366 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:48.367 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:48.367 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-09-17T06:05:48.367 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:48.382 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:05:48.421 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:48.417+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:48.450 INFO:tasks.workunit.client.0.smithi122.stderr:Updating files: 96% (12211/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-17T06:05:48.491 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:48.485+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:48.524 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:48.524 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:48.524 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 180, 2024-09-17T06:05:48.524 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-09-17T06:05:48.524 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:48.540 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:05:48.591 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:48.589+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:48.638 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-09-17T06:05:48.638 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T06:05:48.638 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T06:05:48.638 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T06:05:48.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.637+0000 7fb92e7fc640 1 -- 172.21.15.122:0/3258760116 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v57) ==== 87+0+0 (secure 0 0 0) 0x7fb93005e720 con 0x7fb9380cd3e0 2024-09-17T06:05:48.641 INFO:teuthology.orchestra.run.smithi122.stderr:noscrub is set 2024-09-17T06:05:48.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.641+0000 7fb93fb96640 1 -- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb91c073200 msgr2=0x7fb91c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:48.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.641+0000 7fb93fb96640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb91c073200 0x7fb91c075710 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb9340b2000 tx=0x7fb93401d850 comp rx=0 tx=0).stop 2024-09-17T06:05:48.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.641+0000 7fb93fb96640 1 -- 172.21.15.122:0/3258760116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9380cd3e0 msgr2=0x7fb9381417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:48.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.641+0000 7fb93fb96640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9380cd3e0 0x7fb9381417f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb93000c760 tx=0x7fb93000cc20 comp rx=0 tx=0).stop 2024-09-17T06:05:48.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.641+0000 7fb93fb96640 1 -- 172.21.15.122:0/3258760116 shutdown_connections 2024-09-17T06:05:48.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.641+0000 7fb93fb96640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9380cd3e0 0x7fb9381417f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:48.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.641+0000 7fb93fb96640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb91c073200 0x7fb91c075710 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:48.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.641+0000 7fb93fb96640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb93815d240 0x7fb9380c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:48.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.641+0000 7fb93fb96640 1 --2- 172.21.15.122:0/3258760116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb938159240 0x7fb9380c2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:48.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.641+0000 7fb93fb96640 1 -- 172.21.15.122:0/3258760116 >> 172.21.15.122:0/3258760116 conn(0x7fb9380ca380 msgr2=0x7fb938138200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:48.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.641+0000 7fb93fb96640 1 -- 172.21.15.122:0/3258760116 shutdown_connections 2024-09-17T06:05:48.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.641+0000 7fb93fb96640 1 -- 172.21.15.122:0/3258760116 wait complete. 2024-09-17T06:05:48.692 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:48.689+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:48.732 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.907762567000006, 2024-09-17T06:05:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044462499999999997, 2024-09-17T06:05:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823264+0000", 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3300000000000001e-06 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823284+0000", 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0132e-05 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823364+0000", 2024-09-17T06:05:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9583e-05 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823395+0000", 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1171999999999999e-05 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823538+0000", 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014286600000000001 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823594+0000", 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890999999999997e-05 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827597+0000", 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004003665 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827708+0000", 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110611 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.907570116000002, 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043686330000000002, 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823455+0000", 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2160000000000001e-06 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823471+0000", 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5702999999999999e-05 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823492+0000", 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1039e-05 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823512+0000", 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0364999999999999e-05 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824294+0000", 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00078187600000000003 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824350+0000", 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5367e-05 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827719+0000", 2024-09-17T06:05:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003368916 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827823+0000", 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104151 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.907009337000005, 2024-09-17T06:05:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0094234149999999992, 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824018+0000", 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3629999999999998e-06 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824036+0000", 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7606000000000001e-05 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824065+0000", 2024-09-17T06:05:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9005000000000001e-05 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824092+0000", 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7396e-05 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826491+0000", 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002398776 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826804+0000", 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000312782 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833438+0000", 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066344869999999997 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.906939354000002, 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048433540000000002, 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824087+0000", 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1830000000000001e-06 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824106+0000", 2024-09-17T06:05:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8595999999999999e-05 2024-09-17T06:05:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824137+0000", 2024-09-17T06:05:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1322000000000003e-05 2024-09-17T06:05:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824164+0000", 2024-09-17T06:05:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6605e-05 2024-09-17T06:05:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824807+0000", 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064339900000000001 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824861+0000", 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3687000000000003e-05 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828809+0000", 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039483909999999999 2024-09-17T06:05:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828928+0000", 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119171 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.906858685000003, 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092145760000000004, 2024-09-17T06:05:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824167+0000", 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7540000000000001e-06 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824178+0000", 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0276e-05 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824202+0000", 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4685000000000002e-05 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824223+0000", 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1036e-05 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825070+0000", 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084684500000000004 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825392+0000", 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032213499999999998 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833380+0000", 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079878450000000004 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-17T06:05:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.905853754000006, 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038480469999999998, 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825172+0000", 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.967e-06 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825190+0000", 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7866000000000001e-05 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825217+0000", 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6682e-05 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825239+0000", 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1968999999999999e-05 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825632+0000", 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00039355100000000001 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825690+0000", 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7797000000000002e-05 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828935+0000", 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032449449999999999 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829018+0000", 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3269999999999994e-05 2024-09-17T06:05:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.904799251, 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002834755, 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826227+0000", 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.906e-06 2024-09-17T06:05:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826256+0000", 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8872000000000001e-05 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826399+0000", 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143156 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826453+0000", 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4465000000000001e-05 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826628+0000", 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017420700000000001 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829060+0000", 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024321490000000002 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.903048620000007, 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055191049999999998, 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827978+0000", 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0200000000000001e-06 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827997+0000", 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9836000000000001e-05 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828029+0000", 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1720999999999997e-05 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828055+0000", 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5519000000000001e-05 2024-09-17T06:05:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828193+0000", 2024-09-17T06:05:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013821699999999999 2024-09-17T06:05:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828232+0000", 2024-09-17T06:05:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9351000000000003e-05 2024-09-17T06:05:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833396+0000", 2024-09-17T06:05:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051640119999999999 2024-09-17T06:05:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833495+0000", 2024-09-17T06:05:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8429000000000002e-05 2024-09-17T06:05:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.902923079000004, 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054928850000000003, 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828102+0000", 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-06 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828116+0000", 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3716e-05 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828139+0000", 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3028999999999999e-05 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828156+0000", 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869000000000001e-05 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829124+0000", 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096778700000000001 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829158+0000", 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4671000000000001e-05 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833509+0000", 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004350802 2024-09-17T06:05:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833594+0000", 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4814999999999993e-05 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.898171853999997, 2024-09-17T06:05:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064859200000000003, 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832854+0000", 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8330000000000001e-06 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832867+0000", 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.332e-05 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832906+0000", 2024-09-17T06:05:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8800999999999997e-05 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6468000000000003e-05 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833094+0000", 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014082600000000001 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833501+0000", 2024-09-17T06:05:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040734400000000002 2024-09-17T06:05:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-17T06:05:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.898075048999999, 2024-09-17T06:05:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00050376900000000005, 2024-09-17T06:05:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832952+0000", 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4269999999999998e-06 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832965+0000", 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3736e-05 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832998+0000", 2024-09-17T06:05:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2264999999999997e-05 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833027+0000", 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9658999999999998e-05 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833172+0000", 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014431900000000001 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833453+0000", 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028136300000000002 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.896078113000002, 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00294042, 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834948+0000", 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.21e-06 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834968+0000", 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9443e-05 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835013+0000", 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5324000000000002e-05 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835038+0000", 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5358999999999999e-05 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835255+0000", 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021677600000000001 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835304+0000", 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9261000000000002e-05 2024-09-17T06:05:48.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837761+0000", 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024567230000000001 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837886+0000", 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012532400000000001 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 88.132166756999993, 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001082132, 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598860+0000", 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4569999999999999e-06 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598901+0000", 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1400999999999999e-05 2024-09-17T06:05:48.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598934+0000", 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3012000000000002e-05 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598959+0000", 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4839000000000001e-05 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599073+0000", 2024-09-17T06:05:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113763 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599099+0000", 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6120999999999999e-05 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599900+0000", 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00080140099999999998 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599940+0000", 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9137999999999997e-05 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.411518846000007, 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00153148, 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.789 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.790 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:48.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:48.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319508+0000", 2024-09-17T06:05:48.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5399999999999998e-06 2024-09-17T06:05:48.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319533+0000", 2024-09-17T06:05:48.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4759000000000001e-05 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319568+0000", 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5305000000000002e-05 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319602+0000", 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3992999999999998e-05 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319715+0000", 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113112 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319745+0000", 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9580000000000001e-05 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.320978+0000", 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233165 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.321037+0000", 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9026e-05 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 85.539347735999996, 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00083231099999999997, 2024-09-17T06:05:48.794 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191678+0000", 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869999999999999e-06 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191693+0000", 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4409e-05 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191713+0000", 2024-09-17T06:05:48.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0523e-05 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191726+0000", 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3386e-05 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191806+0000", 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9287000000000002e-05 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191834+0000", 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8323e-05 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192473+0000", 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063865000000000005 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192509+0000", 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6046e-05 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.013239459999994, 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096842599999999999, 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:48.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717787+0000", 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.951e-06 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717801+0000", 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3973e-05 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717822+0000", 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1328e-05 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717836+0000", 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3944000000000001e-05 2024-09-17T06:05:48.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717908+0000", 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1674999999999994e-05 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717940+0000", 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2728999999999998e-05 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718710+0000", 2024-09-17T06:05:48.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076948100000000003 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718753+0000", 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3344999999999999e-05 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:48.803 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.012158649, 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065812800000000001, 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:48.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5000000000000001e-07 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718872+0000", 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5130000000000004e-06 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718883+0000", 2024-09-17T06:05:48.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1195e-05 2024-09-17T06:05:48.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718892+0000", 2024-09-17T06:05:48.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5669999999999995e-06 2024-09-17T06:05:48.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718931+0000", 2024-09-17T06:05:48.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8850000000000002e-05 2024-09-17T06:05:48.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718948+0000", 2024-09-17T06:05:48.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7425999999999999e-05 2024-09-17T06:05:48.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719496+0000", 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00054753699999999996 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719524+0000", 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.809e-05 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:45 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'12, mlcod=26'10)", 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:48.809 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.077792668000001, 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013449270000000001, 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:48.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653233+0000", 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.796e-06 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653250+0000", 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7025999999999999e-05 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653272+0000", 2024-09-17T06:05:48.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1338000000000001e-05 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653287+0000", 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5509999999999999e-05 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653383+0000", 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5904999999999997e-05 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653417+0000", 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3923e-05 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654510+0000", 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001092602 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654576+0000", 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6827000000000002e-05 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.813 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.814 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.814 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.814 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:48.815 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:05:48.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 -- 172.21.15.122:0/599890398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a080b6720 msgr2=0x7f6a080c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 --2- 172.21.15.122:0/599890398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a080b6720 0x7f6a080c6400 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6a0808e9a0 tx=0x7f69f801c8c0 comp rx=0 tx=0).stop 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 -- 172.21.15.122:0/599890398 shutdown_connections 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 --2- 172.21.15.122:0/599890398 >> v2:172.21.15.173:3300/0 conn(0x7f6a08163c90 0x7f6a081660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 --2- 172.21.15.122:0/599890398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a080b6720 0x7f6a080c6400 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 -- 172.21.15.122:0/599890398 >> 172.21.15.122:0/599890398 conn(0x7f6a0806d090 msgr2=0x7f6a0806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 -- 172.21.15.122:0/599890398 shutdown_connections 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 -- 172.21.15.122:0/599890398 wait complete. 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 Processor -- start 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 -- start start 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a080b6720 0x7f6a08145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a0815b320 0x7f6a0814e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a08163c90 0x7f6a081f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:48.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6a080cd230 con 0x7f6a0815b320 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6a080cc610 con 0x7f6a080b6720 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f6a0dabf640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6a080c7490 con 0x7f6a08163c90 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.777+0000 7f69feffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a0815b320 0x7f6a0814e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f69feffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a0815b320 0x7f6a0814e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58018/0 (socket says 172.21.15.122:58018) 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f69feffd640 1 -- 172.21.15.122:0/1898423232 learned_addr learned my addr 172.21.15.122:0/1898423232 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f6a077fe640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a080b6720 0x7f6a08145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f6a07fff640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a08163c90 0x7f6a081f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f69feffd640 1 -- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a08163c90 msgr2=0x7f6a081f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f69feffd640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a08163c90 0x7f6a081f4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f69feffd640 1 -- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a080b6720 msgr2=0x7f6a08145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f69feffd640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a080b6720 0x7f6a08145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f69feffd640 1 -- 172.21.15.122:0/1898423232 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a081456c0 con 0x7f6a0815b320 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f69feffd640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a0815b320 0x7f6a0814e170 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f69f000c400 tx=0x7f69f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:48.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f6a04ff9640 1 -- 172.21.15.122:0/1898423232 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0017070 con 0x7f6a0815b320 2024-09-17T06:05:48.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f6a04ff9640 1 -- 172.21.15.122:0/1898423232 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69f0003600 con 0x7f6a0815b320 2024-09-17T06:05:48.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f6a0dabf640 1 -- 172.21.15.122:0/1898423232 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0814b660 con 0x7f6a0815b320 2024-09-17T06:05:48.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f6a04ff9640 1 -- 172.21.15.122:0/1898423232 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0003a50 con 0x7f6a0815b320 2024-09-17T06:05:48.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f6a0dabf640 1 -- 172.21.15.122:0/1898423232 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a08147330 con 0x7f6a0815b320 2024-09-17T06:05:48.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f6a0dabf640 1 -- 172.21.15.122:0/1898423232 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a08144e30 con 0x7f6a0815b320 2024-09-17T06:05:48.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f6a04ff9640 1 -- 172.21.15.122:0/1898423232 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f69f001a070 con 0x7f6a0815b320 2024-09-17T06:05:48.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f6a04ff9640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f69e8073200 0x7f69e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:48.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f6a04ff9640 1 -- 172.21.15.122:0/1898423232 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6804+0+0 (secure 0 0 0) 0x7f69f0093910 con 0x7f6a0815b320 2024-09-17T06:05:48.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.781+0000 7f6a077fe640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f69e8073200 0x7f69e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:48.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.785+0000 7f6a077fe640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f69e8073200 0x7f69e8075710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f69f80af000 tx=0x7f69f801b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:48.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.785+0000 7f6a04ff9640 1 -- 172.21.15.122:0/1898423232 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f69f005e570 con 0x7f6a0815b320 2024-09-17T06:05:48.822 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:48.809+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:48.916 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:48.913+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:48.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.949+0000 7f6a0dabf640 1 -- 172.21.15.122:0/1898423232 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f6a0806d4a0 con 0x7f6a0815b320 2024-09-17T06:05:48.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.949+0000 7f6a04ff9640 1 -- 172.21.15.122:0/1898423232 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v57) ==== 81+0+38880 (secure 0 0 0) 0x7f69f005de70 con 0x7f6a0815b320 2024-09-17T06:05:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:05:48.954 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: "epoch": 57, 2024-09-17T06:05:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: "fsid": "5aff0fc3-254a-48aa-be08-0081a34bd09c", 2024-09-17T06:05:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: "created": "2024-09-17T06:03:42.642598+0000", 2024-09-17T06:05:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: "modified": "2024-09-17T06:05:48.629192+0000", 2024-09-17T06:05:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: "last_up_change": "2024-09-17T06:05:25.481552+0000", 2024-09-17T06:05:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: "last_in_change": "2024-09-17T06:03:46.879949+0000", 2024-09-17T06:05:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T06:05:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_num": 5801984, 2024-09-17T06:05:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_set": [ 2024-09-17T06:05:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "noscrub", 2024-09-17T06:05:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "pglog_hardlimit", 2024-09-17T06:05:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "purged_snapdirs", 2024-09-17T06:05:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_deletes", 2024-09-17T06:05:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "sortbitwise" 2024-09-17T06:05:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_version": 6, 2024-09-17T06:05:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T06:05:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T06:05:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T06:05:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_snapshot": "", 2024-09-17T06:05:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_max": 4, 2024-09-17T06:05:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "max_osd": 8, 2024-09-17T06:05:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "require_min_compat_client": "luminous", 2024-09-17T06:05:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "min_compat_client": "luminous", 2024-09-17T06:05:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "require_osd_release": "squid", 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "allow_crimson": false, 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "pools": [ 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 1, 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": ".mgr", 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:03:57.560955+0000", 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 1, 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 1, 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 1, 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 1, 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 1, 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "18", 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:48.961 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:48.961 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:48.961 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:05:48.961 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:48.961 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:48.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.961 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:48.961 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:48.961 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:48.961 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:48.961 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:48.961 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:48.962 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:48.962 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:48.962 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:05:48.962 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:48.962 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:48.962 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:48.962 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_max": 32, 2024-09-17T06:05:48.962 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 1 2024-09-17T06:05:48.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.962 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: "mgr": {} 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 6.9000000953674316, 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 6.9000000953674316, 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 0.28999999165534973, 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 2, 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 2, 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 0.875, 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-17T06:05:48.963 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 2, 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_metadata", 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:06.110710+0000", 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:48.964 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 32, 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 32, 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 32, 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 32, 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 32, 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:48.965 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "21", 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:48.966 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:48.967 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:48.968 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_bias": 4, 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 16, 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_priority": 5 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:05:48.969 INFO:teuthology.orchestra.run.smithi122.stdout: "metadata": "cephfs" 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: "score_type": "Fair distribution", 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 1.5299999713897705, 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 1.5299999713897705, 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: "optimal_score": 1, 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity_weighted": 0.875, 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity": 1, 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 3, 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_data", 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:07.186655+0000", 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 1, 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool", 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 1, 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 2, 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 1, 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 0, 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:48.971 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 64, 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 64, 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 64, 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 64, 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 64, 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:48.972 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "22", 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:48.973 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:48.974 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "", 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 0, 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 64, 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: "target_size_ratio": 0.05000000074505806 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: "data": "cephfs" 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.976 INFO:teuthology.orchestra.run.smithi122.stdout: "read_balance": { 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: "error_message": "pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.24), read balance score may not be reliable", 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: "score_acting": 0, 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: "score_stable": 0 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: "pool": 4, 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_name": "cephfs_data_ec", 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: "create_time": "2024-09-17T06:04:10.901448+0000", 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: "flags": 5, 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: "flags_names": "hashpspool,ec_overwrites", 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: "type": 3, 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 4, 2024-09-17T06:05:48.977 INFO:teuthology.orchestra.run.smithi122.stdout: "min_size": 3, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_rule": 1, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_count": 0, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_target": 0, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "is_stretch_pool": false, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "object_hash": 2, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_autoscale_mode": "off", 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num": 32, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num": 32, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_placement_num_target": 32, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_target": 32, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_pending": 32, 2024-09-17T06:05:48.978 INFO:teuthology.orchestra.run.smithi122.stdout: "last_pg_merge_meta": { 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: "source_pgid": "0.0", 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: "ready_epoch": 0, 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_started": 0, 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: "last_epoch_clean": 0, 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: "source_version": "0'0", 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: "target_version": "0'0" 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: "last_change": "26", 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend": "0", 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: "auid": 0, 2024-09-17T06:05:48.979 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_mode": "selfmanaged", 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_seq": 0, 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "snap_epoch": 0, 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "pool_snaps": [], 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps": "[]", 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_bytes": 0, 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "quota_max_objects": 0, 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "tiers": [], 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "tier_of": -1, 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "read_tier": -1, 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "write_tier": -1, 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_mode": "none", 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_bytes": 0, 2024-09-17T06:05:48.980 INFO:teuthology.orchestra.run.smithi122.stdout: "target_max_objects": 0, 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_flush_age": 0, 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: "cache_min_evict_age": 0, 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profile": "cephfs_data_ec", 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_params": { 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "none" 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_period": 0, 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_count": 0, 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: "use_gmt_hitset": true, 2024-09-17T06:05:48.981 INFO:teuthology.orchestra.run.smithi122.stdout: "min_read_recency_for_promote": 0, 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "min_write_recency_for_promote": 0, 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "hit_set_search_last_n": 0, 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "grade_table": [], 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "stripe_width": 8192, 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "expected_num_objects": 0, 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "fast_read": false, 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "options": { 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_num_min": 64, 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "application_metadata": { 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs": { 2024-09-17T06:05:48.982 INFO:teuthology.orchestra.run.smithi122.stdout: "data": "cephfs" 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: "osds": [ 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 0, 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "b8a621d5-9187-4034-ac89-5adb5b22ca7a", 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:48.983 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6824", 2024-09-17T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:48.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6825", 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6826", 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:48.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6827", 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6830", 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:48.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6831", 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6828", 2024-09-17T06:05:48.987 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6829", 2024-09-17T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 776463314 2024-09-17T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6825/776463314", 2024-09-17T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6827/776463314", 2024-09-17T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6831/776463314", 2024-09-17T06:05:48.988 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6829/776463314", 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 1, 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "992e1af1-06d0-4849-93bf-4be8fc437183", 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:48.989 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6800", 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.990 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6801", 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6802", 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6803", 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6806", 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:48.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6807", 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6804", 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:48.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6805", 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2272556556 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6801/2272556556", 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6803/2272556556", 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6807/2272556556", 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6805/2272556556", 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:48.994 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 2, 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "e3a31b77-d4db-4ee6-af7c-60af7df4bd69", 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:48.995 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6816", 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:48.996 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6817", 2024-09-17T06:05:48.997 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:48.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.997 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.997 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:48.997 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:48.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.997 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:48.997 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6818", 2024-09-17T06:05:48.997 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:48.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6819", 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6822", 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6823", 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6820", 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:48.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6821", 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1205784459 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6817/1205784459", 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6819/1205784459", 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6823/1205784459", 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6821/1205784459", 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:49.000 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 3, 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "9f473452-18cd-44a4-803a-e908e21ab405", 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 0, 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:49.001 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6808", 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6809", 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:49.002 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6810", 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6811", 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:49.003 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6814", 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6815", 2024-09-17T06:05:49.004 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6812", 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.005 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.122:6813", 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3198016774 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.122:6809/3198016774", 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.122:6811/3198016774", 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.122:6815/3198016774", 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.122:6813/3198016774", 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 4, 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "f11201b3-22f8-4b9e-873c-0ed12835e2d3", 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 0, 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 35, 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 46, 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:49.007 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6810", 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6811", 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.008 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6812", 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6813", 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.010 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:49.010 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.010 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.010 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6816", 2024-09-17T06:05:49.010 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:49.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.012 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.012 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6817", 2024-09-17T06:05:49.012 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:49.012 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.012 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.012 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:49.012 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.012 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.012 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6814", 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6815", 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 920798795 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6811/920798795", 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6813/920798795", 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6817/920798795", 2024-09-17T06:05:49.013 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6815/920798795", 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: "exists" 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 5, 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "3f853011-9aea-4f7c-bb97-2c74fba1e33e", 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:49.014 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 14, 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6802", 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.015 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6803", 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6804", 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.016 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6805", 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6808", 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6809", 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6806", 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6807", 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 2576144160 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6803/2576144160", 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6805/2576144160", 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6809/2576144160", 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6807/2576144160", 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:49.019 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:49.020 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.020 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 6, 2024-09-17T06:05:49.020 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "445606c9-7e18-44b2-997d-68d280a3a37c", 2024-09-17T06:05:49.020 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:49.020 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:49.020 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:49.020 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:49.020 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:49.020 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:49.020 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 54, 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6818", 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6819", 2024-09-17T06:05:49.021 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:49.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.022 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.022 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:49.022 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.022 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.022 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6820", 2024-09-17T06:05:49.022 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6821", 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.023 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6824", 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6825", 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.024 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6822", 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6823", 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1877869793 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6819/1877869793", 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6821/1877869793", 2024-09-17T06:05:49.025 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6825/1877869793", 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6823/1877869793", 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 7, 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: "uuid": "ce0b67c6-0618-41b7-87e3-bf2d4c708907", 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: "up": 1, 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: "in": 1, 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: "weight": 1, 2024-09-17T06:05:49.026 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_affinity": 1, 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_begin": 0, 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: "last_clean_end": 0, 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: "up_from": 15, 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: "up_thru": 46, 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: "down_at": 0, 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: "lost_at": 0, 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addrs": { 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6826", 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6827", 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addrs": { 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6828", 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6829", 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addrs": { 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6832", 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:49.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6833", 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addrs": { 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: "addrvec": [ 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v2", 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6830", 2024-09-17T06:05:49.030 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "172.21.15.173:6831", 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 1719466778 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: "public_addr": "172.21.15.173:6827/1719466778", 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: "cluster_addr": "172.21.15.173:6829/1719466778", 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_back_addr": "172.21.15.173:6833/1719466778", 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: "heartbeat_front_addr": "172.21.15.173:6831/1719466778", 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: "state": [ 2024-09-17T06:05:49.031 INFO:teuthology.orchestra.run.smithi122.stdout: "exists", 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: "up" 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_xinfo": [ 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 0, 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:49.032 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.176942+0000", 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 1, 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.431303+0000", 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 2, 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.354201+0000", 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 3, 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:49.034 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.748604+0000", 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 4, 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:49.035 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.473848+0000", 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 46 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 5, 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.458683+0000", 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.036 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 6, 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:53.617928+0000", 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: "osd": 7, 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: "down_stamp": "0.000000", 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_probability": 0, 2024-09-17T06:05:49.037 INFO:teuthology.orchestra.run.smithi122.stdout: "laggy_interval": 0, 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: "features": 4540719139924082687, 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: "old_weight": 0, 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: "last_purged_snaps_scrub": "2024-09-17T06:03:54.088763+0000", 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: "dead_epoch": 0 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap": [ 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "2.15", 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: "osds": [ 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: 5, 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: 0 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.19", 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: "osds": [ 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: 6, 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: 5, 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: 0, 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: 4 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap_items": [ 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.2", 2024-09-17T06:05:49.039 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 5, 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 1 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.d", 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 7, 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.040 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "3.1d", 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 5, 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 2 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.c", 2024-09-17T06:05:49.041 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 6, 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 1 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.d", 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 5 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.042 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: "pgid": "4.1d", 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: "mappings": [ 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: "from": 1, 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: "to": 5 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_upmap_primaries": [], 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: "pg_temp": [], 2024-09-17T06:05:49.043 INFO:teuthology.orchestra.run.smithi122.stdout: "primary_temp": [], 2024-09-17T06:05:49.044 INFO:teuthology.orchestra.run.smithi122.stdout: "blocklist": {}, 2024-09-17T06:05:49.044 INFO:teuthology.orchestra.run.smithi122.stdout: "range_blocklist": {}, 2024-09-17T06:05:49.044 INFO:teuthology.orchestra.run.smithi122.stdout: "erasure_code_profiles": { 2024-09-17T06:05:49.044 INFO:teuthology.orchestra.run.smithi122.stdout: "cephfs_data_ec": { 2024-09-17T06:05:49.044 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-device-class": "", 2024-09-17T06:05:49.044 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-failure-domain": "osd", 2024-09-17T06:05:49.044 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-num-failure-domains": "0", 2024-09-17T06:05:49.044 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-osds-per-failure-domain": "0", 2024-09-17T06:05:49.044 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-root": "default", 2024-09-17T06:05:49.045 INFO:teuthology.orchestra.run.smithi122.stdout: "jerasure-per-chunk-alignment": "false", 2024-09-17T06:05:49.045 INFO:teuthology.orchestra.run.smithi122.stdout: "k": "2", 2024-09-17T06:05:49.045 INFO:teuthology.orchestra.run.smithi122.stdout: "m": "2", 2024-09-17T06:05:49.045 INFO:teuthology.orchestra.run.smithi122.stdout: "plugin": "jerasure", 2024-09-17T06:05:49.045 INFO:teuthology.orchestra.run.smithi122.stdout: "technique": "reed_sol_van", 2024-09-17T06:05:49.045 INFO:teuthology.orchestra.run.smithi122.stdout: "w": "8" 2024-09-17T06:05:49.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.045 INFO:teuthology.orchestra.run.smithi122.stdout: "default": { 2024-09-17T06:05:49.045 INFO:teuthology.orchestra.run.smithi122.stdout: "crush-failure-domain": "osd", 2024-09-17T06:05:49.045 INFO:teuthology.orchestra.run.smithi122.stdout: "k": "2", 2024-09-17T06:05:49.045 INFO:teuthology.orchestra.run.smithi122.stdout: "m": "1", 2024-09-17T06:05:49.045 INFO:teuthology.orchestra.run.smithi122.stdout: "plugin": "jerasure", 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: "technique": "reed_sol_van" 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: "removed_snaps_queue": [], 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: "new_removed_snaps": [], 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: "new_purged_snaps": [], 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: "crush_node_flags": {}, 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: "device_class_flags": {}, 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode": { 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode_enabled": false, 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_bucket_count": 0, 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: "degraded_stretch_mode": 0, 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: "recovering_stretch_mode": 0, 2024-09-17T06:05:49.046 INFO:teuthology.orchestra.run.smithi122.stdout: "stretch_mode_bucket": 0 2024-09-17T06:05:49.047 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:49.047 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:49.048 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:49.049 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:49.049 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:49.049 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:49.049 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:05:49.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.953+0000 7f6a0dabf640 1 -- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f69e8073200 msgr2=0x7f69e8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:49.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.953+0000 7f6a0dabf640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f69e8073200 0x7f69e8075710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f69f80af000 tx=0x7f69f801b100 comp rx=0 tx=0).stop 2024-09-17T06:05:49.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.953+0000 7f6a0dabf640 1 -- 172.21.15.122:0/1898423232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a0815b320 msgr2=0x7f6a0814e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:49.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.953+0000 7f6a0dabf640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a0815b320 0x7f6a0814e170 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f69f000c400 tx=0x7f69f000c8c0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.953+0000 7f6a0dabf640 1 -- 172.21.15.122:0/1898423232 shutdown_connections 2024-09-17T06:05:49.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.953+0000 7f6a0dabf640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a08163c90 0x7f6a081f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.953+0000 7f6a0dabf640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a0815b320 0x7f6a0814e170 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.953+0000 7f6a0dabf640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f69e8073200 0x7f69e8075710 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.953+0000 7f6a0dabf640 1 --2- 172.21.15.122:0/1898423232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a080b6720 0x7f6a08145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.953+0000 7f6a0dabf640 1 -- 172.21.15.122:0/1898423232 >> 172.21.15.122:0/1898423232 conn(0x7f6a0806d090 msgr2=0x7f6a0806efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:49.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.953+0000 7f6a0dabf640 1 -- 172.21.15.122:0/1898423232 shutdown_connections 2024-09-17T06:05:49.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:48.953+0000 7f6a0dabf640 1 -- 172.21.15.122:0/1898423232 wait complete. 2024-09-17T06:05:49.052 INFO:tasks.thrashosds.thrasher:j is {'epoch': 57, 'fsid': '5aff0fc3-254a-48aa-be08-0081a34bd09c', 'created': '2024-09-17T06:03:42.642598+0000', 'modified': '2024-09-17T06:05:48.629192+0000', 'last_up_change': '2024-09-17T06:05:25.481552+0000', 'last_in_change': '2024-09-17T06:03:46.879949+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T06:03:57.560955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T06:04:06.110710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5299999713897705, 'score_stable': 1.5299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T06:04:07.186655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.24), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-17T06:04:10.901448+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}], 'osds': [{'osd': 0, 'uuid': 'b8a621d5-9187-4034-ac89-5adb5b22ca7a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6824', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6825', 'nonce': 776463314}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6826', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6827', 'nonce': 776463314}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6830', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6831', 'nonce': 776463314}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6828', 'nonce': 776463314}, {'type': 'v1', 'addr': '172.21.15.122:6829', 'nonce': 776463314}]}, 'public_addr': '172.21.15.122:6825/776463314', 'cluster_addr': '172.21.15.122:6827/776463314', 'heartbeat_back_addr': '172.21.15.122:6831/776463314', 'heartbeat_front_addr': '172.21.15.122:6829/776463314', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '992e1af1-06d0-4849-93bf-4be8fc437183', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6800', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6801', 'nonce': 2272556556}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6802', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6803', 'nonce': 2272556556}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6806', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6807', 'nonce': 2272556556}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6804', 'nonce': 2272556556}, {'type': 'v1', 'addr': '172.21.15.122:6805', 'nonce': 2272556556}]}, 'public_addr': '172.21.15.122:6801/2272556556', 'cluster_addr': '172.21.15.122:6803/2272556556', 'heartbeat_back_addr': '172.21.15.122:6807/2272556556', 'heartbeat_front_addr': '172.21.15.122:6805/2272556556', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'e3a31b77-d4db-4ee6-af7c-60af7df4bd69', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6816', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6817', 'nonce': 1205784459}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6818', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6819', 'nonce': 1205784459}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6822', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6823', 'nonce': 1205784459}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6820', 'nonce': 1205784459}, {'type': 'v1', 'addr': '172.21.15.122:6821', 'nonce': 1205784459}]}, 'public_addr': '172.21.15.122:6817/1205784459', 'cluster_addr': '172.21.15.122:6819/1205784459', 'heartbeat_back_addr': '172.21.15.122:6823/1205784459', 'heartbeat_front_addr': '172.21.15.122:6821/1205784459', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '9f473452-18cd-44a4-803a-e908e21ab405', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6808', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6809', 'nonce': 3198016774}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6810', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6811', 'nonce': 3198016774}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6814', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6815', 'nonce': 3198016774}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6812', 'nonce': 3198016774}, {'type': 'v1', 'addr': '172.21.15.122:6813', 'nonce': 3198016774}]}, 'public_addr': '172.21.15.122:6809/3198016774', 'cluster_addr': '172.21.15.122:6811/3198016774', 'heartbeat_back_addr': '172.21.15.122:6815/3198016774', 'heartbeat_front_addr': '172.21.15.122:6813/3198016774', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'f11201b3-22f8-4b9e-873c-0ed12835e2d3', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 35, 'down_at': 46, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6810', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6811', 'nonce': 920798795}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6812', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6813', 'nonce': 920798795}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6816', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6817', 'nonce': 920798795}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6814', 'nonce': 920798795}, {'type': 'v1', 'addr': '172.21.15.173:6815', 'nonce': 920798795}]}, 'public_addr': '172.21.15.173:6811/920798795', 'cluster_addr': '172.21.15.173:6813/920798795', 'heartbeat_back_addr': '172.21.15.173:6817/920798795', 'heartbeat_front_addr': '172.21.15.173:6815/920798795', 'state': ['exists']}, {'osd': 5, 'uuid': '3f853011-9aea-4f7c-bb97-2c74fba1e33e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6802', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6803', 'nonce': 2576144160}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6804', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6805', 'nonce': 2576144160}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6808', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6809', 'nonce': 2576144160}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6806', 'nonce': 2576144160}, {'type': 'v1', 'addr': '172.21.15.173:6807', 'nonce': 2576144160}]}, 'public_addr': '172.21.15.173:6803/2576144160', 'cluster_addr': '172.21.15.173:6805/2576144160', 'heartbeat_back_addr': '172.21.15.173:6809/2576144160', 'heartbeat_front_addr': '172.21.15.173:6807/2576144160', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '445606c9-7e18-44b2-997d-68d280a3a37c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 54, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6818', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6819', 'nonce': 1877869793}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6820', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6821', 'nonce': 1877869793}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6824', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6825', 'nonce': 1877869793}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6822', 'nonce': 1877869793}, {'type': 'v1', 'addr': '172.21.15.173:6823', 'nonce': 1877869793}]}, 'public_addr': '172.21.15.173:6819/1877869793', 'cluster_addr': '172.21.15.173:6821/1877869793', 'heartbeat_back_addr': '172.21.15.173:6825/1877869793', 'heartbeat_front_addr': '172.21.15.173:6823/1877869793', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'ce0b67c6-0618-41b7-87e3-bf2d4c708907', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6826', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6827', 'nonce': 1719466778}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6828', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6829', 'nonce': 1719466778}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 1719466778}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6830', 'nonce': 1719466778}, {'type': 'v1', 'addr': '172.21.15.173:6831', 'nonce': 1719466778}]}, 'public_addr': '172.21.15.173:6827/1719466778', 'cluster_addr': '172.21.15.173:6829/1719466778', 'heartbeat_back_addr': '172.21.15.173:6833/1719466778', 'heartbeat_front_addr': '172.21.15.173:6831/1719466778', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.176942+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.431303+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.354201+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.748604+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.473848+0000', 'dead_epoch': 46}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.458683+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:53.617928+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T06:03:54.088763+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.15', 'osds': [5, 0]}, {'pgid': '4.19', 'osds': [6, 5, 0, 4]}], 'pg_upmap_items': [{'pgid': '3.2', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '3.d', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '3.1d', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '4.c', 'mappings': [{'from': 6, 'to': 1}]}, {'pgid': '4.d', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.1d', 'mappings': [{'from': 1, 'to': 5}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'cephfs_data_ec': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-num-failure-domains': '0', 'crush-osds-per-failure-domain': '0', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '2', 'plugin': 'jerasure', 'technique': 'reed_sol_van', 'w': '8'}, 'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T06:05:49.052 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 4.19 2024-09-17T06:05:49.052 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 4.19 2024-09-17T06:05:49.052 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:49.045+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:49.149 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:49.145+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:49.163 INFO:tasks.workunit.client.0.smithi122.stderr:Note: switching to 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'. 2024-09-17T06:05:49.163 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-17T06:05:49.163 INFO:tasks.workunit.client.0.smithi122.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T06:05:49.163 INFO:tasks.workunit.client.0.smithi122.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T06:05:49.163 INFO:tasks.workunit.client.0.smithi122.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T06:05:49.163 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-17T06:05:49.163 INFO:tasks.workunit.client.0.smithi122.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T06:05:49.163 INFO:tasks.workunit.client.0.smithi122.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T06:05:49.163 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-17T06:05:49.163 INFO:tasks.workunit.client.0.smithi122.stderr: git switch -c 2024-09-17T06:05:49.164 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-17T06:05:49.164 INFO:tasks.workunit.client.0.smithi122.stderr:Or undo this operation with: 2024-09-17T06:05:49.164 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-17T06:05:49.164 INFO:tasks.workunit.client.0.smithi122.stderr: git switch - 2024-09-17T06:05:49.164 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-17T06:05:49.164 INFO:tasks.workunit.client.0.smithi122.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T06:05:49.164 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-17T06:05:49.164 INFO:tasks.workunit.client.0.smithi122.stderr:HEAD is now at ce1b342bf8c Merge PR #55006 into wip-pdonnell-testing-20240916.200549-debug 2024-09-17T06:05:49.172 DEBUG:teuthology.orchestra.run.smithi122:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T06:05:49.177 INFO:tasks.workunit.client.0.smithi122.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T06:05:49.179 INFO:tasks.workunit.client.0.smithi122.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T06:05:49.179 INFO:tasks.workunit.client.0.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T06:05:49.205 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:49.205 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:49.205 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:49.205 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:49.205 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:49.224 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:05:49.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 -- 172.21.15.122:0/4031218739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f077c06ce90 msgr2=0x7f077c06eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:49.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 --2- 172.21.15.122:0/4031218739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f077c06ce90 0x7f077c06eb20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0764009900 tx=0x7f076401c8e0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 -- 172.21.15.122:0/4031218739 shutdown_connections 2024-09-17T06:05:49.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 --2- 172.21.15.122:0/4031218739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f077c06ce90 0x7f077c06eb20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 --2- 172.21.15.122:0/4031218739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f077c0c93a0 0x7f077c15be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 -- 172.21.15.122:0/4031218739 >> 172.21.15.122:0/4031218739 conn(0x7f077c0cd4f0 msgr2=0x7f077c0cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:49.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 -- 172.21.15.122:0/4031218739 shutdown_connections 2024-09-17T06:05:49.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 -- 172.21.15.122:0/4031218739 wait complete. 2024-09-17T06:05:49.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 Processor -- start 2024-09-17T06:05:49.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 -- start start 2024-09-17T06:05:49.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f077c06ce90 0x7f077c1f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:49.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f077c06de70 0x7f077c13c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:49.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f077c0c93a0 0x7f077c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:49.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f077c06e280 con 0x7f077c06de70 2024-09-17T06:05:49.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f077c0c4250 con 0x7f077c0c93a0 2024-09-17T06:05:49.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0782248640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f077c0c2b20 con 0x7f077c06ce90 2024-09-17T06:05:49.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0773fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f077c06de70 0x7f077c13c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0773fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f077c06de70 0x7f077c13c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58028/0 (socket says 172.21.15.122:58028) 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0773fff640 1 -- 172.21.15.122:0/1164528957 learned_addr learned my addr 172.21.15.122:0/1164528957 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f077b7fe640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f077c06ce90 0x7f077c1f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f077bfff640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f077c0c93a0 0x7f077c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0773fff640 1 -- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f077c06ce90 msgr2=0x7f077c1f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0773fff640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f077c06ce90 0x7f077c1f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0773fff640 1 -- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f077c0c93a0 msgr2=0x7f077c0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0773fff640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f077c0c93a0 0x7f077c0b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f0773fff640 1 -- 172.21.15.122:0/1164528957 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c1f7d90 con 0x7f077c06de70 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.233+0000 7f077bfff640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f077c0c93a0 0x7f077c0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.237+0000 7f0773fff640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f077c06de70 0x7f077c13c480 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f07640b0040 tx=0x7f07640a57a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.237+0000 7f0778ff9640 1 -- 172.21.15.122:0/1164528957 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07640b2040 con 0x7f077c06de70 2024-09-17T06:05:49.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.237+0000 7f0778ff9640 1 -- 172.21.15.122:0/1164528957 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0764005230 con 0x7f077c06de70 2024-09-17T06:05:49.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.237+0000 7f0782248640 1 -- 172.21.15.122:0/1164528957 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077c0b22d0 con 0x7f077c06de70 2024-09-17T06:05:49.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.237+0000 7f0778ff9640 1 -- 172.21.15.122:0/1164528957 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764005640 con 0x7f077c06de70 2024-09-17T06:05:49.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.237+0000 7f0782248640 1 -- 172.21.15.122:0/1164528957 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077c0ada50 con 0x7f077c06de70 2024-09-17T06:05:49.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.237+0000 7f0782248640 1 -- 172.21.15.122:0/1164528957 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f077c0b27f0 con 0x7f077c06de70 2024-09-17T06:05:49.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.237+0000 7f0778ff9640 1 -- 172.21.15.122:0/1164528957 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f07640bf020 con 0x7f077c06de70 2024-09-17T06:05:49.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.237+0000 7f0778ff9640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f075c073200 0x7f075c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:49.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.237+0000 7f0778ff9640 1 -- 172.21.15.122:0/1164528957 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6804+0+0 (secure 0 0 0) 0x7f076412f120 con 0x7f077c06de70 2024-09-17T06:05:49.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.237+0000 7f077b7fe640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f075c073200 0x7f075c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:49.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.237+0000 7f077b7fe640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f075c073200 0x7f075c075710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f076c0058d0 tx=0x7f076c005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:49.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.241+0000 7f0778ff9640 1 -- 172.21.15.122:0/1164528957 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f077c0b27f0 con 0x7f077c06de70 2024-09-17T06:05:49.249 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:49.245+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:49.350 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:49.345+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:49.416 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:49.416 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:49.416 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:49.416 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 95.592969448999995, 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:49.417 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.418 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.419 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:05:49.420 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:49.421 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 95.592857225000003, 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:49.422 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:49.423 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.423 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.423 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.423 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:49.423 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:05:49.423 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:05:49.423 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.423 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:05:49.424 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:49.425 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:49.426 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 95.592651875000001, 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:49.427 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.428 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.428 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.428 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:49.428 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:49.428 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:05:49.428 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.428 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.428 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:49.428 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:05:49.428 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:05:49.428 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.428 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:05:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:49.430 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 95.586511349000006, 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:49.431 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.432 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:05:49.433 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:05:49.434 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:49.435 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 95.586356623, 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:49.436 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.437 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:05:49.438 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:05:49.439 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "MOSDPGPushReply(2.15 43/42 [PushReplyOp(2:a93a17c2:::604.00000000:head)])", 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 28.783255562000001, 2024-09-17T06:05:49.440 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033440999999999999, 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.441 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632988+0000", 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4499999999999996e-07 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632997+0000", 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8349999999999993e-06 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633010+0000", 2024-09-17T06:05:49.442 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2907e-05 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633032+0000", 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2867e-05 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633091+0000", 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8504000000000001e-05 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.443 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633322+0000", 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000230552 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "MOSDPGPushReply(2.15 43/42 [PushReplyOp(2:aa448500:::500.00000000:head)])", 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 28.781043753999999, 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000220134, 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:49.444 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.445 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:49.446 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:49.446 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8999999999999997e-07 2024-09-17T06:05:49.446 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.446 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.446 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:49.446 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635206+0000", 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2949999999999999e-06 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635220+0000", 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3821e-05 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635233+0000", 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3797e-05 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.447 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.448 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:49.448 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635277+0000", 2024-09-17T06:05:49.448 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3161000000000002e-05 2024-09-17T06:05:49.448 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:49.448 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:49.448 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:49.448 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635419+0000", 2024-09-17T06:05:49.448 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014257000000000001 2024-09-17T06:05:49.448 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.448 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:49.449 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.449 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:49.449 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:49.449 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:49.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.417+0000 7f0782248640 1 -- 172.21.15.122:0/1164528957 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd rm-pg-upmap", "pgid": "4.19"} v 0) -- 0x7f077c06eb20 con 0x7f077c06de70 2024-09-17T06:05:49.451 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:05:49.452 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:49.449+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:49.554 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:49.553+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:49.604 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:49.604 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:49.604 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:49.604 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:49.621 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:05:49.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.641+0000 7f0778ff9640 1 -- 172.21.15.122:0/1164528957 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd rm-pg-upmap", "pgid": "4.19"}]=0 clear 4.19 pg_upmap mapping v58) ==== 106+0+0 (secure 0 0 0) 0x7f07640164d0 con 0x7f077c06de70 2024-09-17T06:05:49.644 INFO:teuthology.orchestra.run.smithi122.stderr:clear 4.19 pg_upmap mapping 2024-09-17T06:05:49.650 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.645+0000 7f0782248640 1 -- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f075c073200 msgr2=0x7f075c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:49.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.645+0000 7f0782248640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f075c073200 0x7f075c075710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f076c0058d0 tx=0x7f076c005860 comp rx=0 tx=0).stop 2024-09-17T06:05:49.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.645+0000 7f0782248640 1 -- 172.21.15.122:0/1164528957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f077c06de70 msgr2=0x7f077c13c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:49.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.645+0000 7f0782248640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f077c06de70 0x7f077c13c480 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f07640b0040 tx=0x7f07640a57a0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.645+0000 7f0782248640 1 -- 172.21.15.122:0/1164528957 shutdown_connections 2024-09-17T06:05:49.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.645+0000 7f0782248640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f075c073200 0x7f075c075710 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.645+0000 7f0782248640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f077c0c93a0 0x7f077c0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.645+0000 7f0782248640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f077c06de70 0x7f077c13c480 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.645+0000 7f0782248640 1 --2- 172.21.15.122:0/1164528957 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f077c06ce90 0x7f077c1f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:49.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.645+0000 7f0782248640 1 -- 172.21.15.122:0/1164528957 >> 172.21.15.122:0/1164528957 conn(0x7f077c0cd4f0 msgr2=0x7f077c143aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:49.651 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.645+0000 7f0782248640 1 -- 172.21.15.122:0/1164528957 shutdown_connections 2024-09-17T06:05:49.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:49.645+0000 7f0782248640 1 -- 172.21.15.122:0/1164528957 wait complete. 2024-09-17T06:05:49.659 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:49.653+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:49.754 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:49.753+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:49.810 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:49.810 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:49.810 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:49.811 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:49.811 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:49.829 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:05:49.869 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:49.869+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:49.956 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:49.953+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:50.021 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:50.021 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:50.021 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:50.021 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:50.021 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.021 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:50.022 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:50.022 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 96.197151754000004, 2024-09-17T06:05:50.022 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:05:50.022 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.022 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.022 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.022 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.022 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.022 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.022 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:50.023 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.023 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.023 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.023 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.023 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:50.023 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.023 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.023 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.023 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:05:50.024 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:05:50.025 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.026 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.027 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 96.197031351999996, 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.028 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.029 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:50.029 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.029 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.029 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.029 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.029 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:50.029 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.029 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.029 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.030 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.030 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:05:50.030 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:05:50.032 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.032 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.032 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.033 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:05:50.034 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:50.036 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 96.196903438000007, 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.038 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:05:50.039 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.040 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.041 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 96.195877475000003, 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.042 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.043 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:05:50.045 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:05:50.046 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.047 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 96.195796532000003, 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.048 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.049 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.049 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.049 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:50.049 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.049 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.049 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.049 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.049 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:05:50.049 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:05:50.049 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.050 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.051 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:05:50.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 96.195734130000005, 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.054 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.055 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.056 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:05:50.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 96.195662040000002, 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.063 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 96.195619840000006, 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.064 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.065 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.065 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:50.065 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.065 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.065 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.065 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.065 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:05:50.065 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:05:50.065 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.065 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.065 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.065 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.066 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:05:50.067 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.068 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.068 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.068 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.068 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.068 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:50.068 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:50.068 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 96.193027908000005, 2024-09-17T06:05:50.068 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:05:50.068 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.068 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.068 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.068 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:05:50.069 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:05:50.070 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.070 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.070 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.070 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:05:50.070 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:05:50.070 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.070 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.070 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.070 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:05:50.070 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:05:50.071 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.071 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.071 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.071 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:05:50.071 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:05:50.071 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.072 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.072 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.072 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:05:50.072 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:05:50.072 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.072 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.072 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.072 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:05:50.072 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:05:50.072 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.072 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.072 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.073 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 96.192931772999998, 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.074 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:05:50.075 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.076 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.077 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 96.184499486999997, 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.078 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.079 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:05:50.080 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:05:50.081 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.082 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:05:50.083 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.090910266999998, 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020498320000000001, 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.084 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927895+0000", 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927896+0000", 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6109999999999999e-06 2024-09-17T06:05:50.085 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927910+0000", 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4062e-05 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927930+0000", 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9313999999999998e-05 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.927945+0000", 2024-09-17T06:05:50.086 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5597999999999999e-05 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928115+0000", 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016933900000000001 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.928188+0000", 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3452000000000001e-05 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.087 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929849+0000", 2024-09-17T06:05:50.088 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016613649999999999 2024-09-17T06:05:50.088 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.088 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.088 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.088 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:18.929944+0000", 2024-09-17T06:05:50.088 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5091000000000001e-05 2024-09-17T06:05:50.088 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.088 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.088 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.088 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.088 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.088 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 89.420279902000004, 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.089 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:05:50.091 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:05:50.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.093 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 87.699608945999998, 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.094 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.095 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.095 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.095 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.095 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:50.095 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.095 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.095 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.095 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.095 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:50.095 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.096 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.096 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.096 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.096 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:05:50.096 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:05:50.096 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.096 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.096 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.096 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:05:50.096 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:05:50.096 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.096 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:05:50.097 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.098 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.099 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:41 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 87.696924697, 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00061082699999999998, 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.100 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321880+0000", 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321882+0000", 2024-09-17T06:05:50.101 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0099999999999998e-06 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321894+0000", 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.172e-05 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321924+0000", 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0182e-05 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.102 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321945+0000", 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1339999999999999e-05 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322082+0000", 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013665300000000001 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322112+0000", 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0341999999999999e-05 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.103 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.104 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.104 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322491+0000", 2024-09-17T06:05:50.104 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037858 2024-09-17T06:05:50.104 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.104 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.104 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.104 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.104 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.104 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:50.104 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:50.104 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 86.827722023999996, 2024-09-17T06:05:50.104 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.105 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.106 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.107 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:05:50.108 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.109 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.301281111999998, 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.110 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.111 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.111 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.111 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.111 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.111 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:50.111 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.111 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.111 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.111 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.111 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:50.111 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.111 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.112 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.113 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:05:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:05:50.115 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.301051595999994, 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:05:50.117 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:05:50.118 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:05:50.119 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop_reply(mds.0.4:43 2.14 e26/19 ondisk, result = 0)", 2024-09-17T06:05:50.121 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 66.299086900000006, 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000653211, 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.122 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719718+0000", 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719720+0000", 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0930000000000001e-06 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719757+0000", 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6999000000000003e-05 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.123 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719806+0000", 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8665999999999998e-05 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719829+0000", 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3223000000000001e-05 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720146+0000", 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031701100000000002 2024-09-17T06:05:50.124 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720163+0000", 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6782999999999998e-05 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720371+0000", 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020843599999999999 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.125 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.126 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3611~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:50.126 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:50.126 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 62.365524012999998, 2024-09-17T06:05:50.126 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025412120000000002, 2024-09-17T06:05:50.126 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:50.126 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:50.126 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:50.126 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:50.126 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653281+0000", 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653284+0000", 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7439999999999999e-06 2024-09-17T06:05:50.127 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653303+0000", 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9310999999999999e-05 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653328+0000", 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5466999999999999e-05 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:50.128 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653346+0000", 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7147e-05 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653466+0000", 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0001206 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653613+0000", 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000147312 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.129 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.653814+0000", 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020046800000000001 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655018+0000", 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012044499999999999 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655655+0000", 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00063618500000000005 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.130 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655744+0000", 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9336e-05 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:47.655822+0000", 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8191999999999999e-05 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:50.131 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:50.132 INFO:tasks.workunit.client.0.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T06:05:50.133 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:05:50.134 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:50.129+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:50.158 INFO:tasks.workunit.client.0.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T06:05:50.192 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T06:05:50.219 INFO:tasks.workunit.client.0.smithi122.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T06:05:50.221 INFO:tasks.workunit.client.0.smithi122.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T06:05:50.221 INFO:tasks.workunit.client.0.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T06:05:50.236 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:50.229+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:50.262 INFO:tasks.workunit.client.0.smithi122.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T06:05:50.266 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:05:50.267 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T06:05:50.316 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-09-17T06:05:50.317 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-09-17T06:05:50.317 DEBUG:teuthology.orchestra.run.smithi122:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ce1b342bf8c6349a8c90cd607f83bff2443f21cf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-09-17T06:05:50.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.329+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/1252422903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9c40ced70 msgr2=0x7fc9c40cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:50.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.329+0000 7fc9cbaa4640 1 --2- 172.21.15.122:0/1252422903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9c40ced70 0x7fc9c40cf180 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4159fa0 tx=0x7fc9bc01f370 comp rx=0 tx=0).stop 2024-09-17T06:05:50.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.329+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/1252422903 shutdown_connections 2024-09-17T06:05:50.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.329+0000 7fc9cbaa4640 1 --2- 172.21.15.122:0/1252422903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9c40ced70 0x7fc9c40cf180 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:50.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.329+0000 7fc9cbaa4640 1 --2- 172.21.15.122:0/1252422903 >> v2:172.21.15.173:3300/0 conn(0x7fc9c40c8830 0x7fc9c40b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:50.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.329+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/1252422903 >> 172.21.15.122:0/1252422903 conn(0x7fc9c4070380 msgr2=0x7fc9c4070790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:50.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.329+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/1252422903 shutdown_connections 2024-09-17T06:05:50.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.329+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/1252422903 wait complete. 2024-09-17T06:05:50.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.329+0000 7fc9cbaa4640 1 Processor -- start 2024-09-17T06:05:50.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.329+0000 7fc9cbaa4640 1 -- start start 2024-09-17T06:05:50.335 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:50.335 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:50.336 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:50.336 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:50.336 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:50.333+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:50.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9cbaa4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9c40b2280 0x7fc9c414ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9cbaa4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc9c40c8830 0x7fc9c414a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9cbaa4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9c40ced70 0x7fc9c41e24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9cbaa4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4159ab0 con 0x7fc9c40b2280 2024-09-17T06:05:50.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9cbaa4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c41597d0 con 0x7fc9c40ced70 2024-09-17T06:05:50.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9cbaa4640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c415a2b0 con 0x7fc9c40c8830 2024-09-17T06:05:50.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9c9840640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9c40b2280 0x7fc9c414ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9c9840640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9c40b2280 0x7fc9c414ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58052/0 (socket says 172.21.15.122:58052) 2024-09-17T06:05:50.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9c9840640 1 -- 172.21.15.122:0/789688231 learned_addr learned my addr 172.21.15.122:0/789688231 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9c903f640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc9c40c8830 0x7fc9c414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9ca041640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9c40ced70 0x7fc9c41e24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9c9840640 1 -- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc9c40c8830 msgr2=0x7fc9c414a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9c9840640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc9c40c8830 0x7fc9c414a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9c9840640 1 -- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9c40ced70 msgr2=0x7fc9c41e24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9c9840640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9c40ced70 0x7fc9c41e24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9c9840640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c414f260 con 0x7fc9c40b2280 2024-09-17T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9c9840640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9c40b2280 0x7fc9c414ed20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000c400 tx=0x7fc9c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0017070 con 0x7fc9c40b2280 2024-09-17T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9c0003600 con 0x7fc9c40b2280 2024-09-17T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c414a7c0 con 0x7fc9c40b2280 2024-09-17T06:05:50.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0003a50 con 0x7fc9c40b2280 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c41e32c0 con 0x7fc9c40b2280 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fc9c40b19c0 con 0x7fc9c40b2280 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc9c001a070 con 0x7fc9c40b2280 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9ba7fc640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc9a8073230 0x7fc9a8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6767+0+0 (secure 0 0 0) 0x7fc9c0093f60 con 0x7fc9c40b2280 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v58) ==== 54+0+16 (secure 0 0 0) 0x7fc9c0021070 con 0x7fc9c40b2280 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.333+0000 7fc9c903f640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc9a8073230 0x7fc9a8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.337+0000 7fc9cbaa4640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fc9c40ccc50 0x7fc9c40cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.337+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9c41e22f0 con 0x7fc9c40ccc50 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.337+0000 7fc9ca041640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fc9c40ccc50 0x7fc9c40cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.337+0000 7fc9ca041640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7fc9c40ccc50 0x7fc9c40cd060 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.337+0000 7fc9c903f640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc9a8073230 0x7fc9a8075740 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc9c41f05b0 tx=0x7fc9b400b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:50.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.337+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9c41e22f0 con 0x7fc9c40ccc50 2024-09-17T06:05:50.354 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:05:50.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.353+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc9c41e5250 con 0x7fc9c40ccc50 2024-09-17T06:05:50.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.353+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc9c41e5250 con 0x7fc9c40ccc50 2024-09-17T06:05:50.358 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:50.359 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:50.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.353+0000 7fc9cbaa4640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fc9c40cd5a0 0x7fc9c41f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.353+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fc9c40cc070 con 0x7fc9c40cd5a0 2024-09-17T06:05:50.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.353+0000 7fc9c9840640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fc9c40cd5a0 0x7fc9c41f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.353+0000 7fc9c9840640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7fc9c40cd5a0 0x7fc9c41f2cc0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:50.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.353+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9c40cc070 con 0x7fc9c40cd5a0 2024-09-17T06:05:50.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.369+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc9c40ce580 con 0x7fc9c40cd5a0 2024-09-17T06:05:50.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.373+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc9c40ce580 con 0x7fc9c40cd5a0 2024-09-17T06:05:50.376 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:50.377 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:50.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.373+0000 7fc9cbaa4640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fc9c40638b0 0x7fc9c4063cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.373+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fc9c414e8d0 con 0x7fc9c40638b0 2024-09-17T06:05:50.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.373+0000 7fc9c903f640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fc9c40638b0 0x7fc9c4063cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.373+0000 7fc9c903f640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7fc9c40638b0 0x7fc9c4063cc0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:50.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.373+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9c414e8d0 con 0x7fc9c40638b0 2024-09-17T06:05:50.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.385+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc9c41e2c80 con 0x7fc9c40638b0 2024-09-17T06:05:50.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.389+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc9c41e2c80 con 0x7fc9c40638b0 2024-09-17T06:05:50.392 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:50.393 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:50.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.389+0000 7fc9cbaa4640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc9c40645c0 0x7fc9c40c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.389+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fc9c40ca4e0 con 0x7fc9c40645c0 2024-09-17T06:05:50.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.389+0000 7fc9ca041640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc9c40645c0 0x7fc9c40c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.389+0000 7fc9ca041640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fc9c40645c0 0x7fc9c40c9fa0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:50.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.389+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9c40ca4e0 con 0x7fc9c40645c0 2024-09-17T06:05:50.406 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.401+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc9c40ca9f0 con 0x7fc9c40645c0 2024-09-17T06:05:50.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.405+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc9c40ca9f0 con 0x7fc9c40645c0 2024-09-17T06:05:50.408 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:50.409 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:50.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.405+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=59}) -- 0x7fc9c4202cd0 con 0x7fc9c40b2280 2024-09-17T06:05:50.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.405+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9c40ca9f0 con 0x7fc9c40b2280 2024-09-17T06:05:50.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.405+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fc9c005def0 con 0x7fc9c40b2280 2024-09-17T06:05:50.409 INFO:teuthology.orchestra.run.smithi122.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-17T06:05:50.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.405+0000 7fc9cbaa4640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc9c4202420 0x7fc9c402d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.405+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 10: {"prefix": "get_command_descriptions"}) -- 0x7fc9c4202830 con 0x7fc9c4202420 2024-09-17T06:05:50.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.405+0000 7fc9c9840640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc9c4202420 0x7fc9c402d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.405+0000 7fc9c9840640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc9c4202420 0x7fc9c402d4d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:50.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.409+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 10: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9c4202830 con 0x7fc9c4202420 2024-09-17T06:05:50.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.421+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc9c4202830 con 0x7fc9c4202420 2024-09-17T06:05:50.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.425+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 11: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc9c4202830 con 0x7fc9c4202420 2024-09-17T06:05:50.432 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:50.433 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:50.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.425+0000 7fc9cbaa4640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fc9c402df20 0x7fc9c402e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.425+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7fc9c402e870 con 0x7fc9c402df20 2024-09-17T06:05:50.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.425+0000 7fc9c903f640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fc9c402df20 0x7fc9c402e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.425+0000 7fc9c903f640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7fc9c402df20 0x7fc9c402e330 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:50.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.429+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9c402e870 con 0x7fc9c402df20 2024-09-17T06:05:50.436 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:50.433+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:50.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.441+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc9c4202b20 con 0x7fc9c402df20 2024-09-17T06:05:50.451 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.445+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc9c4202b20 con 0x7fc9c402df20 2024-09-17T06:05:50.451 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:50.452 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:50.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.445+0000 7fc9cbaa4640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fc9c42073d0 0x7fc9c42097f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.445+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7fc9c420c5c0 con 0x7fc9c42073d0 2024-09-17T06:05:50.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.445+0000 7fc9ca041640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fc9c42073d0 0x7fc9c42097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.449+0000 7fc9ca041640 1 --2- 172.21.15.122:0/789688231 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fc9c42073d0 0x7fc9c42097f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:50.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.449+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9c420c5c0 con 0x7fc9c42073d0 2024-09-17T06:05:50.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.461+0000 7fc9cbaa4640 1 -- 172.21.15.122:0/789688231 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc9c4209d30 con 0x7fc9c42073d0 2024-09-17T06:05:50.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.465+0000 7fc9ba7fc640 1 -- 172.21.15.122:0/789688231 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc9c4209d30 con 0x7fc9c42073d0 2024-09-17T06:05:50.471 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:50.471 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:50.478 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T06:05:50.479 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T06:05:50.501 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:50.501 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:50.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:05:50.536 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:50.533+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:50.638 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:50.633+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:50.669 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T06:05:50.718 INFO:teuthology.orchestra.run.smithi173.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:50.718 INFO:teuthology.orchestra.run.smithi173.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:50.736 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T06:05:50.739 INFO:tasks.ceph.osd.1.smithi122.stderr:2024-09-17T06:05:50.733+0000 7f08b937c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 29668) UID: 0 2024-09-17T06:05:50.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 -- 172.21.15.122:0/4196681809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac006dab0 msgr2=0x7f7ac015b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:50.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 --2- 172.21.15.122:0/4196681809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac006dab0 0x7f7ac015b470 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0009840 tx=0x7f7ab001c790 comp rx=0 tx=0).stop 2024-09-17T06:05:50.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 -- 172.21.15.122:0/4196681809 shutdown_connections 2024-09-17T06:05:50.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 --2- 172.21.15.122:0/4196681809 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ac00cbb40 0x7f7ac015b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:50.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 --2- 172.21.15.122:0/4196681809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac006dab0 0x7f7ac015b470 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:50.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 -- 172.21.15.122:0/4196681809 >> 172.21.15.122:0/4196681809 conn(0x7f7ac008d450 msgr2=0x7f7ac006ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:50.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 -- 172.21.15.122:0/4196681809 shutdown_connections 2024-09-17T06:05:50.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 -- 172.21.15.122:0/4196681809 wait complete. 2024-09-17T06:05:50.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 Processor -- start 2024-09-17T06:05:50.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 -- start start 2024-09-17T06:05:50.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ac006dab0 0x7f7ac01f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ac00cbb40 0x7f7ac01483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac00ccdb0 0x7f7ac01488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac00cca70 con 0x7f7ac00ccdb0 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac00cc8f0 con 0x7f7ac006dab0 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac76d3640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac0168510 con 0x7f7ac00cbb40 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac5c70640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac00ccdb0 0x7f7ac01488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac5c70640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac00ccdb0 0x7f7ac01488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58058/0 (socket says 172.21.15.122:58058) 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac5c70640 1 -- 172.21.15.122:0/2470127264 learned_addr learned my addr 172.21.15.122:0/2470127264 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac4c6e640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ac00cbb40 0x7f7ac01483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac546f640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ac006dab0 0x7f7ac01f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac5c70640 1 -- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ac00cbb40 msgr2=0x7f7ac01483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac5c70640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ac00cbb40 0x7f7ac01483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac5c70640 1 -- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ac006dab0 msgr2=0x7f7ac01f8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac5c70640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ac006dab0 0x7f7ac01f8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:50.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac5c70640 1 -- 172.21.15.122:0/2470127264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac0152320 con 0x7f7ac00ccdb0 2024-09-17T06:05:50.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.833+0000 7f7ac4c6e640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ac00cbb40 0x7f7ac01483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:05:50.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.837+0000 7f7ac5c70640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac00ccdb0 0x7f7ac01488e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800e940 tx=0x7f7ab800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:50.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.837+0000 7f7ab5ffb640 1 -- 172.21.15.122:0/2470127264 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8004d30 con 0x7f7ac00ccdb0 2024-09-17T06:05:50.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.837+0000 7f7ab5ffb640 1 -- 172.21.15.122:0/2470127264 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ab800cac0 con 0x7f7ac00ccdb0 2024-09-17T06:05:50.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.837+0000 7f7ab5ffb640 1 -- 172.21.15.122:0/2470127264 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8005020 con 0x7f7ac00ccdb0 2024-09-17T06:05:50.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.837+0000 7f7ac76d3640 1 -- 172.21.15.122:0/2470127264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac01f7d80 con 0x7f7ac00ccdb0 2024-09-17T06:05:50.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.837+0000 7f7ac76d3640 1 -- 172.21.15.122:0/2470127264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac0152590 con 0x7f7ac00ccdb0 2024-09-17T06:05:50.843 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:50.837+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:50.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.837+0000 7f7ac76d3640 1 -- 172.21.15.122:0/2470127264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac00cc1e0 con 0x7f7ac00ccdb0 2024-09-17T06:05:50.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.837+0000 7f7ab5ffb640 1 -- 172.21.15.122:0/2470127264 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7ab80051c0 con 0x7f7ac00ccdb0 2024-09-17T06:05:50.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.837+0000 7f7ab5ffb640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7aa4073230 0x7f7aa4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:50.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.837+0000 7f7ab5ffb640 1 -- 172.21.15.122:0/2470127264 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6767+0+0 (secure 0 0 0) 0x7f7ab8094df0 con 0x7f7ac00ccdb0 2024-09-17T06:05:50.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.837+0000 7f7ac546f640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7aa4073230 0x7f7aa4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:50.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.841+0000 7f7ac546f640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7aa4073230 0x7f7aa4075740 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7abc000f70 tx=0x7f7abc009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:50.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:50.845+0000 7f7ab5ffb640 1 -- 172.21.15.122:0/2470127264 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7ac01f7d80 con 0x7f7ac00ccdb0 2024-09-17T06:05:50.884 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:50.884 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:50.902 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T06:05:50.948 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:50.945+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:51.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.025+0000 7f7ac76d3640 1 -- 172.21.15.122:0/2470127264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) -- 0x7f7ac0158d90 con 0x7f7ac00ccdb0 2024-09-17T06:05:51.042 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:51.037+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:51.045 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:51.045 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:51.062 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T06:05:51.142 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:51.141+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:51.243 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:51.241+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:51.250 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:51.250 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:51.269 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T06:05:51.356 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:51.353+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:51.446 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:51.441+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:51.459 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:51.459 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:51.477 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T06:05:51.547 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:51.545+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:51.648 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:51.645+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:51.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.661+0000 7f7ab5ffb640 1 -- 172.21.15.122:0/2470127264 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v60) ==== 97+0+0 (secure 0 0 0) 0x7f7ab8016030 con 0x7f7ac00ccdb0 2024-09-17T06:05:51.666 INFO:teuthology.orchestra.run.smithi122.stderr:nodeep-scrub is set 2024-09-17T06:05:51.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.665+0000 7f7ac76d3640 1 -- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7aa4073230 msgr2=0x7f7aa4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:51.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.665+0000 7f7ac76d3640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7aa4073230 0x7f7aa4075740 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7abc000f70 tx=0x7f7abc009040 comp rx=0 tx=0).stop 2024-09-17T06:05:51.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.665+0000 7f7ac76d3640 1 -- 172.21.15.122:0/2470127264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac00ccdb0 msgr2=0x7f7ac01488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:51.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.665+0000 7f7ac76d3640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac00ccdb0 0x7f7ac01488e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800e940 tx=0x7f7ab800ee00 comp rx=0 tx=0).stop 2024-09-17T06:05:51.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.665+0000 7f7ac76d3640 1 -- 172.21.15.122:0/2470127264 shutdown_connections 2024-09-17T06:05:51.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.665+0000 7f7ac76d3640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ac00ccdb0 0x7f7ac01488e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:51.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.665+0000 7f7ac76d3640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ac00cbb40 0x7f7ac01483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:51.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.665+0000 7f7ac76d3640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7aa4073230 0x7f7aa4075740 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:51.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.665+0000 7f7ac76d3640 1 --2- 172.21.15.122:0/2470127264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ac006dab0 0x7f7ac01f8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:51.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.665+0000 7f7ac76d3640 1 -- 172.21.15.122:0/2470127264 >> 172.21.15.122:0/2470127264 conn(0x7f7ac008d450 msgr2=0x7f7ac00b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:51.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.665+0000 7f7ac76d3640 1 -- 172.21.15.122:0/2470127264 shutdown_connections 2024-09-17T06:05:51.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:51.665+0000 7f7ac76d3640 1 -- 172.21.15.122:0/2470127264 wait complete. 2024-09-17T06:05:51.690 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:51.690 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:51.714 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T06:05:51.756 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:51.753+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:51.850 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:51.845+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:51.905 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:51.905 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:51.923 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T06:05:51.968 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:51.965+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:52.051 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:52.049+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:52.121 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:52.121 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:52.139 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T06:05:52.152 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-09-17T06:05:52.149+0000 7f58d8302640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29188) UID: 0 2024-09-17T06:05:52.253 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-09-17T06:05:52.253+0000 7f99db485640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29184) UID: 0 2024-09-17T06:05:52.286 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:52.287 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:52.305 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T06:05:52.354 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:52.349+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:52.455 INFO:tasks.ceph.osd.3.smithi122.stderr:2024-09-17T06:05:52.449+0000 7f4fce5bf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 29672) UID: 0 2024-09-17T06:05:52.457 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:52.457 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:52.476 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T06:05:52.480 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T06:05:52.545 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T06:05:52.545 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T06:05:52.592 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:52.589+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:52.644 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-09-17T06:05:52.644 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T06:05:52.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 -- 172.21.15.122:0/4142046723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec0b3b80 msgr2=0x7f3dec152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:52.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 --2- 172.21.15.122:0/4142046723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec0b3b80 0x7f3dec152280 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0ce2c0 tx=0x7f3ddc01eed0 comp rx=0 tx=0).stop 2024-09-17T06:05:52.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 -- 172.21.15.122:0/4142046723 shutdown_connections 2024-09-17T06:05:52.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 --2- 172.21.15.122:0/4142046723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec0b3b80 0x7f3dec152280 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:52.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 --2- 172.21.15.122:0/4142046723 >> v2:172.21.15.173:3300/0 conn(0x7f3dec06f5c0 0x7f3dec0c2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:52.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 -- 172.21.15.122:0/4142046723 >> 172.21.15.122:0/4142046723 conn(0x7f3dec073640 msgr2=0x7f3dec0cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:52.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 -- 172.21.15.122:0/4142046723 shutdown_connections 2024-09-17T06:05:52.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 -- 172.21.15.122:0/4142046723 wait complete. 2024-09-17T06:05:52.673 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:52.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 Processor -- start 2024-09-17T06:05:52.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 -- start start 2024-09-17T06:05:52.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3dec0b3b80 0x7f3dec0c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:52.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3dec0c9fc0 0x7f3dec0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:52.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec15ae40 0x7f3dec15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:52.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec0c2f60 con 0x7f3dec15ae40 2024-09-17T06:05:52.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec06f0a0 con 0x7f3dec0b3b80 2024-09-17T06:05:52.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.669+0000 7f3df3756640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3dec1527c0 con 0x7f3dec0c9fc0 2024-09-17T06:05:52.676 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df1cf3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec15ae40 0x7f3dec15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:52.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df1cf3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec15ae40 0x7f3dec15b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58086/0 (socket says 172.21.15.122:58086) 2024-09-17T06:05:52.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df1cf3640 1 -- 172.21.15.122:0/885795304 learned_addr learned my addr 172.21.15.122:0/885795304 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:52.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df0cf1640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3dec0c9fc0 0x7f3dec0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:52.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df14f2640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3dec0b3b80 0x7f3dec0c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:52.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df1cf3640 1 -- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3dec0c9fc0 msgr2=0x7f3dec0c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:52.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df1cf3640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3dec0c9fc0 0x7f3dec0c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:52.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df1cf3640 1 -- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3dec0b3b80 msgr2=0x7f3dec0c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:52.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df1cf3640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3dec0b3b80 0x7f3dec0c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:52.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df1cf3640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dec15b790 con 0x7f3dec15ae40 2024-09-17T06:05:52.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df1cf3640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec15ae40 0x7f3dec15b250 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3de400ba10 tx=0x7f3de400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:52.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de4019070 con 0x7f3dec15ae40 2024-09-17T06:05:52.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3de400cc30 con 0x7f3dec15ae40 2024-09-17T06:05:52.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de400ce60 con 0x7f3dec15ae40 2024-09-17T06:05:52.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dec15bae0 con 0x7f3dec15ae40 2024-09-17T06:05:52.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dec15c340 con 0x7f3dec15ae40 2024-09-17T06:05:52.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f3dec15bdd0 con 0x7f3dec15ae40 2024-09-17T06:05:52.679 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-09-17T06:05:52.679 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T06:05:52.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3de401c070 con 0x7f3dec15ae40 2024-09-17T06:05:52.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3de1ffb640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3dd0073230 0x7f3dd0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:52.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.673+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6767+0+0 (secure 0 0 0) 0x7f3de4094190 con 0x7f3dec15ae40 2024-09-17T06:05:52.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.677+0000 7f3df14f2640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3dd0073230 0x7f3dd0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:52.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.677+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v60) ==== 54+0+16 (secure 0 0 0) 0x7f3dec15b790 con 0x7f3dec15ae40 2024-09-17T06:05:52.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.677+0000 7f3df3756640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f3dec14b660 0x7f3dec14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:52.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.677+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3dec06f5c0 con 0x7f3dec14b660 2024-09-17T06:05:52.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.677+0000 7f3df0cf1640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f3dec14b660 0x7f3dec14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:52.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.677+0000 7f3df0cf1640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f3dec14b660 0x7f3dec14ba70 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:52.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.677+0000 7f3df14f2640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3dd0073230 0x7f3dd0075740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3de8005fd0 tx=0x7f3de8005d10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:52.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.677+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3dec06f5c0 con 0x7f3dec14b660 2024-09-17T06:05:52.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.693+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f3dec0c96b0 con 0x7f3dec14b660 2024-09-17T06:05:52.698 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T06:05:52.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.693+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f3dec0c96b0 con 0x7f3dec14b660 2024-09-17T06:05:52.699 INFO:teuthology.orchestra.run.smithi122.stdout:osd.0: {} 2024-09-17T06:05:52.700 INFO:teuthology.orchestra.run.smithi122.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T06:05:52.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.693+0000 7f3df3756640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f3dec1f4fc0 0x7f3dec1f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:52.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.693+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f3dec1f5910 con 0x7f3dec1f4fc0 2024-09-17T06:05:52.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.693+0000 7f3df14f2640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f3dec1f4fc0 0x7f3dec1f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:52.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.693+0000 7f3df14f2640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f3dec1f4fc0 0x7f3dec1f53d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:52.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.697+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3dec1f5910 con 0x7f3dec1f4fc0 2024-09-17T06:05:52.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.709+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f3dec06dc20 con 0x7f3dec1f4fc0 2024-09-17T06:05:52.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.713+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f3dec06dc20 con 0x7f3dec1f4fc0 2024-09-17T06:05:52.716 INFO:teuthology.orchestra.run.smithi122.stdout:osd.1: {} 2024-09-17T06:05:52.716 INFO:teuthology.orchestra.run.smithi122.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T06:05:52.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.713+0000 7f3df3756640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f3dec063dc0 0x7f3dec0641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:52.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.713+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f3dec0ca920 con 0x7f3dec063dc0 2024-09-17T06:05:52.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.713+0000 7f3df0cf1640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f3dec063dc0 0x7f3dec0641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:52.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.713+0000 7f3df0cf1640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f3dec063dc0 0x7f3dec0641d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:52.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.713+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3dec0ca920 con 0x7f3dec063dc0 2024-09-17T06:05:52.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.725+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f3dec06d9c0 con 0x7f3dec063dc0 2024-09-17T06:05:52.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.729+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f3ddc0043a0 con 0x7f3dec063dc0 2024-09-17T06:05:52.733 INFO:teuthology.orchestra.run.smithi122.stdout:osd.2: {} 2024-09-17T06:05:52.734 INFO:teuthology.orchestra.run.smithi122.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T06:05:52.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.729+0000 7f3df3756640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f3dec150a50 0x7f3dec150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:52.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.729+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f3dec151420 con 0x7f3dec150a50 2024-09-17T06:05:52.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.729+0000 7f3df1cf3640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f3dec150a50 0x7f3dec150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:52.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.729+0000 7f3df1cf3640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f3dec150a50 0x7f3dec150e60 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:52.735 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.729+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3dec151420 con 0x7f3dec150a50 2024-09-17T06:05:52.748 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.745+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f3dec0b3780 con 0x7f3dec150a50 2024-09-17T06:05:52.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.745+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f3dec0b3780 con 0x7f3dec150a50 2024-09-17T06:05:52.750 INFO:teuthology.orchestra.run.smithi122.stdout:osd.3: {} 2024-09-17T06:05:52.751 INFO:teuthology.orchestra.run.smithi122.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T06:05:52.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.745+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=61}) -- 0x7f3dec0b3990 con 0x7f3dec15ae40 2024-09-17T06:05:52.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.745+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3dec204fa0 con 0x7f3dec15ae40 2024-09-17T06:05:52.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.745+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f3de409b070 con 0x7f3dec15ae40 2024-09-17T06:05:52.752 INFO:teuthology.orchestra.run.smithi122.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-09-17T06:05:52.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.745+0000 7f3df3756640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f3dec2046f0 0x7f3dec02d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:52.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.745+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 10: {"prefix": "get_command_descriptions"}) -- 0x7f3dec204d40 con 0x7f3dec2046f0 2024-09-17T06:05:52.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.749+0000 7f3df14f2640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f3dec2046f0 0x7f3dec02d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:52.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.749+0000 7f3df14f2640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f3dec2046f0 0x7f3dec02d4d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:52.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.749+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 10: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3dec204d40 con 0x7f3dec2046f0 2024-09-17T06:05:52.757 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-09-17T06:05:52.757+0000 7f1403cef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29186) UID: 0 2024-09-17T06:05:52.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.765+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 11: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f3dec02da10 con 0x7f3dec2046f0 2024-09-17T06:05:52.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.769+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 11: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f3dec02da10 con 0x7f3dec2046f0 2024-09-17T06:05:52.773 INFO:teuthology.orchestra.run.smithi122.stdout:osd.5: {} 2024-09-17T06:05:52.773 INFO:teuthology.orchestra.run.smithi122.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T06:05:52.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.769+0000 7f3df3756640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f3dec02e4f0 0x7f3dec209170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:52.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.769+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7f3dec02e900 con 0x7f3dec02e4f0 2024-09-17T06:05:52.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.769+0000 7f3df0cf1640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f3dec02e4f0 0x7f3dec209170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:52.774 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.769+0000 7f3df0cf1640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f3dec02e4f0 0x7f3dec209170 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:52.776 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.773+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3dec02e900 con 0x7f3dec02e4f0 2024-09-17T06:05:52.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.785+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f3dec02e900 con 0x7f3dec02e4f0 2024-09-17T06:05:52.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.789+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f3dec02e900 con 0x7f3dec02e4f0 2024-09-17T06:05:52.795 INFO:teuthology.orchestra.run.smithi122.stdout:osd.6: {} 2024-09-17T06:05:52.795 INFO:teuthology.orchestra.run.smithi122.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T06:05:52.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.789+0000 7f3df3756640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f3dec209bc0 0x7f3dec20bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:52.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.789+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7f3dec20eef0 con 0x7f3dec209bc0 2024-09-17T06:05:52.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.789+0000 7f3df1cf3640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f3dec209bc0 0x7f3dec20bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:52.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.793+0000 7f3df1cf3640 1 --2- 172.21.15.122:0/885795304 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f3dec209bc0 0x7f3dec20bfe0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:52.798 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.793+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3dec20eef0 con 0x7f3dec209bc0 2024-09-17T06:05:52.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.805+0000 7f3df3756640 1 -- 172.21.15.122:0/885795304 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f3dec20c520 con 0x7f3dec209bc0 2024-09-17T06:05:52.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:52.813+0000 7f3de1ffb640 1 -- 172.21.15.122:0/885795304 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f3dec20c520 con 0x7f3dec209bc0 2024-09-17T06:05:52.816 INFO:teuthology.orchestra.run.smithi122.stdout:osd.7: {} 2024-09-17T06:05:52.817 INFO:teuthology.orchestra.run.smithi122.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T06:05:52.823 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T06:05:52.824 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T06:05:52.842 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:52.843 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-09-17T06:05:52.843 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 180, 2024-09-17T06:05:52.843 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-09-17T06:05:52.843 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:52.858 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-17T06:05:52.853+0000 7ffa6ceaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 29666) UID: 0 2024-09-17T06:05:52.861 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T06:05:52.951 DEBUG:teuthology.parallel:result is None 2024-09-17T06:05:52.951 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T06:05:52.975 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T06:05:52.975 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-17T06:05:52.986 INFO:tasks.thrashosds:joining thrashosds 2024-09-17T06:05:52.986 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-09-17T06:05:52.969+0000 7f9184c05640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 29670) UID: 0 2024-09-17T06:05:53.045 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:05:53.045 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-09-17T06:05:53.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.221070803999993, 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044462499999999997, 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823262+0000", 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823264+0000", 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3300000000000001e-06 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823284+0000", 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0132e-05 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823364+0000", 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9583e-05 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823395+0000", 2024-09-17T06:05:53.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1171999999999999e-05 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823538+0000", 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014286600000000001 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823594+0000", 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890999999999997e-05 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827597+0000", 2024-09-17T06:05:53.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004003665 2024-09-17T06:05:53.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827708+0000", 2024-09-17T06:05:53.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110611 2024-09-17T06:05:53.050 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.050 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.050 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.051 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:53.051 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:53.051 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.220878353000003, 2024-09-17T06:05:53.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043686330000000002, 2024-09-17T06:05:53.051 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.051 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.051 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.051 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:53.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823454+0000", 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823455+0000", 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2160000000000001e-06 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823471+0000", 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5702999999999999e-05 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823492+0000", 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1039e-05 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.823512+0000", 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0364999999999999e-05 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824294+0000", 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00078187600000000003 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824350+0000", 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5367e-05 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827719+0000", 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003368916 2024-09-17T06:05:53.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827823+0000", 2024-09-17T06:05:53.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104151 2024-09-17T06:05:53.055 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.055 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.055 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.220317574000006, 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0094234149999999992, 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824015+0000", 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824018+0000", 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3629999999999998e-06 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824036+0000", 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7606000000000001e-05 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824065+0000", 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9005000000000001e-05 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824092+0000", 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7396e-05 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826491+0000", 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002398776 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826804+0000", 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000312782 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833438+0000", 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066344869999999997 2024-09-17T06:05:53.059 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.220247591000003, 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048433540000000002, 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:53.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824085+0000", 2024-09-17T06:05:53.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824087+0000", 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1830000000000001e-06 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824106+0000", 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8595999999999999e-05 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824137+0000", 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1322000000000003e-05 2024-09-17T06:05:53.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824164+0000", 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6605e-05 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824807+0000", 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064339900000000001 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824861+0000", 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3687000000000003e-05 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828809+0000", 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039483909999999999 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828928+0000", 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119171 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.064 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.220166922000004, 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092145760000000004, 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:53.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824165+0000", 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824167+0000", 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7540000000000001e-06 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824178+0000", 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0276e-05 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824202+0000", 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4685000000000002e-05 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.824223+0000", 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1036e-05 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825070+0000", 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084684500000000004 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825392+0000", 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032213499999999998 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833380+0000", 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079878450000000004 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.068 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.219161990999993, 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038480469999999998, 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825170+0000", 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825172+0000", 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.967e-06 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825190+0000", 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7866000000000001e-05 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825217+0000", 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6682e-05 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825239+0000", 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1968999999999999e-05 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825632+0000", 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00039355100000000001 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.825690+0000", 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7797000000000002e-05 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828935+0000", 2024-09-17T06:05:53.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032449449999999999 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829018+0000", 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3269999999999994e-05 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:53.073 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.218107488000001, 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002834755, 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826225+0000", 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826227+0000", 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.906e-06 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826256+0000", 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8872000000000001e-05 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826399+0000", 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143156 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826453+0000", 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4465000000000001e-05 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.826628+0000", 2024-09-17T06:05:53.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017420700000000001 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829060+0000", 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024321490000000002 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:53.077 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.216356856999994, 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055191049999999998, 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827976+0000", 2024-09-17T06:05:53.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827978+0000", 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0200000000000001e-06 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.827997+0000", 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9836000000000001e-05 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828029+0000", 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1720999999999997e-05 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828055+0000", 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5519000000000001e-05 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828193+0000", 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013821699999999999 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828232+0000", 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9351000000000003e-05 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833396+0000", 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051640119999999999 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833495+0000", 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8429000000000002e-05 2024-09-17T06:05:53.081 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.216231316000005, 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054928850000000003, 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828101+0000", 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828102+0000", 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1960000000000001e-06 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828116+0000", 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3716e-05 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828139+0000", 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3028999999999999e-05 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.828156+0000", 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869000000000001e-05 2024-09-17T06:05:53.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829124+0000", 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096778700000000001 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.829158+0000", 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4671000000000001e-05 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833509+0000", 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004350802 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833594+0000", 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4814999999999993e-05 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:53.086 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.211480090999999, 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064859200000000003, 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832852+0000", 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832854+0000", 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8330000000000001e-06 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832867+0000", 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.332e-05 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832906+0000", 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8800999999999997e-05 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6468000000000003e-05 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833094+0000", 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014082600000000001 2024-09-17T06:05:53.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833501+0000", 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040734400000000002 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.211383286, 2024-09-17T06:05:53.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00050376900000000005, 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832949+0000", 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832952+0000", 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4269999999999998e-06 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832965+0000", 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3736e-05 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.832998+0000", 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2264999999999997e-05 2024-09-17T06:05:53.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833027+0000", 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9658999999999998e-05 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833172+0000", 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014431900000000001 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.833453+0000", 2024-09-17T06:05:53.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028136300000000002 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.209386350000003, 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00294042, 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834946+0000", 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834948+0000", 2024-09-17T06:05:53.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.21e-06 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.834968+0000", 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9443e-05 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835013+0000", 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5324000000000002e-05 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835038+0000", 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5358999999999999e-05 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835255+0000", 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021677600000000001 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.835304+0000", 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9261000000000002e-05 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837761+0000", 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024567230000000001 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:13.837886+0000", 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012532400000000001 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.098 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 92.445474993999994, 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001082132, 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598857+0000", 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598860+0000", 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4569999999999999e-06 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598901+0000", 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1400999999999999e-05 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598934+0000", 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3012000000000002e-05 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.598959+0000", 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4839000000000001e-05 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599073+0000", 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113763 2024-09-17T06:05:53.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599099+0000", 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6120999999999999e-05 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599900+0000", 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00080140099999999998 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:20.599940+0000", 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9137999999999997e-05 2024-09-17T06:05:53.102 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.724827082999994, 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00153148, 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319505+0000", 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319508+0000", 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5399999999999998e-06 2024-09-17T06:05:53.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319533+0000", 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4759000000000001e-05 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319568+0000", 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5305000000000002e-05 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319602+0000", 2024-09-17T06:05:53.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3992999999999998e-05 2024-09-17T06:05:53.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319715+0000", 2024-09-17T06:05:53.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113112 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.319745+0000", 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9580000000000001e-05 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.320978+0000", 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001233165 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:22.321037+0000", 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9026e-05 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 89.852655972999997, 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00083231099999999997, 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.108 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191676+0000", 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191678+0000", 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6869999999999999e-06 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191693+0000", 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4409e-05 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191713+0000", 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0523e-05 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191726+0000", 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3386e-05 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191806+0000", 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9287000000000002e-05 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.191834+0000", 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8323e-05 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192473+0000", 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063865000000000005 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:23.192509+0000", 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6046e-05 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-17T06:05:53.112 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.326547696999995, 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096842599999999999, 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717785+0000", 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717787+0000", 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.951e-06 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717801+0000", 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3973e-05 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717822+0000", 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1328e-05 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717836+0000", 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3944000000000001e-05 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717908+0000", 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1674999999999994e-05 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.717940+0000", 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2728999999999998e-05 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718710+0000", 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076948100000000003 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718753+0000", 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3344999999999999e-05 2024-09-17T06:05:53.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.325466886000001, 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065812800000000001, 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718866+0000", 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5000000000000001e-07 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718872+0000", 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5130000000000004e-06 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718883+0000", 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1195e-05 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718892+0000", 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5669999999999995e-06 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718931+0000", 2024-09-17T06:05:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8850000000000002e-05 2024-09-17T06:05:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.718948+0000", 2024-09-17T06:05:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7425999999999999e-05 2024-09-17T06:05:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719496+0000", 2024-09-17T06:05:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00054753699999999996 2024-09-17T06:05:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:43.719524+0000", 2024-09-17T06:05:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.809e-05 2024-09-17T06:05:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.121 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:45 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'12, mlcod=26'10)", 2024-09-17T06:05:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.391100905000002, 2024-09-17T06:05:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013449270000000001, 2024-09-17T06:05:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653232+0000", 2024-09-17T06:05:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653233+0000", 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.796e-06 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653250+0000", 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7025999999999999e-05 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653272+0000", 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1338000000000001e-05 2024-09-17T06:05:53.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653287+0000", 2024-09-17T06:05:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5509999999999999e-05 2024-09-17T06:05:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653383+0000", 2024-09-17T06:05:53.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5904999999999997e-05 2024-09-17T06:05:53.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.653417+0000", 2024-09-17T06:05:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3923e-05 2024-09-17T06:05:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654510+0000", 2024-09-17T06:05:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001092602 2024-09-17T06:05:53.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:04:47.654576+0000", 2024-09-17T06:05:53.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6827000000000002e-05 2024-09-17T06:05:53.128 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.128 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.129 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.129 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.4:53 2.14 e60/19 2:2e2fa760:::200.00000001:head v 60'17, mlcod=60'15)", 2024-09-17T06:05:53.129 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-09-17T06:05:52.965366+0000", 2024-09-17T06:05:53.129 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.078966550999999996, 2024-09-17T06:05:53.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014477660000000001, 2024-09-17T06:05:53.130 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-09-17T06:05:53.130 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-09-17T06:05:53.130 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.130 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-09-17T06:05:53.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-09-17T06:05:53.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:05:52.965366+0000", 2024-09-17T06:05:53.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-09-17T06:05:53.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:05:52.965366+0000", 2024-09-17T06:05:53.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-09-17T06:05:53.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-09-17T06:05:53.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:05:52.965368+0000", 2024-09-17T06:05:53.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.86e-06 2024-09-17T06:05:53.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-09-17T06:05:53.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:05:52.965387+0000", 2024-09-17T06:05:53.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8780999999999999e-05 2024-09-17T06:05:53.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-09-17T06:05:53.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:05:52.965409+0000", 2024-09-17T06:05:53.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2911000000000001e-05 2024-09-17T06:05:53.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:05:52.965438+0000", 2024-09-17T06:05:53.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9037999999999999e-05 2024-09-17T06:05:53.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-09-17T06:05:53.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:05:52.965531+0000", 2024-09-17T06:05:53.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2156000000000003e-05 2024-09-17T06:05:53.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-09-17T06:05:53.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:05:52.965565+0000", 2024-09-17T06:05:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4113999999999999e-05 2024-09-17T06:05:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-09-17T06:05:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:05:52.966713+0000", 2024-09-17T06:05:53.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011481239999999999 2024-09-17T06:05:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-17T06:05:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-09-17T06:05:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-09-17T06:05:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-09-17T06:05:52.966814+0000", 2024-09-17T06:05:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100782 2024-09-17T06:05:53.138 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-17T06:05:53.139 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-17T06:05:53.139 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:05:53.141 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T06:05:53.299 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:53.299 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:53.300 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:53.300 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:53.317 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T06:05:53.470 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:53.470 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:53.470 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:53.470 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:53.470 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:53.487 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T06:05:53.630 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:53.631 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:53.631 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:53.631 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:53.631 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.631 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:53.631 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:53.631 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 99.807928132000001, 2024-09-17T06:05:53.631 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002084696, 2024-09-17T06:05:53.631 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:53.631 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:53.631 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823273+0000", 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.632 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:53.633 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823275+0000", 2024-09-17T06:05:53.633 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1550000000000001e-06 2024-09-17T06:05:53.633 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.633 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.633 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:53.633 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823291+0000", 2024-09-17T06:05:53.633 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5713999999999999e-05 2024-09-17T06:05:53.633 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.633 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.633 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:53.633 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823323+0000", 2024-09-17T06:05:53.633 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1486000000000003e-05 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823340+0000", 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7778000000000002e-05 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823581+0000", 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024098199999999999 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.634 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823631+0000", 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9518000000000003e-05 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825278+0000", 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001647241 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825358+0000", 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9821999999999996e-05 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.635 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 99.807815907999995, 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042774290000000001, 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.636 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823385+0000", 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823386+0000", 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8700000000000005e-07 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.637 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823394+0000", 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9039999999999992e-06 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823407+0000", 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2371000000000001e-05 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823417+0000", 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0016e-05 2024-09-17T06:05:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.639 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.639 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:53.639 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824067+0000", 2024-09-17T06:05:53.639 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00064995899999999998 2024-09-17T06:05:53.639 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.639 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.639 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:53.639 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824098+0000", 2024-09-17T06:05:53.639 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1409999999999999e-05 2024-09-17T06:05:53.639 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827586+0000", 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034879260000000001 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827663+0000", 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7056000000000002e-05 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.640 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 99.807610557999993, 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040468409999999998, 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:53.641 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823591+0000", 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5599999999999995e-07 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823599+0000", 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.5270000000000001e-06 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823618+0000", 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9358999999999999e-05 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823650+0000", 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1498999999999998e-05 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.643 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823757+0000", 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010752900000000001 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823791+0000", 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3966e-05 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827551+0000", 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0037598359999999999 2024-09-17T06:05:53.644 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.827638+0000", 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6569000000000004e-05 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 99.801470031999997, 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003300065, 2024-09-17T06:05:53.645 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829731+0000", 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.646 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829733+0000", 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2759999999999999e-06 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829807+0000", 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4361000000000002e-05 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:53.647 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829834+0000", 2024-09-17T06:05:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7101e-05 2024-09-17T06:05:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829849+0000", 2024-09-17T06:05:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5235999999999999e-05 2024-09-17T06:05:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829941+0000", 2024-09-17T06:05:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1186000000000004e-05 2024-09-17T06:05:53.648 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829976+0000", 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5023e-05 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.832953+0000", 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029772510000000002 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833031+0000", 2024-09-17T06:05:53.649 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8631e-05 2024-09-17T06:05:53.650 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.650 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:53.650 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.650 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.650 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.650 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-17T06:05:53.650 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:53.650 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 99.801315306000006, 2024-09-17T06:05:53.650 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003763092, 2024-09-17T06:05:53.650 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:53.650 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829886+0000", 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.651 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.652 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:53.652 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829887+0000", 2024-09-17T06:05:53.652 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6400000000000001e-07 2024-09-17T06:05:53.652 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.652 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.652 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:53.652 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829894+0000", 2024-09-17T06:05:53.652 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6190000000000002e-06 2024-09-17T06:05:53.652 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.652 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.652 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:53.652 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829907+0000", 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2048000000000001e-05 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829917+0000", 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0735e-05 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830335+0000", 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000417954 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.653 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830373+0000", 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7897e-05 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833597+0000", 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032240459999999999 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.833649+0000", 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2028999999999999e-05 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.654 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "MOSDPGPushReply(2.15 43/42 [PushReplyOp(2:a93a17c2:::604.00000000:head)])", 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 32.998214245, 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033440999999999999, 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.655 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632987+0000", 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632988+0000", 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4499999999999996e-07 2024-09-17T06:05:53.656 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.632997+0000", 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8349999999999993e-06 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633010+0000", 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2907e-05 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633032+0000", 2024-09-17T06:05:53.657 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2867e-05 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633091+0000", 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.8504000000000001e-05 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.633322+0000", 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000230552 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "MOSDPGPushReply(2.15 43/42 [PushReplyOp(2:aa448500:::500.00000000:head)])", 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 32.996002437000001, 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000220134, 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "reached pg", 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:53.659 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635199+0000", 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8999999999999997e-07 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.660 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635206+0000", 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2949999999999999e-06 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635220+0000", 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3821e-05 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635233+0000", 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3797e-05 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.661 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635277+0000", 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3161000000000002e-05 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:20.635419+0000", 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014257000000000001 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:53.662 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:53.663 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:53.664 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T06:05:53.704 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T06:05:53.815 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:53.815 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:53.815 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:53.815 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:53.832 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T06:05:53.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.861+0000 7f04fc247640 1 -- 172.21.15.122:0/3989847524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f4153090 msgr2=0x7f04f4159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:53.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.861+0000 7f04fc247640 1 --2- 172.21.15.122:0/3989847524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f4153090 0x7f04f4159b00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009900 tx=0x7f04e801f0d0 comp rx=0 tx=0).stop 2024-09-17T06:05:53.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.861+0000 7f04fc247640 1 -- 172.21.15.122:0/3989847524 shutdown_connections 2024-09-17T06:05:53.866 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.861+0000 7f04fc247640 1 --2- 172.21.15.122:0/3989847524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04f415aa30 0x7f04f415ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:53.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.861+0000 7f04fc247640 1 --2- 172.21.15.122:0/3989847524 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f4153090 0x7f04f4159b00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:53.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.861+0000 7f04fc247640 1 -- 172.21.15.122:0/3989847524 >> 172.21.15.122:0/3989847524 conn(0x7f04f40746d0 msgr2=0x7f04f4074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:53.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.861+0000 7f04fc247640 1 -- 172.21.15.122:0/3989847524 shutdown_connections 2024-09-17T06:05:53.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.861+0000 7f04fc247640 1 -- 172.21.15.122:0/3989847524 wait complete. 2024-09-17T06:05:53.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fc247640 1 Processor -- start 2024-09-17T06:05:53.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fc247640 1 -- start start 2024-09-17T06:05:53.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fc247640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f40c6780 0x7f04f41e2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:53.870 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fc247640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04f4153090 0x7f04f4140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fc247640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04f415aa30 0x7f04f41e38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fc247640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f04f415d470 con 0x7f04f40c6780 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fc247640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f04f415d1d0 con 0x7f04f415aa30 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fc247640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f04f415b380 con 0x7f04f4153090 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f9fe3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f40c6780 0x7f04f41e2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f9fe3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f40c6780 0x7f04f41e2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58108/0 (socket says 172.21.15.122:58108) 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f9fe3640 1 -- 172.21.15.122:0/3846981629 learned_addr learned my addr 172.21.15.122:0/3846981629 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f97e2640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04f4153090 0x7f04f4140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fa7e4640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04f415aa30 0x7f04f41e38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f9fe3640 1 -- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04f4153090 msgr2=0x7f04f4140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f9fe3640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04f4153090 0x7f04f4140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f9fe3640 1 -- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04f415aa30 msgr2=0x7f04f41e38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f9fe3640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04f415aa30 0x7f04f41e38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:53.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f9fe3640 1 -- 172.21.15.122:0/3846981629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f40c6510 con 0x7f04f40c6780 2024-09-17T06:05:53.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fa7e4640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04f415aa30 0x7f04f41e38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:05:53.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f9fe3640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f40c6780 0x7f04f41e2560 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c3c0 tx=0x7f04ec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:53.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f27fc640 1 -- 172.21.15.122:0/3846981629 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec017070 con 0x7f04f40c6780 2024-09-17T06:05:53.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f27fc640 1 -- 172.21.15.122:0/3846981629 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04ec0053c0 con 0x7f04f40c6780 2024-09-17T06:05:53.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04f27fc640 1 -- 172.21.15.122:0/3846981629 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec003860 con 0x7f04f40c6780 2024-09-17T06:05:53.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fc247640 1 -- 172.21.15.122:0/3846981629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f41e2aa0 con 0x7f04f40c6780 2024-09-17T06:05:53.872 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fc247640 1 -- 172.21.15.122:0/3846981629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f40c2660 con 0x7f04f40c6780 2024-09-17T06:05:53.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.865+0000 7f04fc247640 1 -- 172.21.15.122:0/3846981629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f40b8cf0 con 0x7f04f40c6780 2024-09-17T06:05:53.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.869+0000 7f04f27fc640 1 -- 172.21.15.122:0/3846981629 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f04ec01a070 con 0x7f04f40c6780 2024-09-17T06:05:53.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.869+0000 7f04f27fc640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f04e0073200 0x7f04e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:53.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.869+0000 7f04f27fc640 1 -- 172.21.15.122:0/3846981629 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6767+0+0 (secure 0 0 0) 0x7f04ec093850 con 0x7f04f40c6780 2024-09-17T06:05:53.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.869+0000 7f04f97e2640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f04e0073200 0x7f04e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:53.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.869+0000 7f04f97e2640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f04e0073200 0x7f04e0075710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f04e80b2000 tx=0x7f04e801d910 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:53.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:53.873+0000 7f04f27fc640 1 -- 172.21.15.122:0/3846981629 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f04ec05df20 con 0x7f04f40c6780 2024-09-17T06:05:53.982 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:53.982 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:53.982 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:53.982 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:53.982 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:54.002 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T06:05:54.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.045+0000 7f04fc247640 1 -- 172.21.15.122:0/3846981629 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7f04f4152100 con 0x7f04f40c6780 2024-09-17T06:05:54.154 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 100.33052927599999, 2024-09-17T06:05:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0072404619999999996, 2024-09-17T06:05:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.155 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821653+0000", 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.156 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821656+0000", 2024-09-17T06:05:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1669999999999999e-06 2024-09-17T06:05:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821668+0000", 2024-09-17T06:05:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1867e-05 2024-09-17T06:05:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.157 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821692+0000", 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4079000000000001e-05 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821710+0000", 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8182e-05 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822202+0000", 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000492053 2024-09-17T06:05:54.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822407+0000", 2024-09-17T06:05:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020491500000000001 2024-09-17T06:05:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:54.159 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822631+0000", 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022318899999999999 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828371+0000", 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0057405809999999998 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828715+0000", 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000344068 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.160 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828805+0000", 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9925000000000004e-05 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828894+0000", 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.8436000000000005e-05 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.161 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 100.330408874, 2024-09-17T06:05:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0073113359999999999, 2024-09-17T06:05:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:54.162 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821774+0000", 2024-09-17T06:05:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821775+0000", 2024-09-17T06:05:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1999999999999999e-06 2024-09-17T06:05:54.163 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821793+0000", 2024-09-17T06:05:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8380999999999999e-05 2024-09-17T06:05:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821808+0000", 2024-09-17T06:05:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5009e-05 2024-09-17T06:05:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.164 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821830+0000", 2024-09-17T06:05:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2155e-05 2024-09-17T06:05:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001240437 2024-09-17T06:05:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.165 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823202+0000", 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013151100000000001 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823403+0000", 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020074200000000001 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828380+0000", 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049770989999999996 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.166 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.167 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.167 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828981+0000", 2024-09-17T06:05:54.167 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00060129599999999997 2024-09-17T06:05:54.167 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.167 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829045+0000", 2024-09-17T06:05:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3439e-05 2024-09-17T06:05:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.168 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829085+0000", 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0067000000000001e-05 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 100.33028096, 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045775169999999997, 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.169 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821901+0000", 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.170 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821903+0000", 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.254e-06 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821911+0000", 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4370000000000007e-06 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821925+0000", 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4041e-05 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.171 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.821939+0000", 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3552e-05 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822034+0000", 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5756999999999998e-05 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822244+0000", 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00020934600000000001 2024-09-17T06:05:54.172 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822435+0000", 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019146300000000001 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826287+0000", 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038520440000000002 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.173 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826319+0000", 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1287e-05 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826375+0000", 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6144999999999999e-05 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826479+0000", 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00010419100000000001 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 100.32925499700001, 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0086949699999999998, 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.175 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822927+0000", 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822929+0000", 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4929999999999999e-06 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.176 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822943+0000", 2024-09-17T06:05:54.177 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3976e-05 2024-09-17T06:05:54.177 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.177 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.177 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.177 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822960+0000", 2024-09-17T06:05:54.177 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6716000000000001e-05 2024-09-17T06:05:54.177 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.177 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.177 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.822974+0000", 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4568e-05 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823074+0000", 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9925000000000003e-05 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823203+0000", 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012878100000000001 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.178 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.179 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 7", 2024-09-17T06:05:54.179 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823444+0000", 2024-09-17T06:05:54.179 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024114000000000001 2024-09-17T06:05:54.179 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.179 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.179 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.179 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828240+0000", 2024-09-17T06:05:54.179 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047963739999999999 2024-09-17T06:05:54.179 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.179 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.179 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.179 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831508+0000", 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032678540000000002 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831560+0000", 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1860999999999997e-05 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831622+0000", 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2281999999999998e-05 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.180 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 100.32917405400001, 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068891919999999997, 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.181 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823008+0000", 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823009+0000", 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.096e-06 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.182 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823017+0000", 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1609999999999997e-06 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823030+0000", 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3494e-05 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823044+0000", 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4032999999999999e-05 2024-09-17T06:05:54.183 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823843+0000", 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00079888500000000005 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823994+0000", 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015098499999999999 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824174+0000", 2024-09-17T06:05:54.184 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017970700000000001 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828386+0000", 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0042125239999999996 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829779+0000", 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013926069999999999 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.185 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829828+0000", 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9126999999999999e-05 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.829898+0000", 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.9573000000000006e-05 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:54.186 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 100.32911165199999, 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080247419999999996, 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.187 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823071+0000", 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823072+0000", 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0610000000000001e-06 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823096+0000", 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3700999999999999e-05 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.188 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823109+0000", 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3631999999999999e-05 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823124+0000", 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4987000000000001e-05 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824780+0000", 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001656163 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.189 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.824959+0000", 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017915499999999999 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825147+0000", 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018790899999999999 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830006+0000", 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0048589510000000002 2024-09-17T06:05:54.190 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830926+0000", 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00091945000000000004 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831016+0000", 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0708e-05 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831096+0000", 2024-09-17T06:05:54.191 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9024999999999996e-05 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 100.32903956200001, 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0080961609999999993, 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:54.192 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823143+0000", 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823144+0000", 2024-09-17T06:05:54.193 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2720000000000001e-06 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823150+0000", 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6169999999999998e-06 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823161+0000", 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1625e-05 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.194 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823172+0000", 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0475000000000001e-05 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825665+0000", 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00249314 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825807+0000", 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014226700000000001 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.195 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.831239+0000", 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054317649999999999 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 100.328997362, 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0054527910000000002, 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.196 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823185+0000", 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.197 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823186+0000", 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5000000000000001e-07 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823198+0000", 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1851000000000001e-05 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823243+0000", 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4804e-05 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.198 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823255+0000", 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2029e-05 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823352+0000", 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7325999999999996e-05 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.823541+0000", 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000188705 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.199 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828638+0000", 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0050972259999999998 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 100.32640542999999, 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026255570000000002, 2024-09-17T06:05:54.200 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825777+0000", 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.201 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825779+0000", 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.595e-06 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825790+0000", 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1693e-05 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825806+0000", 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5481999999999998e-05 2024-09-17T06:05:54.202 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825817+0000", 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0890000000000001e-05 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825911+0000", 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4481000000000006e-05 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825939+0000", 2024-09-17T06:05:54.203 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7849000000000001e-05 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828321+0000", 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023816419999999998 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.828403+0000", 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.1924999999999999e-05 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.204 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 100.326309295, 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0051115630000000004, 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:54.205 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825873+0000", 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825874+0000", 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3600000000000002e-07 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825882+0000", 2024-09-17T06:05:54.206 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.7510000000000008e-06 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825896+0000", 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4001e-05 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.825907+0000", 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1622e-05 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.207 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826307+0000", 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00039982400000000001 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.826339+0000", 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2217e-05 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830904+0000", 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045647350000000003 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.208 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.830985+0000", 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.0576999999999998e-05 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 100.317877009, 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0044909019999999997, 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.209 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834305+0000", 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.210 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834308+0000", 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6129999999999998e-06 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834322+0000", 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3515e-05 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834345+0000", 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3941999999999999e-05 2024-09-17T06:05:54.211 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834362+0000", 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6942000000000001e-05 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834460+0000", 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.7347000000000002e-05 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.212 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834602+0000", 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142108 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.834813+0000", 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00021094700000000001 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.837798+0000", 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002984801 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.213 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838697+0000", 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00089980599999999996 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838750+0000", 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2500999999999998e-05 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:13.838796+0000", 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.638e-05 2024-09-17T06:05:54.214 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 93.553657423999994, 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002750682, 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.215 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598525+0000", 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598529+0000", 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8929999999999998e-06 2024-09-17T06:05:54.216 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598551+0000", 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2359999999999999e-05 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598608+0000", 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7027999999999997e-05 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598635+0000", 2024-09-17T06:05:54.217 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7069000000000001e-05 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598799+0000", 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000163442 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.598976+0000", 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017706500000000001 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:54.218 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.599233+0000", 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025685600000000002 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600930+0000", 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0016969520000000001 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.600979+0000", 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9558000000000002e-05 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.219 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601138+0000", 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000159166 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:20.601276+0000", 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000137293 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1389~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 91.832986468000001, 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032767030000000002, 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.221 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319196+0000", 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319200+0000", 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3640000000000001e-06 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319218+0000", 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7506000000000001e-05 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.222 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319252+0000", 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4362000000000001e-05 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319277+0000", 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4743e-05 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319427+0000", 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014996899999999999 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.223 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319612+0000", 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018470199999999999 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.319871+0000", 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025906900000000001 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.321382+0000", 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001511531 2024-09-17T06:05:54.224 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322132+0000", 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000750233 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322327+0000", 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000194964 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:22.322473+0000", 2024-09-17T06:05:54.225 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014526 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3029~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 90.961099546, 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002892876, 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.226 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191083+0000", 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191086+0000", 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0199999999999999e-06 2024-09-17T06:05:54.227 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191102+0000", 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5970000000000001e-05 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191137+0000", 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5539e-05 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.228 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191165+0000", 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7432000000000001e-05 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191362+0000", 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00019742199999999999 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.191656+0000", 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029385199999999999 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.229 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.230 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:54.230 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.192095+0000", 2024-09-17T06:05:54.230 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000438811 2024-09-17T06:05:54.230 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.230 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.230 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.230 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193489+0000", 2024-09-17T06:05:54.230 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013945229999999999 2024-09-17T06:05:54.230 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.230 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.230 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.230 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193802+0000", 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00031305200000000002 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193889+0000", 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6996999999999994e-05 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:23.193976+0000", 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6258e-05 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.231 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3170~441 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 70.434658634000002, 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028318729999999999, 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.232 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717524+0000", 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717528+0000", 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4830000000000001e-06 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.233 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717554+0000", 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5982999999999998e-05 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717604+0000", 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0206e-05 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717640+0000", 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5445999999999999e-05 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.234 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717849+0000", 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209402 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718118+0000", 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026864899999999998 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.718364+0000", 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024605800000000001 2024-09-17T06:05:54.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720095+0000", 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017309650000000001 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720174+0000", 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8818000000000003e-05 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720269+0000", 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5412000000000001e-05 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720356+0000", 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6451000000000003e-05 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 70.434429117999997, 2024-09-17T06:05:54.237 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0056467840000000002, 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717753+0000", 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717756+0000", 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4159999999999998e-06 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717770+0000", 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3973e-05 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717798+0000", 2024-09-17T06:05:54.239 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8592999999999999e-05 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.717823+0000", 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5009000000000001e-05 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719115+0000", 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001291366 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.240 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719268+0000", 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015355699999999999 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.719513+0000", 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000244856 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.720687+0000", 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011735280000000001 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.241 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.242 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723217+0000", 2024-09-17T06:05:54.242 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025302329999999998 2024-09-17T06:05:54.242 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.242 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.242 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.242 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723317+0000", 2024-09-17T06:05:54.242 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9994999999999994e-05 2024-09-17T06:05:54.242 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.242 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.242 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.242 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:04:43.723400+0000", 2024-09-17T06:05:54.242 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3257999999999995e-05 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:53 2.14 2:2e2fa760:::200.00000001:head [write 24145~3176 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:52.964390+0000", 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 1.187792207, 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0028989879999999999, 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.243 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.964390+0000", 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.964390+0000", 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.964393+0000", 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.066e-06 2024-09-17T06:05:54.244 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.964417+0000", 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3353000000000002e-05 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.964465+0000", 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8154e-05 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.245 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.964500+0000", 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.5429000000000002e-05 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.964643+0000", 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000142884 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.964820+0000", 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017691699999999999 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.246 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.965071+0000", 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025056999999999998 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.966855+0000", 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017848919999999999 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.967099+0000", 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024314700000000001 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.247 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.967199+0000", 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.9915999999999997e-05 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:52.967289+0000", 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0660000000000003e-05 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.248 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:55 2.14 2:2e2fa760:::200.00000001:head [write 27321~2911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:53.929176+0000", 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 0.22300604500000001, 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025832400000000001, 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.929176+0000", 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.249 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.929176+0000", 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.929181+0000", 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.95e-06 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.929214+0000", 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2361999999999999e-05 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.250 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.929254+0000", 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.0207999999999999e-05 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.929279+0000", 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5116000000000001e-05 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.929419+0000", 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014019799999999999 2024-09-17T06:05:54.251 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.929591+0000", 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000171423 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 3", 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.929845+0000", 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025428000000000001 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.252 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.931616+0000", 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0017711420000000001 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.931637+0000", 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1416999999999998e-05 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.931698+0000", 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.0164000000000002e-05 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.253 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.931760+0000", 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.198e-05 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:59 2.17 2:eaf075c4:::500.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:53.996377+0000", 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 0.15580588400000001, 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0038905749999999998, 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.254 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996377+0000", 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996377+0000", 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996380+0000", 2024-09-17T06:05:54.255 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7670000000000001e-06 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996399+0000", 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8525e-05 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996450+0000", 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1301999999999998e-05 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996484+0000", 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3862000000000002e-05 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996693+0000", 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000209015 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996998+0000", 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00030466400000000001 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.257 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:54.000267+0000", 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032694400000000002 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(mds.0.4:60 2.14 2:2e992e0f:::500.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:05:53.996558+0000", 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 0.15562404099999999, 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0031951330000000002, 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.258 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "started", 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996558+0000", 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996558+0000", 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.259 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996560+0000", 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8530000000000001e-06 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996571+0000", 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0423e-05 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996604+0000", 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3612000000000003e-05 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.260 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996627+0000", 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2339000000000001e-05 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.996861+0000", 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00023482099999999999 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.997193+0000", 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00033155000000000001 2024-09-17T06:05:54.261 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.262 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.262 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.262 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:05:53.999754+0000", 2024-09-17T06:05:54.262 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025605350000000001 2024-09-17T06:05:54.262 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.262 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.262 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.262 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.262 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.262 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:54.263 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T06:05:54.417 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:54.417 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:54.417 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:05:54.417 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:54.435 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T06:05:54.585 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:54.585 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:05:54.586 INFO:teuthology.orchestra.run.smithi173.stdout: "complaint_time": 180, 2024-09-17T06:05:54.586 INFO:teuthology.orchestra.run.smithi173.stdout: "num_blocked_ops": 0 2024-09-17T06:05:54.586 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:54.605 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T06:05:54.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.673+0000 7f04f27fc640 1 -- 172.21.15.122:0/3846981629 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v61) ==== 91+0+0 (secure 0 0 0) 0x7f04ec062950 con 0x7f04f40c6780 2024-09-17T06:05:54.680 INFO:teuthology.orchestra.run.smithi122.stderr:noscrub is unset 2024-09-17T06:05:54.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.677+0000 7f04fc247640 1 -- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f04e0073200 msgr2=0x7f04e0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:54.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.677+0000 7f04fc247640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f04e0073200 0x7f04e0075710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f04e80b2000 tx=0x7f04e801d910 comp rx=0 tx=0).stop 2024-09-17T06:05:54.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.677+0000 7f04fc247640 1 -- 172.21.15.122:0/3846981629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f40c6780 msgr2=0x7f04f41e2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:54.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.677+0000 7f04fc247640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f40c6780 0x7f04f41e2560 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c3c0 tx=0x7f04ec00c880 comp rx=0 tx=0).stop 2024-09-17T06:05:54.683 INFO:tasks.thrashosds.thrasher:reviving osd 2024-09-17T06:05:54.683 INFO:tasks.thrashosds.thrasher:Reviving osd 4 2024-09-17T06:05:54.683 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T06:05:54.683 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T06:05:54.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.677+0000 7f04fc247640 1 -- 172.21.15.122:0/3846981629 shutdown_connections 2024-09-17T06:05:54.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.677+0000 7f04fc247640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f04e0073200 0x7f04e0075710 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:54.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.677+0000 7f04fc247640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04f415aa30 0x7f04f41e38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:54.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.677+0000 7f04fc247640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04f4153090 0x7f04f4140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:54.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.677+0000 7f04fc247640 1 --2- 172.21.15.122:0/3846981629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f40c6780 0x7f04f41e2560 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:54.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.677+0000 7f04fc247640 1 -- 172.21.15.122:0/3846981629 >> 172.21.15.122:0/3846981629 conn(0x7f04f40746d0 msgr2=0x7f04f4142510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:54.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.677+0000 7f04fc247640 1 -- 172.21.15.122:0/3846981629 shutdown_connections 2024-09-17T06:05:54.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.681+0000 7f04fc247640 1 -- 172.21.15.122:0/3846981629 wait complete. 2024-09-17T06:05:54.687 INFO:tasks.ceph.osd.4:Started 2024-09-17T06:05:54.687 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T06:05:54.711 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T06:05:54.760 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:05:54.760 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 20, 2024-09-17T06:05:54.760 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 600, 2024-09-17T06:05:54.760 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2024-09-17T06:05:54.760 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.761 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.761 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:05:54.761 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 116.120951976, 2024-09-17T06:05:54.761 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.55819121299999996, 2024-09-17T06:05:54.761 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.761 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.761 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.761 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.761 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.761 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.761 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 1 2024-09-17T06:05:54.761 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636955+0000", 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636958+0000", 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4690000000000002e-06 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.636976+0000", 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.802e-05 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637001+0000", 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4552000000000001e-05 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.763 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637024+0000", 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3391999999999999e-05 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637134+0000", 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000109715 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for peered", 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:58.637157+0000", 2024-09-17T06:05:54.764 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3363999999999999e-05 2024-09-17T06:05:54.765 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.765 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.765 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.765 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.191892+0000", 2024-09-17T06:05:54.765 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.55473470899999999 2024-09-17T06:05:54.765 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.765 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.765 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.765 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.192190+0000", 2024-09-17T06:05:54.765 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00029832200000000001 2024-09-17T06:05:54.765 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.765 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.192541+0000", 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00035034999999999998 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.194061+0000", 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0015205959999999999 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.194944+0000", 2024-09-17T06:05:54.766 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00088236399999999996 2024-09-17T06:05:54.767 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.767 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.767 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.767 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.195056+0000", 2024-09-17T06:05:54.767 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011200399999999999 2024-09-17T06:05:54.767 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.767 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.767 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.767 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.195146+0000", 2024-09-17T06:05:54.767 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0356e-05 2024-09-17T06:05:54.767 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.768 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.768 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.768 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.768 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.768 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.768 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:05:54.768 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.416658725, 2024-09-17T06:05:54.768 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.01182241, 2024-09-17T06:05:54.768 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.768 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.768 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.768 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 42 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341248+0000", 2024-09-17T06:05:54.769 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.770 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.770 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.770 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.770 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341249+0000", 2024-09-17T06:05:54.770 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0729999999999999e-06 2024-09-17T06:05:54.770 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.770 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.770 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.770 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341257+0000", 2024-09-17T06:05:54.770 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8800000000000008e-06 2024-09-17T06:05:54.770 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.770 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341275+0000", 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.7842e-05 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341292+0000", 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6829000000000001e-05 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346218+0000", 2024-09-17T06:05:54.771 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049260329999999998 2024-09-17T06:05:54.772 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.772 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.772 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346372+0000", 2024-09-17T06:05:54.772 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015433299999999999 2024-09-17T06:05:54.772 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.772 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.772 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.346635+0000", 2024-09-17T06:05:54.772 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026296700000000002 2024-09-17T06:05:54.772 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351575+0000", 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0049397959999999998 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352898+0000", 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0013230060000000001 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352994+0000", 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6045000000000006e-05 2024-09-17T06:05:54.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353070+0000", 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.6606000000000005e-05 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.41616637600001, 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011645713, 2024-09-17T06:05:54.774 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.775 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.775 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.775 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.775 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.775 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.775 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 43 2024-09-17T06:05:54.775 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.775 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.775 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.775 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.775 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:05:54.775 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341740+0000", 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341743+0000", 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.903e-06 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.776 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341764+0000", 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0988999999999998e-05 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341808+0000", 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3791000000000001e-05 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341839+0000", 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.1216000000000001e-05 2024-09-17T06:05:54.777 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.778 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.778 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.778 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.348686+0000", 2024-09-17T06:05:54.778 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0068463589999999998 2024-09-17T06:05:54.778 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.778 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.778 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.778 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.348832+0000", 2024-09-17T06:05:54.778 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014631 2024-09-17T06:05:54.778 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.778 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.778 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.779 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.349079+0000", 2024-09-17T06:05:54.779 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00024698800000000001 2024-09-17T06:05:54.779 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.779 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.779 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.779 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353095+0000", 2024-09-17T06:05:54.779 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0040160869999999998 2024-09-17T06:05:54.779 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.779 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353170+0000", 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.4976999999999997e-05 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353259+0000", 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.9305e-05 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353386+0000", 2024-09-17T06:05:54.780 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012678799999999999 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.416009643, 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015057846, 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.781 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 44 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.782 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341897+0000", 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.341899+0000", 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9e-06 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342021+0000", 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012252000000000001 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.783 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342055+0000", 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.3095000000000001e-05 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342078+0000", 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3456e-05 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.349806+0000", 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.007728253 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.784 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.350088+0000", 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00028207900000000002 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.350527+0000", 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00043892200000000001 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353510+0000", 2024-09-17T06:05:54.785 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029825590000000001 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356661+0000", 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0031514099999999999 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356817+0000", 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015552900000000001 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.786 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356955+0000", 2024-09-17T06:05:54.787 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013812300000000001 2024-09-17T06:05:54.787 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.787 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.787 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.787 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.787 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.787 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:05:54.787 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.415754749, 2024-09-17T06:05:54.787 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015109994, 2024-09-17T06:05:54.787 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.787 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.788 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.788 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.788 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.788 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.788 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 45 2024-09-17T06:05:54.788 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.788 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.788 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.788 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.788 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:05:54.788 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.788 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342152+0000", 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342154+0000", 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9999999999999999e-06 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.789 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342170+0000", 2024-09-17T06:05:54.790 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.6506000000000001e-05 2024-09-17T06:05:54.790 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.790 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.790 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.790 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342196+0000", 2024-09-17T06:05:54.790 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5412e-05 2024-09-17T06:05:54.790 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.790 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.790 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.790 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342216+0000", 2024-09-17T06:05:54.790 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0191999999999999e-05 2024-09-17T06:05:54.790 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351692+0000", 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0094760650000000005 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.351849+0000", 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015737600000000001 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.352102+0000", 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025282000000000001 2024-09-17T06:05:54.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356610+0000", 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0045081940000000001 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.356984+0000", 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00037321899999999999 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.792 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357126+0000", 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014265999999999999 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357262+0000", 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013554999999999999 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:05:54.793 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.415653814, 2024-09-17T06:05:54.794 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015392114, 2024-09-17T06:05:54.794 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.794 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.794 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.794 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.794 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.794 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.794 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 46 2024-09-17T06:05:54.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.795 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.795 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.795 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.795 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:05:54.795 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.795 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.795 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.795 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342253+0000", 2024-09-17T06:05:54.795 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342254+0000", 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4169999999999999e-06 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342268+0000", 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4086e-05 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.796 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.797 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342283+0000", 2024-09-17T06:05:54.797 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.4919000000000001e-05 2024-09-17T06:05:54.797 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.797 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.797 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.797 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342297+0000", 2024-09-17T06:05:54.797 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3993e-05 2024-09-17T06:05:54.797 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.798 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.798 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.798 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353648+0000", 2024-09-17T06:05:54.798 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011350783 2024-09-17T06:05:54.798 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.798 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.798 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.798 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.353815+0000", 2024-09-17T06:05:54.798 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00016706499999999999 2024-09-17T06:05:54.798 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.354039+0000", 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022362599999999999 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357286+0000", 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003246882 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.799 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357422+0000", 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000136093 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357521+0000", 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.8876000000000007e-05 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357645+0000", 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012437400000000001 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.800 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.415559495, 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.018409992999999999, 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.801 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 47 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342347+0000", 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.802 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342348+0000", 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.333e-06 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342464+0000", 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011581100000000001 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342485+0000", 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0222000000000001e-05 2024-09-17T06:05:54.803 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342512+0000", 2024-09-17T06:05:54.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7158999999999999e-05 2024-09-17T06:05:54.804 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.804 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.804 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.804 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.354773+0000", 2024-09-17T06:05:54.804 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.012261752000000001 2024-09-17T06:05:54.804 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.355011+0000", 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000237982 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.355427+0000", 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000415234 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357770+0000", 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023435320000000002 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360464+0000", 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0026934820000000001 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360614+0000", 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015075900000000001 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360757+0000", 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014272699999999999 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.415344269, 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.020363284999999998, 2024-09-17T06:05:54.807 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 48 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.808 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342562+0000", 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342564+0000", 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.5269999999999999e-06 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342593+0000", 2024-09-17T06:05:54.809 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.9261e-05 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342617+0000", 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.4258999999999999e-05 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342644+0000", 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6645999999999999e-05 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.810 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.357867+0000", 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.015222591000000001 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.358013+0000", 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014652299999999999 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.358238+0000", 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000225193 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.811 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362590+0000", 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.004351471 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362643+0000", 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2957000000000001e-05 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362799+0000", 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015606600000000001 2024-09-17T06:05:54.812 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.362926+0000", 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012679100000000001 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.415219372, 2024-09-17T06:05:54.813 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.021916326, 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 49 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:05:54.814 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342687+0000", 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342689+0000", 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.79e-06 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.815 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342703+0000", 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.3653e-05 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342740+0000", 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.6801000000000002e-05 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342761+0000", 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1713e-05 2024-09-17T06:05:54.816 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359009+0000", 2024-09-17T06:05:54.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.016247663999999998 2024-09-17T06:05:54.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.817 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359291+0000", 2024-09-17T06:05:54.817 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00028178399999999998 2024-09-17T06:05:54.817 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.817 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.817 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.359738+0000", 2024-09-17T06:05:54.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00044704500000000003 2024-09-17T06:05:54.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.818 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363113+0000", 2024-09-17T06:05:54.818 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033748150000000002 2024-09-17T06:05:54.818 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.818 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.818 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364339+0000", 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001226067 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364484+0000", 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014500599999999999 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364604+0000", 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000119988 2024-09-17T06:05:54.819 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.820 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.820 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.820 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.820 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.820 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.820 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:05:54.820 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.415049397, 2024-09-17T06:05:54.820 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023299408000000001, 2024-09-17T06:05:54.820 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.820 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.820 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.820 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 50 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.821 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342857+0000", 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342859+0000", 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.663e-06 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.342981+0000", 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012199800000000001 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.822 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343001+0000", 2024-09-17T06:05:54.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.0432e-05 2024-09-17T06:05:54.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343020+0000", 2024-09-17T06:05:54.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.8236e-05 2024-09-17T06:05:54.823 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.823 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.823 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.823 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.360863+0000", 2024-09-17T06:05:54.823 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.017843741 2024-09-17T06:05:54.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.361095+0000", 2024-09-17T06:05:54.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00023198199999999999 2024-09-17T06:05:54.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.824 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.824 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.824 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.361364+0000", 2024-09-17T06:05:54.824 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00026886 2024-09-17T06:05:54.824 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364745+0000", 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033806690000000002 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365860+0000", 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0011155679999999999 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.825 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366017+0000", 2024-09-17T06:05:54.826 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015673299999999999 2024-09-17T06:05:54.826 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.826 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.826 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366157+0000", 2024-09-17T06:05:54.826 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013952600000000001 2024-09-17T06:05:54.826 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.826 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.826 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.826 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.826 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.826 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.414859366, 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023463673000000001, 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 51 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.827 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343047+0000", 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343048+0000", 2024-09-17T06:05:54.828 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.0729999999999999e-06 2024-09-17T06:05:54.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.829 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343057+0000", 2024-09-17T06:05:54.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.2959999999999999e-06 2024-09-17T06:05:54.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.829 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.829 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343068+0000", 2024-09-17T06:05:54.829 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1793e-05 2024-09-17T06:05:54.829 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.829 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343094+0000", 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.5882000000000001e-05 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363287+0000", 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.020192673000000001 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363457+0000", 2024-09-17T06:05:54.830 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017029600000000001 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.363687+0000", 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00022974099999999999 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366188+0000", 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0025014049999999999 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.831 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366282+0000", 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3992000000000004e-05 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366378+0000", 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.5152e-05 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366511+0000", 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013337000000000001 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.832 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.414793569, 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.023823882000000001, 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.833 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.834 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 52 2024-09-17T06:05:54.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.834 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.834 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.834 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:05:54.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.834 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.834 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.834 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.834 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343113+0000", 2024-09-17T06:05:54.834 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343114+0000", 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5700000000000001e-07 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343122+0000", 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.4919999999999993e-06 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.835 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343134+0000", 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.1970000000000001e-05 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.343144+0000", 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6690000000000001e-06 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.364849+0000", 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.021704826 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.836 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365104+0000", 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025510700000000002 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.365359+0000", 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00025527500000000001 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366737+0000", 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.001377739 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.837 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.838 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366772+0000", 2024-09-17T06:05:54.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.4629000000000003e-05 2024-09-17T06:05:54.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.838 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366865+0000", 2024-09-17T06:05:54.838 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3220999999999994e-05 2024-09-17T06:05:54.838 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.838 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.838 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.366937+0000", 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.2096999999999998e-05 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.144517775, 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010475561, 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.839 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 69 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.840 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.841 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613389+0000", 2024-09-17T06:05:54.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.841 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.841 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.841 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.841 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613390+0000", 2024-09-17T06:05:54.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.8899999999999998e-07 2024-09-17T06:05:54.841 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.841 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.841 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.841 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613458+0000", 2024-09-17T06:05:54.841 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.8127999999999996e-05 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613467+0000", 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.0909999999999999e-06 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613474+0000", 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.2919999999999998e-06 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.842 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.615892+0000", 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.002417836 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.615956+0000", 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3380000000000006e-05 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616042+0000", 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6012000000000003e-05 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.843 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.844 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619165+0000", 2024-09-17T06:05:54.844 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00312321 2024-09-17T06:05:54.844 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.844 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.844 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.844 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623808+0000", 2024-09-17T06:05:54.844 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0046427339999999999 2024-09-17T06:05:54.844 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.844 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.844 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.844 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623836+0000", 2024-09-17T06:05:54.844 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8839999999999998e-05 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623864+0000", 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8048999999999999e-05 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.144400023, 2024-09-17T06:05:54.845 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010433403000000001, 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 70 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.846 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613507+0000", 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.8800000000000002e-07 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.847 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613512+0000", 2024-09-17T06:05:54.848 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.2719999999999999e-06 2024-09-17T06:05:54.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.848 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.848 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.848 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613518+0000", 2024-09-17T06:05:54.848 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.4350000000000002e-06 2024-09-17T06:05:54.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.848 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.848 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.848 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613524+0000", 2024-09-17T06:05:54.848 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5110000000000003e-06 2024-09-17T06:05:54.848 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616673+0000", 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003149102 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616764+0000", 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.1290000000000002e-05 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.849 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.616880+0000", 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00011597800000000001 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619172+0000", 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0022917670000000001 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623892+0000", 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.004720391 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.850 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.851 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.851 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623918+0000", 2024-09-17T06:05:54.851 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.6186999999999998e-05 2024-09-17T06:05:54.851 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.851 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.851 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.851 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.623940+0000", 2024-09-17T06:05:54.851 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1781999999999999e-05 2024-09-17T06:05:54.851 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.851 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.851 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.852 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.852 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.852 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.852 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:05:54.852 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.14425786699999, 2024-09-17T06:05:54.852 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010700696000000001, 2024-09-17T06:05:54.852 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.852 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.852 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.852 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.852 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.852 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 71 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613649+0000", 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.853 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613650+0000", 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.7300000000000005e-07 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613654+0000", 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6920000000000001e-06 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.854 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613662+0000", 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.8439999999999998e-06 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613668+0000", 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.6400000000000002e-06 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617192+0000", 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0035246499999999998 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.855 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617294+0000", 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000101259 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617388+0000", 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.4228999999999995e-05 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620154+0000", 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0027657459999999999 2024-09-17T06:05:54.856 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624067+0000", 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039132730000000001 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624226+0000", 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00015945600000000001 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624349+0000", 2024-09-17T06:05:54.857 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000123034 2024-09-17T06:05:54.858 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.858 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.858 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.858 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.858 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.858 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.858 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:54.858 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.144227937, 2024-09-17T06:05:54.858 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010774550000000001, 2024-09-17T06:05:54.858 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.858 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 72 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.859 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.860 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:54.860 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.860 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.860 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.860 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.860 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613679+0000", 2024-09-17T06:05:54.860 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.7399999999999998e-07 2024-09-17T06:05:54.860 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.860 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.860 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.860 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613717+0000", 2024-09-17T06:05:54.860 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.7406000000000001e-05 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613723+0000", 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.652e-06 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613728+0000", 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6789999999999996e-06 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.861 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617676+0000", 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0039476759999999998 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617728+0000", 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2871999999999998e-05 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.617814+0000", 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.5463999999999994e-05 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.862 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621037+0000", 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0032232910000000001 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624400+0000", 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0033624240000000001 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624430+0000", 2024-09-17T06:05:54.863 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.0552000000000002e-05 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624453+0000", 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.3059999999999999e-05 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.14415539300001, 2024-09-17T06:05:54.864 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010781999, 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 73 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:05:54.865 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.866 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.866 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.866 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.866 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613751+0000", 2024-09-17T06:05:54.866 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.866 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.866 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.866 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.866 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613752+0000", 2024-09-17T06:05:54.866 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.61e-07 2024-09-17T06:05:54.866 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.866 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.867 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.867 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613758+0000", 2024-09-17T06:05:54.867 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.7209999999999999e-06 2024-09-17T06:05:54.867 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.867 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.867 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.867 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613764+0000", 2024-09-17T06:05:54.867 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.3470000000000004e-06 2024-09-17T06:05:54.867 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.867 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.868 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.868 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613769+0000", 2024-09-17T06:05:54.868 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.8810000000000004e-06 2024-09-17T06:05:54.868 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.868 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.868 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.868 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618508+0000", 2024-09-17T06:05:54.868 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0047387669999999996 2024-09-17T06:05:54.868 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.868 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.868 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.868 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618559+0000", 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1440999999999998e-05 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.618705+0000", 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00014593900000000001 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621041+0000", 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0023357400000000002 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.869 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.870 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.870 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624482+0000", 2024-09-17T06:05:54.870 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0034416999999999998 2024-09-17T06:05:54.870 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.870 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.870 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.870 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624511+0000", 2024-09-17T06:05:54.870 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8070000000000001e-05 2024-09-17T06:05:54.870 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.871 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.871 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.871 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624533+0000", 2024-09-17T06:05:54.871 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2731999999999999e-05 2024-09-17T06:05:54.871 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.871 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.871 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.871 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.871 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.144127584, 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.010828374999999999, 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 74 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.872 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.873 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.873 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.873 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:54.873 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.873 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.873 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.873 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.873 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:54.873 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.873 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.873 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.873 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.874 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613779+0000", 2024-09-17T06:05:54.874 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.8599999999999999e-07 2024-09-17T06:05:54.874 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.874 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.874 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.874 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613782+0000", 2024-09-17T06:05:54.874 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7010000000000001e-06 2024-09-17T06:05:54.874 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.874 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.874 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.874 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613787+0000", 2024-09-17T06:05:54.875 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.3980000000000001e-06 2024-09-17T06:05:54.875 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.875 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.875 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.875 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613790+0000", 2024-09-17T06:05:54.875 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.805e-06 2024-09-17T06:05:54.875 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.875 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.875 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.875 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619344+0000", 2024-09-17T06:05:54.875 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.005553685 2024-09-17T06:05:54.876 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.876 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.876 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.876 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619427+0000", 2024-09-17T06:05:54.876 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.2897000000000003e-05 2024-09-17T06:05:54.876 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.876 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.876 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.876 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.619562+0000", 2024-09-17T06:05:54.876 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00013549699999999999 2024-09-17T06:05:54.877 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.877 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.877 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.877 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621581+0000", 2024-09-17T06:05:54.877 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0020184719999999999 2024-09-17T06:05:54.877 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.877 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.877 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.877 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624559+0000", 2024-09-17T06:05:54.877 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0029778230000000001 2024-09-17T06:05:54.878 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.878 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.878 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.878 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624586+0000", 2024-09-17T06:05:54.878 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7093e-05 2024-09-17T06:05:54.878 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.878 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.878 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.878 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624607+0000", 2024-09-17T06:05:54.878 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.1617999999999999e-05 2024-09-17T06:05:54.879 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.879 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.879 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.879 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.879 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.879 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.879 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:05:54.879 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.144056191, 2024-09-17T06:05:54.879 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011087911000000001, 2024-09-17T06:05:54.879 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.879 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.879 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 75 2024-09-17T06:05:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:05:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613850+0000", 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613851+0000", 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.1099999999999995e-07 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613923+0000", 2024-09-17T06:05:54.881 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1439999999999994e-05 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613930+0000", 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.9629999999999998e-06 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613936+0000", 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5659999999999997e-06 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.882 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620210+0000", 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.006273514 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620263+0000", 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2982000000000002e-05 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.620363+0000", 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000100802 2024-09-17T06:05:54.883 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.884 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.884 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.884 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621596+0000", 2024-09-17T06:05:54.884 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0012330329999999999 2024-09-17T06:05:54.884 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.884 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.884 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.884 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624709+0000", 2024-09-17T06:05:54.884 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.003112971 2024-09-17T06:05:54.884 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.884 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.885 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.885 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624838+0000", 2024-09-17T06:05:54.885 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00012835099999999999 2024-09-17T06:05:54.885 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.885 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.885 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.885 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624938+0000", 2024-09-17T06:05:54.885 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000100678 2024-09-17T06:05:54.885 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.885 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.885 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.886 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.886 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.886 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4265.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-17T06:05:54.886 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:54.886 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 115.143956022, 2024-09-17T06:05:54.886 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.011079701000000001, 2024-09-17T06:05:54.886 INFO:teuthology.orchestra.run.smithi173.stdout: "continuous": false, 2024-09-17T06:05:54.886 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2024-09-17T06:05:54.886 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T06:05:54.886 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2024-09-17T06:05:54.886 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4265", 2024-09-17T06:05:54.886 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/2135398454", 2024-09-17T06:05:54.887 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 76 2024-09-17T06:05:54.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.887 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2024-09-17T06:05:54.887 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.887 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2024-09-17T06:05:54.887 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:54.887 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.887 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.887 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.887 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2024-09-17T06:05:54.887 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:54.887 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2024-09-17T06:05:54.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.888 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.888 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2024-09-17T06:05:54.888 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613951+0000", 2024-09-17T06:05:54.888 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.1099999999999996e-07 2024-09-17T06:05:54.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.888 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.888 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2024-09-17T06:05:54.888 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613954+0000", 2024-09-17T06:05:54.888 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 3.2009999999999999e-06 2024-09-17T06:05:54.888 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.888 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613959+0000", 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0440000000000003e-06 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.613964+0000", 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.4329999999999997e-06 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621073+0000", 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0071095209999999997 2024-09-17T06:05:54.889 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "started", 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621133+0000", 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.9740000000000001e-05 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for subops from 0", 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621250+0000", 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000117287 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "op_commit", 2024-09-17T06:05:54.890 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.621908+0000", 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00065739599999999998 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "sub_op_commit_rec", 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.624980+0000", 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.0030722039999999998 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "commit_sent", 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.625008+0000", 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.8061000000000001e-05 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-17T06:05:54.891 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-17T06:05:54.892 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "done", 2024-09-17T06:05:54.892 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-17T06:03:59.625030+0000", 2024-09-17T06:05:54.892 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.2303e-05 2024-09-17T06:05:54.892 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.892 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.892 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.892 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-17T06:05:54.892 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-17T06:05:54.892 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:05:54.895 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T06:05:54.895 INFO:teuthology.orchestra.run.smithi173.stderr:no valid command found; 10 closest matches: 2024-09-17T06:05:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:0 2024-09-17T06:05:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:1 2024-09-17T06:05:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:2 2024-09-17T06:05:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:abort 2024-09-17T06:05:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:assert 2024-09-17T06:05:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:config diff 2024-09-17T06:05:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:config diff get 2024-09-17T06:05:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:config get 2024-09-17T06:05:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:config help [] 2024-09-17T06:05:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:config set ... 2024-09-17T06:05:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:admin_socket: invalid command 2024-09-17T06:05:54.897 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-4, ['dump_ops_in_flight'] 2024-09-17T06:05:54.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.861+0000 7faa88333640 1 -- 172.21.15.122:0/235789246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa8006fc90 msgr2=0x7faa8006d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:54.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.861+0000 7faa88333640 1 --2- 172.21.15.122:0/235789246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa8006fc90 0x7faa8006d760 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7faa800c9e10 tx=0x7faa7801f580 comp rx=0 tx=0).stop 2024-09-17T06:05:54.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.861+0000 7faa88333640 1 -- 172.21.15.122:0/235789246 shutdown_connections 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.861+0000 7faa88333640 1 --2- 172.21.15.122:0/235789246 >> v2:172.21.15.173:3300/0 conn(0x7faa8015d240 0x7faa8006f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.861+0000 7faa88333640 1 --2- 172.21.15.122:0/235789246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa8006fc90 0x7faa8006d760 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.861+0000 7faa88333640 1 --2- 172.21.15.122:0/235789246 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa80159240 0x7faa80142640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.861+0000 7faa88333640 1 -- 172.21.15.122:0/235789246 >> 172.21.15.122:0/235789246 conn(0x7faa800ca380 msgr2=0x7faa800ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.861+0000 7faa88333640 1 -- 172.21.15.122:0/235789246 shutdown_connections 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.861+0000 7faa88333640 1 -- 172.21.15.122:0/235789246 wait complete. 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa88333640 1 Processor -- start 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa88333640 1 -- start start 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa88333640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa8006fc90 0x7faa8015bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa88333640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa80159240 0x7faa8013cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa88333640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa8015d240 0x7faa8013d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa88333640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faa8015d650 con 0x7faa8006fc90 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa88333640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faa8006dca0 con 0x7faa80159240 2024-09-17T06:05:54.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa88333640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7faa80154c40 con 0x7faa8015d240 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa860cf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa8006fc90 0x7faa8015bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa860cf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa8006fc90 0x7faa8015bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51248/0 (socket says 172.21.15.122:51248) 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa860cf640 1 -- 172.21.15.122:0/796898470 learned_addr learned my addr 172.21.15.122:0/796898470 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa868d0640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa8015d240 0x7faa8013d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa858ce640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa80159240 0x7faa8013cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa860cf640 1 -- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa8015d240 msgr2=0x7faa8013d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa860cf640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa8015d240 0x7faa8013d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa860cf640 1 -- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa80159240 msgr2=0x7faa8013cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa860cf640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa80159240 0x7faa8013cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa860cf640 1 -- 172.21.15.122:0/796898470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa80072110 con 0x7faa8006fc90 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa858ce640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa80159240 0x7faa8013cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa860cf640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa8006fc90 0x7faa8015bbc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faa70005950 tx=0x7faa7000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:54.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa76ffd640 1 -- 172.21.15.122:0/796898470 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70007b50 con 0x7faa8006fc90 2024-09-17T06:05:54.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa76ffd640 1 -- 172.21.15.122:0/796898470 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa70007de0 con 0x7faa8006fc90 2024-09-17T06:05:54.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa88333640 1 -- 172.21.15.122:0/796898470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8015c6d0 con 0x7faa8006fc90 2024-09-17T06:05:54.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa76ffd640 1 -- 172.21.15.122:0/796898470 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7000f6b0 con 0x7faa8006fc90 2024-09-17T06:05:54.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.865+0000 7faa88333640 1 -- 172.21.15.122:0/796898470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa801568c0 con 0x7faa8006fc90 2024-09-17T06:05:54.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.869+0000 7faa88333640 1 -- 172.21.15.122:0/796898470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa8006e230 con 0x7faa8006fc90 2024-09-17T06:05:54.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.869+0000 7faa76ffd640 1 -- 172.21.15.122:0/796898470 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faa7000f850 con 0x7faa8006fc90 2024-09-17T06:05:54.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.869+0000 7faa76ffd640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7faa64073200 0x7faa64075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:05:54.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.869+0000 7faa76ffd640 1 -- 172.21.15.122:0/796898470 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6767+0+0 (secure 0 0 0) 0x7faa70094c90 con 0x7faa8006fc90 2024-09-17T06:05:54.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.869+0000 7faa858ce640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7faa64073200 0x7faa64075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:05:54.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.869+0000 7faa858ce640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7faa64073200 0x7faa64075710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faa7c005fd0 tx=0x7faa7c005de0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:05:54.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:54.873+0000 7faa76ffd640 1 -- 172.21.15.122:0/796898470 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7faa70014030 con 0x7faa8006fc90 2024-09-17T06:05:55.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.045+0000 7faa88333640 1 -- 172.21.15.122:0/796898470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) -- 0x7faa80072830 con 0x7faa8006fc90 2024-09-17T06:05:55.682 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.677+0000 7faa76ffd640 1 -- 172.21.15.122:0/796898470 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v62) ==== 101+0+0 (secure 0 0 0) 0x7faa7005f910 con 0x7faa8006fc90 2024-09-17T06:05:55.682 INFO:teuthology.orchestra.run.smithi122.stderr:nodeep-scrub is unset 2024-09-17T06:05:55.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.681+0000 7faa88333640 1 -- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7faa64073200 msgr2=0x7faa64075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:55.686 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.681+0000 7faa88333640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7faa64073200 0x7faa64075710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faa7c005fd0 tx=0x7faa7c005de0 comp rx=0 tx=0).stop 2024-09-17T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.681+0000 7faa88333640 1 -- 172.21.15.122:0/796898470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa8006fc90 msgr2=0x7faa8015bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.681+0000 7faa88333640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa8006fc90 0x7faa8015bbc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faa70005950 tx=0x7faa7000cdd0 comp rx=0 tx=0).stop 2024-09-17T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.681+0000 7faa88333640 1 -- 172.21.15.122:0/796898470 shutdown_connections 2024-09-17T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.681+0000 7faa88333640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa8015d240 0x7faa8013d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.681+0000 7faa88333640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7faa64073200 0x7faa64075710 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.681+0000 7faa88333640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa80159240 0x7faa8013cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.681+0000 7faa88333640 1 --2- 172.21.15.122:0/796898470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa8006fc90 0x7faa8015bbc0 secure :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faa70005950 tx=0x7faa7000cdd0 comp rx=0 tx=0).stop 2024-09-17T06:05:55.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.681+0000 7faa88333640 1 -- 172.21.15.122:0/796898470 >> 172.21.15.122:0/796898470 conn(0x7faa800ca380 msgr2=0x7faa80140770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:05:55.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.685+0000 7faa88333640 1 -- 172.21.15.122:0/796898470 shutdown_connections 2024-09-17T06:05:55.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:05:55.685+0000 7faa88333640 1 -- 172.21.15.122:0/796898470 wait complete. 2024-09-17T06:05:55.780 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:55.777+0000 7f17915927c0 -1 Falling back to public interface 2024-09-17T06:05:59.688 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:05:59.685+0000 7f17915927c0 -1 osd.4 44 log_to_monitors true 2024-09-17T06:05:59.898 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T06:06:00.049 INFO:teuthology.orchestra.run.smithi173.stderr:no valid command found; 10 closest matches: 2024-09-17T06:06:00.049 INFO:teuthology.orchestra.run.smithi173.stderr:0 2024-09-17T06:06:00.050 INFO:teuthology.orchestra.run.smithi173.stderr:1 2024-09-17T06:06:00.050 INFO:teuthology.orchestra.run.smithi173.stderr:2 2024-09-17T06:06:00.050 INFO:teuthology.orchestra.run.smithi173.stderr:abort 2024-09-17T06:06:00.050 INFO:teuthology.orchestra.run.smithi173.stderr:assert 2024-09-17T06:06:00.050 INFO:teuthology.orchestra.run.smithi173.stderr:bluefs debug_inject_read_zeros 2024-09-17T06:06:00.050 INFO:teuthology.orchestra.run.smithi173.stderr:bluefs files list 2024-09-17T06:06:00.050 INFO:teuthology.orchestra.run.smithi173.stderr:bluefs stats 2024-09-17T06:06:00.050 INFO:teuthology.orchestra.run.smithi173.stderr:bluestore allocator dump block 2024-09-17T06:06:00.050 INFO:teuthology.orchestra.run.smithi173.stderr:bluestore allocator fragmentation block 2024-09-17T06:06:00.050 INFO:teuthology.orchestra.run.smithi173.stderr:admin_socket: invalid command 2024-09-17T06:06:00.055 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T06:06:00.056 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-4, ['dump_ops_in_flight'] 2024-09-17T06:06:00.735 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-09-17T06:06:00.733+0000 7f1785335640 -1 osd.4 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T06:06:05.057 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T06:06:05.214 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-17T06:06:05.215 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2024-09-17T06:06:05.215 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2024-09-17T06:06:05.215 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-17T06:06:05.232 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-17T06:06:05.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.389+0000 7efcad242640 1 -- 172.21.15.122:0/1985396497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca80b20e0 msgr2=0x7efca806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.389+0000 7efcad242640 1 --2- 172.21.15.122:0/1985396497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca80b20e0 0x7efca806d3b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efca0009bc0 tx=0x7efca001c9a0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.389+0000 7efcad242640 1 -- 172.21.15.122:0/1985396497 shutdown_connections 2024-09-17T06:06:05.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.389+0000 7efcad242640 1 --2- 172.21.15.122:0/1985396497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca80b20e0 0x7efca806d3b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.389+0000 7efcad242640 1 --2- 172.21.15.122:0/1985396497 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca806e270 0x7efca8155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.389+0000 7efcad242640 1 -- 172.21.15.122:0/1985396497 >> 172.21.15.122:0/1985396497 conn(0x7efca8070d80 msgr2=0x7efca8072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:05.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.389+0000 7efcad242640 1 -- 172.21.15.122:0/1985396497 shutdown_connections 2024-09-17T06:06:05.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.389+0000 7efcad242640 1 -- 172.21.15.122:0/1985396497 wait complete. 2024-09-17T06:06:05.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.389+0000 7efcad242640 1 Processor -- start 2024-09-17T06:06:05.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.389+0000 7efcad242640 1 -- start start 2024-09-17T06:06:05.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efcad242640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca806e270 0x7efca80c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efcad242640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca80b20e0 0x7efca8157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efcad242640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca80c2d60 0x7efca8148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efcad242640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efca80c3f60 con 0x7efca80c2d60 2024-09-17T06:06:05.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efcad242640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efca80c3de0 con 0x7efca806e270 2024-09-17T06:06:05.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efcad242640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7efca8168540 con 0x7efca80b20e0 2024-09-17T06:06:05.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efca759e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca80c2d60 0x7efca8148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efca759e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca80c2d60 0x7efca8148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54180/0 (socket says 172.21.15.122:54180) 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efca759e640 1 -- 172.21.15.122:0/1001791436 learned_addr learned my addr 172.21.15.122:0/1001791436 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca80b20e0 0x7efca8157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efca759e640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca80b20e0 msgr2=0x7efca8157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efca759e640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca80b20e0 0x7efca8157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efca759e640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca806e270 msgr2=0x7efca80c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efca6d9d640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca806e270 0x7efca80c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efca759e640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca806e270 0x7efca80c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efca759e640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca80c8390 con 0x7efca80c2d60 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca80b20e0 0x7efca8157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efca759e640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca80c2d60 0x7efca8148870 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efca001d240 tx=0x7efca00a57f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca00bb070 con 0x7efca80c2d60 2024-09-17T06:06:05.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efca0004d40 con 0x7efca80c2d60 2024-09-17T06:06:05.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca8157eb0 con 0x7efca80c2d60 2024-09-17T06:06:05.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca00b2040 con 0x7efca80c2d60 2024-09-17T06:06:05.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca80c85a0 con 0x7efca80c2d60 2024-09-17T06:06:05.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.393+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7efca806d3b0 con 0x7efca80c2d60 2024-09-17T06:06:05.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efca00be070 con 0x7efca80c2d60 2024-09-17T06:06:05.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efc88073200 0x7efc88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6767+0+0 (secure 0 0 0) 0x7efca012e4d0 con 0x7efca80c2d60 2024-09-17T06:06:05.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1289 (secure 0 0 0) 0x7efca00c7090 con 0x7efca80c2d60 2024-09-17T06:06:05.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efca6d9d640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efc88073200 0x7efc88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efcad242640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca8158810 0x7efca8148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efca80c8840 con 0x7efca8158810 2024-09-17T06:06:05.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca8158810 0x7efca8148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9e59c640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- command(tid 2: {"prefix": "get_command_descriptions"}) -- 0x7efca80c2350 con 0x7efca8158810 2024-09-17T06:06:05.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efca6d9d640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efc88073200 0x7efc88075710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efc980058d0 tx=0x7efc98005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:05.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca8158810 0x7efca8148db0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efc90000f70 tx=0x7efc9000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:05.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc90005270 con 0x7efca8158810 2024-09-17T06:06:05.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.0 v2:172.21.15.122:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efc90017070 con 0x7efca8158810 2024-09-17T06:06:05.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca8158810 msgr2=0x7efca8148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca8158810 0x7efca8148db0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efc90000f70 tx=0x7efc9000db80 comp rx=0 tx=0).stop 2024-09-17T06:06:05.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca8158810 msgr2=0x7efca8148db0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T06:06:05.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.397+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca8158810 0x7efca8148db0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efcad242640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca81f8350 0x7efca81f8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efca8159210 con 0x7efca81f8350 2024-09-17T06:06:05.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca81f8350 0x7efca81f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efc9e59c640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- command(tid 3: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=600"]}) -- 0x7efca80ca220 con 0x7efca81f8350 2024-09-17T06:06:05.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca81f8350 0x7efca81f8760 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efca81513e0 tx=0x7efc90001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:05.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9002a0a0 con 0x7efca81f8350 2024-09-17T06:06:05.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.0 v2:172.21.15.122:3300/0 2 ==== command_reply(tid 3: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) ==== 82+0+3 (secure 0 0 0) 0x7efc9000bb00 con 0x7efca81f8350 2024-09-17T06:06:05.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca81f8350 msgr2=0x7efca81f8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca81f8350 0x7efca81f8760 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efca81513e0 tx=0x7efc90001260 comp rx=0 tx=0).stop 2024-09-17T06:06:05.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca81f8350 msgr2=0x7efca81f8760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T06:06:05.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca81f8350 0x7efca81f8760 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.411 INFO:teuthology.orchestra.run.smithi122.stdout:mon.a: {} 2024-09-17T06:06:05.411 INFO:teuthology.orchestra.run.smithi122.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T06:06:05.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efcad242640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca81f8ca0 0x7efca8153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efca80c2930 con 0x7efca81f8ca0 2024-09-17T06:06:05.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca81f8ca0 0x7efca8153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.405+0000 7efc9e59c640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- command(tid 4: {"prefix": "get_command_descriptions"}) -- 0x7efca8158dc0 con 0x7efca81f8ca0 2024-09-17T06:06:05.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.409+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca81f8ca0 0x7efca8153100 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efc90001ec0 tx=0x7efc9000db80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:05.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.409+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc90038070 con 0x7efca81f8ca0 2024-09-17T06:06:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.409+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.1 v2:172.21.15.173:3300/0 2 ==== command_reply(tid 4: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efc9002d070 con 0x7efca81f8ca0 2024-09-17T06:06:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.409+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca81f8ca0 msgr2=0x7efca8153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.409+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca81f8ca0 0x7efca8153100 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efc90001ec0 tx=0x7efc9000db80 comp rx=0 tx=0).stop 2024-09-17T06:06:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.409+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca81f8ca0 msgr2=0x7efca8153100 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T06:06:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.409+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca81f8ca0 0x7efca8153100 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efc90001ec0 tx=0x7efc9000db80 comp rx=0 tx=0).stop 2024-09-17T06:06:05.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.409+0000 7efca759e640 1 -- 172.21.15.122:0/1001791436 reap_dead start 2024-09-17T06:06:05.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.413+0000 7efcad242640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca80c7e50 0x7efca8157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.413+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efca806e050 con 0x7efca80c7e50 2024-09-17T06:06:05.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.413+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca80c7e50 0x7efca8157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.417+0000 7efc9e59c640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- command(tid 5: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=600"]}) -- 0x7efca80c9670 con 0x7efca80c7e50 2024-09-17T06:06:05.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.417+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca80c7e50 0x7efca8157550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efca80c2ab0 tx=0x7efc90028000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:05.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.417+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc90040070 con 0x7efca80c7e50 2024-09-17T06:06:05.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.1 v2:172.21.15.173:3300/0 2 ==== command_reply(tid 5: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) ==== 82+0+3 (secure 0 0 0) 0x7efc90034b00 con 0x7efca80c7e50 2024-09-17T06:06:05.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca80c7e50 msgr2=0x7efca8157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca80c7e50 0x7efca8157550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efca80c2ab0 tx=0x7efc90028000 comp rx=0 tx=0).stop 2024-09-17T06:06:05.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca80c7e50 msgr2=0x7efca8157550 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T06:06:05.424 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efca80c7e50 0x7efca8157550 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efca80c2ab0 tx=0x7efc90028000 comp rx=0 tx=0).stop 2024-09-17T06:06:05.424 INFO:teuthology.orchestra.run.smithi122.stdout:mon.b: {} 2024-09-17T06:06:05.425 INFO:teuthology.orchestra.run.smithi122.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T06:06:05.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efcad242640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca8153640 0x7efca8153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7efca806f760 con 0x7efca8153640 2024-09-17T06:06:05.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca8153640 0x7efca8153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9e59c640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- command(tid 6: {"prefix": "get_command_descriptions"}) -- 0x7efca81f90b0 con 0x7efca8153640 2024-09-17T06:06:05.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca8153640 0x7efca8153a50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efc9001c450 tx=0x7efc90022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:05.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc90038040 con 0x7efca8153640 2024-09-17T06:06:05.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.2 v2:172.21.15.173:3301/0 2 ==== command_reply(tid 6: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efc9003a9b0 con 0x7efca8153640 2024-09-17T06:06:05.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca8153640 msgr2=0x7efca8153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca8153640 0x7efca8153a50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efc9001c450 tx=0x7efc90022000 comp rx=0 tx=0).stop 2024-09-17T06:06:05.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca8153640 msgr2=0x7efca8153a50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T06:06:05.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.421+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca8153640 0x7efca8153a50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.429+0000 7efcad242640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca802d4d0 0x7efca802d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.433 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.429+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7efca8154080 con 0x7efca802d4d0 2024-09-17T06:06:05.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.429+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca802d4d0 0x7efca802d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.429+0000 7efc9e59c640 1 -- 172.21.15.122:0/1001791436 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- command(tid 7: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=600"]}) -- 0x7efca814e8e0 con 0x7efca802d4d0 2024-09-17T06:06:05.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.429+0000 7efc9e59c640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca802d4d0 0x7efca802d8e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efc9000b4c0 tx=0x7efc90040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:05.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.429+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc900520a0 con 0x7efca802d4d0 2024-09-17T06:06:05.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 <== mon.2 v2:172.21.15.173:3301/0 2 ==== command_reply(tid 7: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) ==== 82+0+3 (secure 0 0 0) 0x7efc9004d260 con 0x7efca802d4d0 2024-09-17T06:06:05.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca802d4d0 msgr2=0x7efca802d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca802d4d0 0x7efca802d8e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efc9000b4c0 tx=0x7efc90040000 comp rx=0 tx=0).stop 2024-09-17T06:06:05.439 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efc9ffff640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca802d4d0 msgr2=0x7efca802d8e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-17T06:06:05.440 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efc9ffff640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efca802d4d0 0x7efca802d8e0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efc9000b4c0 tx=0x7efc90040000 comp rx=0 tx=0).stop 2024-09-17T06:06:05.440 INFO:teuthology.orchestra.run.smithi122.stdout:mon.c: {} 2024-09-17T06:06:05.441 INFO:teuthology.orchestra.run.smithi122.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T06:06:05.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efc88073200 msgr2=0x7efc88075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efcad242640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efc88073200 0x7efc88075710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efc980058d0 tx=0x7efc98005860 comp rx=0 tx=0).stop 2024-09-17T06:06:05.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca80c2d60 msgr2=0x7efca8148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efcad242640 1 --2- 172.21.15.122:0/1001791436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efca80c2d60 0x7efca8148870 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efca001d240 tx=0x7efca00a57f0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efca759e640 1 -- 172.21.15.122:0/1001791436 reap_dead start 2024-09-17T06:06:05.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 shutdown_connections 2024-09-17T06:06:05.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 >> 172.21.15.122:0/1001791436 conn(0x7efca8070d80 msgr2=0x7efca81505f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:05.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 shutdown_connections 2024-09-17T06:06:05.442 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.433+0000 7efcad242640 1 -- 172.21.15.122:0/1001791436 wait complete. 2024-09-17T06:06:05.460 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-17T06:06:05.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.609+0000 7f8aff6d7640 1 -- 172.21.15.122:0/4160952083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af80c67a0 msgr2=0x7f8af814e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.609+0000 7f8aff6d7640 1 --2- 172.21.15.122:0/4160952083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af80c67a0 0x7f8af814e9e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8af4009900 tx=0x7f8af401f0d0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.609+0000 7f8aff6d7640 1 -- 172.21.15.122:0/4160952083 shutdown_connections 2024-09-17T06:06:05.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.609+0000 7f8aff6d7640 1 --2- 172.21.15.122:0/4160952083 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8af815bec0 0x7f8af8072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.609+0000 7f8aff6d7640 1 --2- 172.21.15.122:0/4160952083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af80c67a0 0x7f8af814e9e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.609+0000 7f8aff6d7640 1 -- 172.21.15.122:0/4160952083 >> 172.21.15.122:0/4160952083 conn(0x7f8af80746d0 msgr2=0x7f8af8074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:05.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8aff6d7640 1 -- 172.21.15.122:0/4160952083 shutdown_connections 2024-09-17T06:06:05.616 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8aff6d7640 1 -- 172.21.15.122:0/4160952083 wait complete. 2024-09-17T06:06:05.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8aff6d7640 1 Processor -- start 2024-09-17T06:06:05.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8aff6d7640 1 -- start start 2024-09-17T06:06:05.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8aff6d7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8072270 0x7f8af81537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8aff6d7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8af80c67a0 0x7f8af81f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8aff6d7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8af815bec0 0x7f8af80ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8aff6d7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8af8158a70 con 0x7f8af8072270 2024-09-17T06:06:05.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8aff6d7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8af8158790 con 0x7f8af80c67a0 2024-09-17T06:06:05.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8aff6d7640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8af8158d50 con 0x7f8af815bec0 2024-09-17T06:06:05.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8afd473640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8072270 0x7f8af81537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8afd473640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8072270 0x7f8af81537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54214/0 (socket says 172.21.15.122:54214) 2024-09-17T06:06:05.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8afd473640 1 -- 172.21.15.122:0/2199178712 learned_addr learned my addr 172.21.15.122:0/2199178712 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:05.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8afdc74640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8af815bec0 0x7f8af80ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8afcc72640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8af80c67a0 0x7f8af81f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8afd473640 1 -- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8af815bec0 msgr2=0x7f8af80ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8afd473640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8af815bec0 0x7f8af80ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8afd473640 1 -- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8af80c67a0 msgr2=0x7f8af81f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:05.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8afd473640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8af80c67a0 0x7f8af81f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:05.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8afd473640 1 -- 172.21.15.122:0/2199178712 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af81f34c0 con 0x7f8af8072270 2024-09-17T06:06:05.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8afcc72640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8af80c67a0 0x7f8af81f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:05.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.613+0000 7f8afd473640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8072270 0x7f8af81537b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8af4009850 tx=0x7f8af4005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:05.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.617+0000 7f8aedffb640 1 -- 172.21.15.122:0/2199178712 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af40b5040 con 0x7f8af8072270 2024-09-17T06:06:05.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.617+0000 7f8aedffb640 1 -- 172.21.15.122:0/2199178712 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8af4005310 con 0x7f8af8072270 2024-09-17T06:06:05.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.617+0000 7f8aff6d7640 1 -- 172.21.15.122:0/2199178712 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af8156b50 con 0x7f8af8072270 2024-09-17T06:06:05.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.617+0000 7f8aedffb640 1 -- 172.21.15.122:0/2199178712 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af40046d0 con 0x7f8af8072270 2024-09-17T06:06:05.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.617+0000 7f8aff6d7640 1 -- 172.21.15.122:0/2199178712 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af8149f40 con 0x7f8af8072270 2024-09-17T06:06:05.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.617+0000 7f8aff6d7640 1 -- 172.21.15.122:0/2199178712 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af80c9f70 con 0x7f8af8072270 2024-09-17T06:06:05.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.617+0000 7f8aedffb640 1 -- 172.21.15.122:0/2199178712 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8af4004890 con 0x7f8af8072270 2024-09-17T06:06:05.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.617+0000 7f8aedffb640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8adc073230 0x7f8adc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:05.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.617+0000 7f8aedffb640 1 -- 172.21.15.122:0/2199178712 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6767+0+0 (secure 0 0 0) 0x7f8af4131740 con 0x7f8af8072270 2024-09-17T06:06:05.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.617+0000 7f8afcc72640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8adc073230 0x7f8adc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:05.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.617+0000 7f8afcc72640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8adc073230 0x7f8adc075740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8af80c5ba0 tx=0x7f8ae8008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:05.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.621+0000 7f8aedffb640 1 -- 172.21.15.122:0/2199178712 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8af40c0070 con 0x7f8af8072270 2024-09-17T06:06:05.637 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:06:05.639 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:06:05.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:05.805+0000 7f8aff6d7640 1 -- 172.21.15.122:0/2199178712 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd reweight", "id": 0, "weight": 1.0} v 0) -- 0x7f8af80c33d0 con 0x7f8af8072270 2024-09-17T06:06:06.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.741+0000 7f8aedffb640 1 -- 172.21.15.122:0/2199178712 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 0, "weight": 1.0}]=0 reweighted osd.0 to 1 (10000) v66) ==== 113+0+0 (secure 0 0 0) 0x7f8af4018c30 con 0x7f8af8072270 2024-09-17T06:06:06.746 INFO:teuthology.orchestra.run.smithi122.stderr:reweighted osd.0 to 1 (10000) 2024-09-17T06:06:06.751 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.745+0000 7f8aff6d7640 1 -- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8adc073230 msgr2=0x7f8adc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:06.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.745+0000 7f8aff6d7640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8adc073230 0x7f8adc075740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8af80c5ba0 tx=0x7f8ae8008040 comp rx=0 tx=0).stop 2024-09-17T06:06:06.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.745+0000 7f8aff6d7640 1 -- 172.21.15.122:0/2199178712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8072270 msgr2=0x7f8af81537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:06.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.745+0000 7f8aff6d7640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8072270 0x7f8af81537b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8af4009850 tx=0x7f8af4005e00 comp rx=0 tx=0).stop 2024-09-17T06:06:06.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.745+0000 7f8aff6d7640 1 -- 172.21.15.122:0/2199178712 shutdown_connections 2024-09-17T06:06:06.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.745+0000 7f8aff6d7640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8af815bec0 0x7f8af80ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:06.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.745+0000 7f8aff6d7640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8adc073230 0x7f8adc075740 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:06.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.745+0000 7f8aff6d7640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8af80c67a0 0x7f8af81f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:06.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.745+0000 7f8aff6d7640 1 --2- 172.21.15.122:0/2199178712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af8072270 0x7f8af81537b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:06.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.749+0000 7f8aff6d7640 1 -- 172.21.15.122:0/2199178712 >> 172.21.15.122:0/2199178712 conn(0x7f8af80746d0 msgr2=0x7f8af814af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:06.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.749+0000 7f8aff6d7640 1 -- 172.21.15.122:0/2199178712 shutdown_connections 2024-09-17T06:06:06.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.749+0000 7f8aff6d7640 1 -- 172.21.15.122:0/2199178712 wait complete. 2024-09-17T06:06:06.777 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-17T06:06:06.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.925+0000 7f7d9cff0640 1 -- 172.21.15.122:0/325834019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d98151550 msgr2=0x7f7d9815b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:06.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.925+0000 7f7d9cff0640 1 --2- 172.21.15.122:0/325834019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d98151550 0x7f7d9815b490 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7d980c5f20 tx=0x7f7d8c0203e0 comp rx=0 tx=0).stop 2024-09-17T06:06:06.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.925+0000 7f7d9cff0640 1 -- 172.21.15.122:0/325834019 shutdown_connections 2024-09-17T06:06:06.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.925+0000 7f7d9cff0640 1 --2- 172.21.15.122:0/325834019 >> v2:172.21.15.173:3300/0 conn(0x7f7d9815b9d0 0x7f7d980cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:06.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.925+0000 7f7d9cff0640 1 --2- 172.21.15.122:0/325834019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d98151550 0x7f7d9815b490 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:06.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9cff0640 1 --2- 172.21.15.122:0/325834019 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d980c6870 0x7f7d98158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:06.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9cff0640 1 -- 172.21.15.122:0/325834019 >> 172.21.15.122:0/325834019 conn(0x7f7d980746d0 msgr2=0x7f7d98074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:06.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9cff0640 1 -- 172.21.15.122:0/325834019 shutdown_connections 2024-09-17T06:06:06.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9cff0640 1 -- 172.21.15.122:0/325834019 wait complete. 2024-09-17T06:06:06.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9cff0640 1 Processor -- start 2024-09-17T06:06:06.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9cff0640 1 -- start start 2024-09-17T06:06:06.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9cff0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980c6870 0x7f7d98151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:06.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9cff0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d98151550 0x7f7d9814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:06.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9cff0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d9815b9d0 0x7f7d9814c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:06.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9cff0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7d980c7dd0 con 0x7f7d980c6870 2024-09-17T06:06:06.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9cff0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7d980c7af0 con 0x7f7d98151550 2024-09-17T06:06:06.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9cff0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9815af70 con 0x7f7d9815b9d0 2024-09-17T06:06:06.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980c6870 0x7f7d98151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:06.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980c6870 0x7f7d98151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54242/0 (socket says 172.21.15.122:54242) 2024-09-17T06:06:06.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9659c640 1 -- 172.21.15.122:0/2343357535 learned_addr learned my addr 172.21.15.122:0/2343357535 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:06.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d96d9d640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d9815b9d0 0x7f7d9814c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:06.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d95d9b640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d98151550 0x7f7d9814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:06.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9659c640 1 -- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d9815b9d0 msgr2=0x7f7d9814c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:06.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9659c640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d9815b9d0 0x7f7d9814c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:06.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9659c640 1 -- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d98151550 msgr2=0x7f7d9814bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:06.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9659c640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d98151550 0x7f7d9814bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:06.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9659c640 1 -- 172.21.15.122:0/2343357535 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d981f3780 con 0x7f7d980c6870 2024-09-17T06:06:06.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d95d9b640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d98151550 0x7f7d9814bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:06.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d9659c640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980c6870 0x7f7d98151f60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800c940 tx=0x7f7d8800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:06.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.929+0000 7f7d86ffd640 1 -- 172.21.15.122:0/2343357535 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88004220 con 0x7f7d980c6870 2024-09-17T06:06:06.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.933+0000 7f7d86ffd640 1 -- 172.21.15.122:0/2343357535 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d880079b0 con 0x7f7d980c6870 2024-09-17T06:06:06.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.933+0000 7f7d9cff0640 1 -- 172.21.15.122:0/2343357535 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d981e2b50 con 0x7f7d980c6870 2024-09-17T06:06:06.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.933+0000 7f7d86ffd640 1 -- 172.21.15.122:0/2343357535 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d880044b0 con 0x7f7d980c6870 2024-09-17T06:06:06.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.933+0000 7f7d9cff0640 1 -- 172.21.15.122:0/2343357535 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d981f2ca0 con 0x7f7d980c6870 2024-09-17T06:06:06.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.933+0000 7f7d9cff0640 1 -- 172.21.15.122:0/2343357535 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d98151960 con 0x7f7d980c6870 2024-09-17T06:06:06.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.933+0000 7f7d86ffd640 1 -- 172.21.15.122:0/2343357535 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7d88003600 con 0x7f7d980c6870 2024-09-17T06:06:06.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.933+0000 7f7d86ffd640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7d78073200 0x7f7d78075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:06.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.933+0000 7f7d86ffd640 1 -- 172.21.15.122:0/2343357535 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6767+0+0 (secure 0 0 0) 0x7f7d88094820 con 0x7f7d980c6870 2024-09-17T06:06:06.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.933+0000 7f7d95d9b640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7d78073200 0x7f7d78075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:06.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.933+0000 7f7d95d9b640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7d78073200 0x7f7d78075710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0b2000 tx=0x7f7d8c01ec20 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:06.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:06.937+0000 7f7d86ffd640 1 -- 172.21.15.122:0/2343357535 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7d88014030 con 0x7f7d980c6870 2024-09-17T06:06:07.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.105+0000 7f7d9cff0640 1 -- 172.21.15.122:0/2343357535 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 0, "weight": 1.0} v 0) -- 0x7f7d9814dd00 con 0x7f7d980c6870 2024-09-17T06:06:07.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.769+0000 7f7d86ffd640 1 -- 172.21.15.122:0/2343357535 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]=0 set osd.0 primary-affinity to 1 (8655362) v67) ==== 133+0+0 (secure 0 0 0) 0x7f7d8805f420 con 0x7f7d980c6870 2024-09-17T06:06:07.773 INFO:teuthology.orchestra.run.smithi122.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-17T06:06:07.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.773+0000 7f7d9cff0640 1 -- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7d78073200 msgr2=0x7f7d78075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:07.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.773+0000 7f7d9cff0640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7d78073200 0x7f7d78075710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0b2000 tx=0x7f7d8c01ec20 comp rx=0 tx=0).stop 2024-09-17T06:06:07.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.773+0000 7f7d9cff0640 1 -- 172.21.15.122:0/2343357535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980c6870 msgr2=0x7f7d98151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:07.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.773+0000 7f7d9cff0640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980c6870 0x7f7d98151f60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800c940 tx=0x7f7d8800ce00 comp rx=0 tx=0).stop 2024-09-17T06:06:07.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.773+0000 7f7d9cff0640 1 -- 172.21.15.122:0/2343357535 shutdown_connections 2024-09-17T06:06:07.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.773+0000 7f7d9cff0640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7d9815b9d0 0x7f7d9814c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:07.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.773+0000 7f7d9cff0640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7d78073200 0x7f7d78075710 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:07.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.773+0000 7f7d9cff0640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d98151550 0x7f7d9814bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:07.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.773+0000 7f7d9cff0640 1 --2- 172.21.15.122:0/2343357535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d980c6870 0x7f7d98151f60 secure :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800c940 tx=0x7f7d8800ce00 comp rx=0 tx=0).stop 2024-09-17T06:06:07.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.773+0000 7f7d9cff0640 1 -- 172.21.15.122:0/2343357535 >> 172.21.15.122:0/2343357535 conn(0x7f7d980746d0 msgr2=0x7f7d980c4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:07.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.773+0000 7f7d9cff0640 1 -- 172.21.15.122:0/2343357535 shutdown_connections 2024-09-17T06:06:07.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.773+0000 7f7d9cff0640 1 -- 172.21.15.122:0/2343357535 wait complete. 2024-09-17T06:06:07.804 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-17T06:06:07.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.957+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/2601915380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bac003a10 msgr2=0x7f6bac003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:07.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.957+0000 7f6bc9ac1640 1 --2- 172.21.15.122:0/2601915380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bac003a10 0x7f6bac003e80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4005fd0 tx=0x7f6bb401cda0 comp rx=0 tx=0).stop 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.957+0000 7f6bc3fff640 1 -- 172.21.15.122:0/2601915380 reap_dead start 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.957+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/2601915380 shutdown_connections 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.957+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/2601915380 >> 172.21.15.122:0/2601915380 conn(0x7f6bc408d450 msgr2=0x7f6bc406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.957+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/2601915380 shutdown_connections 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.957+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/2601915380 wait complete. 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.957+0000 7f6bc9ac1640 1 Processor -- start 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.957+0000 7f6bc9ac1640 1 -- start start 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc9ac1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bac003a10 0x7f6bc4163f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc9ac1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc4163640 0x7f6bc4152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc9ac1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc4163a50 0x7f6bc4152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc9ac1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc4166680 con 0x7f6bac003a10 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc9ac1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc4166500 con 0x7f6bc4163640 2024-09-17T06:06:07.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc9ac1640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc4166800 con 0x7f6bc4163a50 2024-09-17T06:06:07.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bac003a10 0x7f6bc4163f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:07.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bac003a10 0x7f6bc4163f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54258/0 (socket says 172.21.15.122:54258) 2024-09-17T06:06:07.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc37fe640 1 -- 172.21.15.122:0/967737314 learned_addr learned my addr 172.21.15.122:0/967737314 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:07.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc2ffd640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc4163640 0x7f6bc4152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:07.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc3fff640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc4163a50 0x7f6bc4152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:07.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc37fe640 1 -- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc4163a50 msgr2=0x7f6bc4152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:07.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc37fe640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc4163a50 0x7f6bc4152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:07.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc37fe640 1 -- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc4163640 msgr2=0x7f6bc4152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:07.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc37fe640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc4163640 0x7f6bc4152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:07.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc37fe640 1 -- 172.21.15.122:0/967737314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc41644c0 con 0x7f6bac003a10 2024-09-17T06:06:07.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc2ffd640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc4163640 0x7f6bc4152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:07.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc3fff640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc4163a50 0x7f6bc4152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:07.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc37fe640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bac003a10 0x7f6bc4163f80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40b1040 tx=0x7f6bb4005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:07.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6babfff640 1 -- 172.21.15.122:0/967737314 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40ab040 con 0x7f6bac003a10 2024-09-17T06:06:07.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6babfff640 1 -- 172.21.15.122:0/967737314 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bb40a5e50 con 0x7f6bac003a10 2024-09-17T06:06:07.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6babfff640 1 -- 172.21.15.122:0/967737314 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4004020 con 0x7f6bac003a10 2024-09-17T06:06:07.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/967737314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc415c220 con 0x7f6bac003a10 2024-09-17T06:06:07.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/967737314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc4155d70 con 0x7f6bac003a10 2024-09-17T06:06:07.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/967737314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc40cc5f0 con 0x7f6bac003a10 2024-09-17T06:06:07.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.961+0000 7f6babfff640 1 -- 172.21.15.122:0/967737314 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6bb40c0020 con 0x7f6bac003a10 2024-09-17T06:06:07.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.965+0000 7f6babfff640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6bb0073200 0x7f6bb0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:07.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.965+0000 7f6babfff640 1 -- 172.21.15.122:0/967737314 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6767+0+0 (secure 0 0 0) 0x7f6bb412ed20 con 0x7f6bac003a10 2024-09-17T06:06:07.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.965+0000 7f6bc2ffd640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6bb0073200 0x7f6bb0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:07.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.965+0000 7f6bc2ffd640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6bb0073200 0x7f6bb0075710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4154600 tx=0x7f6bb8001bf0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:07.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:07.969+0000 7f6babfff640 1 -- 172.21.15.122:0/967737314 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6bb4016ab0 con 0x7f6bac003a10 2024-09-17T06:06:08.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.133+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/967737314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd reweight", "id": 1, "weight": 1.0} v 0) -- 0x7f6bc40cb920 con 0x7f6bac003a10 2024-09-17T06:06:08.777 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.773+0000 7f6babfff640 1 -- 172.21.15.122:0/967737314 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 1, "weight": 1.0}]=0 reweighted osd.1 to 1 (10000) v68) ==== 113+0+0 (secure 0 0 0) 0x7f6bb4102020 con 0x7f6bac003a10 2024-09-17T06:06:08.777 INFO:teuthology.orchestra.run.smithi122.stderr:reweighted osd.1 to 1 (10000) 2024-09-17T06:06:08.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.777+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6bb0073200 msgr2=0x7f6bb0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:08.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.777+0000 7f6bc9ac1640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6bb0073200 0x7f6bb0075710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4154600 tx=0x7f6bb8001bf0 comp rx=0 tx=0).stop 2024-09-17T06:06:08.781 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.777+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/967737314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bac003a10 msgr2=0x7f6bc4163f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:08.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.777+0000 7f6bc9ac1640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bac003a10 0x7f6bc4163f80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40b1040 tx=0x7f6bb4005640 comp rx=0 tx=0).stop 2024-09-17T06:06:08.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.777+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/967737314 shutdown_connections 2024-09-17T06:06:08.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.777+0000 7f6bc9ac1640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc4163a50 0x7f6bc4152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:08.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.777+0000 7f6bc9ac1640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6bb0073200 0x7f6bb0075710 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:08.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.777+0000 7f6bc9ac1640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc4163640 0x7f6bc4152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:08.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.777+0000 7f6bc9ac1640 1 --2- 172.21.15.122:0/967737314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bac003a10 0x7f6bc4163f80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:08.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.777+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/967737314 >> 172.21.15.122:0/967737314 conn(0x7f6bc408d450 msgr2=0x7f6bc4159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:08.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.777+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/967737314 shutdown_connections 2024-09-17T06:06:08.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.777+0000 7f6bc9ac1640 1 -- 172.21.15.122:0/967737314 wait complete. 2024-09-17T06:06:08.806 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-17T06:06:08.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.965+0000 7ff07d850640 1 -- 172.21.15.122:0/187252555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff064003a40 msgr2=0x7ff064003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:08.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.965+0000 7ff07d850640 1 --2- 172.21.15.122:0/187252555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff064003a40 0x7ff064003eb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff06800c310 tx=0x7ff06801cf60 comp rx=0 tx=0).stop 2024-09-17T06:06:08.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.965+0000 7ff0777fe640 1 -- 172.21.15.122:0/187252555 reap_dead start 2024-09-17T06:06:08.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.965+0000 7ff07d850640 1 -- 172.21.15.122:0/187252555 shutdown_connections 2024-09-17T06:06:08.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.965+0000 7ff07d850640 1 -- 172.21.15.122:0/187252555 >> 172.21.15.122:0/187252555 conn(0x7ff0780746d0 msgr2=0x7ff078074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:08.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.965+0000 7ff07d850640 1 -- 172.21.15.122:0/187252555 shutdown_connections 2024-09-17T06:06:08.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.965+0000 7ff07d850640 1 -- 172.21.15.122:0/187252555 wait complete. 2024-09-17T06:06:08.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.965+0000 7ff07d850640 1 Processor -- start 2024-09-17T06:06:08.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.965+0000 7ff07d850640 1 -- start start 2024-09-17T06:06:08.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff07d850640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff064003a40 0x7ff0781f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:08.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff07d850640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0781f5e10 0x7ff078150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:08.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff07d850640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff078153f20 0x7ff078154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:08.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff07d850640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff078157ea0 con 0x7ff0781f5e10 2024-09-17T06:06:08.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff07d850640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff0780c99e0 con 0x7ff064003a40 2024-09-17T06:06:08.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff07d850640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff078074310 con 0x7ff078153f20 2024-09-17T06:06:08.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff06e7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0781f5e10 0x7ff078150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:08.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff06e7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0781f5e10 0x7ff078150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54270/0 (socket says 172.21.15.122:54270) 2024-09-17T06:06:08.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff06e7fc640 1 -- 172.21.15.122:0/1377412200 learned_addr learned my addr 172.21.15.122:0/1377412200 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:08.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff076ffd640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff064003a40 0x7ff0781f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:08.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff0777fe640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff078153f20 0x7ff078154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:08.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff06e7fc640 1 -- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff078153f20 msgr2=0x7ff078154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:08.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff06e7fc640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff078153f20 0x7ff078154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:08.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff06e7fc640 1 -- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff064003a40 msgr2=0x7ff0781f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:08.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff06e7fc640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff064003a40 0x7ff0781f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:08.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff06e7fc640 1 -- 172.21.15.122:0/1377412200 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0781f6560 con 0x7ff0781f5e10 2024-09-17T06:06:08.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff06e7fc640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0781f5e10 0x7ff078150140 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff06000fc60 tx=0x7ff06000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:08.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff074ff9640 1 -- 172.21.15.122:0/1377412200 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060005220 con 0x7ff0781f5e10 2024-09-17T06:06:08.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff074ff9640 1 -- 172.21.15.122:0/1377412200 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0600053c0 con 0x7ff0781f5e10 2024-09-17T06:06:08.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff074ff9640 1 -- 172.21.15.122:0/1377412200 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0600047b0 con 0x7ff0781f5e10 2024-09-17T06:06:08.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff07d850640 1 -- 172.21.15.122:0/1377412200 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff07814a1f0 con 0x7ff0781f5e10 2024-09-17T06:06:08.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff07d850640 1 -- 172.21.15.122:0/1377412200 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07814a7b0 con 0x7ff0781f5e10 2024-09-17T06:06:08.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.969+0000 7ff07d850640 1 -- 172.21.15.122:0/1377412200 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff078149f10 con 0x7ff0781f5e10 2024-09-17T06:06:08.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.973+0000 7ff074ff9640 1 -- 172.21.15.122:0/1377412200 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff060004950 con 0x7ff0781f5e10 2024-09-17T06:06:08.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.973+0000 7ff074ff9640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff058073230 0x7ff058075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:08.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.973+0000 7ff074ff9640 1 -- 172.21.15.122:0/1377412200 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6767+0+0 (secure 0 0 0) 0x7ff0600959a0 con 0x7ff0781f5e10 2024-09-17T06:06:08.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.973+0000 7ff076ffd640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff058073230 0x7ff058075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:08.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.973+0000 7ff076ffd640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff058073230 0x7ff058075740 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0680ab000 tx=0x7ff068019da0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:08.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:08.977+0000 7ff074ff9640 1 -- 172.21.15.122:0/1377412200 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff060060710 con 0x7ff0781f5e10 2024-09-17T06:06:09.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.157+0000 7ff07d850640 1 -- 172.21.15.122:0/1377412200 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 1, "weight": 1.0} v 0) -- 0x7ff07814caf0 con 0x7ff0781f5e10 2024-09-17T06:06:09.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.793+0000 7ff074ff9640 1 -- 172.21.15.122:0/1377412200 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]=0 set osd.1 primary-affinity to 1 (8655362) v69) ==== 133+0+0 (secure 0 0 0) 0x7ff060060010 con 0x7ff0781f5e10 2024-09-17T06:06:09.799 INFO:teuthology.orchestra.run.smithi122.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-17T06:06:09.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.797+0000 7ff07d850640 1 -- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff058073230 msgr2=0x7ff058075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:09.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.797+0000 7ff07d850640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff058073230 0x7ff058075740 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0680ab000 tx=0x7ff068019da0 comp rx=0 tx=0).stop 2024-09-17T06:06:09.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.797+0000 7ff07d850640 1 -- 172.21.15.122:0/1377412200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0781f5e10 msgr2=0x7ff078150140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:09.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.797+0000 7ff07d850640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0781f5e10 0x7ff078150140 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff06000fc60 tx=0x7ff06000d7b0 comp rx=0 tx=0).stop 2024-09-17T06:06:09.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.797+0000 7ff07d850640 1 -- 172.21.15.122:0/1377412200 shutdown_connections 2024-09-17T06:06:09.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.797+0000 7ff07d850640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff078153f20 0x7ff078154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:09.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.797+0000 7ff07d850640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0781f5e10 0x7ff078150140 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:09.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.797+0000 7ff07d850640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff058073230 0x7ff058075740 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0680ab000 tx=0x7ff068019da0 comp rx=0 tx=0).stop 2024-09-17T06:06:09.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.797+0000 7ff07d850640 1 --2- 172.21.15.122:0/1377412200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff064003a40 0x7ff0781f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:09.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.797+0000 7ff07d850640 1 -- 172.21.15.122:0/1377412200 >> 172.21.15.122:0/1377412200 conn(0x7ff0780746d0 msgr2=0x7ff07814d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:09.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.797+0000 7ff07d850640 1 -- 172.21.15.122:0/1377412200 shutdown_connections 2024-09-17T06:06:09.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.797+0000 7ff07d850640 1 -- 172.21.15.122:0/1377412200 wait complete. 2024-09-17T06:06:09.827 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-17T06:06:09.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.981+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2620081472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f00159b30 msgr2=0x7f4f00072270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:09.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.981+0000 7f4f07c5e640 1 --2- 172.21.15.122:0/2620081472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f00159b30 0x7f4f00072270 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009900 tx=0x7f4efc01f0d0 comp rx=0 tx=0).stop 2024-09-17T06:06:09.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.981+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2620081472 shutdown_connections 2024-09-17T06:06:09.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.981+0000 7f4f07c5e640 1 --2- 172.21.15.122:0/2620081472 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f000727b0 0x7f4f0015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:09.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.981+0000 7f4f07c5e640 1 --2- 172.21.15.122:0/2620081472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f00159b30 0x7f4f00072270 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:09.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.981+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2620081472 >> 172.21.15.122:0/2620081472 conn(0x7f4f000746d0 msgr2=0x7f4f00074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:09.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.981+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2620081472 shutdown_connections 2024-09-17T06:06:09.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.981+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2620081472 wait complete. 2024-09-17T06:06:09.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f07c5e640 1 Processor -- start 2024-09-17T06:06:09.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f07c5e640 1 -- start start 2024-09-17T06:06:09.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f07c5e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f000727b0 0x7f4f000cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:09.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f07c5e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f000c6780 0x7f4f000c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:09.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f07c5e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f00159b30 0x7f4f001efc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f07c5e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0015d470 con 0x7f4f000727b0 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f07c5e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0015d190 con 0x7f4f00159b30 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f07c5e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4f00159f40 con 0x7f4f000c6780 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f059fa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f000727b0 0x7f4f000cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f059fa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f000727b0 0x7f4f000cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54284/0 (socket says 172.21.15.122:54284) 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f059fa640 1 -- 172.21.15.122:0/2779198179 learned_addr learned my addr 172.21.15.122:0/2779198179 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f051f9640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f000c6780 0x7f4f000c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f061fb640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f00159b30 0x7f4f001efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f059fa640 1 -- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f000c6780 msgr2=0x7f4f000c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f059fa640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f000c6780 0x7f4f000c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f059fa640 1 -- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f00159b30 msgr2=0x7f4f001efc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f059fa640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f00159b30 0x7f4f001efc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:09.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f059fa640 1 -- 172.21.15.122:0/2779198179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f000cbc50 con 0x7f4f000727b0 2024-09-17T06:06:09.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f061fb640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f00159b30 0x7f4f001efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:09.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f059fa640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f000727b0 0x7f4f000cb710 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000c3f0 tx=0x7f4ef000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:09.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4ef67fc640 1 -- 172.21.15.122:0/2779198179 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0017070 con 0x7f4f000727b0 2024-09-17T06:06:09.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4ef67fc640 1 -- 172.21.15.122:0/2779198179 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ef00053c0 con 0x7f4f000727b0 2024-09-17T06:06:09.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2779198179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f000c8420 con 0x7f4f000727b0 2024-09-17T06:06:09.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4ef67fc640 1 -- 172.21.15.122:0/2779198179 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0003860 con 0x7f4f000727b0 2024-09-17T06:06:09.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.985+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2779198179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f000c6f40 con 0x7f4f000727b0 2024-09-17T06:06:09.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.989+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2779198179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f000cbe20 con 0x7f4f000727b0 2024-09-17T06:06:09.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.989+0000 7f4ef67fc640 1 -- 172.21.15.122:0/2779198179 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4ef001a070 con 0x7f4f000727b0 2024-09-17T06:06:09.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.989+0000 7f4ef67fc640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4ee4073200 0x7f4ee4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:09.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.989+0000 7f4ef67fc640 1 -- 172.21.15.122:0/2779198179 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6767+0+0 (secure 0 0 0) 0x7f4ef0093a50 con 0x7f4f000727b0 2024-09-17T06:06:09.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.989+0000 7f4f051f9640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4ee4073200 0x7f4ee4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:09.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.989+0000 7f4f051f9640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4ee4073200 0x7f4ee4075710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0b2000 tx=0x7f4efc01d910 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:09.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:09.993+0000 7f4ef67fc640 1 -- 172.21.15.122:0/2779198179 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4ef005e650 con 0x7f4f000727b0 2024-09-17T06:06:10.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.173+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2779198179 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd reweight", "id": 2, "weight": 1.0} v 0) -- 0x7f4f000b8cf0 con 0x7f4f000727b0 2024-09-17T06:06:10.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.797+0000 7f4ef67fc640 1 -- 172.21.15.122:0/2779198179 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 2, "weight": 1.0}]=0 reweighted osd.2 to 1 (10000) v70) ==== 113+0+0 (secure 0 0 0) 0x7f4ef005df50 con 0x7f4f000727b0 2024-09-17T06:06:10.802 INFO:teuthology.orchestra.run.smithi122.stderr:reweighted osd.2 to 1 (10000) 2024-09-17T06:06:10.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.801+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4ee4073200 msgr2=0x7f4ee4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:10.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.801+0000 7f4f07c5e640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4ee4073200 0x7f4ee4075710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0b2000 tx=0x7f4efc01d910 comp rx=0 tx=0).stop 2024-09-17T06:06:10.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.801+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2779198179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f000727b0 msgr2=0x7f4f000cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:10.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.801+0000 7f4f07c5e640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f000727b0 0x7f4f000cb710 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000c3f0 tx=0x7f4ef000c8b0 comp rx=0 tx=0).stop 2024-09-17T06:06:10.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.801+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2779198179 shutdown_connections 2024-09-17T06:06:10.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.801+0000 7f4f07c5e640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4ee4073200 0x7f4ee4075710 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:10.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.801+0000 7f4f07c5e640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f00159b30 0x7f4f001efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:10.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.801+0000 7f4f07c5e640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4f000c6780 0x7f4f000c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:10.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.801+0000 7f4f07c5e640 1 --2- 172.21.15.122:0/2779198179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f000727b0 0x7f4f000cb710 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:10.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.801+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2779198179 >> 172.21.15.122:0/2779198179 conn(0x7f4f000746d0 msgr2=0x7f4f0015bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:10.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.801+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2779198179 shutdown_connections 2024-09-17T06:06:10.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.801+0000 7f4f07c5e640 1 -- 172.21.15.122:0/2779198179 wait complete. 2024-09-17T06:06:10.835 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-17T06:06:10.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 -- 172.21.15.122:0/2410938157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f4c0b6720 msgr2=0x7f7f4c0c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:10.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 --2- 172.21.15.122:0/2410938157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f4c0b6720 0x7f7f4c0c6400 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009900 tx=0x7f7f3c01c8e0 comp rx=0 tx=0).stop 2024-09-17T06:06:10.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 -- 172.21.15.122:0/2410938157 shutdown_connections 2024-09-17T06:06:10.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 --2- 172.21.15.122:0/2410938157 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f4c163c90 0x7f7f4c1660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:10.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 --2- 172.21.15.122:0/2410938157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f4c0b6720 0x7f7f4c0c6400 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:10.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 -- 172.21.15.122:0/2410938157 >> 172.21.15.122:0/2410938157 conn(0x7f7f4c06d090 msgr2=0x7f7f4c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:10.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 -- 172.21.15.122:0/2410938157 shutdown_connections 2024-09-17T06:06:10.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 -- 172.21.15.122:0/2410938157 wait complete. 2024-09-17T06:06:10.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 Processor -- start 2024-09-17T06:06:10.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 -- start start 2024-09-17T06:06:11.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f4c15b320 0x7f7f4c0cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:11.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f4c163c90 0x7f7f4c1f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:11.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f4c0ce880 0x7f7f4c1f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:11.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c0cd230 con 0x7f7f4c15b320 2024-09-17T06:06:11.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c0cc610 con 0x7f7f4c0ce880 2024-09-17T06:06:11.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f51b78640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4c0c7490 con 0x7f7f4c163c90 2024-09-17T06:06:11.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f4b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f4c15b320 0x7f7f4c0cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:11.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f4b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f4c15b320 0x7f7f4c0cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54306/0 (socket says 172.21.15.122:54306) 2024-09-17T06:06:11.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.993+0000 7f7f4b7fe640 1 -- 172.21.15.122:0/1337983994 learned_addr learned my addr 172.21.15.122:0/1337983994 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:11.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f4bfff640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f4c0ce880 0x7f7f4c1f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:11.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f4affd640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f4c163c90 0x7f7f4c1f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:11.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f4b7fe640 1 -- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f4c163c90 msgr2=0x7f7f4c1f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:11.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f4b7fe640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f4c163c90 0x7f7f4c1f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:11.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f4b7fe640 1 -- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f4c0ce880 msgr2=0x7f7f4c1f8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:11.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f4b7fe640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f4c0ce880 0x7f7f4c1f8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:11.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f4b7fe640 1 -- 172.21.15.122:0/1337983994 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c151c20 con 0x7f7f4c15b320 2024-09-17T06:06:11.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f4b7fe640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f4c15b320 0x7f7f4c0cf7e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009850 tx=0x7f7f3c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:11.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f33fff640 1 -- 172.21.15.122:0/1337983994 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c0b2040 con 0x7f7f4c15b320 2024-09-17T06:06:11.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f33fff640 1 -- 172.21.15.122:0/1337983994 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f3c005070 con 0x7f7f4c15b320 2024-09-17T06:06:11.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f51b78640 1 -- 172.21.15.122:0/1337983994 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4c155530 con 0x7f7f4c15b320 2024-09-17T06:06:11.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f33fff640 1 -- 172.21.15.122:0/1337983994 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c005480 con 0x7f7f4c15b320 2024-09-17T06:06:11.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f51b78640 1 -- 172.21.15.122:0/1337983994 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f4c1f8b10 con 0x7f7f4c15b320 2024-09-17T06:06:11.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f51b78640 1 -- 172.21.15.122:0/1337983994 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f4c0cccd0 con 0x7f7f4c15b320 2024-09-17T06:06:11.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f33fff640 1 -- 172.21.15.122:0/1337983994 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7f3c0bd060 con 0x7f7f4c15b320 2024-09-17T06:06:11.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f33fff640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7f38073230 0x7f7f38075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:11.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f33fff640 1 -- 172.21.15.122:0/1337983994 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6767+0+0 (secure 0 0 0) 0x7f7f3c12e170 con 0x7f7f4c15b320 2024-09-17T06:06:11.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:10.997+0000 7f7f4affd640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7f38073230 0x7f7f38075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:11.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.001+0000 7f7f4affd640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7f38073230 0x7f7f38075740 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0ccf80 tx=0x7f7f40009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:11.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.001+0000 7f7f33fff640 1 -- 172.21.15.122:0/1337983994 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7f3c0164d0 con 0x7f7f4c15b320 2024-09-17T06:06:11.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.189+0000 7f7f51b78640 1 -- 172.21.15.122:0/1337983994 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 2, "weight": 1.0} v 0) -- 0x7f7f4c15bb70 con 0x7f7f4c15b320 2024-09-17T06:06:11.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.813+0000 7f7f33fff640 1 -- 172.21.15.122:0/1337983994 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]=0 set osd.2 primary-affinity to 1 (8655362) v71) ==== 133+0+0 (secure 0 0 0) 0x7f7f3c0f8ee0 con 0x7f7f4c15b320 2024-09-17T06:06:11.817 INFO:teuthology.orchestra.run.smithi122.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-17T06:06:11.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.817+0000 7f7f51b78640 1 -- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7f38073230 msgr2=0x7f7f38075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:11.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.817+0000 7f7f51b78640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7f38073230 0x7f7f38075740 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0ccf80 tx=0x7f7f40009040 comp rx=0 tx=0).stop 2024-09-17T06:06:11.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.817+0000 7f7f51b78640 1 -- 172.21.15.122:0/1337983994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f4c15b320 msgr2=0x7f7f4c0cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:11.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.817+0000 7f7f51b78640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f4c15b320 0x7f7f4c0cf7e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009850 tx=0x7f7f3c004040 comp rx=0 tx=0).stop 2024-09-17T06:06:11.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.817+0000 7f7f51b78640 1 -- 172.21.15.122:0/1337983994 shutdown_connections 2024-09-17T06:06:11.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.817+0000 7f7f51b78640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7f38073230 0x7f7f38075740 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:11.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.817+0000 7f7f51b78640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f4c0ce880 0x7f7f4c1f8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:11.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.817+0000 7f7f51b78640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7f4c163c90 0x7f7f4c1f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:11.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.817+0000 7f7f51b78640 1 --2- 172.21.15.122:0/1337983994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f4c15b320 0x7f7f4c0cf7e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:11.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.817+0000 7f7f51b78640 1 -- 172.21.15.122:0/1337983994 >> 172.21.15.122:0/1337983994 conn(0x7f7f4c06d090 msgr2=0x7f7f4c159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:11.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.817+0000 7f7f51b78640 1 -- 172.21.15.122:0/1337983994 shutdown_connections 2024-09-17T06:06:11.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:11.817+0000 7f7f51b78640 1 -- 172.21.15.122:0/1337983994 wait complete. 2024-09-17T06:06:11.846 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-17T06:06:12.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.005+0000 7f89a2933640 1 -- 172.21.15.122:0/1762123826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8988004810 msgr2=0x7f8988004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:12.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.005+0000 7f89a2933640 1 --2- 172.21.15.122:0/1762123826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8988004810 0x7f8988004c20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8984009b60 tx=0x7f898401d340 comp rx=0 tx=0).stop 2024-09-17T06:06:12.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.005+0000 7f89a0ed0640 1 -- 172.21.15.122:0/1762123826 reap_dead start 2024-09-17T06:06:12.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.005+0000 7f89a2933640 1 -- 172.21.15.122:0/1762123826 shutdown_connections 2024-09-17T06:06:12.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.005+0000 7f89a2933640 1 -- 172.21.15.122:0/1762123826 >> 172.21.15.122:0/1762123826 conn(0x7f899c0747d0 msgr2=0x7f899c0ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:12.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.005+0000 7f89a2933640 1 -- 172.21.15.122:0/1762123826 shutdown_connections 2024-09-17T06:06:12.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.005+0000 7f89a2933640 1 -- 172.21.15.122:0/1762123826 wait complete. 2024-09-17T06:06:12.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a2933640 1 Processor -- start 2024-09-17T06:06:12.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a2933640 1 -- start start 2024-09-17T06:06:12.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a2933640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8988004810 0x7f899c06f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:12.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a2933640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f899c14c980 0x7f899c1f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:12.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a2933640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c06e170 0x7f899c1e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:12.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a2933640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f899c072cf0 con 0x7f899c06e170 2024-09-17T06:06:12.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a2933640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f899c0c6c80 con 0x7f8988004810 2024-09-17T06:06:12.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a2933640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f899c15a060 con 0x7f899c14c980 2024-09-17T06:06:12.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a0ed0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c06e170 0x7f899c1e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:12.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a0ed0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c06e170 0x7f899c1e4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54310/0 (socket says 172.21.15.122:54310) 2024-09-17T06:06:12.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a0ed0640 1 -- 172.21.15.122:0/1581023527 learned_addr learned my addr 172.21.15.122:0/1581023527 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:12.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f899b7fe640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f899c14c980 0x7f899c1f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:12.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f899bfff640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8988004810 0x7f899c06f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:12.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a0ed0640 1 -- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f899c14c980 msgr2=0x7f899c1f1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:12.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a0ed0640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f899c14c980 0x7f899c1f1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:12.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a0ed0640 1 -- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8988004810 msgr2=0x7f899c06f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:12.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a0ed0640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8988004810 0x7f899c06f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:12.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a0ed0640 1 -- 172.21.15.122:0/1581023527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c1f1f70 con 0x7f899c06e170 2024-09-17T06:06:12.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a0ed0640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c06e170 0x7f899c1e4260 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f899c08cb80 tx=0x7f898c011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:12.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f8998ff9640 1 -- 172.21.15.122:0/1581023527 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c004230 con 0x7f899c06e170 2024-09-17T06:06:12.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f8998ff9640 1 -- 172.21.15.122:0/1581023527 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f898c016070 con 0x7f899c06e170 2024-09-17T06:06:12.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a2933640 1 -- 172.21.15.122:0/1581023527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c1df6e0 con 0x7f899c06e170 2024-09-17T06:06:12.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f8998ff9640 1 -- 172.21.15.122:0/1581023527 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c00faf0 con 0x7f899c06e170 2024-09-17T06:06:12.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a2933640 1 -- 172.21.15.122:0/1581023527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c1dfca0 con 0x7f899c06e170 2024-09-17T06:06:12.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.009+0000 7f89a2933640 1 -- 172.21.15.122:0/1581023527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c1f2140 con 0x7f899c06e170 2024-09-17T06:06:12.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.013+0000 7f8998ff9640 1 -- 172.21.15.122:0/1581023527 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f898c003600 con 0x7f899c06e170 2024-09-17T06:06:12.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.013+0000 7f8998ff9640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f897c073200 0x7f897c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:12.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.013+0000 7f8998ff9640 1 -- 172.21.15.122:0/1581023527 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6767+0+0 (secure 0 0 0) 0x7f898c0951b0 con 0x7f899c06e170 2024-09-17T06:06:12.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.013+0000 7f899bfff640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f897c073200 0x7f897c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:12.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.013+0000 7f899bfff640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f897c073200 0x7f897c075710 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8994004c30 tx=0x7f8994001260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:12.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.017+0000 7f8998ff9640 1 -- 172.21.15.122:0/1581023527 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f899c1f2140 con 0x7f899c06e170 2024-09-17T06:06:12.203 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.197+0000 7f89a2933640 1 -- 172.21.15.122:0/1581023527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd reweight", "id": 3, "weight": 1.0} v 0) -- 0x7f899c0738f0 con 0x7f899c06e170 2024-09-17T06:06:12.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.825+0000 7f8998ff9640 1 -- 172.21.15.122:0/1581023527 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 3, "weight": 1.0}]=0 reweighted osd.3 to 1 (10000) v72) ==== 113+0+0 (secure 0 0 0) 0x7f898c05fdb0 con 0x7f899c06e170 2024-09-17T06:06:13.068 INFO:teuthology.orchestra.run.smithi122.stderr:reweighted osd.3 to 1 (10000) 2024-09-17T06:06:13.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.829+0000 7f89a2933640 1 -- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f897c073200 msgr2=0x7f897c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:13.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.829+0000 7f89a2933640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f897c073200 0x7f897c075710 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8994004c30 tx=0x7f8994001260 comp rx=0 tx=0).stop 2024-09-17T06:06:13.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.829+0000 7f89a2933640 1 -- 172.21.15.122:0/1581023527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c06e170 msgr2=0x7f899c1e4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:13.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.829+0000 7f89a2933640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c06e170 0x7f899c1e4260 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f899c08cb80 tx=0x7f898c011b10 comp rx=0 tx=0).stop 2024-09-17T06:06:13.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.829+0000 7f89a2933640 1 -- 172.21.15.122:0/1581023527 shutdown_connections 2024-09-17T06:06:13.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.829+0000 7f89a2933640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c06e170 0x7f899c1e4260 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.829+0000 7f89a2933640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f899c14c980 0x7f899c1f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.829+0000 7f89a2933640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f897c073200 0x7f897c075710 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.829+0000 7f89a2933640 1 --2- 172.21.15.122:0/1581023527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8988004810 0x7f899c06f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.829+0000 7f89a2933640 1 -- 172.21.15.122:0/1581023527 >> 172.21.15.122:0/1581023527 conn(0x7f899c0747d0 msgr2=0x7f899c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:13.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.829+0000 7f89a2933640 1 -- 172.21.15.122:0/1581023527 shutdown_connections 2024-09-17T06:06:13.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:12.829+0000 7f89a2933640 1 -- 172.21.15.122:0/1581023527 wait complete. 2024-09-17T06:06:13.071 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-17T06:06:13.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.236+0000 7f0dfde60640 1 -- 172.21.15.122:0/3470108526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0df80ccdb0 msgr2=0x7f0df80cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:13.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.236+0000 7f0dfde60640 1 --2- 172.21.15.122:0/3470108526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0df80ccdb0 0x7f0df80cc1e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009900 tx=0x7f0de801c870 comp rx=0 tx=0).stop 2024-09-17T06:06:13.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.236+0000 7f0dfde60640 1 -- 172.21.15.122:0/3470108526 shutdown_connections 2024-09-17T06:06:13.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.236+0000 7f0dfde60640 1 --2- 172.21.15.122:0/3470108526 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0df815bb80 0x7f0df80cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.236+0000 7f0dfde60640 1 --2- 172.21.15.122:0/3470108526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0df80ccdb0 0x7f0df80cc1e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.236+0000 7f0dfde60640 1 -- 172.21.15.122:0/3470108526 >> 172.21.15.122:0/3470108526 conn(0x7f0df808d450 msgr2=0x7f0df806ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:13.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.236+0000 7f0dfde60640 1 -- 172.21.15.122:0/3470108526 shutdown_connections 2024-09-17T06:06:13.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.236+0000 7f0dfde60640 1 -- 172.21.15.122:0/3470108526 wait complete. 2024-09-17T06:06:13.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.236+0000 7f0dfde60640 1 Processor -- start 2024-09-17T06:06:13.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.236+0000 7f0dfde60640 1 -- start start 2024-09-17T06:06:13.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0dfde60640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df806dab0 0x7f0df8152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:13.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0dfde60640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0df80ccdb0 0x7f0df81f9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:13.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0dfde60640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0df815bb80 0x7f0df8151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:13.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0dfde60640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0df8168690 con 0x7f0df815bb80 2024-09-17T06:06:13.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0dfde60640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0df8168510 con 0x7f0df806dab0 2024-09-17T06:06:13.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0dfde60640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0df8168810 con 0x7f0df80ccdb0 2024-09-17T06:06:13.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0df7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0df815bb80 0x7f0df8151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:13.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0df7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0df815bb80 0x7f0df8151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54336/0 (socket says 172.21.15.122:54336) 2024-09-17T06:06:13.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0df7fff640 1 -- 172.21.15.122:0/3378305034 learned_addr learned my addr 172.21.15.122:0/3378305034 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:13.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0df77fe640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df806dab0 0x7f0df8152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:13.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0df6ffd640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0df80ccdb0 0x7f0df81f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:13.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0df7fff640 1 -- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0df80ccdb0 msgr2=0x7f0df81f9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:13.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0df7fff640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0df80ccdb0 0x7f0df81f9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0df7fff640 1 -- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df806dab0 msgr2=0x7f0df8152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:13.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0df7fff640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df806dab0 0x7f0df8152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0df7fff640 1 -- 172.21.15.122:0/3378305034 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df8146d00 con 0x7f0df815bb80 2024-09-17T06:06:13.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0df77fe640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df806dab0 0x7f0df8152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:13.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0df7fff640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0df815bb80 0x7f0df8151740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0df000ba10 tx=0x7f0df000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:13.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0ddffff640 1 -- 172.21.15.122:0/3378305034 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df0019070 con 0x7f0df815bb80 2024-09-17T06:06:13.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0ddffff640 1 -- 172.21.15.122:0/3378305034 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0df000cc30 con 0x7f0df815bb80 2024-09-17T06:06:13.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0dfde60640 1 -- 172.21.15.122:0/3378305034 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df81477b0 con 0x7f0df815bb80 2024-09-17T06:06:13.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0ddffff640 1 -- 172.21.15.122:0/3378305034 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df00146a0 con 0x7f0df815bb80 2024-09-17T06:06:13.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0dfde60640 1 -- 172.21.15.122:0/3378305034 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df81f87a0 con 0x7f0df815bb80 2024-09-17T06:06:13.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0dfde60640 1 -- 172.21.15.122:0/3378305034 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df815b470 con 0x7f0df815bb80 2024-09-17T06:06:13.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0ddffff640 1 -- 172.21.15.122:0/3378305034 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0df001c070 con 0x7f0df815bb80 2024-09-17T06:06:13.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.240+0000 7f0ddffff640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0de4073200 0x7f0de4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:13.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.244+0000 7f0ddffff640 1 -- 172.21.15.122:0/3378305034 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6767+0+0 (secure 0 0 0) 0x7f0df0094770 con 0x7f0df815bb80 2024-09-17T06:06:13.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.244+0000 7f0df77fe640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0de4073200 0x7f0de4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:13.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.244+0000 7f0df77fe640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0de4073200 0x7f0de4075710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0de80af000 tx=0x7f0de801b0b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:13.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.248+0000 7f0ddffff640 1 -- 172.21.15.122:0/3378305034 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f0df0023020 con 0x7f0df815bb80 2024-09-17T06:06:13.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.428+0000 7f0dfde60640 1 -- 172.21.15.122:0/3378305034 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 3, "weight": 1.0} v 0) -- 0x7f0df80cb920 con 0x7f0df815bb80 2024-09-17T06:06:13.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.840+0000 7f0ddffff640 1 -- 172.21.15.122:0/3378305034 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]=0 set osd.3 primary-affinity to 1 (8655362) v73) ==== 133+0+0 (secure 0 0 0) 0x7f0df000ce20 con 0x7f0df815bb80 2024-09-17T06:06:13.846 INFO:teuthology.orchestra.run.smithi122.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-17T06:06:13.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.844+0000 7f0dfde60640 1 -- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0de4073200 msgr2=0x7f0de4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:13.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.844+0000 7f0dfde60640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0de4073200 0x7f0de4075710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0de80af000 tx=0x7f0de801b0b0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.844+0000 7f0dfde60640 1 -- 172.21.15.122:0/3378305034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0df815bb80 msgr2=0x7f0df8151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:13.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.844+0000 7f0dfde60640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0df815bb80 0x7f0df8151740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0df000ba10 tx=0x7f0df000bed0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.844+0000 7f0dfde60640 1 -- 172.21.15.122:0/3378305034 shutdown_connections 2024-09-17T06:06:13.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.844+0000 7f0dfde60640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0df815bb80 0x7f0df8151740 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.844+0000 7f0dfde60640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0df80ccdb0 0x7f0df81f9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.844+0000 7f0dfde60640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0de4073200 0x7f0de4075710 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.844+0000 7f0dfde60640 1 --2- 172.21.15.122:0/3378305034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df806dab0 0x7f0df8152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:13.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.844+0000 7f0dfde60640 1 -- 172.21.15.122:0/3378305034 >> 172.21.15.122:0/3378305034 conn(0x7f0df808d450 msgr2=0x7f0df80b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:13.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.844+0000 7f0dfde60640 1 -- 172.21.15.122:0/3378305034 shutdown_connections 2024-09-17T06:06:13.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:13.844+0000 7f0dfde60640 1 -- 172.21.15.122:0/3378305034 wait complete. 2024-09-17T06:06:13.886 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-17T06:06:14.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 -- 172.21.15.122:0/1365919712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03d8005310 msgr2=0x7f03d800dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:14.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 --2- 172.21.15.122:0/1365919712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03d8005310 0x7f03d800dbe0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009e00 tx=0x7f03e401d170 comp rx=0 tx=0).stop 2024-09-17T06:06:14.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 -- 172.21.15.122:0/1365919712 shutdown_connections 2024-09-17T06:06:14.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 --2- 172.21.15.122:0/1365919712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03d8005310 0x7f03d800dbe0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:14.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 -- 172.21.15.122:0/1365919712 >> 172.21.15.122:0/1365919712 conn(0x7f03ec0746d0 msgr2=0x7f03ec074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:14.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 -- 172.21.15.122:0/1365919712 shutdown_connections 2024-09-17T06:06:14.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 -- 172.21.15.122:0/1365919712 wait complete. 2024-09-17T06:06:14.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 Processor -- start 2024-09-17T06:06:14.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 -- start start 2024-09-17T06:06:14.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03d8005310 0x7f03ec14a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:14.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03ec0c5860 0x7f03ec1f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:14.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec15aa30 0x7f03ec14c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:14.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.036+0000 7f03f451d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec0c9f70 con 0x7f03ec15aa30 2024-09-17T06:06:14.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f451d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec158e10 con 0x7f03d8005310 2024-09-17T06:06:14.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f451d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f03ec157f80 con 0x7f03ec0c5860 2024-09-17T06:06:14.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f2aba640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec15aa30 0x7f03ec14c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:14.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f2aba640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec15aa30 0x7f03ec14c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54348/0 (socket says 172.21.15.122:54348) 2024-09-17T06:06:14.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f2aba640 1 -- 172.21.15.122:0/3365313799 learned_addr learned my addr 172.21.15.122:0/3365313799 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:14.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f22b9640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03d8005310 0x7f03ec14a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:14.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f1ab8640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03ec0c5860 0x7f03ec1f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:14.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f2aba640 1 -- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03ec0c5860 msgr2=0x7f03ec1f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:14.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f2aba640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03ec0c5860 0x7f03ec1f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:14.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f2aba640 1 -- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03d8005310 msgr2=0x7f03ec14a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:14.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f2aba640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03d8005310 0x7f03ec14a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:14.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f2aba640 1 -- 172.21.15.122:0/3365313799 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec1f0ee0 con 0x7f03ec15aa30 2024-09-17T06:06:14.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f22b9640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03d8005310 0x7f03ec14a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:06:14.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f2aba640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec15aa30 0x7f03ec14c570 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f03e401da10 tx=0x7f03e40acaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:14.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03e2ffd640 1 -- 172.21.15.122:0/3365313799 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e40bd070 con 0x7f03ec15aa30 2024-09-17T06:06:14.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03e2ffd640 1 -- 172.21.15.122:0/3365313799 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03e40a5e60 con 0x7f03ec15aa30 2024-09-17T06:06:14.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f451d640 1 -- 172.21.15.122:0/3365313799 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03ec0c4ff0 con 0x7f03ec15aa30 2024-09-17T06:06:14.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03e2ffd640 1 -- 172.21.15.122:0/3365313799 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e4004c60 con 0x7f03ec15aa30 2024-09-17T06:06:14.047 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f451d640 1 -- 172.21.15.122:0/3365313799 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03ec0cd4b0 con 0x7f03ec15aa30 2024-09-17T06:06:14.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f451d640 1 -- 172.21.15.122:0/3365313799 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03ec152540 con 0x7f03ec15aa30 2024-09-17T06:06:14.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03e2ffd640 1 -- 172.21.15.122:0/3365313799 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f03e40c0070 con 0x7f03ec15aa30 2024-09-17T06:06:14.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03e2ffd640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f03d00731a0 0x7f03d00756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:14.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03e2ffd640 1 -- 172.21.15.122:0/3365313799 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6767+0+0 (secure 0 0 0) 0x7f03e412f4b0 con 0x7f03ec15aa30 2024-09-17T06:06:14.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.040+0000 7f03f22b9640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f03d00731a0 0x7f03d00756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:14.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.044+0000 7f03f22b9640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f03d00731a0 0x7f03d00756b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f03e8001870 tx=0x7f03e80011c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:14.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.044+0000 7f03e2ffd640 1 -- 172.21.15.122:0/3365313799 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f03e4016e80 con 0x7f03ec15aa30 2024-09-17T06:06:14.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.228+0000 7f03f451d640 1 -- 172.21.15.122:0/3365313799 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd reweight", "id": 5, "weight": 1.0} v 0) -- 0x7f03ec159bf0 con 0x7f03ec15aa30 2024-09-17T06:06:14.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.844+0000 7f03e2ffd640 1 -- 172.21.15.122:0/3365313799 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 5, "weight": 1.0}]=0 reweighted osd.5 to 1 (10000) v74) ==== 113+0+0 (secure 0 0 0) 0x7f03ec159bf0 con 0x7f03ec15aa30 2024-09-17T06:06:14.849 INFO:teuthology.orchestra.run.smithi122.stderr:reweighted osd.5 to 1 (10000) 2024-09-17T06:06:14.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.848+0000 7f03f451d640 1 -- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f03d00731a0 msgr2=0x7f03d00756b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:14.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.848+0000 7f03f451d640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f03d00731a0 0x7f03d00756b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f03e8001870 tx=0x7f03e80011c0 comp rx=0 tx=0).stop 2024-09-17T06:06:14.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.848+0000 7f03f451d640 1 -- 172.21.15.122:0/3365313799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec15aa30 msgr2=0x7f03ec14c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:14.853 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.848+0000 7f03f451d640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec15aa30 0x7f03ec14c570 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f03e401da10 tx=0x7f03e40acaa0 comp rx=0 tx=0).stop 2024-09-17T06:06:14.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.848+0000 7f03f451d640 1 -- 172.21.15.122:0/3365313799 shutdown_connections 2024-09-17T06:06:14.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.848+0000 7f03f451d640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec15aa30 0x7f03ec14c570 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:14.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.848+0000 7f03f451d640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f03ec0c5860 0x7f03ec1f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:14.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.848+0000 7f03f451d640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f03d00731a0 0x7f03d00756b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:14.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.848+0000 7f03f451d640 1 --2- 172.21.15.122:0/3365313799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f03d8005310 0x7f03ec14a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:14.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.848+0000 7f03f451d640 1 -- 172.21.15.122:0/3365313799 >> 172.21.15.122:0/3365313799 conn(0x7f03ec0746d0 msgr2=0x7f03ec0c3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:14.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.848+0000 7f03f451d640 1 -- 172.21.15.122:0/3365313799 shutdown_connections 2024-09-17T06:06:14.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:14.848+0000 7f03f451d640 1 -- 172.21.15.122:0/3365313799 wait complete. 2024-09-17T06:06:14.889 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-17T06:06:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 -- 172.21.15.122:0/266057876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4980c68d0 msgr2=0x7fa498072870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 --2- 172.21.15.122:0/266057876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4980c68d0 0x7fa498072870 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa498073d30 tx=0x7fa48801c800 comp rx=0 tx=0).stop 2024-09-17T06:06:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 -- 172.21.15.122:0/266057876 shutdown_connections 2024-09-17T06:06:15.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 --2- 172.21.15.122:0/266057876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4980c68d0 0x7fa498072870 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:15.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 --2- 172.21.15.122:0/266057876 >> v2:172.21.15.173:3300/0 conn(0x7fa4980c8df0 0x7fa498072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:15.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 -- 172.21.15.122:0/266057876 >> 172.21.15.122:0/266057876 conn(0x7fa4980746d0 msgr2=0x7fa498074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:15.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 -- 172.21.15.122:0/266057876 shutdown_connections 2024-09-17T06:06:15.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 -- 172.21.15.122:0/266057876 wait complete. 2024-09-17T06:06:15.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 Processor -- start 2024-09-17T06:06:15.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 -- start start 2024-09-17T06:06:15.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4980c68d0 0x7fa49814ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:15.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4980c8df0 0x7fa498139140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:15.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49814eae0 0x7fa49814a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:15.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa498152540 con 0x7fa49814eae0 2024-09-17T06:06:15.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa4980c9f70 con 0x7fa4980c68d0 2024-09-17T06:06:15.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49f87e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa4981526c0 con 0x7fa4980c8df0 2024-09-17T06:06:15.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49de1b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49814eae0 0x7fa49814a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:15.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49de1b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49814eae0 0x7fa49814a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44680/0 (socket says 172.21.15.122:44680) 2024-09-17T06:06:15.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49de1b640 1 -- 172.21.15.122:0/2876510520 learned_addr learned my addr 172.21.15.122:0/2876510520 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:15.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49ce19640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4980c8df0 0x7fa498139140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:15.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49d61a640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4980c68d0 0x7fa49814ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:15.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49de1b640 1 -- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4980c8df0 msgr2=0x7fa498139140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:15.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49de1b640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4980c8df0 0x7fa498139140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:15.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49de1b640 1 -- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4980c68d0 msgr2=0x7fa49814ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:15.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49de1b640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4980c68d0 0x7fa49814ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:15.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.044+0000 7fa49de1b640 1 -- 172.21.15.122:0/2876510520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa498142d40 con 0x7fa49814eae0 2024-09-17T06:06:15.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.048+0000 7fa49de1b640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49814eae0 0x7fa49814a1e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa49000c730 tx=0x7fa49000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:15.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.048+0000 7fa48dffb640 1 -- 172.21.15.122:0/2876510520 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490003b80 con 0x7fa49814eae0 2024-09-17T06:06:15.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.048+0000 7fa48dffb640 1 -- 172.21.15.122:0/2876510520 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa490003d40 con 0x7fa49814eae0 2024-09-17T06:06:15.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.048+0000 7fa49f87e640 1 -- 172.21.15.122:0/2876510520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49814d590 con 0x7fa49814eae0 2024-09-17T06:06:15.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.048+0000 7fa48dffb640 1 -- 172.21.15.122:0/2876510520 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4900052d0 con 0x7fa49814eae0 2024-09-17T06:06:15.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.048+0000 7fa49f87e640 1 -- 172.21.15.122:0/2876510520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49814d830 con 0x7fa49814eae0 2024-09-17T06:06:15.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.048+0000 7fa49f87e640 1 -- 172.21.15.122:0/2876510520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4981427d0 con 0x7fa49814eae0 2024-09-17T06:06:15.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.048+0000 7fa48dffb640 1 -- 172.21.15.122:0/2876510520 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa490005680 con 0x7fa49814eae0 2024-09-17T06:06:15.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.048+0000 7fa48dffb640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa47c073200 0x7fa47c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:15.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.048+0000 7fa48dffb640 1 -- 172.21.15.122:0/2876510520 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6767+0+0 (secure 0 0 0) 0x7fa490094560 con 0x7fa49814eae0 2024-09-17T06:06:15.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.048+0000 7fa49d61a640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa47c073200 0x7fa47c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:15.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.052+0000 7fa49d61a640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa47c073200 0x7fa47c075710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa4940058d0 tx=0x7fa494005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:15.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.052+0000 7fa48dffb640 1 -- 172.21.15.122:0/2876510520 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa49005f280 con 0x7fa49814eae0 2024-09-17T06:06:15.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.240+0000 7fa49f87e640 1 -- 172.21.15.122:0/2876510520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 5, "weight": 1.0} v 0) -- 0x7fa49815b810 con 0x7fa49814eae0 2024-09-17T06:06:15.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.872+0000 7fa48dffb640 1 -- 172.21.15.122:0/2876510520 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]=0 set osd.5 primary-affinity to 1 (8655362) v75) ==== 133+0+0 (secure 0 0 0) 0x7fa49005eb80 con 0x7fa49814eae0 2024-09-17T06:06:15.876 INFO:teuthology.orchestra.run.smithi122.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-17T06:06:15.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.876+0000 7fa49f87e640 1 -- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa47c073200 msgr2=0x7fa47c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:15.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.876+0000 7fa49f87e640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa47c073200 0x7fa47c075710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa4940058d0 tx=0x7fa494005860 comp rx=0 tx=0).stop 2024-09-17T06:06:15.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.876+0000 7fa49f87e640 1 -- 172.21.15.122:0/2876510520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49814eae0 msgr2=0x7fa49814a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:15.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.876+0000 7fa49f87e640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49814eae0 0x7fa49814a1e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa49000c730 tx=0x7fa49000cbf0 comp rx=0 tx=0).stop 2024-09-17T06:06:15.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.876+0000 7fa49f87e640 1 -- 172.21.15.122:0/2876510520 shutdown_connections 2024-09-17T06:06:15.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.876+0000 7fa49f87e640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49814eae0 0x7fa49814a1e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:15.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.876+0000 7fa49f87e640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4980c8df0 0x7fa498139140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:15.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.876+0000 7fa49f87e640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa47c073200 0x7fa47c075710 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:15.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.876+0000 7fa49f87e640 1 --2- 172.21.15.122:0/2876510520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4980c68d0 0x7fa49814ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:15.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.876+0000 7fa49f87e640 1 -- 172.21.15.122:0/2876510520 >> 172.21.15.122:0/2876510520 conn(0x7fa4980746d0 msgr2=0x7fa49814b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:15.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.876+0000 7fa49f87e640 1 -- 172.21.15.122:0/2876510520 shutdown_connections 2024-09-17T06:06:15.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:15.876+0000 7fa49f87e640 1 -- 172.21.15.122:0/2876510520 wait complete. 2024-09-17T06:06:15.909 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-17T06:06:16.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.068+0000 7fa82217a640 1 -- 172.21.15.122:0/3549542790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa804003a10 msgr2=0x7fa804003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:16.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.068+0000 7fa82217a640 1 --2- 172.21.15.122:0/3549542790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa804003a10 0x7fa804003e80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009b60 tx=0x7fa80c01d340 comp rx=0 tx=0).stop 2024-09-17T06:06:16.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.068+0000 7fa81bfff640 1 -- 172.21.15.122:0/3549542790 reap_dead start 2024-09-17T06:06:16.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.068+0000 7fa82217a640 1 -- 172.21.15.122:0/3549542790 shutdown_connections 2024-09-17T06:06:16.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.068+0000 7fa82217a640 1 -- 172.21.15.122:0/3549542790 >> 172.21.15.122:0/3549542790 conn(0x7fa81c0746d0 msgr2=0x7fa81c074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:16.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.068+0000 7fa82217a640 1 -- 172.21.15.122:0/3549542790 shutdown_connections 2024-09-17T06:06:16.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.068+0000 7fa82217a640 1 -- 172.21.15.122:0/3549542790 wait complete. 2024-09-17T06:06:16.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa82217a640 1 Processor -- start 2024-09-17T06:06:16.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa82217a640 1 -- start start 2024-09-17T06:06:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa82217a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa804003a10 0x7fa81c1ee610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa82217a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa81c148c00 0x7fa81c0c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa82217a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81c142f50 0x7fa81c143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa82217a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c158a70 con 0x7fa804003a10 2024-09-17T06:06:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa82217a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c158790 con 0x7fa81c142f50 2024-09-17T06:06:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa82217a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa81c158d50 con 0x7fa81c148c00 2024-09-17T06:06:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa81b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa804003a10 0x7fa81c1ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa81b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa804003a10 0x7fa81c1ee610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44686/0 (socket says 172.21.15.122:44686) 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa81b7fe640 1 -- 172.21.15.122:0/3040285585 learned_addr learned my addr 172.21.15.122:0/3040285585 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa81bfff640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81c142f50 0x7fa81c143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa81affd640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa81c148c00 0x7fa81c0c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa81b7fe640 1 -- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa81c148c00 msgr2=0x7fa81c0c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa81b7fe640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa81c148c00 0x7fa81c0c5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa81b7fe640 1 -- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81c142f50 msgr2=0x7fa81c143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa81b7fe640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81c142f50 0x7fa81c143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa81b7fe640 1 -- 172.21.15.122:0/3040285585 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c1eeb50 con 0x7fa804003a10 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa81b7fe640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa804003a10 0x7fa81c1ee610 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009a80 tx=0x7fa80c0056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa803fff640 1 -- 172.21.15.122:0/3040285585 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0b2070 con 0x7fa804003a10 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa803fff640 1 -- 172.21.15.122:0/3040285585 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa80c0bc070 con 0x7fa804003a10 2024-09-17T06:06:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa803fff640 1 -- 172.21.15.122:0/3040285585 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0add40 con 0x7fa804003a10 2024-09-17T06:06:16.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa82217a640 1 -- 172.21.15.122:0/3040285585 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa81c148710 con 0x7fa804003a10 2024-09-17T06:06:16.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.072+0000 7fa82217a640 1 -- 172.21.15.122:0/3040285585 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa81c1489b0 con 0x7fa804003a10 2024-09-17T06:06:16.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.076+0000 7fa82217a640 1 -- 172.21.15.122:0/3040285585 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa81c0c9f70 con 0x7fa804003a10 2024-09-17T06:06:16.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.076+0000 7fa803fff640 1 -- 172.21.15.122:0/3040285585 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa80c0ad4c0 con 0x7fa804003a10 2024-09-17T06:06:16.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.076+0000 7fa803fff640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa808073230 0x7fa808075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:16.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.076+0000 7fa803fff640 1 -- 172.21.15.122:0/3040285585 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6767+0+0 (secure 0 0 0) 0x7fa80c12f3b0 con 0x7fa804003a10 2024-09-17T06:06:16.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.076+0000 7fa81affd640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa808073230 0x7fa808075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:16.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.076+0000 7fa81affd640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa808073230 0x7fa808075740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa81c1456c0 tx=0x7fa8100091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:16.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.080+0000 7fa803fff640 1 -- 172.21.15.122:0/3040285585 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa80c016fc0 con 0x7fa804003a10 2024-09-17T06:06:16.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.268+0000 7fa82217a640 1 -- 172.21.15.122:0/3040285585 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd reweight", "id": 6, "weight": 1.0} v 0) -- 0x7fa81c15bd40 con 0x7fa804003a10 2024-09-17T06:06:16.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.872+0000 7fa803fff640 1 -- 172.21.15.122:0/3040285585 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 6, "weight": 1.0}]=0 reweighted osd.6 to 1 (10000) v76) ==== 113+0+0 (secure 0 0 0) 0x7fa80c0f9fb0 con 0x7fa804003a10 2024-09-17T06:06:16.880 INFO:teuthology.orchestra.run.smithi122.stderr:reweighted osd.6 to 1 (10000) 2024-09-17T06:06:16.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.876+0000 7fa82217a640 1 -- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa808073230 msgr2=0x7fa808075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:16.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.876+0000 7fa82217a640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa808073230 0x7fa808075740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa81c1456c0 tx=0x7fa8100091e0 comp rx=0 tx=0).stop 2024-09-17T06:06:16.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.876+0000 7fa82217a640 1 -- 172.21.15.122:0/3040285585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa804003a10 msgr2=0x7fa81c1ee610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:16.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.876+0000 7fa82217a640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa804003a10 0x7fa81c1ee610 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009a80 tx=0x7fa80c0056a0 comp rx=0 tx=0).stop 2024-09-17T06:06:16.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.876+0000 7fa82217a640 1 -- 172.21.15.122:0/3040285585 shutdown_connections 2024-09-17T06:06:16.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.876+0000 7fa82217a640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa808073230 0x7fa808075740 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:16.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.876+0000 7fa82217a640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa81c142f50 0x7fa81c143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:16.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.876+0000 7fa82217a640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa81c148c00 0x7fa81c0c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:16.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.876+0000 7fa82217a640 1 --2- 172.21.15.122:0/3040285585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa804003a10 0x7fa81c1ee610 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:16.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.876+0000 7fa82217a640 1 -- 172.21.15.122:0/3040285585 >> 172.21.15.122:0/3040285585 conn(0x7fa81c0746d0 msgr2=0x7fa81c0c9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:16.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.876+0000 7fa82217a640 1 -- 172.21.15.122:0/3040285585 shutdown_connections 2024-09-17T06:06:16.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:16.876+0000 7fa82217a640 1 -- 172.21.15.122:0/3040285585 wait complete. 2024-09-17T06:06:16.912 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-17T06:06:17.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/1354807223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d00cc620 msgr2=0x7fe5d00cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:17.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 --2- 172.21.15.122:0/1354807223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d00cc620 0x7fe5d00cca30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000aa10 tx=0x7fe5c0020420 comp rx=0 tx=0).stop 2024-09-17T06:06:17.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/1354807223 shutdown_connections 2024-09-17T06:06:17.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 --2- 172.21.15.122:0/1354807223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d00cc620 0x7fe5d00cca30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:17.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/1354807223 >> 172.21.15.122:0/1354807223 conn(0x7fe5d00746d0 msgr2=0x7fe5d0074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:17.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/1354807223 shutdown_connections 2024-09-17T06:06:17.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/1354807223 wait complete. 2024-09-17T06:06:17.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 Processor -- start 2024-09-17T06:06:17.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 -- start start 2024-09-17T06:06:17.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d00c8850 0x7fe5d0154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:17.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5d00c8c60 0x7fe5d0158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:17.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5d00cc620 0x7fe5d01589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:17.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d00c7880 con 0x7fe5d00c8850 2024-09-17T06:06:17.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d00c83c0 con 0x7fe5d00c8c60 2024-09-17T06:06:17.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5d5bf4640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d00c7b60 con 0x7fe5d00cc620 2024-09-17T06:06:17.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5cf7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d00c8850 0x7fe5d0154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:17.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5cf7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d00c8850 0x7fe5d0154340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44710/0 (socket says 172.21.15.122:44710) 2024-09-17T06:06:17.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.068+0000 7fe5cf7fe640 1 -- 172.21.15.122:0/2105086455 learned_addr learned my addr 172.21.15.122:0/2105086455 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5cffff640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5d00cc620 0x7fe5d01589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5ceffd640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5d00c8c60 0x7fe5d0158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5cf7fe640 1 -- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5d00cc620 msgr2=0x7fe5d01589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5cf7fe640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5d00cc620 0x7fe5d01589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5cf7fe640 1 -- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5d00c8c60 msgr2=0x7fe5d0158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5cf7fe640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5d00c8c60 0x7fe5d0158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5cf7fe640 1 -- 172.21.15.122:0/2105086455 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d0145870 con 0x7fe5d00c8850 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5ceffd640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5d00c8c60 0x7fe5d0158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5cf7fe640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d00c8850 0x7fe5d0154340 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800c3f0 tx=0x7fe5b800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5c7fff640 1 -- 172.21.15.122:0/2105086455 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8017070 con 0x7fe5d00c8850 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5c7fff640 1 -- 172.21.15.122:0/2105086455 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5b80053c0 con 0x7fe5d00c8850 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/2105086455 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d01f5010 con 0x7fe5d00c8850 2024-09-17T06:06:17.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5c7fff640 1 -- 172.21.15.122:0/2105086455 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8003860 con 0x7fe5d00c8850 2024-09-17T06:06:17.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/2105086455 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d01f55d0 con 0x7fe5d00c8850 2024-09-17T06:06:17.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/2105086455 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d015a8e0 con 0x7fe5d00c8850 2024-09-17T06:06:17.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5c7fff640 1 -- 172.21.15.122:0/2105086455 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe5b801a070 con 0x7fe5d00c8850 2024-09-17T06:06:17.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5c7fff640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe5b0073230 0x7fe5b0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:17.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5c7fff640 1 -- 172.21.15.122:0/2105086455 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6767+0+0 (secure 0 0 0) 0x7fe5b8093c70 con 0x7fe5d00c8850 2024-09-17T06:06:17.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.072+0000 7fe5ceffd640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe5b0073230 0x7fe5b0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:17.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.076+0000 7fe5ceffd640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe5b0073230 0x7fe5b0075740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0074dc0 tx=0x7fe5c80073c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:17.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.076+0000 7fe5c7fff640 1 -- 172.21.15.122:0/2105086455 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe5b8021020 con 0x7fe5d00c8850 2024-09-17T06:06:17.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.264+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/2105086455 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 6, "weight": 1.0} v 0) -- 0x7fe5d0071260 con 0x7fe5d00c8850 2024-09-17T06:06:17.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.888+0000 7fe5c7fff640 1 -- 172.21.15.122:0/2105086455 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]=0 set osd.6 primary-affinity to 1 (8655362) v77) ==== 133+0+0 (secure 0 0 0) 0x7fe5b805e9e0 con 0x7fe5d00c8850 2024-09-17T06:06:17.893 INFO:teuthology.orchestra.run.smithi122.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-17T06:06:17.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.892+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe5b0073230 msgr2=0x7fe5b0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:17.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.892+0000 7fe5d5bf4640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe5b0073230 0x7fe5b0075740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0074dc0 tx=0x7fe5c80073c0 comp rx=0 tx=0).stop 2024-09-17T06:06:17.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.892+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/2105086455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d00c8850 msgr2=0x7fe5d0154340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:17.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.892+0000 7fe5d5bf4640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d00c8850 0x7fe5d0154340 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800c3f0 tx=0x7fe5b800c8b0 comp rx=0 tx=0).stop 2024-09-17T06:06:17.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.892+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/2105086455 shutdown_connections 2024-09-17T06:06:17.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.892+0000 7fe5d5bf4640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe5d00cc620 0x7fe5d01589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:17.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.892+0000 7fe5d5bf4640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe5b0073230 0x7fe5b0075740 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:17.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.892+0000 7fe5d5bf4640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe5d00c8c60 0x7fe5d0158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:17.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.892+0000 7fe5d5bf4640 1 --2- 172.21.15.122:0/2105086455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d00c8850 0x7fe5d0154340 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:17.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.892+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/2105086455 >> 172.21.15.122:0/2105086455 conn(0x7fe5d00746d0 msgr2=0x7fe5d0156680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:17.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.892+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/2105086455 shutdown_connections 2024-09-17T06:06:17.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:17.892+0000 7fe5d5bf4640 1 -- 172.21.15.122:0/2105086455 wait complete. 2024-09-17T06:06:17.923 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-17T06:06:18.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 -- 172.21.15.122:0/424281281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4c4005260 msgr2=0x7fb4c400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:18.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 --2- 172.21.15.122:0/424281281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4c4005260 0x7fb4c400b9d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb4d81590d0 tx=0x7fb4d001caf0 comp rx=0 tx=0).stop 2024-09-17T06:06:18.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 -- 172.21.15.122:0/424281281 shutdown_connections 2024-09-17T06:06:18.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 --2- 172.21.15.122:0/424281281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4c4005260 0x7fb4c400b9d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:18.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 -- 172.21.15.122:0/424281281 >> 172.21.15.122:0/424281281 conn(0x7fb4d80746d0 msgr2=0x7fb4d8074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:18.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 -- 172.21.15.122:0/424281281 shutdown_connections 2024-09-17T06:06:18.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 -- 172.21.15.122:0/424281281 wait complete. 2024-09-17T06:06:18.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 Processor -- start 2024-09-17T06:06:18.086 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 -- start start 2024-09-17T06:06:18.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4c4005260 0x7fb4d81f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:18.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4d80c9d10 0x7fb4d814b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:18.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4d8146f20 0x7fb4d8147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:18.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d815c620 con 0x7fb4c4005260 2024-09-17T06:06:18.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d8159fd0 con 0x7fb4d8146f20 2024-09-17T06:06:18.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.080+0000 7fb4dca80640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d8153640 con 0x7fb4d80c9d10 2024-09-17T06:06:18.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4d659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4c4005260 0x7fb4d81f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:18.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4d659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4c4005260 0x7fb4d81f1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44732/0 (socket says 172.21.15.122:44732) 2024-09-17T06:06:18.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4d659c640 1 -- 172.21.15.122:0/2691440879 learned_addr learned my addr 172.21.15.122:0/2691440879 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:18.089 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4d5d9b640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4d80c9d10 0x7fb4d814b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:18.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4d659c640 1 -- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4d80c9d10 msgr2=0x7fb4d814b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:18.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4d659c640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4d80c9d10 0x7fb4d814b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:18.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4d659c640 1 -- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4d8146f20 msgr2=0x7fb4d8147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:18.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4d659c640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4d8146f20 0x7fb4d8147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:18.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4d659c640 1 -- 172.21.15.122:0/2691440879 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d81f1ab0 con 0x7fb4c4005260 2024-09-17T06:06:18.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4d5d9b640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4d80c9d10 0x7fb4d814b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:18.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4d659c640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4c4005260 0x7fb4d81f1570 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8011750 tx=0x7fb4c8011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:18.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4ceffd640 1 -- 172.21.15.122:0/2691440879 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800fd50 con 0x7fb4c4005260 2024-09-17T06:06:18.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4ceffd640 1 -- 172.21.15.122:0/2691440879 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4c8016070 con 0x7fb4c4005260 2024-09-17T06:06:18.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4ceffd640 1 -- 172.21.15.122:0/2691440879 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c80126b0 con 0x7fb4c4005260 2024-09-17T06:06:18.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4dca80640 1 -- 172.21.15.122:0/2691440879 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d8153b00 con 0x7fb4c4005260 2024-09-17T06:06:18.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4dca80640 1 -- 172.21.15.122:0/2691440879 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d81540c0 con 0x7fb4c4005260 2024-09-17T06:06:18.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4dca80640 1 -- 172.21.15.122:0/2691440879 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d814fbe0 con 0x7fb4c4005260 2024-09-17T06:06:18.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4ceffd640 1 -- 172.21.15.122:0/2691440879 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb4c8018030 con 0x7fb4c4005260 2024-09-17T06:06:18.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4ceffd640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb4b8073230 0x7fb4b8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:18.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4ceffd640 1 -- 172.21.15.122:0/2691440879 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6767+0+0 (secure 0 0 0) 0x7fb4c8095560 con 0x7fb4c4005260 2024-09-17T06:06:18.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.084+0000 7fb4d5d9b640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb4b8073230 0x7fb4b8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:18.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.088+0000 7fb4d5d9b640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb4b8073230 0x7fb4b8075740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0001250 tx=0x7fb4c0001500 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:18.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.088+0000 7fb4ceffd640 1 -- 172.21.15.122:0/2691440879 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb4c8011e60 con 0x7fb4c4005260 2024-09-17T06:06:18.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.268+0000 7fb4dca80640 1 -- 172.21.15.122:0/2691440879 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd reweight", "id": 7, "weight": 1.0} v 0) -- 0x7fb4d81598f0 con 0x7fb4c4005260 2024-09-17T06:06:18.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.900+0000 7fb4ceffd640 1 -- 172.21.15.122:0/2691440879 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 7, "weight": 1.0}]=0 reweighted osd.7 to 1 (10000) v78) ==== 113+0+0 (secure 0 0 0) 0x7fb4c8060240 con 0x7fb4c4005260 2024-09-17T06:06:18.907 INFO:teuthology.orchestra.run.smithi122.stderr:reweighted osd.7 to 1 (10000) 2024-09-17T06:06:18.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.904+0000 7fb4dca80640 1 -- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb4b8073230 msgr2=0x7fb4b8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:18.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.904+0000 7fb4dca80640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb4b8073230 0x7fb4b8075740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0001250 tx=0x7fb4c0001500 comp rx=0 tx=0).stop 2024-09-17T06:06:18.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.904+0000 7fb4dca80640 1 -- 172.21.15.122:0/2691440879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4c4005260 msgr2=0x7fb4d81f1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:18.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.904+0000 7fb4dca80640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4c4005260 0x7fb4d81f1570 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8011750 tx=0x7fb4c8011c10 comp rx=0 tx=0).stop 2024-09-17T06:06:18.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.904+0000 7fb4dca80640 1 -- 172.21.15.122:0/2691440879 shutdown_connections 2024-09-17T06:06:18.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.904+0000 7fb4dca80640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb4b8073230 0x7fb4b8075740 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:18.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.904+0000 7fb4dca80640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4d8146f20 0x7fb4d8147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:18.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.904+0000 7fb4dca80640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4d80c9d10 0x7fb4d814b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:18.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.904+0000 7fb4dca80640 1 --2- 172.21.15.122:0/2691440879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4c4005260 0x7fb4d81f1570 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:18.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.904+0000 7fb4dca80640 1 -- 172.21.15.122:0/2691440879 >> 172.21.15.122:0/2691440879 conn(0x7fb4d80746d0 msgr2=0x7fb4d814e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:18.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.904+0000 7fb4dca80640 1 -- 172.21.15.122:0/2691440879 shutdown_connections 2024-09-17T06:06:18.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:18.904+0000 7fb4dca80640 1 -- 172.21.15.122:0/2691440879 wait complete. 2024-09-17T06:06:18.938 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-17T06:06:19.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.092+0000 7f9b25bf6640 1 -- 172.21.15.122:0/3425898154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b0c003a40 msgr2=0x7f9b0c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:19.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.092+0000 7f9b25bf6640 1 --2- 172.21.15.122:0/3425898154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b0c003a40 0x7f9b0c003eb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9b10009b40 tx=0x7f9b1001d290 comp rx=0 tx=0).stop 2024-09-17T06:06:19.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.092+0000 7f9b1ffff640 1 -- 172.21.15.122:0/3425898154 reap_dead start 2024-09-17T06:06:19.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.092+0000 7f9b25bf6640 1 -- 172.21.15.122:0/3425898154 shutdown_connections 2024-09-17T06:06:19.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.092+0000 7f9b25bf6640 1 -- 172.21.15.122:0/3425898154 >> 172.21.15.122:0/3425898154 conn(0x7f9b200746d0 msgr2=0x7f9b20074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:19.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.092+0000 7f9b25bf6640 1 -- 172.21.15.122:0/3425898154 shutdown_connections 2024-09-17T06:06:19.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.092+0000 7f9b25bf6640 1 -- 172.21.15.122:0/3425898154 wait complete. 2024-09-17T06:06:19.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.092+0000 7f9b25bf6640 1 Processor -- start 2024-09-17T06:06:19.098 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.092+0000 7f9b25bf6640 1 -- start start 2024-09-17T06:06:19.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b25bf6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b0c003a40 0x7f9b2014f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:19.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b25bf6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b20159350 0x7f9b20147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:19.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b25bf6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b200c70b0 0x7f9b200c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:19.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b25bf6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20158d50 con 0x7f9b200c70b0 2024-09-17T06:06:19.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b25bf6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20158a70 con 0x7f9b0c003a40 2024-09-17T06:06:19.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b25bf6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9b20152540 con 0x7f9b20159350 2024-09-17T06:06:19.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b200c70b0 0x7f9b200c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:19.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b200c70b0 0x7f9b200c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44756/0 (socket says 172.21.15.122:44756) 2024-09-17T06:06:19.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1ffff640 1 -- 172.21.15.122:0/1894220274 learned_addr learned my addr 172.21.15.122:0/1894220274 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1f7fe640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b0c003a40 0x7f9b2014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b16ffd640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b20159350 0x7f9b20147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1ffff640 1 -- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b20159350 msgr2=0x7f9b20147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1ffff640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b20159350 0x7f9b20147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1ffff640 1 -- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b0c003a40 msgr2=0x7f9b2014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1ffff640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b0c003a40 0x7f9b2014f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1ffff640 1 -- 172.21.15.122:0/1894220274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b200cd130 con 0x7f9b200c70b0 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1ffff640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b200c70b0 0x7f9b200c74c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9b200b8110 tx=0x7f9b1800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1cff9640 1 -- 172.21.15.122:0/1894220274 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18017070 con 0x7f9b200c70b0 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1cff9640 1 -- 172.21.15.122:0/1894220274 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b18005e40 con 0x7f9b200c70b0 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b25bf6640 1 -- 172.21.15.122:0/1894220274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b200c1a00 con 0x7f9b200c70b0 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1cff9640 1 -- 172.21.15.122:0/1894220274 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1800a8a0 con 0x7f9b200c70b0 2024-09-17T06:06:19.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b25bf6640 1 -- 172.21.15.122:0/1894220274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b2015a7d0 con 0x7f9b200c70b0 2024-09-17T06:06:19.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b25bf6640 1 -- 172.21.15.122:0/1894220274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b200c9fc0 con 0x7f9b200c70b0 2024-09-17T06:06:19.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1cff9640 1 -- 172.21.15.122:0/1894220274 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9b1800aa40 con 0x7f9b200c70b0 2024-09-17T06:06:19.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1cff9640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9b00073200 0x7f9b00075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:19.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1cff9640 1 -- 172.21.15.122:0/1894220274 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6767+0+0 (secure 0 0 0) 0x7f9b180936c0 con 0x7f9b200c70b0 2024-09-17T06:06:19.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.096+0000 7f9b1f7fe640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9b00073200 0x7f9b00075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:19.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.100+0000 7f9b1f7fe640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9b00073200 0x7f9b00075710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b100ad000 tx=0x7f9b1001a030 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:19.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.104+0000 7f9b1cff9640 1 -- 172.21.15.122:0/1894220274 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9b1805e2d0 con 0x7f9b200c70b0 2024-09-17T06:06:19.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.272+0000 7f9b25bf6640 1 -- 172.21.15.122:0/1894220274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 7, "weight": 1.0} v 0) -- 0x7f9b200cd420 con 0x7f9b200c70b0 2024-09-17T06:06:19.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.928+0000 7f9b1cff9640 1 -- 172.21.15.122:0/1894220274 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]=0 set osd.7 primary-affinity to 1 (8655362) v79) ==== 133+0+0 (secure 0 0 0) 0x7f9b1805dbd0 con 0x7f9b200c70b0 2024-09-17T06:06:19.933 INFO:teuthology.orchestra.run.smithi122.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-17T06:06:19.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.932+0000 7f9b25bf6640 1 -- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9b00073200 msgr2=0x7f9b00075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:19.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.932+0000 7f9b25bf6640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9b00073200 0x7f9b00075710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b100ad000 tx=0x7f9b1001a030 comp rx=0 tx=0).stop 2024-09-17T06:06:19.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.932+0000 7f9b25bf6640 1 -- 172.21.15.122:0/1894220274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b200c70b0 msgr2=0x7f9b200c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:19.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.932+0000 7f9b25bf6640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b200c70b0 0x7f9b200c74c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9b200b8110 tx=0x7f9b1800cb90 comp rx=0 tx=0).stop 2024-09-17T06:06:19.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.932+0000 7f9b25bf6640 1 -- 172.21.15.122:0/1894220274 shutdown_connections 2024-09-17T06:06:19.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.932+0000 7f9b25bf6640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b200c70b0 0x7f9b200c74c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:19.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.932+0000 7f9b25bf6640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9b20159350 0x7f9b20147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:19.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.932+0000 7f9b25bf6640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9b00073200 0x7f9b00075710 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:19.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.932+0000 7f9b25bf6640 1 --2- 172.21.15.122:0/1894220274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b0c003a40 0x7f9b2014f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:19.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.932+0000 7f9b25bf6640 1 -- 172.21.15.122:0/1894220274 >> 172.21.15.122:0/1894220274 conn(0x7f9b200746d0 msgr2=0x7f9b201570a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:19.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.932+0000 7f9b25bf6640 1 -- 172.21.15.122:0/1894220274 shutdown_connections 2024-09-17T06:06:19.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:19.932+0000 7f9b25bf6640 1 -- 172.21.15.122:0/1894220274 wait complete. 2024-09-17T06:06:19.962 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-17T06:06:20.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.120+0000 7fa19d06b640 1 -- 172.21.15.122:0/750809272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa198151f40 msgr2=0x7fa198158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:20.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.120+0000 7fa19d06b640 1 --2- 172.21.15.122:0/750809272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa198151f40 0x7fa198158a00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa188009900 tx=0x7fa18801c8b0 comp rx=0 tx=0).stop 2024-09-17T06:06:20.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.120+0000 7fa19d06b640 1 -- 172.21.15.122:0/750809272 shutdown_connections 2024-09-17T06:06:20.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.120+0000 7fa19d06b640 1 --2- 172.21.15.122:0/750809272 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1981609d0 0x7fa198162df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:20.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.120+0000 7fa19d06b640 1 --2- 172.21.15.122:0/750809272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa198151f40 0x7fa198158a00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:20.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.120+0000 7fa19d06b640 1 -- 172.21.15.122:0/750809272 >> 172.21.15.122:0/750809272 conn(0x7fa198073750 msgr2=0x7fa1980cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:20.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.120+0000 7fa19d06b640 1 -- 172.21.15.122:0/750809272 shutdown_connections 2024-09-17T06:06:20.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.120+0000 7fa19d06b640 1 -- 172.21.15.122:0/750809272 wait complete. 2024-09-17T06:06:20.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.120+0000 7fa19d06b640 1 Processor -- start 2024-09-17T06:06:20.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.120+0000 7fa19d06b640 1 -- start start 2024-09-17T06:06:20.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa19d06b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1980c2980 0x7fa1980cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:20.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa19d06b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa198151f40 0x7fa1981f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:20.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa19d06b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1981609d0 0x7fa19814a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:20.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa19d06b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa1980c8f10 con 0x7fa1980c2980 2024-09-17T06:06:20.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa19d06b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa198158f40 con 0x7fa198151f40 2024-09-17T06:06:20.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa19d06b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa1980c9090 con 0x7fa1981609d0 2024-09-17T06:06:20.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa196d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1980c2980 0x7fa1980cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:20.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa196d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1980c2980 0x7fa1980cd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44778/0 (socket says 172.21.15.122:44778) 2024-09-17T06:06:20.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa196d9d640 1 -- 172.21.15.122:0/288009124 learned_addr learned my addr 172.21.15.122:0/288009124 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:20.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa19759e640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1981609d0 0x7fa19814a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:20.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa196d9d640 1 -- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1981609d0 msgr2=0x7fa19814a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:20.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa19659c640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa198151f40 0x7fa1981f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:20.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa196d9d640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1981609d0 0x7fa19814a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:20.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa196d9d640 1 -- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa198151f40 msgr2=0x7fa1981f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:20.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa196d9d640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa198151f40 0x7fa1981f8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:20.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa196d9d640 1 -- 172.21.15.122:0/288009124 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1981f88a0 con 0x7fa1980c2980 2024-09-17T06:06:20.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa196d9d640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1980c2980 0x7fa1980cd040 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa188009850 tx=0x7fa188004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:20.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa17f7fe640 1 -- 172.21.15.122:0/288009124 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1880b2040 con 0x7fa1980c2980 2024-09-17T06:06:20.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa17f7fe640 1 -- 172.21.15.122:0/288009124 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa188003600 con 0x7fa1980c2980 2024-09-17T06:06:20.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa19d06b640 1 -- 172.21.15.122:0/288009124 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa198165b80 con 0x7fa1980c2980 2024-09-17T06:06:20.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa17f7fe640 1 -- 172.21.15.122:0/288009124 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188003a10 con 0x7fa1980c2980 2024-09-17T06:06:20.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa19d06b640 1 -- 172.21.15.122:0/288009124 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa198166140 con 0x7fa1980c2980 2024-09-17T06:06:20.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa19d06b640 1 -- 172.21.15.122:0/288009124 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa198152350 con 0x7fa1980c2980 2024-09-17T06:06:20.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa17f7fe640 1 -- 172.21.15.122:0/288009124 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa188003bb0 con 0x7fa1980c2980 2024-09-17T06:06:20.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa17f7fe640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa184073200 0x7fa184075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:20.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.124+0000 7fa17f7fe640 1 -- 172.21.15.122:0/288009124 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6767+0+0 (secure 0 0 0) 0x7fa18812e980 con 0x7fa1980c2980 2024-09-17T06:06:20.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.128+0000 7fa19659c640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa184073200 0x7fa184075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:20.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.128+0000 7fa19659c640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa184073200 0x7fa184075710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa198163000 tx=0x7fa18c008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:20.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.132+0000 7fa17f7fe640 1 -- 172.21.15.122:0/288009124 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa1880164d0 con 0x7fa1980c2980 2024-09-17T06:06:20.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.312+0000 7fa19d06b640 1 -- 172.21.15.122:0/288009124 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd reweight", "id": 4, "weight": 1.0} v 0) -- 0x7fa198156120 con 0x7fa1980c2980 2024-09-17T06:06:20.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.940+0000 7fa17f7fe640 1 -- 172.21.15.122:0/288009124 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 4, "weight": 1.0}]=0 reweighted osd.4 to 1 (10000) v80) ==== 113+0+0 (secure 0 0 0) 0x7fa1880f9580 con 0x7fa1980c2980 2024-09-17T06:06:20.947 INFO:teuthology.orchestra.run.smithi122.stderr:reweighted osd.4 to 1 (10000) 2024-09-17T06:06:20.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.944+0000 7fa19d06b640 1 -- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa184073200 msgr2=0x7fa184075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:20.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.944+0000 7fa19d06b640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa184073200 0x7fa184075710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa198163000 tx=0x7fa18c008040 comp rx=0 tx=0).stop 2024-09-17T06:06:20.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.944+0000 7fa19d06b640 1 -- 172.21.15.122:0/288009124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1980c2980 msgr2=0x7fa1980cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:20.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.944+0000 7fa19d06b640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1980c2980 0x7fa1980cd040 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa188009850 tx=0x7fa188004040 comp rx=0 tx=0).stop 2024-09-17T06:06:20.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.948+0000 7fa19d06b640 1 -- 172.21.15.122:0/288009124 shutdown_connections 2024-09-17T06:06:20.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.948+0000 7fa19d06b640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa1981609d0 0x7fa19814a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:20.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.948+0000 7fa19d06b640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa184073200 0x7fa184075710 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:20.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.948+0000 7fa19d06b640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa198151f40 0x7fa1981f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:20.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.948+0000 7fa19d06b640 1 --2- 172.21.15.122:0/288009124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1980c2980 0x7fa1980cd040 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:20.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.948+0000 7fa19d06b640 1 -- 172.21.15.122:0/288009124 >> 172.21.15.122:0/288009124 conn(0x7fa198073750 msgr2=0x7fa19814e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:20.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.948+0000 7fa19d06b640 1 -- 172.21.15.122:0/288009124 shutdown_connections 2024-09-17T06:06:20.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:20.948+0000 7fa19d06b640 1 -- 172.21.15.122:0/288009124 wait complete. 2024-09-17T06:06:20.981 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-17T06:06:21.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.136+0000 7f90d11c4640 1 -- 172.21.15.122:0/4046143235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90cc15b7b0 msgr2=0x7f90cc15bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:21.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.136+0000 7f90d11c4640 1 --2- 172.21.15.122:0/4046143235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90cc15b7b0 0x7f90cc15bbc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f90cc073d30 tx=0x7f90c401f580 comp rx=0 tx=0).stop 2024-09-17T06:06:21.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.136+0000 7f90d11c4640 1 -- 172.21.15.122:0/4046143235 shutdown_connections 2024-09-17T06:06:21.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.136+0000 7f90d11c4640 1 --2- 172.21.15.122:0/4046143235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90cc15b7b0 0x7f90cc15bbc0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:21.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.136+0000 7f90d11c4640 1 --2- 172.21.15.122:0/4046143235 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90cc072270 0x7f90cc072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:21.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.136+0000 7f90d11c4640 1 --2- 172.21.15.122:0/4046143235 >> v2:172.21.15.173:3300/0 conn(0x7f90cc0c67a0 0x7f90cc14e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:21.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.136+0000 7f90d11c4640 1 -- 172.21.15.122:0/4046143235 >> 172.21.15.122:0/4046143235 conn(0x7f90cc0746d0 msgr2=0x7f90cc074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:21.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.136+0000 7f90d11c4640 1 -- 172.21.15.122:0/4046143235 shutdown_connections 2024-09-17T06:06:21.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.136+0000 7f90d11c4640 1 -- 172.21.15.122:0/4046143235 wait complete. 2024-09-17T06:06:21.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.136+0000 7f90d11c4640 1 Processor -- start 2024-09-17T06:06:21.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90d11c4640 1 -- start start 2024-09-17T06:06:21.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90d11c4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc072270 0x7f90cc1ef020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:21.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90d11c4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90cc0c67a0 0x7f90cc156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:21.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90d11c4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90cc15b7b0 0x7f90cc14d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:21.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90d11c4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc158a70 con 0x7f90cc0c67a0 2024-09-17T06:06:21.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90d11c4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc158790 con 0x7f90cc072270 2024-09-17T06:06:21.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90d11c4640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f90cc158d50 con 0x7f90cc15b7b0 2024-09-17T06:06:21.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90ca59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90cc0c67a0 0x7f90cc156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:21.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90ca59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90cc0c67a0 0x7f90cc156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44790/0 (socket says 172.21.15.122:44790) 2024-09-17T06:06:21.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90ca59c640 1 -- 172.21.15.122:0/3140937666 learned_addr learned my addr 172.21.15.122:0/3140937666 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:21.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90cad9d640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc072270 0x7f90cc1ef020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:21.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90cb59e640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90cc15b7b0 0x7f90cc14d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:21.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90ca59c640 1 -- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90cc15b7b0 msgr2=0x7f90cc14d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:21.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90ca59c640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90cc15b7b0 0x7f90cc14d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:21.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90ca59c640 1 -- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc072270 msgr2=0x7f90cc1ef020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:21.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90ca59c640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc072270 0x7f90cc1ef020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:21.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90ca59c640 1 -- 172.21.15.122:0/3140937666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc1ef560 con 0x7f90cc0c67a0 2024-09-17T06:06:21.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90ca59c640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90cc0c67a0 0x7f90cc156080 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f90c000d630 tx=0x7f90c000daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:21.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90b37fe640 1 -- 172.21.15.122:0/3140937666 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0017070 con 0x7f90cc0c67a0 2024-09-17T06:06:21.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90b37fe640 1 -- 172.21.15.122:0/3140937666 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90c0005310 con 0x7f90cc0c67a0 2024-09-17T06:06:21.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90b37fe640 1 -- 172.21.15.122:0/3140937666 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c00047b0 con 0x7f90cc0c67a0 2024-09-17T06:06:21.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90d11c4640 1 -- 172.21.15.122:0/3140937666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90cc14c9c0 con 0x7f90cc0c67a0 2024-09-17T06:06:21.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90d11c4640 1 -- 172.21.15.122:0/3140937666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90cc149250 con 0x7f90cc0c67a0 2024-09-17T06:06:21.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.140+0000 7f90d11c4640 1 -- 172.21.15.122:0/3140937666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90cc152540 con 0x7f90cc0c67a0 2024-09-17T06:06:21.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.144+0000 7f90b37fe640 1 -- 172.21.15.122:0/3140937666 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f90c0004950 con 0x7f90cc0c67a0 2024-09-17T06:06:21.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.144+0000 7f90b37fe640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f90b8073200 0x7f90b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:21.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.144+0000 7f90b37fe640 1 -- 172.21.15.122:0/3140937666 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6767+0+0 (secure 0 0 0) 0x7f90c00945c0 con 0x7f90cc0c67a0 2024-09-17T06:06:21.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.144+0000 7f90cad9d640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f90b8073200 0x7f90b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:21.150 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.144+0000 7f90cad9d640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f90b8073200 0x7f90b8075710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f90bc005fd0 tx=0x7f90bc005d10 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:21.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.148+0000 7f90b37fe640 1 -- 172.21.15.122:0/3140937666 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f90c005f2e0 con 0x7f90cc0c67a0 2024-09-17T06:06:21.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.336+0000 7f90d11c4640 1 -- 172.21.15.122:0/3140937666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 4, "weight": 1.0} v 0) -- 0x7f90cc0c33d0 con 0x7f90cc0c67a0 2024-09-17T06:06:21.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.952+0000 7f90b37fe640 1 -- 172.21.15.122:0/3140937666 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]=0 set osd.4 primary-affinity to 1 (8655362) v81) ==== 133+0+0 (secure 0 0 0) 0x7f90c005ebe0 con 0x7f90cc0c67a0 2024-09-17T06:06:21.959 INFO:teuthology.orchestra.run.smithi122.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-17T06:06:21.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.956+0000 7f90d11c4640 1 -- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f90b8073200 msgr2=0x7f90b8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:21.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.956+0000 7f90d11c4640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f90b8073200 0x7f90b8075710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f90bc005fd0 tx=0x7f90bc005d10 comp rx=0 tx=0).stop 2024-09-17T06:06:21.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.956+0000 7f90d11c4640 1 -- 172.21.15.122:0/3140937666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90cc0c67a0 msgr2=0x7f90cc156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:21.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.956+0000 7f90d11c4640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90cc0c67a0 0x7f90cc156080 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f90c000d630 tx=0x7f90c000daf0 comp rx=0 tx=0).stop 2024-09-17T06:06:21.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.956+0000 7f90d11c4640 1 -- 172.21.15.122:0/3140937666 shutdown_connections 2024-09-17T06:06:21.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.956+0000 7f90d11c4640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90cc15b7b0 0x7f90cc14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:21.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.956+0000 7f90d11c4640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90cc0c67a0 0x7f90cc156080 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:21.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.956+0000 7f90d11c4640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f90b8073200 0x7f90b8075710 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:21.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.956+0000 7f90d11c4640 1 --2- 172.21.15.122:0/3140937666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90cc072270 0x7f90cc1ef020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:21.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.956+0000 7f90d11c4640 1 -- 172.21.15.122:0/3140937666 >> 172.21.15.122:0/3140937666 conn(0x7f90cc0746d0 msgr2=0x7f90cc1e4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:21.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.956+0000 7f90d11c4640 1 -- 172.21.15.122:0/3140937666 shutdown_connections 2024-09-17T06:06:21.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:21.956+0000 7f90d11c4640 1 -- 172.21.15.122:0/3140937666 wait complete. 2024-09-17T06:06:21.988 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-17T06:06:21.988 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-17T06:06:21.988 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-17T06:06:21.988 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-17T06:06:21.988 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T06:06:21.988 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:06:22.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.140+0000 7fefc94fe640 1 -- 172.21.15.122:0/1247818487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb0004d50 msgr2=0x7fefb0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.140+0000 7fefc94fe640 1 --2- 172.21.15.122:0/1247818487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb0004d50 0x7fefb0005200 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009eb0 tx=0x7fefbc01d5f0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.140+0000 7fefc37fe640 1 -- 172.21.15.122:0/1247818487 reap_dead start 2024-09-17T06:06:22.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.140+0000 7fefc94fe640 1 -- 172.21.15.122:0/1247818487 shutdown_connections 2024-09-17T06:06:22.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.140+0000 7fefc94fe640 1 -- 172.21.15.122:0/1247818487 >> 172.21.15.122:0/1247818487 conn(0x7fefc40746d0 msgr2=0x7fefc4074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:22.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.140+0000 7fefc94fe640 1 -- 172.21.15.122:0/1247818487 shutdown_connections 2024-09-17T06:06:22.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.140+0000 7fefc94fe640 1 -- 172.21.15.122:0/1247818487 wait complete. 2024-09-17T06:06:22.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc94fe640 1 Processor -- start 2024-09-17T06:06:22.148 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc94fe640 1 -- start start 2024-09-17T06:06:22.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc94fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb0004d50 0x7fefc41f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc94fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc40ccbf0 0x7fefc414f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc94fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefc414f810 0x7fefc41510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc94fe640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fefc4158a70 con 0x7fefc40ccbf0 2024-09-17T06:06:22.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc94fe640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fefc4158790 con 0x7fefc414f810 2024-09-17T06:06:22.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc94fe640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fefc4158d50 con 0x7fefb0004d50 2024-09-17T06:06:22.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefba7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc40ccbf0 0x7fefc414f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefba7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc40ccbf0 0x7fefc414f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44810/0 (socket says 172.21.15.122:44810) 2024-09-17T06:06:22.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefba7fc640 1 -- 172.21.15.122:0/2860618677 learned_addr learned my addr 172.21.15.122:0/2860618677 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:22.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc2ffd640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb0004d50 0x7fefc41f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc37fe640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefc414f810 0x7fefc41510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefba7fc640 1 -- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb0004d50 msgr2=0x7fefc41f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefba7fc640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb0004d50 0x7fefc41f2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefba7fc640 1 -- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefc414f810 msgr2=0x7fefc41510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefba7fc640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefc414f810 0x7fefc41510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefba7fc640 1 -- 172.21.15.122:0/2860618677 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc414a760 con 0x7fefc40ccbf0 2024-09-17T06:06:22.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc37fe640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefc414f810 0x7fefc41510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:22.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefba7fc640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc40ccbf0 0x7fefc414f2d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fefac00d500 tx=0x7fefac00d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:22.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefbbfff640 1 -- 172.21.15.122:0/2860618677 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac016020 con 0x7fefc40ccbf0 2024-09-17T06:06:22.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefbbfff640 1 -- 172.21.15.122:0/2860618677 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefac012630 con 0x7fefc40ccbf0 2024-09-17T06:06:22.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefbbfff640 1 -- 172.21.15.122:0/2860618677 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac012a80 con 0x7fefc40ccbf0 2024-09-17T06:06:22.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc94fe640 1 -- 172.21.15.122:0/2860618677 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc414aa40 con 0x7fefc40ccbf0 2024-09-17T06:06:22.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.144+0000 7fefc94fe640 1 -- 172.21.15.122:0/2860618677 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc41ef100 con 0x7fefc40ccbf0 2024-09-17T06:06:22.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.148+0000 7fefc94fe640 1 -- 172.21.15.122:0/2860618677 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefc414a4d0 con 0x7fefc40ccbf0 2024-09-17T06:06:22.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.148+0000 7fefbbfff640 1 -- 172.21.15.122:0/2860618677 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fefac019020 con 0x7fefc40ccbf0 2024-09-17T06:06:22.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.148+0000 7fefbbfff640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fefa4073200 0x7fefa4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.148+0000 7fefbbfff640 1 -- 172.21.15.122:0/2860618677 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7fefac0940c0 con 0x7fefc40ccbf0 2024-09-17T06:06:22.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.148+0000 7fefc2ffd640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fefa4073200 0x7fefa4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.148+0000 7fefc2ffd640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fefa4073200 0x7fefa4075710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fefb4007950 tx=0x7fefb4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:22.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.152+0000 7fefbbfff640 1 -- 172.21.15.122:0/2860618677 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fefac020030 con 0x7fefc40ccbf0 2024-09-17T06:06:22.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.320+0000 7fefc94fe640 1 -- 172.21.15.122:0/2860618677 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fefc41f24f0 con 0x7fefc40ccbf0 2024-09-17T06:06:22.330 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.324+0000 7fefbbfff640 1 -- 172.21.15.122:0/2860618677 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+19030 (secure 0 0 0) 0x7fefac05ee20 con 0x7fefc40ccbf0 2024-09-17T06:06:22.330 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:06:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":81,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:06:21.948320+0000","last_up_change":"2024-09-17T06:06:01.694374+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":44,"up_from":64,"up_thru":64,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6811","nonce":1065110369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6813","nonce":1065110369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6817","nonce":1065110369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6815","nonce":1065110369}]},"public_addr":"172.21.15.173:6811/1065110369","cluster_addr":"172.21.15.173:6813/1065110369","heartbeat_back_addr":"172.21.15.173:6817/1065110369","heartbeat_front_addr":"172.21.15.173:6815/1065110369","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":46},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.15","osds":[5,0]}],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":6,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:06:22.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.328+0000 7fefc94fe640 1 -- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fefa4073200 msgr2=0x7fefa4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.328+0000 7fefc94fe640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fefa4073200 0x7fefa4075710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fefb4007950 tx=0x7fefb4009040 comp rx=0 tx=0).stop 2024-09-17T06:06:22.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.328+0000 7fefc94fe640 1 -- 172.21.15.122:0/2860618677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc40ccbf0 msgr2=0x7fefc414f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.328+0000 7fefc94fe640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc40ccbf0 0x7fefc414f2d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fefac00d500 tx=0x7fefac00d9c0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.328+0000 7fefc94fe640 1 -- 172.21.15.122:0/2860618677 shutdown_connections 2024-09-17T06:06:22.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.328+0000 7fefc94fe640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fefa4073200 0x7fefa4075710 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.328+0000 7fefc94fe640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefc414f810 0x7fefc41510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.328+0000 7fefc94fe640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefc40ccbf0 0x7fefc414f2d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.328+0000 7fefc94fe640 1 --2- 172.21.15.122:0/2860618677 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb0004d50 0x7fefc41f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.328+0000 7fefc94fe640 1 -- 172.21.15.122:0/2860618677 >> 172.21.15.122:0/2860618677 conn(0x7fefc40746d0 msgr2=0x7fefc4157760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:22.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.328+0000 7fefc94fe640 1 -- 172.21.15.122:0/2860618677 shutdown_connections 2024-09-17T06:06:22.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.328+0000 7fefc94fe640 1 -- 172.21.15.122:0/2860618677 wait complete. 2024-09-17T06:06:22.354 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T06:06:22.354 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:06:22.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.500+0000 7fed6c902640 1 -- 172.21.15.122:0/2140606128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed680c2010 msgr2=0x7fed680c2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.500+0000 7fed6c902640 1 --2- 172.21.15.122:0/2140606128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed680c2010 0x7fed680c2420 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fed680caa50 tx=0x7fed6001cd80 comp rx=0 tx=0).stop 2024-09-17T06:06:22.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.500+0000 7fed6c902640 1 -- 172.21.15.122:0/2140606128 shutdown_connections 2024-09-17T06:06:22.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.500+0000 7fed6c902640 1 --2- 172.21.15.122:0/2140606128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed680c2010 0x7fed680c2420 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.500+0000 7fed6c902640 1 --2- 172.21.15.122:0/2140606128 >> v2:172.21.15.173:3300/0 conn(0x7fed6806e780 0x7fed6806eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.500+0000 7fed6c902640 1 -- 172.21.15.122:0/2140606128 >> 172.21.15.122:0/2140606128 conn(0x7fed68070c10 msgr2=0x7fed68072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:22.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.500+0000 7fed6c902640 1 -- 172.21.15.122:0/2140606128 shutdown_connections 2024-09-17T06:06:22.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.500+0000 7fed6c902640 1 -- 172.21.15.122:0/2140606128 wait complete. 2024-09-17T06:06:22.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.500+0000 7fed6c902640 1 Processor -- start 2024-09-17T06:06:22.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.500+0000 7fed6c902640 1 -- start start 2024-09-17T06:06:22.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed6c902640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed6806e780 0x7fed68153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed6c902640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed680c2010 0x7fed68152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed6c902640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed680c3440 0x7fed68149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed6c902640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fed68151eb0 con 0x7fed680c2010 2024-09-17T06:06:22.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed6c902640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fed68151d30 con 0x7fed6806e780 2024-09-17T06:06:22.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed6c902640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fed680c3a00 con 0x7fed680c3440 2024-09-17T06:06:22.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed65d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed680c2010 0x7fed68152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed65d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed680c2010 0x7fed68152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44822/0 (socket says 172.21.15.122:44822) 2024-09-17T06:06:22.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed65d9b640 1 -- 172.21.15.122:0/1612470921 learned_addr learned my addr 172.21.15.122:0/1612470921 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:22.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed66d9d640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed680c3440 0x7fed68149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed65d9b640 1 -- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed680c3440 msgr2=0x7fed68149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed6659c640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed6806e780 0x7fed68153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed65d9b640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed680c3440 0x7fed68149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed65d9b640 1 -- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed6806e780 msgr2=0x7fed68153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed65d9b640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed6806e780 0x7fed68153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed65d9b640 1 -- 172.21.15.122:0/1612470921 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed68152bc0 con 0x7fed680c2010 2024-09-17T06:06:22.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed65d9b640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed680c2010 0x7fed68152680 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fed5800d6d0 tx=0x7fed5800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:22.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed56ffd640 1 -- 172.21.15.122:0/1612470921 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58017070 con 0x7fed680c2010 2024-09-17T06:06:22.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed56ffd640 1 -- 172.21.15.122:0/1612470921 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed58009ab0 con 0x7fed680c2010 2024-09-17T06:06:22.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed56ffd640 1 -- 172.21.15.122:0/1612470921 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58010460 con 0x7fed680c2010 2024-09-17T06:06:22.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed6c902640 1 -- 172.21.15.122:0/1612470921 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed6814a310 con 0x7fed680c2010 2024-09-17T06:06:22.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed6c902640 1 -- 172.21.15.122:0/1612470921 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed68148390 con 0x7fed680c2010 2024-09-17T06:06:22.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed6c902640 1 -- 172.21.15.122:0/1612470921 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed680c4080 con 0x7fed680c2010 2024-09-17T06:06:22.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed56ffd640 1 -- 172.21.15.122:0/1612470921 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fed5801a070 con 0x7fed680c2010 2024-09-17T06:06:22.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed56ffd640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fed48073230 0x7fed48075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed56ffd640 1 -- 172.21.15.122:0/1612470921 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7fed58094790 con 0x7fed680c2010 2024-09-17T06:06:22.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.504+0000 7fed6659c640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fed48073230 0x7fed48075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.508+0000 7fed6659c640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fed48073230 0x7fed48075740 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00a790 tx=0x7fed5c008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:22.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.508+0000 7fed56ffd640 1 -- 172.21.15.122:0/1612470921 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fed5805f390 con 0x7fed680c2010 2024-09-17T06:06:22.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.684+0000 7fed6c902640 1 -- 172.21.15.122:0/1612470921 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed68145680 con 0x7fed680c2010 2024-09-17T06:06:22.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.684+0000 7fed56ffd640 1 -- 172.21.15.122:0/1612470921 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+19030 (secure 0 0 0) 0x7fed5805ec90 con 0x7fed680c2010 2024-09-17T06:06:22.694 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:06:22.695 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":81,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:06:21.948320+0000","last_up_change":"2024-09-17T06:06:01.694374+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":44,"up_from":64,"up_thru":64,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6811","nonce":1065110369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6813","nonce":1065110369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6817","nonce":1065110369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6815","nonce":1065110369}]},"public_addr":"172.21.15.173:6811/1065110369","cluster_addr":"172.21.15.173:6813/1065110369","heartbeat_back_addr":"172.21.15.173:6817/1065110369","heartbeat_front_addr":"172.21.15.173:6815/1065110369","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":46},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.15","osds":[5,0]}],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":6,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:06:22.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.688+0000 7fed6c902640 1 -- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fed48073230 msgr2=0x7fed48075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.688+0000 7fed6c902640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fed48073230 0x7fed48075740 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00a790 tx=0x7fed5c008040 comp rx=0 tx=0).stop 2024-09-17T06:06:22.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.688+0000 7fed6c902640 1 -- 172.21.15.122:0/1612470921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed680c2010 msgr2=0x7fed68152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.688+0000 7fed6c902640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed680c2010 0x7fed68152680 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fed5800d6d0 tx=0x7fed5800db90 comp rx=0 tx=0).stop 2024-09-17T06:06:22.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.688+0000 7fed6c902640 1 -- 172.21.15.122:0/1612470921 shutdown_connections 2024-09-17T06:06:22.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.688+0000 7fed6c902640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed680c3440 0x7fed68149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.688+0000 7fed6c902640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed680c2010 0x7fed68152680 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.688+0000 7fed6c902640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fed48073230 0x7fed48075740 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.688+0000 7fed6c902640 1 --2- 172.21.15.122:0/1612470921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed6806e780 0x7fed68153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.688+0000 7fed6c902640 1 -- 172.21.15.122:0/1612470921 >> 172.21.15.122:0/1612470921 conn(0x7fed68070c10 msgr2=0x7fed68143740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:22.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.688+0000 7fed6c902640 1 -- 172.21.15.122:0/1612470921 shutdown_connections 2024-09-17T06:06:22.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.688+0000 7fed6c902640 1 -- 172.21.15.122:0/1612470921 wait complete. 2024-09-17T06:06:22.714 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T06:06:22.715 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T06:06:22.715 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T06:06:22.716 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T06:06:22.716 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T06:06:22.717 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T06:06:22.717 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T06:06:22.718 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T06:06:22.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.948+0000 7f521da71640 1 -- 172.21.15.122:0/628687136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5218073040 msgr2=0x7f5218073450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.948+0000 7f521da71640 1 --2- 172.21.15.122:0/628687136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5218073040 0x7f5218073450 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5218074c40 tx=0x7f521001cda0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.948+0000 7f521da71640 1 -- 172.21.15.122:0/628687136 shutdown_connections 2024-09-17T06:06:22.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.948+0000 7f521da71640 1 --2- 172.21.15.122:0/628687136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5218073040 0x7f5218073450 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.948+0000 7f521da71640 1 --2- 172.21.15.122:0/628687136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f521815b4d0 0x7f5218151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.948+0000 7f521da71640 1 --2- 172.21.15.122:0/628687136 >> v2:172.21.15.173:3300/0 conn(0x7f52180c2b50 0x7f52180c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.948+0000 7f521da71640 1 -- 172.21.15.122:0/628687136 >> 172.21.15.122:0/628687136 conn(0x7f5218070fe0 msgr2=0x7f52180713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:22.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f521da71640 1 -- 172.21.15.122:0/628687136 shutdown_connections 2024-09-17T06:06:22.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2176819115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ebc04b8e0 msgr2=0x7f0ebc0dec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f0ec9e53640 1 --2- 172.21.15.122:0/2176819115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ebc04b8e0 0x7f0ebc0dec10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4076320 tx=0x7f0ec4099750 comp rx=0 tx=0).stop 2024-09-17T06:06:22.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2176819115 shutdown_connections 2024-09-17T06:06:22.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f0ec9e53640 1 --2- 172.21.15.122:0/2176819115 >> v2:172.21.15.173:3300/0 conn(0x7f0ebc047120 0x7f0ebc046760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f0ec9e53640 1 --2- 172.21.15.122:0/2176819115 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ebc006a40 0x7f0ebc006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f0ec9e53640 1 --2- 172.21.15.122:0/2176819115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ebc04b8e0 0x7f0ebc0dec10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2176819115 >> 172.21.15.122:0/2176819115 conn(0x7f0ebc050f60 msgr2=0x7f0ebc051370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:22.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f555dde1640 1 -- 172.21.15.122:0/4041490923 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55581575f0 msgr2=0x7f55580c4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f555dde1640 1 --2- 172.21.15.122:0/4041490923 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55581575f0 0x7f55580c4b00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5558073b20 tx=0x7f554401f0d0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f555dde1640 1 -- 172.21.15.122:0/4041490923 shutdown_connections 2024-09-17T06:06:22.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f555dde1640 1 --2- 172.21.15.122:0/4041490923 >> v2:172.21.15.122:3300/0 conn(0x7f55580c6670 0x7f5558071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f555dde1640 1 --2- 172.21.15.122:0/4041490923 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55581575f0 0x7f55580c4b00 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5558073b20 tx=0x7f554401f0d0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f555dde1640 1 --2- 172.21.15.122:0/4041490923 >> v2:172.21.15.173:3300/0 conn(0x7f55580ccfe0 0x7f555814ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f555dde1640 1 -- 172.21.15.122:0/4041490923 >> 172.21.15.122:0/4041490923 conn(0x7f55580744c0 msgr2=0x7f55580748d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:22.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f521da71640 1 -- 172.21.15.122:0/628687136 wait complete. 2024-09-17T06:06:22.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f2edec96640 1 -- 172.21.15.122:0/3315694775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ec40039c0 msgr2=0x7f2ec4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f2edec96640 1 --2- 172.21.15.122:0/3315694775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ec40039c0 0x7f2ec4003e30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8051dc0 tx=0x7f2ed8099f90 comp rx=0 tx=0).stop 2024-09-17T06:06:22.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f555dde1640 1 -- 172.21.15.122:0/4041490923 shutdown_connections 2024-09-17T06:06:22.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f555dde1640 1 -- 172.21.15.122:0/4041490923 wait complete. 2024-09-17T06:06:22.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f2ede495640 1 -- 172.21.15.122:0/3315694775 reap_dead start 2024-09-17T06:06:22.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f2edec96640 1 -- 172.21.15.122:0/3315694775 shutdown_connections 2024-09-17T06:06:22.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f2edec96640 1 -- 172.21.15.122:0/3315694775 >> 172.21.15.122:0/3315694775 conn(0x7f2ed004fe40 msgr2=0x7f2ed0050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:22.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f2edec96640 1 -- 172.21.15.122:0/3315694775 shutdown_connections 2024-09-17T06:06:22.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f2edec96640 1 -- 172.21.15.122:0/3315694775 wait complete. 2024-09-17T06:06:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f36adff0640 1 -- 172.21.15.122:0/3321670046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a8074e50 msgr2=0x7f36a8159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.952+0000 7f36adff0640 1 --2- 172.21.15.122:0/3321670046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a8074e50 0x7f36a8159510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f36a8072cf0 tx=0x7f369c01c800 comp rx=0 tx=0).stop 2024-09-17T06:06:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f36adff0640 1 -- 172.21.15.122:0/3321670046 shutdown_connections 2024-09-17T06:06:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f36adff0640 1 --2- 172.21.15.122:0/3321670046 >> v2:172.21.15.122:3300/0 conn(0x7f36a80c8090 0x7f36a80c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f36adff0640 1 --2- 172.21.15.122:0/3321670046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a8074e50 0x7f36a8159510 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f36a8072cf0 tx=0x7f369c01c800 comp rx=0 tx=0).stop 2024-09-17T06:06:22.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f36adff0640 1 -- 172.21.15.122:0/3321670046 >> 172.21.15.122:0/3321670046 conn(0x7f36a806d290 msgr2=0x7f36a806d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f521da71640 1 Processor -- start 2024-09-17T06:06:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f521da71640 1 -- start start 2024-09-17T06:06:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f36adff0640 1 -- 172.21.15.122:0/3321670046 shutdown_connections 2024-09-17T06:06:22.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2176819115 shutdown_connections 2024-09-17T06:06:22.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f555dde1640 1 Processor -- start 2024-09-17T06:06:22.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f521da71640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5218073040 0x7f521815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f521da71640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52180c2b50 0x7f52181f7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f521da71640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f521815b4d0 0x7f52181f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f2edec96640 1 Processor -- start 2024-09-17T06:06:22.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f52177fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5218073040 0x7f521815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f5216ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52180c2b50 0x7f52181f7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f2edec96640 1 -- start start 2024-09-17T06:06:22.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f5216ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52180c2b50 0x7f52181f7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:57950/0 (socket says 172.21.15.122:57950) 2024-09-17T06:06:22.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f5216ffd640 1 -- 172.21.15.122:0/1434337447 learned_addr learned my addr 172.21.15.122:0/1434337447 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:22.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f555dde1640 1 -- start start 2024-09-17T06:06:22.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f36adff0640 1 -- 172.21.15.122:0/3321670046 wait complete. 2024-09-17T06:06:22.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f36adff0640 1 Processor -- start 2024-09-17T06:06:22.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2176819115 wait complete. 2024-09-17T06:06:22.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f0ec9e53640 1 Processor -- start 2024-09-17T06:06:22.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f0ec9e53640 1 -- start start 2024-09-17T06:06:22.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f5217fff640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f521815b4d0 0x7f52181f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f521da71640 1 -- 172.21.15.122:0/1434337447 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f52180cade0 con 0x7f521815b4d0 2024-09-17T06:06:22.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f521da71640 1 -- 172.21.15.122:0/1434337447 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5218152520 con 0x7f5218073040 2024-09-17T06:06:22.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f521da71640 1 -- 172.21.15.122:0/1434337447 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f52180caf60 con 0x7f52180c2b50 2024-09-17T06:06:22.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7fd4cfbf0640 1 -- 172.21.15.122:0/648904851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4c8159230 msgr2=0x7fd4c80c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7fd4cfbf0640 1 --2- 172.21.15.122:0/648904851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4c8159230 0x7fd4c80c5530 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009840 tx=0x7fd4b801f010 comp rx=0 tx=0).stop 2024-09-17T06:06:22.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7fd4cfbf0640 1 -- 172.21.15.122:0/648904851 shutdown_connections 2024-09-17T06:06:22.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7fd4cfbf0640 1 --2- 172.21.15.122:0/648904851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4c8159230 0x7fd4c80c5530 secure :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009840 tx=0x7fd4b801f010 comp rx=0 tx=0).stop 2024-09-17T06:06:22.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7fd4cfbf0640 1 --2- 172.21.15.122:0/648904851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4c80c4840 0x7fd4c814fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7fd4cfbf0640 1 -- 172.21.15.122:0/648904851 >> 172.21.15.122:0/648904851 conn(0x7fd4c80705b0 msgr2=0x7fd4c80709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:22.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f5217fff640 1 -- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52180c2b50 msgr2=0x7f52181f7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f5217fff640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52180c2b50 0x7f52181f7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f5217fff640 1 -- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5218073040 msgr2=0x7f521815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f5217fff640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5218073040 0x7f521815ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f5217fff640 1 -- 172.21.15.122:0/1434337447 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521815b2c0 con 0x7f521815b4d0 2024-09-17T06:06:22.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f5216ffd640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52180c2b50 0x7f52181f7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T06:06:22.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555dde1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55580c6670 0x7f555814e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f5217fff640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f521815b4d0 0x7f52181f8150 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f52180ca060 tx=0x7f5210005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:22.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555dde1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55580ccfe0 0x7f555814c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555dde1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55581541c0 0x7f5558149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555dde1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f55580c8d60 con 0x7f55580c6670 2024-09-17T06:06:22.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f51fffff640 1 -- 172.21.15.122:0/1434337447 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52100b2040 con 0x7f521815b4d0 2024-09-17T06:06:22.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f51fffff640 1 -- 172.21.15.122:0/1434337447 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5210004b40 con 0x7f521815b4d0 2024-09-17T06:06:22.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f51fffff640 1 -- 172.21.15.122:0/1434337447 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5210004000 con 0x7f521815b4d0 2024-09-17T06:06:22.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555dde1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f555814e410 con 0x7f55580ccfe0 2024-09-17T06:06:22.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555dde1640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f55580c5040 con 0x7f55581541c0 2024-09-17T06:06:22.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.956+0000 7f36adff0640 1 -- start start 2024-09-17T06:06:22.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555cddf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55580c6670 0x7f555814e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555cddf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55580c6670 0x7f555814e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44908/0 (socket says 172.21.15.122:44908) 2024-09-17T06:06:22.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555cddf640 1 -- 172.21.15.122:0/4197156631 learned_addr learned my addr 172.21.15.122:0/4197156631 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:22.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2edec96640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2ed00068c0 0x7f2ed00c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec9e53640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ebc006a40 0x7f0ebc0dab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec9e53640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ebc047120 0x7f0ebc0db0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2edec96640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ed0030e80 0x7f2ed00d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec9e53640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ebc04b8e0 0x7f0ebc0db9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7fc4f92ec640 1 -- 172.21.15.122:0/2992891432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4dc004810 msgr2=0x7fc4dc004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7fc4f92ec640 1 --2- 172.21.15.122:0/2992891432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4dc004810 0x7fc4dc004c20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40c57e0 tx=0x7fc4e801f730 comp rx=0 tx=0).stop 2024-09-17T06:06:22.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2edec96640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ed00d1030 0x7f2ed0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec9e53640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc046ca0 con 0x7f0ebc047120 2024-09-17T06:06:22.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7fc4f92ec640 1 -- 172.21.15.122:0/2992891432 shutdown_connections 2024-09-17T06:06:22.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7fc4f92ec640 1 --2- 172.21.15.122:0/2992891432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4dc004810 0x7fc4dc004c20 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7fc4f92ec640 1 -- 172.21.15.122:0/2992891432 >> 172.21.15.122:0/2992891432 conn(0x7fc4f406d290 msgr2=0x7fc4f406d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:22.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec9e53640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc047c00 con 0x7f0ebc04b8e0 2024-09-17T06:06:22.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec9e53640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0ebc046e20 con 0x7f0ebc006a40 2024-09-17T06:06:22.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2eddc94640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2ed00068c0 0x7f2ed00c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2eddc94640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2ed00068c0 0x7f2ed00c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:57976/0 (socket says 172.21.15.122:57976) 2024-09-17T06:06:22.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2edd493640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ed0030e80 0x7f2ed00d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2ede495640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ed00d1030 0x7f2ed0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2ede495640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ed00d1030 0x7f2ed0004cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44936/0 (socket says 172.21.15.122:44936) 2024-09-17T06:06:22.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2edd493640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ed0030e80 0x7f2ed00d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:45828/0 (socket says 172.21.15.122:45828) 2024-09-17T06:06:22.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec9652640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ebc04b8e0 0x7f0ebc0db9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2eddc94640 1 -- 172.21.15.122:0/971961112 learned_addr learned my addr 172.21.15.122:0/971961112 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:22.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec8e51640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ebc006a40 0x7f0ebc0dab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed0034840 con 0x7f2ed00d1030 2024-09-17T06:06:22.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec8e51640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ebc006a40 0x7f0ebc0dab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:57986/0 (socket says 172.21.15.122:57986) 2024-09-17T06:06:22.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec8e51640 1 -- 172.21.15.122:0/2250454782 learned_addr learned my addr 172.21.15.122:0/2250454782 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:22.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555cddf640 1 -- 172.21.15.122:0/4197156631 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55581541c0 msgr2=0x7f5558149de0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T06:06:22.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555cddf640 1 --2- 172.21.15.122:0/4197156631 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55581541c0 0x7f5558149de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555cddf640 1 -- 172.21.15.122:0/4197156631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55580ccfe0 msgr2=0x7f555814c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555cddf640 1 --2- 172.21.15.122:0/4197156631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55580ccfe0 0x7f555814c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555cddf640 1 -- 172.21.15.122:0/4197156631 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5558155270 con 0x7f55580c6670 2024-09-17T06:06:22.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec3fff640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ebc047120 0x7f0ebc0db0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed004c160 con 0x7f2ed0030e80 2024-09-17T06:06:22.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed004c5c0 con 0x7f2ed00068c0 2024-09-17T06:06:22.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec3fff640 1 -- 172.21.15.122:0/2250454782 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ebc006a40 msgr2=0x7f0ebc0dab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec3fff640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ebc006a40 0x7f0ebc0dab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec3fff640 1 -- 172.21.15.122:0/2250454782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ebc04b8e0 msgr2=0x7f0ebc0db9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec3fff640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ebc04b8e0 0x7f0ebc0db9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec3fff640 1 -- 172.21.15.122:0/2250454782 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ebc033960 con 0x7f0ebc047120 2024-09-17T06:06:22.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f555cddf640 1 --2- 172.21.15.122:0/4197156631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55580c6670 0x7f555814e7c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f554c016fc0 tx=0x7f554c014490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:22.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f521da71640 1 -- 172.21.15.122:0/1434337447 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5218144cd0 con 0x7f521815b4d0 2024-09-17T06:06:22.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7fc4f92ec640 1 -- 172.21.15.122:0/2992891432 shutdown_connections 2024-09-17T06:06:22.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2ede495640 1 -- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2ed00068c0 msgr2=0x7f2ed00c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2ede495640 1 --2- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2ed00068c0 0x7f2ed00c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2ede495640 1 -- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ed0030e80 msgr2=0x7f2ed00d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2ede495640 1 --2- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ed0030e80 0x7f2ed00d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f0ec3fff640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ebc047120 0x7f0ebc0db0a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800b410 tx=0x7f0eb800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:22.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2ede495640 1 -- 172.21.15.122:0/971961112 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed01791f0 con 0x7f2ed00d1030 2024-09-17T06:06:22.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f2ede495640 1 --2- 172.21.15.122:0/971961112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ed00d1030 0x7f2ed0004cf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0046df0 tx=0x7f2ec800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:22.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f36adff0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36a8075290 0x7f36a814a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f521da71640 1 -- 172.21.15.122:0/1434337447 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52181f8840 con 0x7f521815b4d0 2024-09-17T06:06:22.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f521da71640 1 -- 172.21.15.122:0/1434337447 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52181f8690 con 0x7f521815b4d0 2024-09-17T06:06:22.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7f36adff0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a80c8090 0x7f36a815f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36a77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36a8075290 0x7f36a814a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36a77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36a8075290 0x7f36a814a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44940/0 (socket says 172.21.15.122:44940) 2024-09-17T06:06:22.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36a77fe640 1 -- 172.21.15.122:0/304370264 learned_addr learned my addr 172.21.15.122:0/304370264 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:22.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36adff0640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36a81440b0 0x7f36a81444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f36a8159a50 con 0x7f36a8075290 2024-09-17T06:06:22.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80c5880 con 0x7f36a80c8090 2024-09-17T06:06:22.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f36a80c7470 con 0x7f36a81440b0 2024-09-17T06:06:22.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36a6ffd640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a80c8090 0x7f36a815f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f55557fa640 1 -- 172.21.15.122:0/4197156631 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c00fbd0 con 0x7f55580c6670 2024-09-17T06:06:22.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f555dde1640 1 -- 172.21.15.122:0/4197156631 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555814ed00 con 0x7f55580c6670 2024-09-17T06:06:22.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f555dde1640 1 -- 172.21.15.122:0/4197156631 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5558150c70 con 0x7f55580c6670 2024-09-17T06:06:22.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36a7fff640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36a81440b0 0x7f36a81444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36a77fe640 1 -- 172.21.15.122:0/304370264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36a81440b0 msgr2=0x7f36a81444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36a77fe640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36a81440b0 0x7f36a81444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36a77fe640 1 -- 172.21.15.122:0/304370264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a80c8090 msgr2=0x7f36a815f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36a77fe640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36a80c8090 0x7f36a815f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36a77fe640 1 -- 172.21.15.122:0/304370264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a814ad20 con 0x7f36a8075290 2024-09-17T06:06:22.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f36a77fe640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36a8075290 0x7f36a814a7e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f369c000c10 tx=0x7f369c0a5630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:22.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f0ec17fa640 1 -- 172.21.15.122:0/2250454782 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8015020 con 0x7f0ebc047120 2024-09-17T06:06:22.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2250454782 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ebc048d70 con 0x7f0ebc047120 2024-09-17T06:06:22.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2250454782 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ebc0db5e0 con 0x7f0ebc047120 2024-09-17T06:06:22.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.960+0000 7fc4f92ec640 1 -- 172.21.15.122:0/2992891432 wait complete. 2024-09-17T06:06:22.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7fc4f92ec640 1 Processor -- start 2024-09-17T06:06:22.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7fc4f92ec640 1 -- start start 2024-09-17T06:06:22.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f92ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4dc004810 0x7fc4f406f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f92ec640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4f40c4720 0x7fc4f414da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f2ece7fc640 1 -- 172.21.15.122:0/971961112 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800e880 con 0x7f2ed00d1030 2024-09-17T06:06:22.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed0179490 con 0x7f2ed00d1030 2024-09-17T06:06:22.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed0179a50 con 0x7f2ed00d1030 2024-09-17T06:06:22.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f2ece7fc640 1 -- 172.21.15.122:0/971961112 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ec800ea20 con 0x7f2ed00d1030 2024-09-17T06:06:22.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f2ece7fc640 1 -- 172.21.15.122:0/971961112 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800edf0 con 0x7f2ed00d1030 2024-09-17T06:06:22.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ec0001040 con 0x7f2ed00d1030 2024-09-17T06:06:22.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7fd4cfbf0640 1 -- 172.21.15.122:0/648904851 shutdown_connections 2024-09-17T06:06:22.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7fd4cfbf0640 1 -- 172.21.15.122:0/648904851 wait complete. 2024-09-17T06:06:22.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7fd4cfbf0640 1 Processor -- start 2024-09-17T06:06:22.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.964+0000 7fd4cfbf0640 1 -- start start 2024-09-17T06:06:22.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cfbf0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4c80c39b0 0x7fd4c80b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cfbf0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4c80c4840 0x7fd4c81456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cfbf0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4c806ea10 0x7fd4c81f9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cfbf0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c80c5a70 con 0x7fd4c806ea10 2024-09-17T06:06:22.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cfbf0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c80cacf0 con 0x7fd4c80c4840 2024-09-17T06:06:22.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cfbf0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c81537e0 con 0x7fd4c80c39b0 2024-09-17T06:06:22.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f92ec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4f414dfa0 0x7fc4f40c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f92ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f4159a90 con 0x7fc4dc004810 2024-09-17T06:06:22.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f92ec640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f41597b0 con 0x7fc4f414dfa0 2024-09-17T06:06:22.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f92ec640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f4153730 con 0x7fc4f40c4720 2024-09-17T06:06:22.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cd98c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4c80c39b0 0x7fd4c80b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cd98c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4c80c39b0 0x7fd4c80b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:58000/0 (socket says 172.21.15.122:58000) 2024-09-17T06:06:22.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cd98c640 1 -- 172.21.15.122:0/506265879 learned_addr learned my addr 172.21.15.122:0/506265879 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:22.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cd18b640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4c80c4840 0x7fd4c81456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f37fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4f40c4720 0x7fc4f414da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f8aeb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4f414dfa0 0x7fc4f40c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f37fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4f40c4720 0x7fc4f414da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:58004/0 (socket says 172.21.15.122:58004) 2024-09-17T06:06:22.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f37fe640 1 -- 172.21.15.122:0/461840330 learned_addr learned my addr 172.21.15.122:0/461840330 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:22.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f555dde1640 1 -- 172.21.15.122:0/4197156631 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f55580724f0 con 0x7f55580c6670 2024-09-17T06:06:22.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2250454782 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ebc0cdfe0 con 0x7f0ebc047120 2024-09-17T06:06:22.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cd18b640 1 -- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4c80c39b0 msgr2=0x7fd4c80b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cd18b640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4c80c39b0 0x7fd4c80b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cd18b640 1 -- 172.21.15.122:0/506265879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4c806ea10 msgr2=0x7fd4c81f9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cd18b640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4c806ea10 0x7fd4c81f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cd18b640 1 -- 172.21.15.122:0/506265879 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c80b3590 con 0x7fd4c80c4840 2024-09-17T06:06:22.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f0ec17fa640 1 -- 172.21.15.122:0/2250454782 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ebc0cdfe0 con 0x7f0ebc047120 2024-09-17T06:06:22.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f0ec17fa640 1 -- 172.21.15.122:0/2250454782 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8011a50 con 0x7f0ebc047120 2024-09-17T06:06:22.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f37fe640 1 -- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4f414dfa0 msgr2=0x7fc4f40c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f37fe640 1 --2- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4f414dfa0 0x7fc4f40c03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f37fe640 1 -- 172.21.15.122:0/461840330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4dc004810 msgr2=0x7fc4f406f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f37fe640 1 --2- 172.21.15.122:0/461840330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4dc004810 0x7fc4f406f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f37fe640 1 -- 172.21.15.122:0/461840330 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f40c3d30 con 0x7fc4f40c4720 2024-09-17T06:06:22.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f368ffff640 1 -- 172.21.15.122:0/304370264 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c0bb070 con 0x7f36a8075290 2024-09-17T06:06:22.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f368ffff640 1 -- 172.21.15.122:0/304370264 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f369c004430 con 0x7f36a8075290 2024-09-17T06:06:22.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f368ffff640 1 -- 172.21.15.122:0/304370264 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c0b2040 con 0x7f36a8075290 2024-09-17T06:06:22.992 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a814f160 con 0x7f36a8075290 2024-09-17T06:06:22.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a8146670 con 0x7f36a8075290 2024-09-17T06:06:22.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f37fe640 1 --2- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4f40c4720 0x7fc4f414da60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4e801de30 tx=0x7fc4e8006df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:22.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f0ff9640 1 -- 172.21.15.122:0/461840330 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80bf070 con 0x7fc4f40c4720 2024-09-17T06:06:22.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4cd18b640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4c80c4840 0x7fd4c81456c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80af000 tx=0x7fd4b8005640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:22.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f2ece7fc640 1 -- 172.21.15.122:0/971961112 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2ec800f450 con 0x7f2ed00d1030 2024-09-17T06:06:22.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f2ece7fc640 1 --2- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2ebc073200 0x7f2ebc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f2ece7fc640 1 -- 172.21.15.122:0/971961112 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f2ec8095020 con 0x7f2ed00d1030 2024-09-17T06:06:22.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f2eddc94640 1 --2- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2ebc073200 0x7f2ebc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f2ece7fc640 1 --2- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f2ebc07cd70 0x7f2ebc07f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f2ece7fc640 1 -- 172.21.15.122:0/971961112 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ec8013ec0 con 0x7f2ebc07cd70 2024-09-17T06:06:22.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f2ece7fc640 1 -- 172.21.15.122:0/971961112 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f2ec8095410 con 0x7f2ed00d1030 2024-09-17T06:06:22.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f0ff9640 1 -- 172.21.15.122:0/461840330 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4e80b4040 con 0x7fc4f40c4720 2024-09-17T06:06:22.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fc4f0ff9640 1 -- 172.21.15.122:0/461840330 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80b3070 con 0x7fc4f40c4720 2024-09-17T06:06:22.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7fc4f92ec640 1 -- 172.21.15.122:0/461840330 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f40c3a90 con 0x7fc4f40c4720 2024-09-17T06:06:22.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f1efffff640 1 -- 172.21.15.122:0/1099049916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ee80050a0 msgr2=0x7f1ee80054b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:22.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f1efffff640 1 --2- 172.21.15.122:0/1099049916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ee80050a0 0x7f1ee80054b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00098a0 tx=0x7f1ef001c6a0 comp rx=0 tx=0).stop 2024-09-17T06:06:22.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f0ec17fa640 1 -- 172.21.15.122:0/2250454782 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0eb8018020 con 0x7f0ebc047120 2024-09-17T06:06:22.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7fc4f92ec640 1 -- 172.21.15.122:0/461840330 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f4202260 con 0x7fc4f40c4720 2024-09-17T06:06:22.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f0ec17fa640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0ea8073200 0x7f0ea8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4be7fc640 1 -- 172.21.15.122:0/506265879 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b80c0070 con 0x7fd4c80c4840 2024-09-17T06:06:22.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4be7fc640 1 -- 172.21.15.122:0/506265879 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4b80047c0 con 0x7fd4c80c4840 2024-09-17T06:06:22.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7fd4be7fc640 1 -- 172.21.15.122:0/506265879 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b80b5040 con 0x7fd4c80c4840 2024-09-17T06:06:22.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f0ec17fa640 1 -- 172.21.15.122:0/2250454782 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f0eb8094900 con 0x7f0ebc047120 2024-09-17T06:06:22.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f51fffff640 1 -- 172.21.15.122:0/1434337447 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f52100be020 con 0x7f521815b4d0 2024-09-17T06:06:22.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f51fffff640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f5204073300 0x7f5204075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f51fffff640 1 -- 172.21.15.122:0/1434337447 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f521012e830 con 0x7f521815b4d0 2024-09-17T06:06:22.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f52177fe640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f5204073300 0x7f5204075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f51fffff640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] conn(0x7f520407ce60 0x7f520407f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f51fffff640 1 -- 172.21.15.122:0/1434337447 --> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52100bbe80 con 0x7f520407ce60 2024-09-17T06:06:22.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f51fffff640 1 -- 172.21.15.122:0/1434337447 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f521012ec20 con 0x7f521815b4d0 2024-09-17T06:06:22.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f2eddc94640 1 --2- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2ebc073200 0x7f2ebc075710 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2ed806c760 tx=0x7f2ec4006a40 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:22.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f2edd493640 1 --2- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f2ebc07cd70 0x7f2ebc07f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:22.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f0ec17fa640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f0ea807cce0 0x7f0ea807f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:22.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f0ec17fa640 1 -- 172.21.15.122:0/2250454782 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0eb800fe50 con 0x7f0ea807cce0 2024-09-17T06:06:22.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f0ec17fa640 1 -- 172.21.15.122:0/2250454782 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f0eb8094cf0 con 0x7f0ebc047120 2024-09-17T06:06:22.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7fc4f92ec640 1 -- 172.21.15.122:0/461840330 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4f40cf0d0 con 0x7fc4f40c4720 2024-09-17T06:06:22.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f55557fa640 1 -- 172.21.15.122:0/4197156631 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f554c021070 con 0x7f55580c6670 2024-09-17T06:06:22.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f55557fa640 1 -- 172.21.15.122:0/4197156631 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c0110d0 con 0x7f55580c6670 2024-09-17T06:06:22.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f55557fa640 1 -- 172.21.15.122:0/4197156631 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f554c01a050 con 0x7f55580c6670 2024-09-17T06:06:22.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f5216ffd640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] conn(0x7f520407ce60 0x7f520407f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f55557fa640 1 --2- 172.21.15.122:0/4197156631 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f553c0731b0 0x7f553c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7fd4cfbf0640 1 -- 172.21.15.122:0/506265879 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c8164950 con 0x7fd4c80c4840 2024-09-17T06:06:23.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7fd4cfbf0640 1 -- 172.21.15.122:0/506265879 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c8156760 con 0x7fd4c80c4840 2024-09-17T06:06:23.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7fd4cfbf0640 1 -- 172.21.15.122:0/506265879 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd4c806dfa0 con 0x7fd4c80c4840 2024-09-17T06:06:23.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f1efffff640 1 -- 172.21.15.122:0/1099049916 shutdown_connections 2024-09-17T06:06:23.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f1efffff640 1 --2- 172.21.15.122:0/1099049916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ee80050a0 0x7f1ee80054b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f1efffff640 1 -- 172.21.15.122:0/1099049916 >> 172.21.15.122:0/1099049916 conn(0x7f1f0006d490 msgr2=0x7f1f00071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.968+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f36a8159510 con 0x7f36a8075290 2024-09-17T06:06:23.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f0ec9652640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f0ea807cce0 0x7f0ea807f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f1efffff640 1 -- 172.21.15.122:0/1099049916 shutdown_connections 2024-09-17T06:06:23.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f0ec8e51640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0ea8073200 0x7f0ea8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.002 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f5557fff640 1 --2- 172.21.15.122:0/4197156631 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f553c0731b0 0x7f553c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f5216ffd640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] conn(0x7f520407ce60 0x7f520407f350 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f2edd493640 1 --2- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f2ebc07cd70 0x7f2ebc07f260 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f52177fe640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f5204073300 0x7f5204075810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f520c009980 tx=0x7f520c005ca0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.972+0000 7f1efffff640 1 -- 172.21.15.122:0/1099049916 wait complete. 2024-09-17T06:06:23.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f55557fa640 1 -- 172.21.15.122:0/4197156631 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f554c0641f0 con 0x7f55580c6670 2024-09-17T06:06:23.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f55557fa640 1 --2- 172.21.15.122:0/4197156631 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f553c07cc90 0x7f553c07f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f55557fa640 1 -- 172.21.15.122:0/4197156631 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f554c01ce50 con 0x7f553c07cc90 2024-09-17T06:06:23.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f55557fa640 1 -- 172.21.15.122:0/4197156631 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f554c0645d0 con 0x7f55580c6670 2024-09-17T06:06:23.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f0ec8e51640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0ea8073200 0x7f0ea8075710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4052280 tx=0x7f0ec4097fe0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f555d5e0640 1 --2- 172.21.15.122:0/4197156631 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f553c07cc90 0x7f553c07f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fc4f0ff9640 1 -- 172.21.15.122:0/461840330 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc4e8003970 con 0x7fc4f40c4720 2024-09-17T06:06:23.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fc4f0ff9640 1 --2- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc4e0073200 0x7fc4e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fc4f0ff9640 1 -- 172.21.15.122:0/461840330 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7fc4e8132620 con 0x7fc4f40c4720 2024-09-17T06:06:23.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fc4f0ff9640 1 --2- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc4e007cd60 0x7fc4e007f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fc4f0ff9640 1 -- 172.21.15.122:0/461840330 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4e80bcec0 con 0x7fc4e007cd60 2024-09-17T06:06:23.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fc4f0ff9640 1 -- 172.21.15.122:0/461840330 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fc4e8132a10 con 0x7fc4f40c4720 2024-09-17T06:06:23.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f368ffff640 1 -- 172.21.15.122:0/304370264 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f369c0be070 con 0x7f36a8075290 2024-09-17T06:06:23.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f368ffff640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f36940732d0 0x7f36940757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f368ffff640 1 -- 172.21.15.122:0/304370264 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f369c12e6e0 con 0x7f36a8075290 2024-09-17T06:06:23.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f368ffff640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f369407ce30 0x7f369407f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f368ffff640 1 -- 172.21.15.122:0/304370264 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f369c00b0b0 con 0x7f369407ce30 2024-09-17T06:06:23.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f368ffff640 1 -- 172.21.15.122:0/304370264 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f369c12ead0 con 0x7f36a8075290 2024-09-17T06:06:23.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f36a7fff640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f369407ce30 0x7f369407f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fc4f3fff640 1 --2- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc4e0073200 0x7fc4e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fd4be7fc640 1 -- 172.21.15.122:0/506265879 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd4b8004bf0 con 0x7fd4c80c4840 2024-09-17T06:06:23.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fd4be7fc640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd4ac073200 0x7fd4ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fd4be7fc640 1 -- 172.21.15.122:0/506265879 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7fd4b8132370 con 0x7fd4c80c4840 2024-09-17T06:06:23.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fd4cd98c640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd4ac073200 0x7fd4ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fd4be7fc640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd4ac07cc70 0x7fd4ac07f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fd4be7fc640 1 -- 172.21.15.122:0/506265879 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd4ac07f830 con 0x7fd4ac07cc70 2024-09-17T06:06:23.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fd4be7fc640 1 -- 172.21.15.122:0/506265879 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fd4b8132800 con 0x7fd4c80c4840 2024-09-17T06:06:23.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f555d5e0640 1 --2- 172.21.15.122:0/4197156631 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f553c07cc90 0x7f553c07f180 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fc4f8aeb640 1 --2- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc4e007cd60 0x7fc4e007f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f2ece7fc640 1 -- 172.21.15.122:0/971961112 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ec8013ec0 con 0x7f2ebc07cd70 2024-09-17T06:06:23.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fd4ce18d640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd4ac07cc70 0x7fd4ac07f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f36a6ffd640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f36940732d0 0x7f36940757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f51fffff640 1 -- 172.21.15.122:0/1434337447 <== osd.4 v2:172.21.15.173:6810/1065110369 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52100bbe80 con 0x7f520407ce60 2024-09-17T06:06:23.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f5557fff640 1 --2- 172.21.15.122:0/4197156631 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f553c0731b0 0x7f553c0756c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55440b2000 tx=0x7f554401be70 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f1efffff640 1 Processor -- start 2024-09-17T06:06:23.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f0ec9652640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f0ea807cce0 0x7f0ea807f1d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fc4f8aeb640 1 --2- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc4e007cd60 0x7fc4e007f250 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fc4f3fff640 1 --2- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc4e0073200 0x7fc4e0075710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40064b0 tx=0x7fc4e4006ab0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f36a7fff640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f369407ce30 0x7f369407f320 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f1efffff640 1 -- start start 2024-09-17T06:06:23.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f368ffff640 1 -- 172.21.15.122:0/304370264 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f369c00b0b0 con 0x7f369407ce30 2024-09-17T06:06:23.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7f0ec17fa640 1 -- 172.21.15.122:0/2250454782 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0eb800fe50 con 0x7f0ea807cce0 2024-09-17T06:06:23.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f36a6ffd640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f36940732d0 0x7f36940757e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f36a814cec0 tx=0x7f36a0009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee80050a0 0x7f1f001f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efffff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f00159f40 0x7f1f00146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f000ca840 0x7f1f00140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efffff640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00151910 con 0x7f1f000ca840 2024-09-17T06:06:23.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efffff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00151790 con 0x7f1ee80050a0 2024-09-17T06:06:23.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efffff640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1f000c3300 con 0x7f1f00159f40 2024-09-17T06:06:23.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efeffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee80050a0 0x7f1f001f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efeffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee80050a0 0x7f1f001f1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:45856/0 (socket says 172.21.15.122:45856) 2024-09-17T06:06:23.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efeffd640 1 -- 172.21.15.122:0/1709452782 learned_addr learned my addr 172.21.15.122:0/1709452782 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:23.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efe7fc640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f00159f40 0x7f1f00146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1eff7fe640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f000ca840 0x7f1f00140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efeffd640 1 -- 172.21.15.122:0/1709452782 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f00159f40 msgr2=0x7f1f00146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efeffd640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f00159f40 0x7f1f00146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efeffd640 1 -- 172.21.15.122:0/1709452782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f000ca840 msgr2=0x7f1f00140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efeffd640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f000ca840 0x7f1f00140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efeffd640 1 -- 172.21.15.122:0/1709452782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f001f2130 con 0x7f1ee80050a0 2024-09-17T06:06:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efeffd640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee80050a0 0x7f1f001f1bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4010630 tx=0x7f1ef40046a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1ee77fe640 1 -- 172.21.15.122:0/1709452782 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef400d820 con 0x7f1ee80050a0 2024-09-17T06:06:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1ee77fe640 1 -- 172.21.15.122:0/1709452782 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ef400d9c0 con 0x7f1ee80050a0 2024-09-17T06:06:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1ee77fe640 1 -- 172.21.15.122:0/1709452782 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef400ddf0 con 0x7f1ee80050a0 2024-09-17T06:06:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efffff640 1 -- 172.21.15.122:0/1709452782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f00159c60 con 0x7f1ee80050a0 2024-09-17T06:06:23.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7f1efffff640 1 -- 172.21.15.122:0/1709452782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f001f2340 con 0x7f1ee80050a0 2024-09-17T06:06:23.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.976+0000 7fd4cd98c640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd4ac073200 0x7fd4ac075710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009c00 tx=0x7fd4c40091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7fd4ce18d640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd4ac07cc70 0x7fd4ac07f160 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.980+0000 7fd4be7fc640 1 -- 172.21.15.122:0/506265879 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd4ac07f830 con 0x7fd4ac07cc70 2024-09-17T06:06:23.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.984+0000 7f1efffff640 1 -- 172.21.15.122:0/1709452782 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f001f14e0 con 0x7f1ee80050a0 2024-09-17T06:06:23.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.984+0000 7f1ee77fe640 1 -- 172.21.15.122:0/1709452782 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1ef4023440 con 0x7f1ee80050a0 2024-09-17T06:06:23.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.984+0000 7f1ee77fe640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1eec073200 0x7f1eec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.984+0000 7fc4f0ff9640 1 -- 172.21.15.122:0/461840330 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4e80bcec0 con 0x7fc4e007cd60 2024-09-17T06:06:23.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.984+0000 7f55557fa640 1 -- 172.21.15.122:0/4197156631 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f554c01ce50 con 0x7f553c07cc90 2024-09-17T06:06:23.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.984+0000 7f1ee77fe640 1 -- 172.21.15.122:0/1709452782 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f1ef4098350 con 0x7f1ee80050a0 2024-09-17T06:06:23.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.984+0000 7f1efe7fc640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1eec073200 0x7f1eec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.984+0000 7f1ee77fe640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f1eec07cc60 0x7f1eec07f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.984+0000 7f1ee77fe640 1 -- 172.21.15.122:0/1709452782 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1eec07f820 con 0x7f1eec07cc60 2024-09-17T06:06:23.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.984+0000 7f1ee77fe640 1 -- 172.21.15.122:0/1709452782 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f1ef40987e0 con 0x7f1ee80050a0 2024-09-17T06:06:23.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.984+0000 7f1eff7fe640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f1eec07cc60 0x7f1eec07f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.988+0000 7f1efe7fc640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1eec073200 0x7f1eec075710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009870 tx=0x7f1ef0019440 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.988+0000 7f1eff7fe640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f1eec07cc60 0x7f1eec07f150 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:22.988+0000 7f1ee77fe640 1 -- 172.21.15.122:0/1709452782 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1eec07f820 con 0x7f1eec07cc60 2024-09-17T06:06:23.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2250454782 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ebc006e50 con 0x7f0ea807cce0 2024-09-17T06:06:23.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec17fa640 1 -- 172.21.15.122:0/2250454782 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0ebc006e50 con 0x7f0ea807cce0 2024-09-17T06:06:23.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2250454782 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f0ea807cce0 msgr2=0x7f0ea807f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec9e53640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7f0ea807cce0 0x7f0ea807f1d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2250454782 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0ea8073200 msgr2=0x7f0ea8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec9e53640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0ea8073200 0x7f0ea8075710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4052280 tx=0x7f0ec4097fe0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2250454782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ebc047120 msgr2=0x7f0ebc0db0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec9e53640 1 --2- 172.21.15.122:0/2250454782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ebc047120 0x7f0ebc0db0a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800b410 tx=0x7f0eb800b810 comp rx=0 tx=0).stop 2024-09-17T06:06:23.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec9652640 1 -- 172.21.15.122:0/2250454782 reap_dead start 2024-09-17T06:06:23.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2250454782 shutdown_connections 2024-09-17T06:06:23.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2250454782 >> 172.21.15.122:0/2250454782 conn(0x7f0ebc050f60 msgr2=0x7f0ebc0d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2250454782 shutdown_connections 2024-09-17T06:06:23.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f0ec9e53640 1 -- 172.21.15.122:0/2250454782 wait complete. 2024-09-17T06:06:23.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f36a814d1d0 con 0x7f369407ce30 2024-09-17T06:06:23.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.004+0000 7f368ffff640 1 -- 172.21.15.122:0/304370264 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f36a814d1d0 con 0x7f369407ce30 2024-09-17T06:06:23.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f369407ce30 msgr2=0x7f369407f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f36adff0640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f369407ce30 0x7f369407f320 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f36940732d0 msgr2=0x7f36940757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f36adff0640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f36940732d0 0x7f36940757e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f36a814cec0 tx=0x7f36a0009040 comp rx=0 tx=0).stop 2024-09-17T06:06:23.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36a8075290 msgr2=0x7f36a814a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f36adff0640 1 --2- 172.21.15.122:0/304370264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36a8075290 0x7f36a814a7e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f369c000c10 tx=0x7f369c0a5630 comp rx=0 tx=0).stop 2024-09-17T06:06:23.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f36a7fff640 1 -- 172.21.15.122:0/304370264 reap_dead start 2024-09-17T06:06:23.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 shutdown_connections 2024-09-17T06:06:23.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 >> 172.21.15.122:0/304370264 conn(0x7f36a806d290 msgr2=0x7f36a815d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 shutdown_connections 2024-09-17T06:06:23.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f36adff0640 1 -- 172.21.15.122:0/304370264 wait complete. 2024-09-17T06:06:23.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f1efffff640 1 -- 172.21.15.122:0/1709452782 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f0014ccd0 con 0x7f1eec07cc60 2024-09-17T06:06:23.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7fd4cfbf0640 1 -- 172.21.15.122:0/506265879 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd4c80b1a40 con 0x7fd4ac07cc70 2024-09-17T06:06:23.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ec0002d60 con 0x7f2ebc07cd70 2024-09-17T06:06:23.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.008+0000 7f1ee77fe640 1 -- 172.21.15.122:0/1709452782 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1f0014ccd0 con 0x7f1eec07cc60 2024-09-17T06:06:23.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f1efffff640 1 -- 172.21.15.122:0/1709452782 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f1eec07cc60 msgr2=0x7f1eec07f150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f1efffff640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7f1eec07cc60 0x7f1eec07f150 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7fd4be7fc640 1 -- 172.21.15.122:0/506265879 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd4c80b1a40 con 0x7fd4ac07cc70 2024-09-17T06:06:23.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f1efffff640 1 -- 172.21.15.122:0/1709452782 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1eec073200 msgr2=0x7f1eec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f1efffff640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1eec073200 0x7f1eec075710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009870 tx=0x7f1ef0019440 comp rx=0 tx=0).stop 2024-09-17T06:06:23.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f1efffff640 1 -- 172.21.15.122:0/1709452782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee80050a0 msgr2=0x7f1f001f1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f1efffff640 1 --2- 172.21.15.122:0/1709452782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ee80050a0 0x7f1f001f1bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4010630 tx=0x7f1ef40046a0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f1eff7fe640 1 -- 172.21.15.122:0/1709452782 reap_dead start 2024-09-17T06:06:23.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f1efffff640 1 -- 172.21.15.122:0/1709452782 shutdown_connections 2024-09-17T06:06:23.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f1efffff640 1 -- 172.21.15.122:0/1709452782 >> 172.21.15.122:0/1709452782 conn(0x7f1f0006d490 msgr2=0x7f1f00156520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f1efffff640 1 -- 172.21.15.122:0/1709452782 shutdown_connections 2024-09-17T06:06:23.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f1efffff640 1 -- 172.21.15.122:0/1709452782 wait complete. 2024-09-17T06:06:23.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7fd4abfff640 1 -- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd4ac07cc70 msgr2=0x7fd4ac07f160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7fd4abfff640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7fd4ac07cc70 0x7fd4ac07f160 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7fd4abfff640 1 -- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd4ac073200 msgr2=0x7fd4ac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7fd4abfff640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd4ac073200 0x7fd4ac075710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009c00 tx=0x7fd4c40091e0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7fd4abfff640 1 -- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4c80c4840 msgr2=0x7fd4c81456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7fd4abfff640 1 --2- 172.21.15.122:0/506265879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4c80c4840 0x7fd4c81456c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80af000 tx=0x7fd4b8005640 comp rx=0 tx=0).stop 2024-09-17T06:06:23.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7fd4ce18d640 1 -- 172.21.15.122:0/506265879 reap_dead start 2024-09-17T06:06:23.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f2ece7fc640 1 -- 172.21.15.122:0/971961112 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2ec0002d60 con 0x7f2ebc07cd70 2024-09-17T06:06:23.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7fd4abfff640 1 -- 172.21.15.122:0/506265879 shutdown_connections 2024-09-17T06:06:23.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7fd4abfff640 1 -- 172.21.15.122:0/506265879 >> 172.21.15.122:0/506265879 conn(0x7fd4c80705b0 msgr2=0x7fd4c80709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7fd4abfff640 1 -- 172.21.15.122:0/506265879 shutdown_connections 2024-09-17T06:06:23.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f2ebc07cd70 msgr2=0x7f2ebc07f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f2edec96640 1 --2- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f2ebc07cd70 0x7f2ebc07f260 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2ebc073200 msgr2=0x7f2ebc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f2edec96640 1 --2- 172.21.15.122:0/971961112 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2ebc073200 0x7f2ebc075710 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2ed806c760 tx=0x7f2ec4006a40 comp rx=0 tx=0).stop 2024-09-17T06:06:23.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ed00d1030 msgr2=0x7f2ed0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f2edec96640 1 --2- 172.21.15.122:0/971961112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ed00d1030 0x7f2ed0004cf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0046df0 tx=0x7f2ec800cf90 comp rx=0 tx=0).stop 2024-09-17T06:06:23.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f2ede495640 1 -- 172.21.15.122:0/971961112 reap_dead start 2024-09-17T06:06:23.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7fd4abfff640 1 -- 172.21.15.122:0/506265879 wait complete. 2024-09-17T06:06:23.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 shutdown_connections 2024-09-17T06:06:23.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 >> 172.21.15.122:0/971961112 conn(0x7f2ed004fe40 msgr2=0x7f2ed00db460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 shutdown_connections 2024-09-17T06:06:23.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f2edec96640 1 -- 172.21.15.122:0/971961112 wait complete. 2024-09-17T06:06:23.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f555dde1640 1 -- 172.21.15.122:0/4197156631 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f55580724f0 con 0x7f553c07cc90 2024-09-17T06:06:23.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f521da71640 1 -- 172.21.15.122:0/1434337447 --> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f52180cb5d0 con 0x7f520407ce60 2024-09-17T06:06:23.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.012+0000 7f55557fa640 1 -- 172.21.15.122:0/4197156631 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f55580724f0 con 0x7f553c07cc90 2024-09-17T06:06:23.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f555dde1640 1 -- 172.21.15.122:0/4197156631 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f553c07cc90 msgr2=0x7f553c07f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f555dde1640 1 --2- 172.21.15.122:0/4197156631 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f553c07cc90 0x7f553c07f180 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f51fffff640 1 -- 172.21.15.122:0/1434337447 <== osd.4 v2:172.21.15.173:6810/1065110369 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f52180cb5d0 con 0x7f520407ce60 2024-09-17T06:06:23.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f555dde1640 1 -- 172.21.15.122:0/4197156631 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f553c0731b0 msgr2=0x7f553c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f555dde1640 1 --2- 172.21.15.122:0/4197156631 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f553c0731b0 0x7f553c0756c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55440b2000 tx=0x7f554401be70 comp rx=0 tx=0).stop 2024-09-17T06:06:23.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f555dde1640 1 -- 172.21.15.122:0/4197156631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55580c6670 msgr2=0x7f555814e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f555dde1640 1 --2- 172.21.15.122:0/4197156631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55580c6670 0x7f555814e7c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f554c016fc0 tx=0x7f554c014490 comp rx=0 tx=0).stop 2024-09-17T06:06:23.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f555d5e0640 1 -- 172.21.15.122:0/4197156631 reap_dead start 2024-09-17T06:06:23.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f555dde1640 1 -- 172.21.15.122:0/4197156631 shutdown_connections 2024-09-17T06:06:23.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f555dde1640 1 -- 172.21.15.122:0/4197156631 >> 172.21.15.122:0/4197156631 conn(0x7f55580744c0 msgr2=0x7f5558155460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f51fdffb640 1 -- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] conn(0x7f520407ce60 msgr2=0x7f520407f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f51fdffb640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] conn(0x7f520407ce60 0x7f520407f350 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f51fdffb640 1 -- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f5204073300 msgr2=0x7f5204075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f51fdffb640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f5204073300 0x7f5204075810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f520c009980 tx=0x7f520c005ca0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7fc4f92ec640 1 -- 172.21.15.122:0/461840330 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc4f40c53b0 con 0x7fc4e007cd60 2024-09-17T06:06:23.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f51fdffb640 1 -- 172.21.15.122:0/1434337447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f521815b4d0 msgr2=0x7f52181f8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f51fdffb640 1 --2- 172.21.15.122:0/1434337447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f521815b4d0 0x7f52181f8150 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f52180ca060 tx=0x7f5210005b10 comp rx=0 tx=0).stop 2024-09-17T06:06:23.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f5217fff640 1 -- 172.21.15.122:0/1434337447 reap_dead start 2024-09-17T06:06:23.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f51fdffb640 1 -- 172.21.15.122:0/1434337447 shutdown_connections 2024-09-17T06:06:23.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f51fdffb640 1 -- 172.21.15.122:0/1434337447 >> 172.21.15.122:0/1434337447 conn(0x7f5218070fe0 msgr2=0x7f52181513b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f51fdffb640 1 -- 172.21.15.122:0/1434337447 shutdown_connections 2024-09-17T06:06:23.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7f51fdffb640 1 -- 172.21.15.122:0/1434337447 wait complete. 2024-09-17T06:06:23.038 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7fc4f0ff9640 1 -- 172.21.15.122:0/461840330 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc4f40c53b0 con 0x7fc4e007cd60 2024-09-17T06:06:23.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7fc4f92ec640 1 -- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc4e007cd60 msgr2=0x7fc4e007f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7fc4f92ec640 1 --2- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7fc4e007cd60 0x7fc4e007f250 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7fc4f92ec640 1 -- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc4e0073200 msgr2=0x7fc4e0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7fc4f92ec640 1 --2- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc4e0073200 0x7fc4e0075710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40064b0 tx=0x7fc4e4006ab0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7fc4f92ec640 1 -- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4f40c4720 msgr2=0x7fc4f414da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.016+0000 7fc4f92ec640 1 --2- 172.21.15.122:0/461840330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc4f40c4720 0x7fc4f414da60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4e801de30 tx=0x7fc4e8006df0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.039 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.020+0000 7fc4f8aeb640 1 -- 172.21.15.122:0/461840330 reap_dead start 2024-09-17T06:06:23.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.020+0000 7fc4f92ec640 1 -- 172.21.15.122:0/461840330 shutdown_connections 2024-09-17T06:06:23.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.020+0000 7fc4f92ec640 1 -- 172.21.15.122:0/461840330 >> 172.21.15.122:0/461840330 conn(0x7fc4f406d290 msgr2=0x7fc4f41e6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.024+0000 7f555dde1640 1 -- 172.21.15.122:0/4197156631 shutdown_connections 2024-09-17T06:06:23.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.024+0000 7fc4f92ec640 1 -- 172.21.15.122:0/461840330 shutdown_connections 2024-09-17T06:06:23.040 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.024+0000 7fc4f92ec640 1 -- 172.21.15.122:0/461840330 wait complete. 2024-09-17T06:06:23.041 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.024+0000 7f555dde1640 1 -- 172.21.15.122:0/4197156631 wait complete. 2024-09-17T06:06:23.049 INFO:teuthology.orchestra.run.smithi122.stdout:64424509474 2024-09-17T06:06:23.050 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T06:06:23.051 INFO:teuthology.orchestra.run.smithi122.stdout:64424509475 2024-09-17T06:06:23.051 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T06:06:23.054 INFO:teuthology.orchestra.run.smithi122.stdout:64424509475 2024-09-17T06:06:23.054 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T06:06:23.055 INFO:teuthology.orchestra.run.smithi122.stdout:274877906950 2024-09-17T06:06:23.055 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T06:06:23.060 INFO:teuthology.orchestra.run.smithi122.stdout:64424509473 2024-09-17T06:06:23.061 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T06:06:23.062 INFO:teuthology.orchestra.run.smithi122.stdout:64424509475 2024-09-17T06:06:23.062 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T06:06:23.064 INFO:teuthology.orchestra.run.smithi122.stdout:64424509475 2024-09-17T06:06:23.064 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T06:06:23.066 INFO:teuthology.orchestra.run.smithi122.stdout:60129542177 2024-09-17T06:06:23.067 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T06:06:23.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.248+0000 7f1d4c217640 1 -- 172.21.15.122:0/3567718569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d30004810 msgr2=0x7f1d30004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.248+0000 7f1d4c217640 1 --2- 172.21.15.122:0/3567718569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d30004810 0x7f1d30004cc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c001f50 tx=0x7f1d3c01f3a0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.248+0000 7f1d4a7b4640 1 -- 172.21.15.122:0/3567718569 reap_dead start 2024-09-17T06:06:23.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.248+0000 7f1d4c217640 1 -- 172.21.15.122:0/3567718569 shutdown_connections 2024-09-17T06:06:23.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.248+0000 7f1d4c217640 1 -- 172.21.15.122:0/3567718569 >> 172.21.15.122:0/3567718569 conn(0x7f1d4406d290 msgr2=0x7f1d4406d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.251 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.248+0000 7f1d4c217640 1 -- 172.21.15.122:0/3567718569 shutdown_connections 2024-09-17T06:06:23.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.248+0000 7f1d4c217640 1 -- 172.21.15.122:0/3567718569 wait complete. 2024-09-17T06:06:23.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.252+0000 7f1d4c217640 1 Processor -- start 2024-09-17T06:06:23.254 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.252+0000 7f1d4c217640 1 -- start start 2024-09-17T06:06:23.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d4c217640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d4414bf40 0x7f1d441564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d4c217640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d4414c350 0x7f1d4415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d4c217640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d44156a30 0x7f1d4415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d4c217640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440c60b0 con 0x7f1d4414bf40 2024-09-17T06:06:23.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d4c217640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440cd240 con 0x7f1d4414c350 2024-09-17T06:06:23.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d4c217640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1d44074e50 con 0x7f1d44156a30 2024-09-17T06:06:23.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d49fb3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d4414bf40 0x7f1d441564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d49fb3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d4414bf40 0x7f1d441564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:44992/0 (socket says 172.21.15.122:44992) 2024-09-17T06:06:23.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d49fb3640 1 -- 172.21.15.122:0/3357873980 learned_addr learned my addr 172.21.15.122:0/3357873980 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:23.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d4a7b4640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d44156a30 0x7f1d4415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d497b2640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d4414c350 0x7f1d4415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d49fb3640 1 -- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d44156a30 msgr2=0x7f1d4415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d49fb3640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d44156a30 0x7f1d4415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d49fb3640 1 -- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d4414c350 msgr2=0x7f1d4415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d49fb3640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d4414c350 0x7f1d4415ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d49fb3640 1 -- 172.21.15.122:0/3357873980 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d441f9020 con 0x7f1d4414bf40 2024-09-17T06:06:23.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d49fb3640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d4414bf40 0x7f1d441564f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400e6d0 tx=0x7f1d3400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d3a7fc640 1 -- 172.21.15.122:0/3357873980 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34015070 con 0x7f1d4414bf40 2024-09-17T06:06:23.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d4c217640 1 -- 172.21.15.122:0/3357873980 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d441f8da0 con 0x7f1d4414bf40 2024-09-17T06:06:23.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d4c217640 1 -- 172.21.15.122:0/3357873980 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d4415e510 con 0x7f1d4414bf40 2024-09-17T06:06:23.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d3a7fc640 1 -- 172.21.15.122:0/3357873980 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d3400cb30 con 0x7f1d4414bf40 2024-09-17T06:06:23.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.256+0000 7f1d3a7fc640 1 -- 172.21.15.122:0/3357873980 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34011460 con 0x7f1d4414bf40 2024-09-17T06:06:23.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.260+0000 7f1d3a7fc640 1 -- 172.21.15.122:0/3357873980 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1d34018070 con 0x7f1d4414bf40 2024-09-17T06:06:23.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.260+0000 7f1d3a7fc640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d28073230 0x7f1d28075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.264+0000 7f1d3a7fc640 1 -- 172.21.15.122:0/3357873980 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f1d34094aa0 con 0x7f1d4414bf40 2024-09-17T06:06:23.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.264+0000 7f1d497b2640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d28073230 0x7f1d28075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.264+0000 7f1d4c217640 1 -- 172.21.15.122:0/3357873980 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2c0052a0 con 0x7f1d4414bf40 2024-09-17T06:06:23.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.264+0000 7f27b6708640 1 -- 172.21.15.122:0/934319470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a804c190 msgr2=0x7f27a80fc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.264+0000 7f27b6708640 1 --2- 172.21.15.122:0/934319470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a804c190 0x7f27a80fc810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f27a800b780 tx=0x7f27ac0201c0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.272+0000 7f27b6708640 1 -- 172.21.15.122:0/934319470 shutdown_connections 2024-09-17T06:06:23.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.272+0000 7f27b6708640 1 --2- 172.21.15.122:0/934319470 >> v2:172.21.15.122:3300/0 conn(0x7f27a80f6a00 0x7f27a804b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.272+0000 7f27b6708640 1 --2- 172.21.15.122:0/934319470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a804c190 0x7f27a80fc810 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.272+0000 7f27b6708640 1 -- 172.21.15.122:0/934319470 >> 172.21.15.122:0/934319470 conn(0x7f27a804fe40 msgr2=0x7f27a8050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.264+0000 7f1d497b2640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d28073230 0x7f1d28075740 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0af000 tx=0x7f1d3c01c1f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.272+0000 7f27b6708640 1 -- 172.21.15.122:0/934319470 shutdown_connections 2024-09-17T06:06:23.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.272+0000 7f27b6708640 1 -- 172.21.15.122:0/934319470 wait complete. 2024-09-17T06:06:23.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.272+0000 7f1d3a7fc640 1 -- 172.21.15.122:0/3357873980 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1d441f8da0 con 0x7f1d4414bf40 2024-09-17T06:06:23.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b6708640 1 Processor -- start 2024-09-17T06:06:23.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b6708640 1 -- start start 2024-09-17T06:06:23.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b6708640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27a8045810 0x7f27a8197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b6708640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a804c190 0x7f27a80f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b6708640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a80f6a00 0x7f27a80eda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b6708640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27a80f6e10 con 0x7f27a804c190 2024-09-17T06:06:23.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b6708640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f27a80460e0 con 0x7f27a80f6a00 2024-09-17T06:06:23.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b6708640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f27a8005c10 con 0x7f27a8045810 2024-09-17T06:06:23.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b4f05640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a804c190 0x7f27a80f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b4f05640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a804c190 0x7f27a80f1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45012/0 (socket says 172.21.15.122:45012) 2024-09-17T06:06:23.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b4f05640 1 -- 172.21.15.122:0/825527230 learned_addr learned my addr 172.21.15.122:0/825527230 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:23.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b5706640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27a8045810 0x7f27a8197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b5f07640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a80f6a00 0x7f27a80eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b4f05640 1 -- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27a8045810 msgr2=0x7f27a8197bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b4f05640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27a8045810 0x7f27a8197bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b4f05640 1 -- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a80f6a00 msgr2=0x7f27a80eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b4f05640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a80f6a00 0x7f27a80eda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b4f05640 1 -- 172.21.15.122:0/825527230 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a8198130 con 0x7f27a804c190 2024-09-17T06:06:23.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27b4f05640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a804c190 0x7f27a80f1ff0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f27ac01e870 tx=0x7f27ac0b0400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27a5ffb640 1 -- 172.21.15.122:0/825527230 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0b5040 con 0x7f27a804c190 2024-09-17T06:06:23.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27a5ffb640 1 -- 172.21.15.122:0/825527230 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27ac0bf070 con 0x7f27a804c190 2024-09-17T06:06:23.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.276+0000 7f27a5ffb640 1 -- 172.21.15.122:0/825527230 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac005070 con 0x7f27a804c190 2024-09-17T06:06:23.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.280+0000 7f27b6708640 1 -- 172.21.15.122:0/825527230 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a80f2c30 con 0x7f27a804c190 2024-09-17T06:06:23.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.280+0000 7f27b6708640 1 -- 172.21.15.122:0/825527230 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a80f31f0 con 0x7f27a804c190 2024-09-17T06:06:23.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7f27937fe640 1 -- 172.21.15.122:0/825527230 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a80fc810 con 0x7f27a804c190 2024-09-17T06:06:23.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7f27a5ffb640 1 -- 172.21.15.122:0/825527230 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f27ac005210 con 0x7f27a804c190 2024-09-17T06:06:23.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7f27a5ffb640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2794073230 0x7f2794075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7f27a5ffb640 1 -- 172.21.15.122:0/825527230 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f27ac132890 con 0x7f27a804c190 2024-09-17T06:06:23.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7fefa9808640 1 -- 172.21.15.122:0/3927881989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef9c045b00 msgr2=0x7fef9c045f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7fefa9808640 1 --2- 172.21.15.122:0/3927881989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef9c045b00 0x7fef9c045f10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00e4f0 tx=0x7fef9001c8e0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7fefa9808640 1 -- 172.21.15.122:0/3927881989 shutdown_connections 2024-09-17T06:06:23.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7fefa9808640 1 --2- 172.21.15.122:0/3927881989 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef9c0468e0 0x7fef9c046cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7fefa9808640 1 --2- 172.21.15.122:0/3927881989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef9c045b00 0x7fef9c045f10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7fefa9808640 1 -- 172.21.15.122:0/3927881989 >> 172.21.15.122:0/3927881989 conn(0x7fef9c0506e0 msgr2=0x7fef9c050af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7fefa9808640 1 -- 172.21.15.122:0/3927881989 shutdown_connections 2024-09-17T06:06:23.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7fefa9808640 1 -- 172.21.15.122:0/3927881989 wait complete. 2024-09-17T06:06:23.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.284+0000 7f27b5706640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2794073230 0x7f2794075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa9808640 1 Processor -- start 2024-09-17T06:06:23.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa9808640 1 -- start start 2024-09-17T06:06:23.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa9808640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef9c045b00 0x7fef9c048ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa9808640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef9c0468e0 0x7fef9c0d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa9808640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef9c0dafe0 0x7fef9c0d7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa8806640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef9c045b00 0x7fef9c048ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa8806640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef9c045b00 0x7fef9c048ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45040/0 (socket says 172.21.15.122:45040) 2024-09-17T06:06:23.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa8806640 1 -- 172.21.15.122:0/3287270088 learned_addr learned my addr 172.21.15.122:0/3287270088 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:23.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa3fff640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef9c0468e0 0x7fef9c0d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa9808640 1 -- 172.21.15.122:0/3287270088 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c0346f0 con 0x7fef9c045b00 2024-09-17T06:06:23.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa9808640 1 -- 172.21.15.122:0/3287270088 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c0e6af0 con 0x7fef9c0dafe0 2024-09-17T06:06:23.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa9007640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef9c0dafe0 0x7fef9c0d7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.288+0000 7fefa9808640 1 -- 172.21.15.122:0/3287270088 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fef9c04cae0 con 0x7fef9c0468e0 2024-09-17T06:06:23.292 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.292+0000 7f27b5706640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2794073230 0x7f2794075740 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f27a000b810 tx=0x7f27a0008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.292+0000 7fefa8806640 1 -- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef9c0468e0 msgr2=0x7fef9c0d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.292+0000 7fefa8806640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef9c0468e0 0x7fef9c0d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.292+0000 7fefa8806640 1 -- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef9c0dafe0 msgr2=0x7fef9c0d7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.292+0000 7fefa8806640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef9c0dafe0 0x7fef9c0d7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.292+0000 7fefa8806640 1 -- 172.21.15.122:0/3287270088 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9c0491e0 con 0x7fef9c045b00 2024-09-17T06:06:23.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.292+0000 7fefa8806640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef9c045b00 0x7fef9c048ca0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fef9800b440 tx=0x7fef9800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.292+0000 7f27a5ffb640 1 -- 172.21.15.122:0/825527230 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f27ac019d40 con 0x7f27a804c190 2024-09-17T06:06:23.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.292+0000 7fefa17fa640 1 -- 172.21.15.122:0/3287270088 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98015020 con 0x7fef9c045b00 2024-09-17T06:06:23.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.292+0000 7fefa9808640 1 -- 172.21.15.122:0/3287270088 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef9c047ee0 con 0x7fef9c045b00 2024-09-17T06:06:23.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.292+0000 7fefa9808640 1 -- 172.21.15.122:0/3287270088 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef9c0484a0 con 0x7fef9c045b00 2024-09-17T06:06:23.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7fefa9808640 1 -- 172.21.15.122:0/3287270088 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef9c0d8900 con 0x7fef9c045b00 2024-09-17T06:06:23.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8173fff640 1 -- 172.21.15.122:0/2720739561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f816c04b410 msgr2=0x7f816c04b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8173fff640 1 --2- 172.21.15.122:0/2720739561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f816c04b410 0x7f816c04b820 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8164009830 tx=0x7f816401f010 comp rx=0 tx=0).stop 2024-09-17T06:06:23.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7fefa17fa640 1 -- 172.21.15.122:0/3287270088 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef98004020 con 0x7fef9c045b00 2024-09-17T06:06:23.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7fefa17fa640 1 -- 172.21.15.122:0/3287270088 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98004430 con 0x7fef9c045b00 2024-09-17T06:06:23.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8173fff640 1 -- 172.21.15.122:0/2720739561 shutdown_connections 2024-09-17T06:06:23.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8173fff640 1 --2- 172.21.15.122:0/2720739561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f816c04b410 0x7f816c04b820 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8173fff640 1 --2- 172.21.15.122:0/2720739561 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f816c005c10 0x7f816c0dab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8173fff640 1 -- 172.21.15.122:0/2720739561 >> 172.21.15.122:0/2720739561 conn(0x7f816c04fe40 msgr2=0x7f816c050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8173fff640 1 -- 172.21.15.122:0/2720739561 shutdown_connections 2024-09-17T06:06:23.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8f1f368640 1 -- 172.21.15.122:0/305187367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f10044cf0 msgr2=0x7f8f100d8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8f1f368640 1 --2- 172.21.15.122:0/305187367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f10044cf0 0x7f8f100d8d20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8f10007070 tx=0x7f8f1401c830 comp rx=0 tx=0).stop 2024-09-17T06:06:23.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8173fff640 1 -- 172.21.15.122:0/2720739561 wait complete. 2024-09-17T06:06:23.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8f1f368640 1 -- 172.21.15.122:0/305187367 shutdown_connections 2024-09-17T06:06:23.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8f1f368640 1 --2- 172.21.15.122:0/305187367 >> v2:172.21.15.173:3300/0 conn(0x7f8f10045370 0x7f8f100e2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8f1f368640 1 --2- 172.21.15.122:0/305187367 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f10045780 0x7f8f100e2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8f1f368640 1 --2- 172.21.15.122:0/305187367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f10044cf0 0x7f8f100d8d20 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8f1f368640 1 -- 172.21.15.122:0/305187367 >> 172.21.15.122:0/305187367 conn(0x7f8f1004fe70 msgr2=0x7f8f10050280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8f1f368640 1 -- 172.21.15.122:0/305187367 shutdown_connections 2024-09-17T06:06:23.299 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.296+0000 7f8f1f368640 1 -- 172.21.15.122:0/305187367 wait complete. 2024-09-17T06:06:23.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8173fff640 1 Processor -- start 2024-09-17T06:06:23.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8173fff640 1 -- start start 2024-09-17T06:06:23.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1f368640 1 Processor -- start 2024-09-17T06:06:23.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1f368640 1 -- start start 2024-09-17T06:06:23.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7fefa17fa640 1 -- 172.21.15.122:0/3287270088 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fef98018020 con 0x7fef9c045b00 2024-09-17T06:06:23.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7fefa17fa640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fef88073200 0x7fef88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7fefa17fa640 1 -- 172.21.15.122:0/3287270088 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7fef98094be0 con 0x7fef9c045b00 2024-09-17T06:06:23.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7fefa3fff640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fef88073200 0x7fef88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7fefa3fff640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fef88073200 0x7fef88075710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fef900ae000 tx=0x7fef9001b120 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1f368640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f10044cf0 0x7f8f1017c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1f368640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f10045370 0x7f8f100d5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1f368640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f10045780 0x7f8f100cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1f368640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8f10007380 con 0x7f8f10045370 2024-09-17T06:06:23.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1f368640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1004bc00 con 0x7f8f10044cf0 2024-09-17T06:06:23.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1f368640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8f101788c0 con 0x7f8f10045780 2024-09-17T06:06:23.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1c903640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f10045370 0x7f8f100d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1c903640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f10045370 0x7f8f100d5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45068/0 (socket says 172.21.15.122:45068) 2024-09-17T06:06:23.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1c903640 1 -- 172.21.15.122:0/559802196 learned_addr learned my addr 172.21.15.122:0/559802196 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:23.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1d104640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f10044cf0 0x7f8f1017c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1d905640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f10045780 0x7f8f100cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1c903640 1 -- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f10045780 msgr2=0x7f8f100cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1c903640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f10045780 0x7f8f100cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1c903640 1 -- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f10044cf0 msgr2=0x7f8f1017c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1c903640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f10044cf0 0x7f8f1017c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.300+0000 7f8f1c903640 1 -- 172.21.15.122:0/559802196 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f100d1260 con 0x7f8f10045370 2024-09-17T06:06:23.304 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8f1c903640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f10045370 0x7f8f100d5a70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800e7d0 tx=0x7f8f0800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8173fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f816c005c10 0x7f816c0c1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8173fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f816c046890 0x7f816c0d8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8173fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f816c04b410 0x7f816c0d91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8173fff640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f816c046ca0 con 0x7f816c046890 2024-09-17T06:06:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8173fff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f816c046370 con 0x7f816c005c10 2024-09-17T06:06:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8173fff640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f816c04c610 con 0x7f816c04b410 2024-09-17T06:06:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f81727fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f816c046890 0x7f816c0d8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f81727fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f816c046890 0x7f816c0d8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45078/0 (socket says 172.21.15.122:45078) 2024-09-17T06:06:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f81727fc640 1 -- 172.21.15.122:0/42313478 learned_addr learned my addr 172.21.15.122:0/42313478 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8172ffd640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f816c005c10 0x7f816c0c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f81737fe640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f816c04b410 0x7f816c0d91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7fefa17fa640 1 -- 172.21.15.122:0/3287270088 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fef9801f020 con 0x7fef9c045b00 2024-09-17T06:06:23.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f81727fc640 1 -- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f816c04b410 msgr2=0x7f816c0d91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f81727fc640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f816c04b410 0x7f816c0d91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f81727fc640 1 -- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f816c005c10 msgr2=0x7f816c0c1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f81727fc640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f816c005c10 0x7f816c0c1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f81727fc640 1 -- 172.21.15.122:0/42313478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816c0da670 con 0x7f816c046890 2024-09-17T06:06:23.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8f0dffb640 1 -- 172.21.15.122:0/559802196 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0800ccc0 con 0x7f8f10045370 2024-09-17T06:06:23.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f9fdd59a640 1 -- 172.21.15.122:0/1457418097 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0009730 con 0x7f9fc4004810 2024-09-17T06:06:23.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8f1f368640 1 -- 172.21.15.122:0/559802196 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f100d3000 con 0x7f8f10045370 2024-09-17T06:06:23.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8f0dffb640 1 -- 172.21.15.122:0/559802196 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f08010430 con 0x7f8f10045370 2024-09-17T06:06:23.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8f0dffb640 1 -- 172.21.15.122:0/559802196 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08010860 con 0x7f8f10045370 2024-09-17T06:06:23.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f8f1f368640 1 -- 172.21.15.122:0/559802196 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1017bc50 con 0x7f8f10045370 2024-09-17T06:06:23.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.304+0000 7f81727fc640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f816c046890 0x7f816c0d8c60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f816800b390 tx=0x7f816800b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.308+0000 7f8f1f368640 1 -- 172.21.15.122:0/559802196 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f100d2d70 con 0x7f8f10045370 2024-09-17T06:06:23.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.308+0000 7f8f0dffb640 1 -- 172.21.15.122:0/559802196 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8f08010a00 con 0x7f8f10045370 2024-09-17T06:06:23.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.308+0000 7f8f0dffb640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8f04073380 0x7f8f04075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.308+0000 7f8f0dffb640 1 -- 172.21.15.122:0/559802196 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f8f08095060 con 0x7f8f10045370 2024-09-17T06:06:23.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.308+0000 7f815b7fe640 1 -- 172.21.15.122:0/42313478 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8168015030 con 0x7f816c046890 2024-09-17T06:06:23.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.308+0000 7f815b7fe640 1 -- 172.21.15.122:0/42313478 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8168004020 con 0x7f816c046890 2024-09-17T06:06:23.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.308+0000 7f8173fff640 1 -- 172.21.15.122:0/42313478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816c0d7c10 con 0x7f816c046890 2024-09-17T06:06:23.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.308+0000 7f815b7fe640 1 -- 172.21.15.122:0/42313478 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8168004450 con 0x7f816c046890 2024-09-17T06:06:23.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.308+0000 7f8f1d104640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8f04073380 0x7f8f04075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.308+0000 7f8f1d104640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8f04073380 0x7f8f04075890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8f140af000 tx=0x7f8f140a8040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.308+0000 7f8173fff640 1 -- 172.21.15.122:0/42313478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f816c0cb8f0 con 0x7f816c046890 2024-09-17T06:06:23.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.308+0000 7f8173fff640 1 -- 172.21.15.122:0/42313478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f816c0d8770 con 0x7f816c046890 2024-09-17T06:06:23.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.312+0000 7f9fe0800640 1 -- 172.21.15.122:0/1457418097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc4004810 msgr2=0x7f9fc4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.312+0000 7f9fe0800640 1 --2- 172.21.15.122:0/1457418097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc4004810 0x7f9fc4004c20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009b60 tx=0x7f9fd001d290 comp rx=0 tx=0).stop 2024-09-17T06:06:23.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.312+0000 7f9fded9d640 1 -- 172.21.15.122:0/1457418097 reap_dead start 2024-09-17T06:06:23.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.312+0000 7f9fe0800640 1 -- 172.21.15.122:0/1457418097 shutdown_connections 2024-09-17T06:06:23.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.312+0000 7f9fe0800640 1 -- 172.21.15.122:0/1457418097 >> 172.21.15.122:0/1457418097 conn(0x7f9fd806d290 msgr2=0x7f9fd806d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.312+0000 7f9fe0800640 1 -- 172.21.15.122:0/1457418097 shutdown_connections 2024-09-17T06:06:23.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.312+0000 7f9fe0800640 1 -- 172.21.15.122:0/1457418097 wait complete. 2024-09-17T06:06:23.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.312+0000 7f9fe0800640 1 Processor -- start 2024-09-17T06:06:23.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.312+0000 7f9fe0800640 1 -- start start 2024-09-17T06:06:23.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fe0800640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fd81e0810 0x7f9fd8153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fe0800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fd8154720 0x7f9fd8153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fe0800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fd81540d0 0x7f9fd82014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fe0800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd80c8d10 con 0x7f9fd8154720 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fe0800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd80c7390 con 0x7f9fd81540d0 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fe0800640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd80c8e90 con 0x7f9fd81e0810 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fddd9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fd8154720 0x7f9fd8153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fddd9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fd8154720 0x7f9fd8153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45084/0 (socket says 172.21.15.122:45084) 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fddd9b640 1 -- 172.21.15.122:0/3151045574 learned_addr learned my addr 172.21.15.122:0/3151045574 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fde59c640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fd81e0810 0x7f9fd8153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fded9d640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fd81540d0 0x7f9fd82014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fddd9b640 1 -- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fd81e0810 msgr2=0x7f9fd8153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fddd9b640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fd81e0810 0x7f9fd8153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fddd9b640 1 -- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fd81540d0 msgr2=0x7f9fd82014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fddd9b640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fd81540d0 0x7f9fd82014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fddd9b640 1 -- 172.21.15.122:0/3151045574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd8153740 con 0x7f9fd8154720 2024-09-17T06:06:23.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f9fddd9b640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fd8154720 0x7f9fd8153b90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00af040 tx=0x7f9fd0005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.316+0000 7f8f0dffb640 1 -- 172.21.15.122:0/559802196 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8f0805f570 con 0x7f8f10045370 2024-09-17T06:06:23.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.320+0000 7f815b7fe640 1 -- 172.21.15.122:0/42313478 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8168018070 con 0x7f816c046890 2024-09-17T06:06:23.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.320+0000 7f815b7fe640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8160073280 0x7f8160075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.320+0000 7f815b7fe640 1 -- 172.21.15.122:0/42313478 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f816805acf0 con 0x7f816c046890 2024-09-17T06:06:23.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.320+0000 7f8172ffd640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8160073280 0x7f8160075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.320+0000 7f9fcaffd640 1 -- 172.21.15.122:0/3151045574 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00b1040 con 0x7f9fd8154720 2024-09-17T06:06:23.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.320+0000 7f9fcaffd640 1 -- 172.21.15.122:0/3151045574 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fd00bb070 con 0x7f9fd8154720 2024-09-17T06:06:23.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.320+0000 7f9fcaffd640 1 -- 172.21.15.122:0/3151045574 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0004290 con 0x7f9fd8154720 2024-09-17T06:06:23.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.324+0000 7f9fe0800640 1 -- 172.21.15.122:0/3151045574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd81dd9a0 con 0x7f9fd8154720 2024-09-17T06:06:23.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.324+0000 7f9fe0800640 1 -- 172.21.15.122:0/3151045574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd81e3cf0 con 0x7f9fd8154720 2024-09-17T06:06:23.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.324+0000 7f9fe0800640 1 -- 172.21.15.122:0/3151045574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd80c7cc0 con 0x7f9fd8154720 2024-09-17T06:06:23.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.324+0000 7f8172ffd640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8160073280 0x7f8160075790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8174066790 tx=0x7f8174074040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.328+0000 7f4843252640 1 -- 172.21.15.122:0/3794562043 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c0c2110 msgr2=0x7f483c0c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.328+0000 7f4843252640 1 --2- 172.21.15.122:0/3794562043 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c0c2110 0x7f483c0c7af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4828009870 tx=0x7f482801c8a0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.328+0000 7f4843252640 1 -- 172.21.15.122:0/3794562043 shutdown_connections 2024-09-17T06:06:23.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.328+0000 7f4843252640 1 --2- 172.21.15.122:0/3794562043 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c0c2110 0x7f483c0c7af0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.328+0000 7f4843252640 1 -- 172.21.15.122:0/3794562043 >> 172.21.15.122:0/3794562043 conn(0x7f483c0cd4f0 msgr2=0x7f483c0cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.328+0000 7f4843252640 1 -- 172.21.15.122:0/3794562043 shutdown_connections 2024-09-17T06:06:23.329 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.328+0000 7f4843252640 1 -- 172.21.15.122:0/3794562043 wait complete. 2024-09-17T06:06:23.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.328+0000 7f4843252640 1 Processor -- start 2024-09-17T06:06:23.331 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.328+0000 7f4843252640 1 -- start start 2024-09-17T06:06:23.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f4843252640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c0c2110 0x7f483c14c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f4843252640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f483c0c8030 0x7f483c0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f483bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f483c0c8030 0x7f483c0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f483bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f483c0c8030 0x7f483c0c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45096/0 (socket says 172.21.15.122:45096) 2024-09-17T06:06:23.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f483bfff640 1 -- 172.21.15.122:0/2244584174 learned_addr learned my addr 172.21.15.122:0/2244584174 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:23.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f4843252640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f483c151ad0 0x7f483c0c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f483c1585c0 con 0x7f483c0c8030 2024-09-17T06:06:23.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f483c158440 con 0x7f483c151ad0 2024-09-17T06:06:23.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f483c1650a0 con 0x7f483c0c2110 2024-09-17T06:06:23.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f4840fee640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c0c2110 0x7f483c14c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f483bfff640 1 -- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c0c2110 msgr2=0x7f483c14c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f483bfff640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c0c2110 0x7f483c14c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f483bfff640 1 -- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f483c151ad0 msgr2=0x7f483c0c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f483bfff640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f483c151ad0 0x7f483c0c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f483bfff640 1 -- 172.21.15.122:0/2244584174 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c150f60 con 0x7f483c0c8030 2024-09-17T06:06:23.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f483bfff640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f483c0c8030 0x7f483c0c6dc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f483000c430 tx=0x7f483000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.332+0000 7f815b7fe640 1 -- 172.21.15.122:0/42313478 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f816801f070 con 0x7f816c046890 2024-09-17T06:06:23.335 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f48397fa640 1 -- 172.21.15.122:0/2244584174 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830011790 con 0x7f483c0c8030 2024-09-17T06:06:23.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483c153320 con 0x7f483c0c8030 2024-09-17T06:06:23.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f483c153040 con 0x7f483c0c8030 2024-09-17T06:06:23.336 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f483c0b1200 con 0x7f483c0c8030 2024-09-17T06:06:23.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f9fcaffd640 1 -- 172.21.15.122:0/3151045574 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9fd00046d0 con 0x7f9fd8154720 2024-09-17T06:06:23.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f9fcaffd640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9fc40777e0 0x7f9fc4079cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.337 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f9fcaffd640 1 -- 172.21.15.122:0/3151045574 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f9fd0130110 con 0x7f9fd8154720 2024-09-17T06:06:23.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f409eaa0640 1 -- 172.21.15.122:0/1904362576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40980c2dd0 msgr2=0x7f40980c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f409eaa0640 1 --2- 172.21.15.122:0/1904362576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40980c2dd0 0x7f40980c9200 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4090009bc0 tx=0x7f409001cb30 comp rx=0 tx=0).stop 2024-09-17T06:06:23.338 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f9fde59c640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9fc40777e0 0x7f9fc4079cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f409eaa0640 1 -- 172.21.15.122:0/1904362576 shutdown_connections 2024-09-17T06:06:23.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f409eaa0640 1 --2- 172.21.15.122:0/1904362576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40980c2dd0 0x7f40980c9200 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f409eaa0640 1 -- 172.21.15.122:0/1904362576 >> 172.21.15.122:0/1904362576 conn(0x7f40980ca380 msgr2=0x7f40980ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f409eaa0640 1 -- 172.21.15.122:0/1904362576 shutdown_connections 2024-09-17T06:06:23.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f9fde59c640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9fc40777e0 0x7f9fc4079cf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc006700 tx=0x7f9fcc001130 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.339 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.336+0000 7f409eaa0640 1 -- 172.21.15.122:0/1904362576 wait complete. 2024-09-17T06:06:23.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.340+0000 7f48397fa640 1 -- 172.21.15.122:0/2244584174 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4830017070 con 0x7f483c0c8030 2024-09-17T06:06:23.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.340+0000 7f48397fa640 1 -- 172.21.15.122:0/2244584174 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830011ca0 con 0x7f483c0c8030 2024-09-17T06:06:23.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.340+0000 7f409eaa0640 1 Processor -- start 2024-09-17T06:06:23.341 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.340+0000 7f409eaa0640 1 -- start start 2024-09-17T06:06:23.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.340+0000 7f409eaa0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40980c29c0 0x7f4098146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.344+0000 7f409eaa0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40980c2dd0 0x7f4098145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.344+0000 7f409c83c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40980c29c0 0x7f4098146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.344+0000 7f409c83c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40980c29c0 0x7f4098146520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.122:45968/0 (socket says 172.21.15.122:45968) 2024-09-17T06:06:23.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.344+0000 7f409c83c640 1 -- 172.21.15.122:0/2226117715 learned_addr learned my addr 172.21.15.122:0/2226117715 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:23.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.344+0000 7f4097fff640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40980c2dd0 0x7f4098145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.344+0000 7f409eaa0640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4098158150 0x7f409814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.344+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f409806ff60 con 0x7f40980c2dd0 2024-09-17T06:06:23.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.344+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40980728c0 con 0x7f40980c29c0 2024-09-17T06:06:23.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.344+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f40981f8fc0 con 0x7f4098158150 2024-09-17T06:06:23.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.344+0000 7f409d03d640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4098158150 0x7f409814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.344+0000 7f9fcaffd640 1 -- 172.21.15.122:0/3151045574 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9fd8153740 con 0x7f9fd8154720 2024-09-17T06:06:23.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.344+0000 7f48397fa640 1 -- 172.21.15.122:0/2244584174 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f483001c460 con 0x7f483c0c8030 2024-09-17T06:06:23.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.348+0000 7f48397fa640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4820073200 0x7f4820075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.348+0000 7f48397fa640 1 -- 172.21.15.122:0/2244584174 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f4830094e80 con 0x7f483c0c8030 2024-09-17T06:06:23.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.348+0000 7f4840fee640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4820073200 0x7f4820075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.348+0000 7f4840fee640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4820073200 0x7f4820075710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f48280af000 tx=0x7f482801b0e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f48397fa640 1 -- 172.21.15.122:0/2244584174 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f483c0b1200 con 0x7f483c0c8030 2024-09-17T06:06:23.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f409c83c640 1 -- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4098158150 msgr2=0x7f409814fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f409c83c640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4098158150 0x7f409814fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f409c83c640 1 -- 172.21.15.122:0/2226117715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40980c2dd0 msgr2=0x7f4098145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f409c83c640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40980c2dd0 0x7f4098145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f409c83c640 1 -- 172.21.15.122:0/2226117715 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40981f8200 con 0x7f40980c29c0 2024-09-17T06:06:23.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f409d03d640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4098158150 0x7f409814fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:23.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f409c83c640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40980c29c0 0x7f4098146520 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f408400c450 tx=0x7f408400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f40957fa640 1 -- 172.21.15.122:0/2226117715 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084017070 con 0x7f40980c29c0 2024-09-17T06:06:23.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40981f84e0 con 0x7f40980c29c0 2024-09-17T06:06:23.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40981f8aa0 con 0x7f40980c29c0 2024-09-17T06:06:23.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f40957fa640 1 -- 172.21.15.122:0/2226117715 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40840053c0 con 0x7f40980c29c0 2024-09-17T06:06:23.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.352+0000 7f40957fa640 1 -- 172.21.15.122:0/2226117715 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084003860 con 0x7f40980c29c0 2024-09-17T06:06:23.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.356+0000 7f40957fa640 1 -- 172.21.15.122:0/2226117715 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f408401a070 con 0x7f40980c29c0 2024-09-17T06:06:23.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.356+0000 7f40957fa640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f407c073200 0x7f407c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:23.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.356+0000 7f40957fa640 1 -- 172.21.15.122:0/2226117715 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f40840938f0 con 0x7f40980c29c0 2024-09-17T06:06:23.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.356+0000 7f4097fff640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f407c073200 0x7f407c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:23.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.356+0000 7f4097fff640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f407c073200 0x7f407c075710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f409814fc00 tx=0x7f408c007ea0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:23.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.360+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40780052a0 con 0x7f40980c29c0 2024-09-17T06:06:23.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.376+0000 7f40957fa640 1 -- 172.21.15.122:0/2226117715 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f408405df20 con 0x7f40980c29c0 2024-09-17T06:06:23.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.628+0000 7f1d4c217640 1 -- 172.21.15.122:0/3357873980 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1d2c005590 con 0x7f1d4414bf40 2024-09-17T06:06:23.630 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.628+0000 7f1d3a7fc640 1 -- 172.21.15.122:0/3357873980 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1d4415b5b0 con 0x7f1d4414bf40 2024-09-17T06:06:23.633 INFO:teuthology.orchestra.run.smithi122.stdout:64424509472 2024-09-17T06:06:23.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f1d27fff640 1 -- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d28073230 msgr2=0x7f1d28075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f1d27fff640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d28073230 0x7f1d28075740 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0af000 tx=0x7f1d3c01c1f0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f1d27fff640 1 -- 172.21.15.122:0/3357873980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d4414bf40 msgr2=0x7f1d441564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f1d27fff640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d4414bf40 0x7f1d441564f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400e6d0 tx=0x7f1d3400eb90 comp rx=0 tx=0).stop 2024-09-17T06:06:23.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f1d27fff640 1 -- 172.21.15.122:0/3357873980 shutdown_connections 2024-09-17T06:06:23.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f1d27fff640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d44156a30 0x7f1d4415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f1d27fff640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d28073230 0x7f1d28075740 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f1d27fff640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d4414c350 0x7f1d4415ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f1d27fff640 1 --2- 172.21.15.122:0/3357873980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d4414bf40 0x7f1d441564f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f1d27fff640 1 -- 172.21.15.122:0/3357873980 >> 172.21.15.122:0/3357873980 conn(0x7f1d4406d290 msgr2=0x7f1d4406d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f1d27fff640 1 -- 172.21.15.122:0/3357873980 shutdown_connections 2024-09-17T06:06:23.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f1d27fff640 1 -- 172.21.15.122:0/3357873980 wait complete. 2024-09-17T06:06:23.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f27937fe640 1 -- 172.21.15.122:0/825527230 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f27a80327f0 con 0x7f27a804c190 2024-09-17T06:06:23.639 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.636+0000 7f27a5ffb640 1 -- 172.21.15.122:0/825527230 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f27ac0fd510 con 0x7f27a804c190 2024-09-17T06:06:23.642 INFO:teuthology.orchestra.run.smithi122.stdout:64424509473 2024-09-17T06:06:23.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.640+0000 7f8f1f368640 1 -- 172.21.15.122:0/559802196 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8f1017ba60 con 0x7f8f10045370 2024-09-17T06:06:23.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.640+0000 7f27b6708640 1 -- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2794073230 msgr2=0x7f2794075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.640+0000 7f27b6708640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2794073230 0x7f2794075740 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f27a000b810 tx=0x7f27a0008040 comp rx=0 tx=0).stop 2024-09-17T06:06:23.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f27b6708640 1 -- 172.21.15.122:0/825527230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a804c190 msgr2=0x7f27a80f1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f27b6708640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a804c190 0x7f27a80f1ff0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f27ac01e870 tx=0x7f27ac0b0400 comp rx=0 tx=0).stop 2024-09-17T06:06:23.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f27b6708640 1 -- 172.21.15.122:0/825527230 shutdown_connections 2024-09-17T06:06:23.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f27b6708640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2794073230 0x7f2794075740 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f27b6708640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a80f6a00 0x7f27a80eda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f27b6708640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a804c190 0x7f27a80f1ff0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f27b6708640 1 --2- 172.21.15.122:0/825527230 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27a8045810 0x7f27a8197bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f27b6708640 1 -- 172.21.15.122:0/825527230 >> 172.21.15.122:0/825527230 conn(0x7f27a804fe40 msgr2=0x7f27a8050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f0dffb640 1 -- 172.21.15.122:0/559802196 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8f08063fa0 con 0x7f8f10045370 2024-09-17T06:06:23.645 INFO:teuthology.orchestra.run.smithi122.stdout:274877906949 2024-09-17T06:06:23.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f27b6708640 1 -- 172.21.15.122:0/825527230 shutdown_connections 2024-09-17T06:06:23.646 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f27b6708640 1 -- 172.21.15.122:0/825527230 wait complete. 2024-09-17T06:06:23.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f1f368640 1 -- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8f04073380 msgr2=0x7f8f04075890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f1f368640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8f04073380 0x7f8f04075890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8f140af000 tx=0x7f8f140a8040 comp rx=0 tx=0).stop 2024-09-17T06:06:23.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f1f368640 1 -- 172.21.15.122:0/559802196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f10045370 msgr2=0x7f8f100d5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f1f368640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f10045370 0x7f8f100d5a70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800e7d0 tx=0x7f8f0800ec90 comp rx=0 tx=0).stop 2024-09-17T06:06:23.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f1f368640 1 -- 172.21.15.122:0/559802196 shutdown_connections 2024-09-17T06:06:23.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f1f368640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f10045780 0x7f8f100cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f1f368640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f10045370 0x7f8f100d5a70 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f1f368640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8f04073380 0x7f8f04075890 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f1f368640 1 --2- 172.21.15.122:0/559802196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f10044cf0 0x7f8f1017c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f1f368640 1 -- 172.21.15.122:0/559802196 >> 172.21.15.122:0/559802196 conn(0x7f8f1004fe70 msgr2=0x7f8f100049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f1f368640 1 -- 172.21.15.122:0/559802196 shutdown_connections 2024-09-17T06:06:23.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.644+0000 7f8f1f368640 1 -- 172.21.15.122:0/559802196 wait complete. 2024-09-17T06:06:23.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.648+0000 7fefa9808640 1 -- 172.21.15.122:0/3287270088 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fef9c0332e0 con 0x7fef9c045b00 2024-09-17T06:06:23.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.648+0000 7fefa17fa640 1 -- 172.21.15.122:0/3287270088 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fef9800d040 con 0x7fef9c045b00 2024-09-17T06:06:23.653 INFO:teuthology.orchestra.run.smithi122.stdout:64424509473 2024-09-17T06:06:23.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.656+0000 7fef8effd640 1 -- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fef88073200 msgr2=0x7fef88075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.656+0000 7fef8effd640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fef88073200 0x7fef88075710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fef900ae000 tx=0x7fef9001b120 comp rx=0 tx=0).stop 2024-09-17T06:06:23.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.656+0000 7fef8effd640 1 -- 172.21.15.122:0/3287270088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef9c045b00 msgr2=0x7fef9c048ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.656+0000 7fef8effd640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef9c045b00 0x7fef9c048ca0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fef9800b440 tx=0x7fef9800b900 comp rx=0 tx=0).stop 2024-09-17T06:06:23.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.656+0000 7fef8effd640 1 -- 172.21.15.122:0/3287270088 shutdown_connections 2024-09-17T06:06:23.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.656+0000 7fef8effd640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fef88073200 0x7fef88075710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.656+0000 7fef8effd640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef9c0dafe0 0x7fef9c0d7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.656+0000 7fef8effd640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef9c0468e0 0x7fef9c0d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.656+0000 7fef8effd640 1 --2- 172.21.15.122:0/3287270088 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef9c045b00 0x7fef9c048ca0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.657 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.656+0000 7fef8effd640 1 -- 172.21.15.122:0/3287270088 >> 172.21.15.122:0/3287270088 conn(0x7fef9c0506e0 msgr2=0x7fef9c0da590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.656+0000 7fef8effd640 1 -- 172.21.15.122:0/3287270088 shutdown_connections 2024-09-17T06:06:23.658 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.656+0000 7fef8effd640 1 -- 172.21.15.122:0/3287270088 wait complete. 2024-09-17T06:06:23.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509474 got 64424509472 for osd.3 2024-09-17T06:06:23.679 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.676+0000 7f8173fff640 1 -- 172.21.15.122:0/42313478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f816c044da0 con 0x7f816c046890 2024-09-17T06:06:23.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f815b7fe640 1 -- 172.21.15.122:0/42313478 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f816805f180 con 0x7f816c046890 2024-09-17T06:06:23.680 INFO:teuthology.orchestra.run.smithi122.stdout:64424509473 2024-09-17T06:06:23.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509473 for osd.2 2024-09-17T06:06:23.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 274877906950 got 274877906949 for osd.4 2024-09-17T06:06:23.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f8173fff640 1 -- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8160073280 msgr2=0x7f8160075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f8173fff640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8160073280 0x7f8160075790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8174066790 tx=0x7f8174074040 comp rx=0 tx=0).stop 2024-09-17T06:06:23.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f8173fff640 1 -- 172.21.15.122:0/42313478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f816c046890 msgr2=0x7f816c0d8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f8173fff640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f816c046890 0x7f816c0d8c60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f816800b390 tx=0x7f816800b850 comp rx=0 tx=0).stop 2024-09-17T06:06:23.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f8173fff640 1 -- 172.21.15.122:0/42313478 shutdown_connections 2024-09-17T06:06:23.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f8173fff640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f816c04b410 0x7f816c0d91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f8173fff640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f816c046890 0x7f816c0d8c60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f8173fff640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8160073280 0x7f8160075790 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f8173fff640 1 --2- 172.21.15.122:0/42313478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f816c005c10 0x7f816c0c1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f8173fff640 1 -- 172.21.15.122:0/42313478 >> 172.21.15.122:0/42313478 conn(0x7f816c04fe40 msgr2=0x7f816c006950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f8173fff640 1 -- 172.21.15.122:0/42313478 shutdown_connections 2024-09-17T06:06:23.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.680+0000 7f8173fff640 1 -- 172.21.15.122:0/42313478 wait complete. 2024-09-17T06:06:23.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509473 for osd.7 2024-09-17T06:06:23.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.692+0000 7f9fe0800640 1 -- 172.21.15.122:0/3151045574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9fd8154ca0 con 0x7f9fd8154720 2024-09-17T06:06:23.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.692+0000 7f9fcaffd640 1 -- 172.21.15.122:0/3151045574 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9fd0016fa0 con 0x7f9fd8154720 2024-09-17T06:06:23.694 INFO:teuthology.orchestra.run.smithi122.stdout:64424509471 2024-09-17T06:06:23.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f483c0c8530 con 0x7f483c0c8030 2024-09-17T06:06:23.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f48397fa640 1 -- 172.21.15.122:0/2244584174 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f483005fb60 con 0x7f483c0c8030 2024-09-17T06:06:23.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f9fe0800640 1 -- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9fc40777e0 msgr2=0x7f9fc4079cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f9fe0800640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9fc40777e0 0x7f9fc4079cf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc006700 tx=0x7f9fcc001130 comp rx=0 tx=0).stop 2024-09-17T06:06:23.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f9fe0800640 1 -- 172.21.15.122:0/3151045574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fd8154720 msgr2=0x7f9fd8153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f9fe0800640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fd8154720 0x7f9fd8153b90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00af040 tx=0x7f9fd0005590 comp rx=0 tx=0).stop 2024-09-17T06:06:23.697 INFO:teuthology.orchestra.run.smithi122.stdout:64424509473 2024-09-17T06:06:23.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f9fe0800640 1 -- 172.21.15.122:0/3151045574 shutdown_connections 2024-09-17T06:06:23.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f9fe0800640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9fc40777e0 0x7f9fc4079cf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f9fe0800640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fd81540d0 0x7f9fd82014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f9fe0800640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fd8154720 0x7f9fd8153b90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f9fe0800640 1 --2- 172.21.15.122:0/3151045574 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fd81e0810 0x7f9fd8153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f9fe0800640 1 -- 172.21.15.122:0/3151045574 >> 172.21.15.122:0/3151045574 conn(0x7f9fd806d290 msgr2=0x7f9fd81506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f9fe0800640 1 -- 172.21.15.122:0/3151045574 shutdown_connections 2024-09-17T06:06:23.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.696+0000 7f9fe0800640 1 -- 172.21.15.122:0/3151045574 wait complete. 2024-09-17T06:06:23.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4820073200 msgr2=0x7f4820075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f4843252640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4820073200 0x7f4820075710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f48280af000 tx=0x7f482801b0e0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f483c0c8030 msgr2=0x7f483c0c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f4843252640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f483c0c8030 0x7f483c0c6dc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f483000c430 tx=0x7f483000c8f0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 shutdown_connections 2024-09-17T06:06:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f4843252640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4820073200 0x7f4820075710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f4843252640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f483c151ad0 0x7f483c0c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f4843252640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f483c0c8030 0x7f483c0c6dc0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f4843252640 1 --2- 172.21.15.122:0/2244584174 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f483c0c2110 0x7f483c14c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 >> 172.21.15.122:0/2244584174 conn(0x7f483c0cd4f0 msgr2=0x7f483c14cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 shutdown_connections 2024-09-17T06:06:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f4843252640 1 -- 172.21.15.122:0/2244584174 wait complete. 2024-09-17T06:06:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4078005590 con 0x7f40980c29c0 2024-09-17T06:06:23.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f40957fa640 1 -- 172.21.15.122:0/2226117715 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4084062950 con 0x7f40980c29c0 2024-09-17T06:06:23.702 INFO:teuthology.orchestra.run.smithi122.stdout:60129542176 2024-09-17T06:06:23.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f407c073200 msgr2=0x7f407c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f407c073200 0x7f407c075710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f409814fc00 tx=0x7f408c007ea0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40980c29c0 msgr2=0x7f4098146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:23.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40980c29c0 0x7f4098146520 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f408400c450 tx=0x7f408400c910 comp rx=0 tx=0).stop 2024-09-17T06:06:23.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 shutdown_connections 2024-09-17T06:06:23.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4098158150 0x7f409814fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40980c2dd0 0x7f4098145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f407c073200 0x7f407c075710 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 --2- 172.21.15.122:0/2226117715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40980c29c0 0x7f4098146520 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:23.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 >> 172.21.15.122:0/2226117715 conn(0x7f40980ca380 msgr2=0x7f4098148630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:23.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 shutdown_connections 2024-09-17T06:06:23.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:23.700+0000 7f409eaa0640 1 -- 172.21.15.122:0/2226117715 wait complete. 2024-09-17T06:06:23.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509473 for osd.1 2024-09-17T06:06:23.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509473 for osd.0 2024-09-17T06:06:23.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509473 got 64424509471 for osd.6 2024-09-17T06:06:23.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542176 for osd.5 2024-09-17T06:06:24.670 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T06:06:24.681 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T06:06:24.684 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T06:06:24.685 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T06:06:24.706 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T06:06:24.723 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T06:06:24.729 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T06:06:24.732 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T06:06:24.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.904+0000 7f1d22bb4640 1 -- 172.21.15.122:0/439568936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c075290 msgr2=0x7f1d1c0c4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.904+0000 7f1d22bb4640 1 --2- 172.21.15.122:0/439568936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c075290 0x7f1d1c0c4300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009840 tx=0x7f1d0c01c7b0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.904+0000 7f1d22bb4640 1 -- 172.21.15.122:0/439568936 shutdown_connections 2024-09-17T06:06:24.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.904+0000 7f1d22bb4640 1 --2- 172.21.15.122:0/439568936 >> v2:172.21.15.173:3300/0 conn(0x7f1d1c15b1a0 0x7f1d1c0cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.904+0000 7f1d22bb4640 1 --2- 172.21.15.122:0/439568936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c075290 0x7f1d1c0c4300 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.904+0000 7f1d22bb4640 1 -- 172.21.15.122:0/439568936 >> 172.21.15.122:0/439568936 conn(0x7f1d1c06d290 msgr2=0x7f1d1c06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:24.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.904+0000 7f1d22bb4640 1 -- 172.21.15.122:0/439568936 shutdown_connections 2024-09-17T06:06:24.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.904+0000 7f1d22bb4640 1 -- 172.21.15.122:0/439568936 wait complete. 2024-09-17T06:06:24.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.908+0000 7f1d22bb4640 1 Processor -- start 2024-09-17T06:06:24.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.908+0000 7f1d22bb4640 1 -- start start 2024-09-17T06:06:24.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d22bb4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d1c0c6f60 0x7f1d1c1f9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d22bb4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c15b1a0 0x7f1d1c14d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d22bb4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d1c14b510 0x7f1d1c14b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d22bb4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c168340 con 0x7f1d1c14b510 2024-09-17T06:06:24.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d22bb4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c0c6990 con 0x7f1d1c0c6f60 2024-09-17T06:06:24.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d21151640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d1c14b510 0x7f1d1c14b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d20950640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d1c0c6f60 0x7f1d1c1f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d21151640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d1c14b510 0x7f1d1c14b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54536/0 (socket says 172.21.15.122:54536) 2024-09-17T06:06:24.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d21151640 1 -- 172.21.15.122:0/2580307686 learned_addr learned my addr 172.21.15.122:0/2580307686 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:24.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d1bfff640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c15b1a0 0x7f1d1c14d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d22bb4640 1 -- 172.21.15.122:0/2580307686 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1d1c1684c0 con 0x7f1d1c15b1a0 2024-09-17T06:06:24.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d21151640 1 -- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c15b1a0 msgr2=0x7f1d1c14d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d21151640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c15b1a0 0x7f1d1c14d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d21151640 1 -- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d1c0c6f60 msgr2=0x7f1d1c1f9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d21151640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d1c0c6f60 0x7f1d1c1f9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d21151640 1 -- 172.21.15.122:0/2580307686 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c15ef20 con 0x7f1d1c14b510 2024-09-17T06:06:24.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.912+0000 7f1d21151640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d1c14b510 0x7f1d1c14b920 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400e9d0 tx=0x7f1d1400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:24.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.916+0000 7f1d197fa640 1 -- 172.21.15.122:0/2580307686 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400cde0 con 0x7f1d1c14b510 2024-09-17T06:06:24.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.916+0000 7f1d197fa640 1 -- 172.21.15.122:0/2580307686 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d14004c20 con 0x7f1d1c14b510 2024-09-17T06:06:24.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.916+0000 7f1d22bb4640 1 -- 172.21.15.122:0/2580307686 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1c14caa0 con 0x7f1d1c14b510 2024-09-17T06:06:24.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.916+0000 7f1d22bb4640 1 -- 172.21.15.122:0/2580307686 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1c1f8c60 con 0x7f1d1c14b510 2024-09-17T06:06:24.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.916+0000 7f1d22bb4640 1 -- 172.21.15.122:0/2580307686 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d1c1f99a0 con 0x7f1d1c14b510 2024-09-17T06:06:24.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.920+0000 7f1d197fa640 1 -- 172.21.15.122:0/2580307686 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14005020 con 0x7f1d1c14b510 2024-09-17T06:06:24.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.920+0000 7f1d197fa640 1 -- 172.21.15.122:0/2580307686 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1d14005280 con 0x7f1d1c14b510 2024-09-17T06:06:24.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.920+0000 7f1d197fa640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d040737a0 0x7f1d04075cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.920+0000 7f1d197fa640 1 -- 172.21.15.122:0/2580307686 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f1d14095300 con 0x7f1d1c14b510 2024-09-17T06:06:24.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.920+0000 7f1d20950640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d040737a0 0x7f1d04075cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.920+0000 7f1d20950640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d040737a0 0x7f1d04075cb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0ae000 tx=0x7f1d0c01aff0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:24.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.928+0000 7f1d197fa640 1 -- 172.21.15.122:0/2580307686 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1d1c1f99a0 con 0x7f1d1c14b510 2024-09-17T06:06:24.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.936+0000 7f675d090640 1 -- 172.21.15.122:0/2862371501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6748005160 msgr2=0x7f674800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.936+0000 7f675d090640 1 --2- 172.21.15.122:0/2862371501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6748005160 0x7f674800b9d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f67580668e0 tx=0x7f6758099b20 comp rx=0 tx=0).stop 2024-09-17T06:06:24.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.936+0000 7f8194b4c640 1 -- 172.21.15.122:0/766083383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8190157cd0 msgr2=0x7f8190072710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.936+0000 7f8194b4c640 1 --2- 172.21.15.122:0/766083383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8190157cd0 0x7f8190072710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f818800afd0 tx=0x7f818801d910 comp rx=0 tx=0).stop 2024-09-17T06:06:24.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.936+0000 7f8194b4c640 1 -- 172.21.15.122:0/766083383 shutdown_connections 2024-09-17T06:06:24.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.936+0000 7f8194b4c640 1 --2- 172.21.15.122:0/766083383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8190157cd0 0x7f8190072710 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.936+0000 7f8194b4c640 1 --2- 172.21.15.122:0/766083383 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81900c4550 0x7f81900721d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.936+0000 7f8194b4c640 1 -- 172.21.15.122:0/766083383 >> 172.21.15.122:0/766083383 conn(0x7f8190070000 msgr2=0x7f8190070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:24.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.936+0000 7f675c88f640 1 -- 172.21.15.122:0/2862371501 reap_dead start 2024-09-17T06:06:24.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.936+0000 7f8194b4c640 1 -- 172.21.15.122:0/766083383 shutdown_connections 2024-09-17T06:06:24.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7f675d090640 1 -- 172.21.15.122:0/2862371501 shutdown_connections 2024-09-17T06:06:24.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7f675d090640 1 -- 172.21.15.122:0/2862371501 >> 172.21.15.122:0/2862371501 conn(0x7f675004fe40 msgr2=0x7f6750050250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:24.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7f8194b4c640 1 -- 172.21.15.122:0/766083383 wait complete. 2024-09-17T06:06:24.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7f8194b4c640 1 Processor -- start 2024-09-17T06:06:24.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7f675d090640 1 -- 172.21.15.122:0/2862371501 shutdown_connections 2024-09-17T06:06:24.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7faa0fcc3640 1 -- 172.21.15.122:0/2016845345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9f4003ab0 msgr2=0x7fa9f4003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7faa0fcc3640 1 --2- 172.21.15.122:0/2016845345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9f4003ab0 0x7fa9f4003f00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faa0400a9b0 tx=0x7faa0401c8b0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7faa0e260640 1 -- 172.21.15.122:0/2016845345 reap_dead start 2024-09-17T06:06:24.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7faa0fcc3640 1 -- 172.21.15.122:0/2016845345 shutdown_connections 2024-09-17T06:06:24.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7faa0fcc3640 1 -- 172.21.15.122:0/2016845345 >> 172.21.15.122:0/2016845345 conn(0x7faa0806d290 msgr2=0x7faa0806d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:24.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7faa0fcc3640 1 -- 172.21.15.122:0/2016845345 shutdown_connections 2024-09-17T06:06:24.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7faa0fcc3640 1 -- 172.21.15.122:0/2016845345 wait complete. 2024-09-17T06:06:24.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.940+0000 7f675d090640 1 -- 172.21.15.122:0/2862371501 wait complete. 2024-09-17T06:06:24.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7f675d090640 1 Processor -- start 2024-09-17T06:06:24.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0fcc3640 1 Processor -- start 2024-09-17T06:06:24.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7f675d090640 1 -- start start 2024-09-17T06:06:24.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0fcc3640 1 -- start start 2024-09-17T06:06:24.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0fcc3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9f4003ab0 0x7faa0814b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0da5f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9f4003ab0 0x7faa0814b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0da5f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9f4003ab0 0x7faa0814b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54566/0 (socket says 172.21.15.122:54566) 2024-09-17T06:06:24.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0da5f640 1 -- 172.21.15.122:0/3321383931 learned_addr learned my addr 172.21.15.122:0/3321383931 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:24.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0fcc3640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa08157d30 0x7faa0814c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0fcc3640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa08150e50 0x7faa08149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faa080c7f10 con 0x7fa9f4003ab0 2024-09-17T06:06:24.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faa080c83e0 con 0x7faa08157d30 2024-09-17T06:06:24.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7faa080c6990 con 0x7faa08150e50 2024-09-17T06:06:24.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0d25e640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa08157d30 0x7faa0814c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.944+0000 7faa0e260640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa08150e50 0x7faa08149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.949 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f675d090640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67500eeb10 0x7f67500d3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f8194b4c640 1 -- start start 2024-09-17T06:06:24.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7faa0da5f640 1 -- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa08150e50 msgr2=0x7faa08149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7faa0da5f640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa08150e50 0x7faa08149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7faa0da5f640 1 -- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa08157d30 msgr2=0x7faa0814c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7faa0da5f640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa08157d30 0x7faa0814c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7faa0da5f640 1 -- 172.21.15.122:0/3321383931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0814ba40 con 0x7fa9f4003ab0 2024-09-17T06:06:24.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7faa0da5f640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9f4003ab0 0x7faa0814b500 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faa040af040 tx=0x7faa040a5e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:24.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f8194b4c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81900c4550 0x7f81901586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7fcb3117f640 1 -- 172.21.15.122:0/4173028431 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0ae440 con 0x7fcb2c14dd90 2024-09-17T06:06:24.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f675d090640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67500d3b60 0x7f67500d2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f675d090640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67500d29d0 0x7f6750184e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7fcb33183640 1 -- 172.21.15.122:0/4173028431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c14dd90 msgr2=0x7fcb2c0ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7fcb33183640 1 --2- 172.21.15.122:0/4173028431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c14dd90 0x7fcb2c0ccb10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c074110 tx=0x7fcb1c01db30 comp rx=0 tx=0).stop 2024-09-17T06:06:24.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f67577fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67500d3b60 0x7f67500d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f67577fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67500d3b60 0x7f67500d2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54576/0 (socket says 172.21.15.122:54576) 2024-09-17T06:06:24.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f67577fe640 1 -- 172.21.15.122:0/3744728795 learned_addr learned my addr 172.21.15.122:0/3744728795 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:24.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f6757fff640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67500eeb10 0x7f67500d3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6750046810 con 0x7f67500d3b60 2024-09-17T06:06:24.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f67500334a0 con 0x7f67500d29d0 2024-09-17T06:06:24.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f818f7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81900c4550 0x7f81901586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f818f7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81900c4550 0x7f81901586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.122:36422/0 (socket says 172.21.15.122:36422) 2024-09-17T06:06:24.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f675c88f640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67500d29d0 0x7f6750184e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f67500d3f70 con 0x7f67500eeb10 2024-09-17T06:06:24.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f818f7fe640 1 -- 172.21.15.122:0/4045693461 learned_addr learned my addr 172.21.15.122:0/4045693461 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:24.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f8194b4c640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819014dd50 0x7f8190140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f8194b4c640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8190157cd0 0x7f81901494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f818effd640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819014dd50 0x7f8190140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f81900c9e10 con 0x7f819014dd50 2024-09-17T06:06:24.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8190151740 con 0x7f8190157cd0 2024-09-17T06:06:24.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f81900c9f90 con 0x7f81900c4550 2024-09-17T06:06:24.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f67577fe640 1 -- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67500eeb10 msgr2=0x7f67500d3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f67577fe640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67500eeb10 0x7f67500d3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f67577fe640 1 -- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67500d29d0 msgr2=0x7f6750184e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f67577fe640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67500d29d0 0x7f6750184e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.948+0000 7f67577fe640 1 -- 172.21.15.122:0/3744728795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67500461b0 con 0x7f67500d3b60 2024-09-17T06:06:24.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7fcb33183640 1 -- 172.21.15.122:0/4173028431 shutdown_connections 2024-09-17T06:06:24.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7fcb33183640 1 --2- 172.21.15.122:0/4173028431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c14dd90 0x7fcb2c0ccb10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7fcb33183640 1 --2- 172.21.15.122:0/4173028431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb2c074e70 0x7fcb2c0c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7fcb33183640 1 -- 172.21.15.122:0/4173028431 >> 172.21.15.122:0/4173028431 conn(0x7fcb2c071c60 msgr2=0x7fcb2c072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:24.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7fcb33183640 1 -- 172.21.15.122:0/4173028431 shutdown_connections 2024-09-17T06:06:24.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f818ffff640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8190157cd0 0x7f81901494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f818effd640 1 -- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81900c4550 msgr2=0x7f81901586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f818effd640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81900c4550 0x7f81901586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f818effd640 1 -- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8190157cd0 msgr2=0x7f81901494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f818effd640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8190157cd0 0x7f81901494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f818effd640 1 -- 172.21.15.122:0/4045693461 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8190158c10 con 0x7f819014dd50 2024-09-17T06:06:24.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f818ffff640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8190157cd0 0x7f81901494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:06:24.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f67577fe640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67500d3b60 0x7f67500d2490 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f674c003f20 tx=0x7f674c0017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:24.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f818effd640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819014dd50 0x7f8190140460 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f818400c3c0 tx=0x7f818400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:24.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f6754ff9640 1 -- 172.21.15.122:0/3744728795 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c015070 con 0x7f67500d3b60 2024-09-17T06:06:24.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6750045780 con 0x7f67500d3b60 2024-09-17T06:06:24.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67500d41a0 con 0x7f67500d3b60 2024-09-17T06:06:24.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f8177fff640 1 -- 172.21.15.122:0/4045693461 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8184017070 con 0x7f819014dd50 2024-09-17T06:06:24.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f8177fff640 1 -- 172.21.15.122:0/4045693461 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81840053c0 con 0x7f819014dd50 2024-09-17T06:06:24.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f8177fff640 1 -- 172.21.15.122:0/4045693461 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8184003860 con 0x7f819014dd50 2024-09-17T06:06:24.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81901455c0 con 0x7f819014dd50 2024-09-17T06:06:24.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8190202320 con 0x7f819014dd50 2024-09-17T06:06:24.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7fcb33183640 1 -- 172.21.15.122:0/4173028431 wait complete. 2024-09-17T06:06:24.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f6754ff9640 1 -- 172.21.15.122:0/3744728795 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f674c011900 con 0x7f67500d3b60 2024-09-17T06:06:24.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f6754ff9640 1 -- 172.21.15.122:0/3744728795 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c011d50 con 0x7f67500d3b60 2024-09-17T06:06:24.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67380052a0 con 0x7f67500d3b60 2024-09-17T06:06:24.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8190159c20 con 0x7f819014dd50 2024-09-17T06:06:24.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7f6754ff9640 1 -- 172.21.15.122:0/3744728795 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f674c018070 con 0x7f67500d3b60 2024-09-17T06:06:24.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.952+0000 7fcb33183640 1 Processor -- start 2024-09-17T06:06:24.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7f6754ff9640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f673c073200 0x7f673c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7f6754ff9640 1 -- 172.21.15.122:0/3744728795 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f674c0953c0 con 0x7f67500d3b60 2024-09-17T06:06:24.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7f6757fff640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f673c073200 0x7f673c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fa9fe7fc640 1 -- 172.21.15.122:0/3321383931 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04005c80 con 0x7fa9f4003ab0 2024-09-17T06:06:24.963 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7f6757fff640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f673c073200 0x7f673c075710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6750050520 tx=0x7f6744001ba0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:24.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa08157a80 con 0x7fa9f4003ab0 2024-09-17T06:06:24.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa08158600 con 0x7fa9f4003ab0 2024-09-17T06:06:24.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fa9fe7fc640 1 -- 172.21.15.122:0/3321383931 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa040be070 con 0x7fa9f4003ab0 2024-09-17T06:06:24.964 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fa9fe7fc640 1 -- 172.21.15.122:0/3321383931 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa040b7950 con 0x7fa9f4003ab0 2024-09-17T06:06:24.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7f8177fff640 1 -- 172.21.15.122:0/4045693461 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f818401a070 con 0x7f819014dd50 2024-09-17T06:06:24.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7f8177fff640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f817c073280 0x7f817c075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7f8177fff640 1 -- 172.21.15.122:0/4045693461 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f81840939a0 con 0x7f819014dd50 2024-09-17T06:06:24.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb33183640 1 -- start start 2024-09-17T06:06:24.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb33183640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb2c074e70 0x7fcb2c147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb33183640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb2c0cd050 0x7fcb2c0c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb33183640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c14dd90 0x7fcb2c0c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb33183640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c1517e0 con 0x7fcb2c0cd050 2024-09-17T06:06:24.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb33183640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c0c6770 con 0x7fcb2c14dd90 2024-09-17T06:06:24.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb33183640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2c151960 con 0x7fcb2c074e70 2024-09-17T06:06:24.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f00052a0 con 0x7fa9f4003ab0 2024-09-17T06:06:24.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7f818f7fe640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f817c073280 0x7f817c075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb31980640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb2c0cd050 0x7fcb2c0c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb31980640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb2c0cd050 0x7fcb2c0c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54594/0 (socket says 172.21.15.122:54594) 2024-09-17T06:06:24.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb31980640 1 -- 172.21.15.122:0/1719509811 learned_addr learned my addr 172.21.15.122:0/1719509811 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:24.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb32181640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb2c074e70 0x7fcb2c147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb32982640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c14dd90 0x7fcb2c0c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb31980640 1 -- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb2c074e70 msgr2=0x7fcb2c147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb31980640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb2c074e70 0x7fcb2c147330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb31980640 1 -- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c14dd90 msgr2=0x7fcb2c0c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb31980640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c14dd90 0x7fcb2c0c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.956+0000 7fcb31980640 1 -- 172.21.15.122:0/1719509811 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c153d00 con 0x7fcb2c0cd050 2024-09-17T06:06:24.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.960+0000 7fcb31980640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb2c0cd050 0x7fcb2c0c7e90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c01f140 tx=0x7fcb1c005a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:24.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.960+0000 7f818f7fe640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f817c073280 0x7f817c075790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f81800058d0 tx=0x7f818000a2d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:24.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.964+0000 7f8177fff640 1 -- 172.21.15.122:0/4045693461 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8184021080 con 0x7f819014dd50 2024-09-17T06:06:24.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.968+0000 7fa9fe7fc640 1 -- 172.21.15.122:0/3321383931 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faa040b7af0 con 0x7fa9f4003ab0 2024-09-17T06:06:24.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.968+0000 7fa9fe7fc640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa9ec073280 0x7fa9ec075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.968+0000 7faa0d25e640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa9ec073280 0x7fa9ec075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.972+0000 7faa0d25e640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa9ec073280 0x7fa9ec075790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8001420 tx=0x7fa9f80069a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:24.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.972+0000 7fcb22ffd640 1 -- 172.21.15.122:0/1719509811 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0b3040 con 0x7fcb2c0cd050 2024-09-17T06:06:24.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.972+0000 7f6754ff9640 1 -- 172.21.15.122:0/3744728795 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f674c05f960 con 0x7f67500d3b60 2024-09-17T06:06:24.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.972+0000 7fcb33183640 1 -- 172.21.15.122:0/1719509811 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2c153a50 con 0x7fcb2c0cd050 2024-09-17T06:06:24.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.972+0000 7fcb33183640 1 -- 172.21.15.122:0/1719509811 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2c1f9ad0 con 0x7fcb2c0cd050 2024-09-17T06:06:24.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.972+0000 7fa9fe7fc640 1 -- 172.21.15.122:0/3321383931 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7faa040f5c80 con 0x7fa9f4003ab0 2024-09-17T06:06:24.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.972+0000 7fcb22ffd640 1 -- 172.21.15.122:0/1719509811 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb1c0046d0 con 0x7fcb2c0cd050 2024-09-17T06:06:24.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.972+0000 7fcb22ffd640 1 -- 172.21.15.122:0/1719509811 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c004aa0 con 0x7fcb2c0cd050 2024-09-17T06:06:24.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.972+0000 7fcb33183640 1 -- 172.21.15.122:0/1719509811 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb140052a0 con 0x7fcb2c0cd050 2024-09-17T06:06:24.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.976+0000 7f1de900e640 1 -- 172.21.15.122:0/636104807 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de00b2070 con 0x7f1de40c5e80 2024-09-17T06:06:24.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.980+0000 7f1dec274640 1 -- 172.21.15.122:0/636104807 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1de40c5e80 msgr2=0x7f1de40cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.980+0000 7f1dec274640 1 --2- 172.21.15.122:0/636104807 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1de40c5e80 0x7f1de40cc1c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009870 tx=0x7f1de001c860 comp rx=0 tx=0).stop 2024-09-17T06:06:24.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.980+0000 7f1dec274640 1 -- 172.21.15.122:0/636104807 shutdown_connections 2024-09-17T06:06:24.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.980+0000 7f1dec274640 1 --2- 172.21.15.122:0/636104807 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1de40c5e80 0x7f1de40cc1c0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009870 tx=0x7f1de001c860 comp rx=0 tx=0).stop 2024-09-17T06:06:24.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.980+0000 7f1dec274640 1 -- 172.21.15.122:0/636104807 >> 172.21.15.122:0/636104807 conn(0x7f1de408d460 msgr2=0x7f1de406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:24.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.980+0000 7f1dec274640 1 -- 172.21.15.122:0/636104807 shutdown_connections 2024-09-17T06:06:24.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.980+0000 7fa9fe7fc640 1 -- 172.21.15.122:0/3321383931 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7faa040165c0 con 0x7fa9f4003ab0 2024-09-17T06:06:24.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.980+0000 7f1dec274640 1 -- 172.21.15.122:0/636104807 wait complete. 2024-09-17T06:06:24.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.980+0000 7f1dec274640 1 Processor -- start 2024-09-17T06:06:24.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.980+0000 7f1dec274640 1 -- start start 2024-09-17T06:06:24.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dec274640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1de41557e0 0x7f1de40ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dec274640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1de415f1b0 0x7f1de40ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dec274640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1de4201100 0x7f1de4201510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7fcb22ffd640 1 -- 172.21.15.122:0/1719509811 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcb1c0bf060 con 0x7fcb2c0cd050 2024-09-17T06:06:24.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dea811640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1de4201100 0x7f1de4201510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.986 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1de980f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1de415f1b0 0x7f1de40ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dea811640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1de4201100 0x7f1de4201510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54616/0 (socket says 172.21.15.122:54616) 2024-09-17T06:06:24.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dea811640 1 -- 172.21.15.122:0/3956945922 learned_addr learned my addr 172.21.15.122:0/3956945922 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:24.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dec274640 1 -- 172.21.15.122:0/3956945922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1de40cb620 con 0x7f1de4201100 2024-09-17T06:06:24.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dec274640 1 -- 172.21.15.122:0/3956945922 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1de40cb4a0 con 0x7f1de415f1b0 2024-09-17T06:06:24.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dec274640 1 -- 172.21.15.122:0/3956945922 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1de4169c70 con 0x7f1de41557e0 2024-09-17T06:06:24.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7fcb22ffd640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcb18073350 0x7fcb18075860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dea811640 1 -- 172.21.15.122:0/3956945922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1de41557e0 msgr2=0x7f1de40ce8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T06:06:24.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dea811640 1 --2- 172.21.15.122:0/3956945922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1de41557e0 0x7f1de40ce8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dea811640 1 -- 172.21.15.122:0/3956945922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1de415f1b0 msgr2=0x7f1de40ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dea811640 1 --2- 172.21.15.122:0/3956945922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1de415f1b0 0x7f1de40ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dea811640 1 -- 172.21.15.122:0/3956945922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de40cee20 con 0x7f1de4201100 2024-09-17T06:06:24.988 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7fcb32181640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcb18073350 0x7fcb18075860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7f1dea811640 1 --2- 172.21.15.122:0/3956945922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1de4201100 0x7f1de4201510 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00cb40 tx=0x7f1ddc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:24.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.984+0000 7fcb22ffd640 1 -- 172.21.15.122:0/1719509811 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7fcb1c12c910 con 0x7fcb2c0cd050 2024-09-17T06:06:24.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7fcb32181640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcb18073350 0x7fcb18075860 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800bb50 tx=0x7fcb2800b2e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:24.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f1ddaffd640 1 -- 172.21.15.122:0/3956945922 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc016020 con 0x7f1de4201100 2024-09-17T06:06:24.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f1dec274640 1 -- 172.21.15.122:0/3956945922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de4152d30 con 0x7f1de4201100 2024-09-17T06:06:24.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f1dec274640 1 -- 172.21.15.122:0/3956945922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de4155f40 con 0x7f1de4201100 2024-09-17T06:06:24.990 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f342c910640 1 -- 172.21.15.122:0/1917989625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34281522c0 msgr2=0x7f3428163960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f342c910640 1 --2- 172.21.15.122:0/1917989625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34281522c0 0x7f3428163960 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3420009bc0 tx=0x7f342001f3d0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f342c910640 1 -- 172.21.15.122:0/1917989625 shutdown_connections 2024-09-17T06:06:24.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f342c910640 1 --2- 172.21.15.122:0/1917989625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34281522c0 0x7f3428163960 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f342c910640 1 -- 172.21.15.122:0/1917989625 >> 172.21.15.122:0/1917989625 conn(0x7f34280cd4f0 msgr2=0x7f34280cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:24.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f342c910640 1 -- 172.21.15.122:0/1917989625 shutdown_connections 2024-09-17T06:06:24.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f342c910640 1 -- 172.21.15.122:0/1917989625 wait complete. 2024-09-17T06:06:24.991 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f1dd8ff9640 1 -- 172.21.15.122:0/3956945922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dcc0052a0 con 0x7f1de4201100 2024-09-17T06:06:24.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f342c910640 1 Processor -- start 2024-09-17T06:06:24.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.988+0000 7f342c910640 1 -- start start 2024-09-17T06:06:24.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342c910640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342806e370 0x7f342814bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342806e370 0x7f342814bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342806e370 0x7f342814bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54630/0 (socket says 172.21.15.122:54630) 2024-09-17T06:06:24.993 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342c910640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34280c26f0 0x7f3428150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342c910640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34281522c0 0x7f3428151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342c910640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3428158810 con 0x7f342806e370 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342c910640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3428158530 con 0x7f34281522c0 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342c910640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3428158af0 con 0x7f34280c26f0 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342659c640 1 -- 172.21.15.122:0/67053080 learned_addr learned my addr 172.21.15.122:0/67053080 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f3425d9b640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34280c26f0 0x7f3428150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342659c640 1 -- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34280c26f0 msgr2=0x7f3428150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342659c640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34280c26f0 0x7f3428150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f3426d9d640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34281522c0 0x7f3428151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342659c640 1 -- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34281522c0 msgr2=0x7f3428151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342659c640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34281522c0 0x7f3428151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342659c640 1 -- 172.21.15.122:0/67053080 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34280cc940 con 0x7f342806e370 2024-09-17T06:06:24.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342659c640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342806e370 0x7f342814bbe0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f341800c460 tx=0x7f341800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:24.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7fcb22ffd640 1 -- 172.21.15.122:0/1719509811 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fcb1c017720 con 0x7fcb2c0cd050 2024-09-17T06:06:24.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f1ddaffd640 1 -- 172.21.15.122:0/3956945922 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ddc00a9f0 con 0x7f1de4201100 2024-09-17T06:06:24.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f1ddaffd640 1 -- 172.21.15.122:0/3956945922 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc00ae20 con 0x7f1de4201100 2024-09-17T06:06:24.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f3416ffd640 1 -- 172.21.15.122:0/67053080 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418016020 con 0x7f342806e370 2024-09-17T06:06:24.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342c910640 1 -- 172.21.15.122:0/67053080 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34280ccc20 con 0x7f342806e370 2024-09-17T06:06:24.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.992+0000 7f342c910640 1 -- 172.21.15.122:0/67053080 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3428070fc0 con 0x7f342806e370 2024-09-17T06:06:24.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.996+0000 7f3416ffd640 1 -- 172.21.15.122:0/67053080 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3418012940 con 0x7f342806e370 2024-09-17T06:06:24.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.996+0000 7f3416ffd640 1 -- 172.21.15.122:0/67053080 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418012d90 con 0x7f342806e370 2024-09-17T06:06:24.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.996+0000 7f1ddaffd640 1 -- 172.21.15.122:0/3956945922 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1ddc019020 con 0x7f1de4201100 2024-09-17T06:06:24.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.996+0000 7f1ddaffd640 1 --2- 172.21.15.122:0/3956945922 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1dc8073230 0x7f1dc8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:24.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.996+0000 7f1ddaffd640 1 -- 172.21.15.122:0/3956945922 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f1ddc094710 con 0x7f1de4201100 2024-09-17T06:06:24.999 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.996+0000 7f1dea010640 1 --2- 172.21.15.122:0/3956945922 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1dc8073230 0x7f1dc8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:24.996+0000 7f1dea010640 1 --2- 172.21.15.122:0/3956945922 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1dc8073230 0x7f1dc8075740 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1de00af000 tx=0x7f1de001b0a0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:25.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.000+0000 7f1ddaffd640 1 -- 172.21.15.122:0/3956945922 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1ddc020030 con 0x7f1de4201100 2024-09-17T06:06:25.003 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.000+0000 7f342c910640 1 -- 172.21.15.122:0/67053080 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f340c0052a0 con 0x7f342806e370 2024-09-17T06:06:25.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.004+0000 7f3416ffd640 1 -- 172.21.15.122:0/67053080 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3418019020 con 0x7f342806e370 2024-09-17T06:06:25.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.004+0000 7f3416ffd640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3408073200 0x7f3408075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.004+0000 7f3416ffd640 1 -- 172.21.15.122:0/67053080 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f3418094650 con 0x7f342806e370 2024-09-17T06:06:25.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.004+0000 7f3425d9b640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3408073200 0x7f3408075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.008+0000 7f3425d9b640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3408073200 0x7f3408075710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f34280c3580 tx=0x7f341c009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:25.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.012+0000 7f3416ffd640 1 -- 172.21.15.122:0/67053080 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3418020030 con 0x7f342806e370 2024-09-17T06:06:25.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.016+0000 7f1729705640 1 -- 172.21.15.122:0/2142023902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17240c6870 msgr2=0x7f17240c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.016+0000 7f1729705640 1 --2- 172.21.15.122:0/2142023902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17240c6870 0x7f17240c4590 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1724073ea0 tx=0x7f171802d970 comp rx=0 tx=0).stop 2024-09-17T06:06:25.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.016+0000 7f1729705640 1 -- 172.21.15.122:0/2142023902 shutdown_connections 2024-09-17T06:06:25.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.016+0000 7f1729705640 1 --2- 172.21.15.122:0/2142023902 >> v2:172.21.15.173:3300/0 conn(0x7f17240cc5d0 0x7f17240cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.016+0000 7f1729705640 1 --2- 172.21.15.122:0/2142023902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17240c6870 0x7f17240c4590 secure :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1724073ea0 tx=0x7f171802d970 comp rx=0 tx=0).stop 2024-09-17T06:06:25.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.016+0000 7f1729705640 1 -- 172.21.15.122:0/2142023902 >> 172.21.15.122:0/2142023902 conn(0x7f1724071cc0 msgr2=0x7f17240720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:25.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.016+0000 7f1729705640 1 -- 172.21.15.122:0/2142023902 shutdown_connections 2024-09-17T06:06:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.016+0000 7f1729705640 1 -- 172.21.15.122:0/2142023902 wait complete. 2024-09-17T06:06:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.016+0000 7f1729705640 1 Processor -- start 2024-09-17T06:06:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.016+0000 7f1729705640 1 -- start start 2024-09-17T06:06:25.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.020+0000 7f1729705640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17240cc5d0 0x7f17241578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.020+0000 7f1729705640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f172415b1e0 0x7f172414a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.020+0000 7f17237fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f172415b1e0 0x7f172414a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.020+0000 7f17237fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f172415b1e0 0x7f172414a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54640/0 (socket says 172.21.15.122:54640) 2024-09-17T06:06:25.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.020+0000 7f17237fe640 1 -- 172.21.15.122:0/137694630 learned_addr learned my addr 172.21.15.122:0/137694630 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:25.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.020+0000 7f1729705640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1724152200 0x7f1724153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.020+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f172415b770 con 0x7f172415b1e0 2024-09-17T06:06:25.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.020+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f172415b5f0 con 0x7f1724152200 2024-09-17T06:06:25.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.020+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f17240c9de0 con 0x7f17240cc5d0 2024-09-17T06:06:25.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.020+0000 7f1728f04640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1724152200 0x7f1724153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.024+0000 7f1723fff640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17240cc5d0 0x7f17241578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.024+0000 7f17237fe640 1 -- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17240cc5d0 msgr2=0x7f17241578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.024+0000 7f17237fe640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17240cc5d0 0x7f17241578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.024+0000 7f17237fe640 1 -- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1724152200 msgr2=0x7f1724153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.024+0000 7f17237fe640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1724152200 0x7f1724153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.024+0000 7f17237fe640 1 -- 172.21.15.122:0/137694630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17241ef5f0 con 0x7f172415b1e0 2024-09-17T06:06:25.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.024+0000 7f17237fe640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f172415b1e0 0x7f172414a3e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f171c00c790 tx=0x7f171c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:25.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.024+0000 7f1720ff9640 1 -- 172.21.15.122:0/137694630 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c003b80 con 0x7f172415b1e0 2024-09-17T06:06:25.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.024+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172414fe20 con 0x7f172415b1e0 2024-09-17T06:06:25.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.024+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1724150b80 con 0x7f172415b1e0 2024-09-17T06:06:25.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.028+0000 7f1720ff9640 1 -- 172.21.15.122:0/137694630 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f171c003d20 con 0x7f172415b1e0 2024-09-17T06:06:25.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.028+0000 7f1720ff9640 1 -- 172.21.15.122:0/137694630 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c00aa50 con 0x7f172415b1e0 2024-09-17T06:06:25.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.028+0000 7f1720ff9640 1 -- 172.21.15.122:0/137694630 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f171c00ac30 con 0x7f172415b1e0 2024-09-17T06:06:25.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.028+0000 7f1720ff9640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1710073300 0x7f1710075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.028+0000 7f1720ff9640 1 -- 172.21.15.122:0/137694630 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f171c0943f0 con 0x7f172415b1e0 2024-09-17T06:06:25.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.028+0000 7f1723fff640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1710073300 0x7f1710075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.028+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17040052a0 con 0x7f172415b1e0 2024-09-17T06:06:25.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.032+0000 7f1723fff640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1710073300 0x7f1710075810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f17180c0000 tx=0x7f171802c1b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:25.042 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.040+0000 7f1720ff9640 1 -- 172.21.15.122:0/137694630 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f171c05ea10 con 0x7f172415b1e0 2024-09-17T06:06:25.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.256+0000 7f1d22bb4640 1 -- 172.21.15.122:0/2580307686 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1d1c1f8a50 con 0x7f1d1c14b510 2024-09-17T06:06:25.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.256+0000 7f1d197fa640 1 -- 172.21.15.122:0/2580307686 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1d1405f9b0 con 0x7f1d1c14b510 2024-09-17T06:06:25.260 INFO:teuthology.orchestra.run.smithi122.stdout:64424509474 2024-09-17T06:06:25.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.260+0000 7f1d02ffd640 1 -- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d040737a0 msgr2=0x7f1d04075cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.260+0000 7f1d02ffd640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d040737a0 0x7f1d04075cb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0ae000 tx=0x7f1d0c01aff0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.260+0000 7f1d02ffd640 1 -- 172.21.15.122:0/2580307686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d1c14b510 msgr2=0x7f1d1c14b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.260+0000 7f1d02ffd640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d1c14b510 0x7f1d1c14b920 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400e9d0 tx=0x7f1d1400ee90 comp rx=0 tx=0).stop 2024-09-17T06:06:25.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.260+0000 7f1d02ffd640 1 -- 172.21.15.122:0/2580307686 shutdown_connections 2024-09-17T06:06:25.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.260+0000 7f1d02ffd640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d1c14b510 0x7f1d1c14b920 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.260+0000 7f1d02ffd640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c15b1a0 0x7f1d1c14d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.260+0000 7f1d02ffd640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d040737a0 0x7f1d04075cb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.260+0000 7f1d02ffd640 1 --2- 172.21.15.122:0/2580307686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d1c0c6f60 0x7f1d1c1f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.260+0000 7f1d02ffd640 1 -- 172.21.15.122:0/2580307686 >> 172.21.15.122:0/2580307686 conn(0x7f1d1c06d290 msgr2=0x7f1d1c0c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:25.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.260+0000 7f1d02ffd640 1 -- 172.21.15.122:0/2580307686 shutdown_connections 2024-09-17T06:06:25.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.260+0000 7f1d02ffd640 1 -- 172.21.15.122:0/2580307686 wait complete. 2024-09-17T06:06:25.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509474 got 64424509474 for osd.3 2024-09-17T06:06:25.290 DEBUG:teuthology.parallel:result is None 2024-09-17T06:06:25.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.308+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8190158310 con 0x7f819014dd50 2024-09-17T06:06:25.310 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.308+0000 7fcb33183640 1 -- 172.21.15.122:0/1719509811 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fcb14005860 con 0x7fcb2c0cd050 2024-09-17T06:06:25.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.312+0000 7f8177fff640 1 -- 172.21.15.122:0/4045693461 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f818405e180 con 0x7f819014dd50 2024-09-17T06:06:25.314 INFO:teuthology.orchestra.run.smithi122.stdout:274877906950 2024-09-17T06:06:25.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.312+0000 7fcb22ffd640 1 -- 172.21.15.122:0/1719509811 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcb1c0f8d30 con 0x7fcb2c0cd050 2024-09-17T06:06:25.314 INFO:teuthology.orchestra.run.smithi122.stdout:64424509475 2024-09-17T06:06:25.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7fcb33183640 1 -- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcb18073350 msgr2=0x7fcb18075860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7fcb33183640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcb18073350 0x7fcb18075860 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800bb50 tx=0x7fcb2800b2e0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7fcb33183640 1 -- 172.21.15.122:0/1719509811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb2c0cd050 msgr2=0x7fcb2c0c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7fcb33183640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb2c0cd050 0x7fcb2c0c7e90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c01f140 tx=0x7fcb1c005a30 comp rx=0 tx=0).stop 2024-09-17T06:06:25.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7fcb33183640 1 -- 172.21.15.122:0/1719509811 shutdown_connections 2024-09-17T06:06:25.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7fcb33183640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcb18073350 0x7fcb18075860 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7fcb33183640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb2c14dd90 0x7fcb2c0c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7fcb33183640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb2c0cd050 0x7fcb2c0c7e90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7fcb33183640 1 --2- 172.21.15.122:0/1719509811 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb2c074e70 0x7fcb2c147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7fcb33183640 1 -- 172.21.15.122:0/1719509811 >> 172.21.15.122:0/1719509811 conn(0x7fcb2c071c60 msgr2=0x7fcb2c14b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:25.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7fcb33183640 1 -- 172.21.15.122:0/1719509811 shutdown_connections 2024-09-17T06:06:25.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7fcb33183640 1 -- 172.21.15.122:0/1719509811 wait complete. 2024-09-17T06:06:25.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6738005590 con 0x7f67500d3b60 2024-09-17T06:06:25.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f6754ff9640 1 -- 172.21.15.122:0/3744728795 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f674c064390 con 0x7f67500d3b60 2024-09-17T06:06:25.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f817c073280 msgr2=0x7f817c075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f8194b4c640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f817c073280 0x7f817c075790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f81800058d0 tx=0x7f818000a2d0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819014dd50 msgr2=0x7f8190140460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f8194b4c640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819014dd50 0x7f8190140460 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f818400c3c0 tx=0x7f818400c880 comp rx=0 tx=0).stop 2024-09-17T06:06:25.319 INFO:teuthology.orchestra.run.smithi122.stdout:64424509475 2024-09-17T06:06:25.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 shutdown_connections 2024-09-17T06:06:25.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f8194b4c640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f817c073280 0x7f817c075790 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f8194b4c640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8190157cd0 0x7f81901494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f8194b4c640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819014dd50 0x7f8190140460 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f8194b4c640 1 --2- 172.21.15.122:0/4045693461 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81900c4550 0x7f81901586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 >> 172.21.15.122:0/4045693461 conn(0x7f8190070000 msgr2=0x7f81900c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:25.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 shutdown_connections 2024-09-17T06:06:25.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.316+0000 7f8194b4c640 1 -- 172.21.15.122:0/4045693461 wait complete. 2024-09-17T06:06:25.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.320+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f673c073200 msgr2=0x7f673c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.320+0000 7f675d090640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f673c073200 0x7f673c075710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6750050520 tx=0x7f6744001ba0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.320+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67500d3b60 msgr2=0x7f67500d2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.320+0000 7f675d090640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67500d3b60 0x7f67500d2490 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f674c003f20 tx=0x7f674c0017e0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.320+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 shutdown_connections 2024-09-17T06:06:25.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.320+0000 7f675d090640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f673c073200 0x7f673c075710 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.320+0000 7f675d090640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67500d29d0 0x7f6750184e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.320+0000 7f675d090640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67500d3b60 0x7f67500d2490 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.320+0000 7f675d090640 1 --2- 172.21.15.122:0/3744728795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67500eeb10 0x7f67500d3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.320+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 >> 172.21.15.122:0/3744728795 conn(0x7f675004fe40 msgr2=0x7f675004a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:25.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.320+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 shutdown_connections 2024-09-17T06:06:25.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.320+0000 7f675d090640 1 -- 172.21.15.122:0/3744728795 wait complete. 2024-09-17T06:06:25.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.328+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa9f0005860 con 0x7fa9f4003ab0 2024-09-17T06:06:25.328 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.328+0000 7fa9fe7fc640 1 -- 172.21.15.122:0/3321383931 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa040fa110 con 0x7fa9f4003ab0 2024-09-17T06:06:25.329 INFO:teuthology.orchestra.run.smithi122.stdout:64424509475 2024-09-17T06:06:25.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.332+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa9ec073280 msgr2=0x7fa9ec075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.332+0000 7faa0fcc3640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa9ec073280 0x7fa9ec075790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8001420 tx=0x7fa9f80069a0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.332+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9f4003ab0 msgr2=0x7faa0814b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.332+0000 7faa0fcc3640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9f4003ab0 0x7faa0814b500 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faa040af040 tx=0x7faa040a5e70 comp rx=0 tx=0).stop 2024-09-17T06:06:25.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.332+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 shutdown_connections 2024-09-17T06:06:25.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.332+0000 7faa0fcc3640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa08150e50 0x7faa08149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.332+0000 7faa0fcc3640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa9ec073280 0x7fa9ec075790 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.332+0000 7faa0fcc3640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa08157d30 0x7faa0814c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.332+0000 7faa0fcc3640 1 --2- 172.21.15.122:0/3321383931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9f4003ab0 0x7faa0814b500 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.332+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 >> 172.21.15.122:0/3321383931 conn(0x7faa0806d290 msgr2=0x7faa080cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:25.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.332+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 shutdown_connections 2024-09-17T06:06:25.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.332+0000 7faa0fcc3640 1 -- 172.21.15.122:0/3321383931 wait complete. 2024-09-17T06:06:25.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 -- 172.21.15.122:0/3956945922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1dcc005860 con 0x7f1de4201100 2024-09-17T06:06:25.340 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1ddaffd640 1 -- 172.21.15.122:0/3956945922 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ddc05f380 con 0x7f1de4201100 2024-09-17T06:06:25.340 INFO:teuthology.orchestra.run.smithi122.stdout:60129542177 2024-09-17T06:06:25.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 -- 172.21.15.122:0/3956945922 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1dc8073230 msgr2=0x7f1dc8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 --2- 172.21.15.122:0/3956945922 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1dc8073230 0x7f1dc8075740 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1de00af000 tx=0x7f1de001b0a0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 -- 172.21.15.122:0/3956945922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1de4201100 msgr2=0x7f1de4201510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 --2- 172.21.15.122:0/3956945922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1de4201100 0x7f1de4201510 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00cb40 tx=0x7f1ddc00cc30 comp rx=0 tx=0).stop 2024-09-17T06:06:25.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 -- 172.21.15.122:0/3956945922 shutdown_connections 2024-09-17T06:06:25.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 --2- 172.21.15.122:0/3956945922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1de4201100 0x7f1de4201510 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 --2- 172.21.15.122:0/3956945922 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1dc8073230 0x7f1dc8075740 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 --2- 172.21.15.122:0/3956945922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1de415f1b0 0x7f1de40ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 --2- 172.21.15.122:0/3956945922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1de41557e0 0x7f1de40ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 -- 172.21.15.122:0/3956945922 >> 172.21.15.122:0/3956945922 conn(0x7f1de408d460 msgr2=0x7f1de406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:25.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 -- 172.21.15.122:0/3956945922 shutdown_connections 2024-09-17T06:06:25.344 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.340+0000 7f1dd8ff9640 1 -- 172.21.15.122:0/3956945922 wait complete. 2024-09-17T06:06:25.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509475 for osd.1 2024-09-17T06:06:25.346 DEBUG:teuthology.parallel:result is None 2024-09-17T06:06:25.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509475 for osd.7 2024-09-17T06:06:25.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 274877906950 got 274877906950 for osd.4 2024-09-17T06:06:25.356 DEBUG:teuthology.parallel:result is None 2024-09-17T06:06:25.356 DEBUG:teuthology.parallel:result is None 2024-09-17T06:06:25.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.360+0000 7f342c910640 1 -- 172.21.15.122:0/67053080 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f340c005860 con 0x7f342806e370 2024-09-17T06:06:25.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.360+0000 7f3416ffd640 1 -- 172.21.15.122:0/67053080 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3428157fd0 con 0x7f342806e370 2024-09-17T06:06:25.361 INFO:teuthology.orchestra.run.smithi122.stdout:64424509475 2024-09-17T06:06:25.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509475 for osd.2 2024-09-17T06:06:25.362 DEBUG:teuthology.parallel:result is None 2024-09-17T06:06:25.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.364+0000 7f342c910640 1 -- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3408073200 msgr2=0x7f3408075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.364+0000 7f342c910640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3408073200 0x7f3408075710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f34280c3580 tx=0x7f341c009040 comp rx=0 tx=0).stop 2024-09-17T06:06:25.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.364+0000 7f342c910640 1 -- 172.21.15.122:0/67053080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342806e370 msgr2=0x7f342814bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.364+0000 7f342c910640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342806e370 0x7f342814bbe0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f341800c460 tx=0x7f341800c920 comp rx=0 tx=0).stop 2024-09-17T06:06:25.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.364+0000 7f342c910640 1 -- 172.21.15.122:0/67053080 shutdown_connections 2024-09-17T06:06:25.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.364+0000 7f342c910640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3408073200 0x7f3408075710 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.364+0000 7f342c910640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34281522c0 0x7f3428151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.364+0000 7f342c910640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34280c26f0 0x7f3428150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.364+0000 7f342c910640 1 --2- 172.21.15.122:0/67053080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f342806e370 0x7f342814bbe0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.364+0000 7f342c910640 1 -- 172.21.15.122:0/67053080 >> 172.21.15.122:0/67053080 conn(0x7f34280cd4f0 msgr2=0x7f342814dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:25.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.364+0000 7f342c910640 1 -- 172.21.15.122:0/67053080 shutdown_connections 2024-09-17T06:06:25.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.364+0000 7f342c910640 1 -- 172.21.15.122:0/67053080 wait complete. 2024-09-17T06:06:25.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542177 for osd.5 2024-09-17T06:06:25.366 DEBUG:teuthology.parallel:result is None 2024-09-17T06:06:25.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1704005590 con 0x7f172415b1e0 2024-09-17T06:06:25.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1720ff9640 1 -- 172.21.15.122:0/137694630 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f171c063440 con 0x7f172415b1e0 2024-09-17T06:06:25.381 INFO:teuthology.orchestra.run.smithi122.stdout:64424509473 2024-09-17T06:06:25.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1710073300 msgr2=0x7f1710075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1710073300 0x7f1710075810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f17180c0000 tx=0x7f171802c1b0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f172415b1e0 msgr2=0x7f172414a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f172415b1e0 0x7f172414a3e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f171c00c790 tx=0x7f171c00cc50 comp rx=0 tx=0).stop 2024-09-17T06:06:25.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 shutdown_connections 2024-09-17T06:06:25.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1710073300 0x7f1710075810 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1724152200 0x7f1724153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f172415b1e0 0x7f172414a3e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 --2- 172.21.15.122:0/137694630 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17240cc5d0 0x7f17241578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 >> 172.21.15.122:0/137694630 conn(0x7f1724071cc0 msgr2=0x7f17240c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:25.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 shutdown_connections 2024-09-17T06:06:25.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.380+0000 7f1729705640 1 -- 172.21.15.122:0/137694630 wait complete. 2024-09-17T06:06:25.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509475 for osd.0 2024-09-17T06:06:25.386 DEBUG:teuthology.parallel:result is None 2024-09-17T06:06:25.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509473 got 64424509473 for osd.6 2024-09-17T06:06:25.401 DEBUG:teuthology.parallel:result is None 2024-09-17T06:06:25.401 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-17T06:06:25.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:06:25.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.580+0000 7fd43b220640 1 -- 172.21.15.122:0/1301845728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd41c004810 msgr2=0x7fd41c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.580+0000 7fd43b220640 1 --2- 172.21.15.122:0/1301845728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd41c004810 0x7fd41c004c20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd434075240 tx=0x7fd42801ee30 comp rx=0 tx=0).stop 2024-09-17T06:06:25.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.580+0000 7fd4397bd640 1 -- 172.21.15.122:0/1301845728 reap_dead start 2024-09-17T06:06:25.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.580+0000 7fd43b220640 1 -- 172.21.15.122:0/1301845728 shutdown_connections 2024-09-17T06:06:25.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.580+0000 7fd43b220640 1 -- 172.21.15.122:0/1301845728 >> 172.21.15.122:0/1301845728 conn(0x7fd434072fe0 msgr2=0x7fd4340733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:25.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.580+0000 7fd43b220640 1 -- 172.21.15.122:0/1301845728 shutdown_connections 2024-09-17T06:06:25.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.580+0000 7fd43b220640 1 -- 172.21.15.122:0/1301845728 wait complete. 2024-09-17T06:06:25.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd43b220640 1 Processor -- start 2024-09-17T06:06:25.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd43b220640 1 -- start start 2024-09-17T06:06:25.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd43b220640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd41c004810 0x7fd4340ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd43b220640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4340cd910 0x7fd4341552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd43b220640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4340b1cd0 0x7fd434147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd43b220640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd4341527c0 con 0x7fd4340cd910 2024-09-17T06:06:25.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd43b220640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd43406f740 con 0x7fd41c004810 2024-09-17T06:06:25.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd43b220640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd4340c8d80 con 0x7fd4340b1cd0 2024-09-17T06:06:25.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd433fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4340cd910 0x7fd4341552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd433fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4340cd910 0x7fd4341552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54662/0 (socket says 172.21.15.122:54662) 2024-09-17T06:06:25.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd433fff640 1 -- 172.21.15.122:0/2668155975 learned_addr learned my addr 172.21.15.122:0/2668155975 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:25.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd4397bd640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4340b1cd0 0x7fd434147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd438fbc640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd41c004810 0x7fd4340ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd433fff640 1 -- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4340b1cd0 msgr2=0x7fd434147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd433fff640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4340b1cd0 0x7fd434147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd433fff640 1 -- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd41c004810 msgr2=0x7fd4340ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd433fff640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd41c004810 0x7fd4340ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd433fff640 1 -- 172.21.15.122:0/2668155975 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4340ce180 con 0x7fd4340cd910 2024-09-17T06:06:25.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd4397bd640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4340b1cd0 0x7fd434147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:06:25.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd433fff640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4340cd910 0x7fd4341552c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd4280b3040 tx=0x7fd4280056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:25.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd4317fa640 1 -- 172.21.15.122:0/2668155975 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4280ad040 con 0x7fd4340cd910 2024-09-17T06:06:25.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd4317fa640 1 -- 172.21.15.122:0/2668155975 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd428010240 con 0x7fd4340cd910 2024-09-17T06:06:25.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd43b220640 1 -- 172.21.15.122:0/2668155975 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4340cc2f0 con 0x7fd4340cd910 2024-09-17T06:06:25.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd4317fa640 1 -- 172.21.15.122:0/2668155975 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428004930 con 0x7fd4340cd910 2024-09-17T06:06:25.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.584+0000 7fd43b220640 1 -- 172.21.15.122:0/2668155975 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4340cc8b0 con 0x7fd4340cd910 2024-09-17T06:06:25.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.588+0000 7fd43b220640 1 -- 172.21.15.122:0/2668155975 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4340cdef0 con 0x7fd4340cd910 2024-09-17T06:06:25.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.588+0000 7fd4317fa640 1 -- 172.21.15.122:0/2668155975 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd428004ad0 con 0x7fd4340cd910 2024-09-17T06:06:25.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.588+0000 7fd4317fa640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd420073230 0x7fd420075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.588+0000 7fd4317fa640 1 -- 172.21.15.122:0/2668155975 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7fd42812f0b0 con 0x7fd4340cd910 2024-09-17T06:06:25.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.588+0000 7fd438fbc640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd420073230 0x7fd420075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.588+0000 7fd438fbc640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd420073230 0x7fd420075740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd424000f90 tx=0x7fd424006ed0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:25.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.592+0000 7fd4317fa640 1 -- 172.21.15.122:0/2668155975 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd428018b40 con 0x7fd4340cd910 2024-09-17T06:06:25.747 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.744+0000 7fd43b220640 1 -- 172.21.15.122:0/2668155975 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4340caa50 con 0x7fd420073230 2024-09-17T06:06:25.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.764+0000 7fd4317fa640 1 -- 172.21.15.122:0/2668155975 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332688 (secure 0 0 0) 0x7fd4340caa50 con 0x7fd420073230 2024-09-17T06:06:25.769 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:06:25.771 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:06:25.771 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.768+0000 7fd43b220640 1 -- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd420073230 msgr2=0x7fd420075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.768+0000 7fd43b220640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd420073230 0x7fd420075740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd424000f90 tx=0x7fd424006ed0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.768+0000 7fd43b220640 1 -- 172.21.15.122:0/2668155975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4340cd910 msgr2=0x7fd4341552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.768+0000 7fd43b220640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4340cd910 0x7fd4341552c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd4280b3040 tx=0x7fd4280056a0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.768+0000 7fd43b220640 1 -- 172.21.15.122:0/2668155975 shutdown_connections 2024-09-17T06:06:25.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.768+0000 7fd43b220640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd4340b1cd0 0x7fd434147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.768+0000 7fd43b220640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4340cd910 0x7fd4341552c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.768+0000 7fd43b220640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd420073230 0x7fd420075740 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.768+0000 7fd43b220640 1 --2- 172.21.15.122:0/2668155975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd41c004810 0x7fd4340ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.768+0000 7fd43b220640 1 -- 172.21.15.122:0/2668155975 >> 172.21.15.122:0/2668155975 conn(0x7fd434072fe0 msgr2=0x7fd43406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:25.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.768+0000 7fd43b220640 1 -- 172.21.15.122:0/2668155975 shutdown_connections 2024-09-17T06:06:25.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.768+0000 7fd43b220640 1 -- 172.21.15.122:0/2668155975 wait complete. 2024-09-17T06:06:25.790 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-17T06:06:25.569528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627667,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":187,"num_write_kb":1697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234232,"kb_used_data":8652,"kb_used_omap":17,"kb_used_meta":225390,"kb_avail":754740488,"statfs":{"total":773094113280,"available":772854259712,"internally_reserved":0,"allocated":8859648,"data_stored":5184857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":230800109},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002756"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500455+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:06:22.500455+0000","last_peered":"2024-09-17T06:06:22.500455+0000","last_clean":"2024-09-17T06:06:22.500455+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:06:22.500455+0000","last_undegraded":"2024-09-17T06:06:22.500455+0000","last_fullsized":"2024-09-17T06:06:22.500455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499776+0000","last_change":"2024-09-17T06:06:14.882867+0000","last_active":"2024-09-17T06:06:22.499776+0000","last_peered":"2024-09-17T06:06:22.499776+0000","last_clean":"2024-09-17T06:06:22.499776+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:06:22.499776+0000","last_undegraded":"2024-09-17T06:06:22.499776+0000","last_fullsized":"2024-09-17T06:06:22.499776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:30.856555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498014+0000","last_change":"2024-09-17T06:06:15.369420+0000","last_active":"2024-09-17T06:06:22.498014+0000","last_peered":"2024-09-17T06:06:22.498014+0000","last_clean":"2024-09-17T06:06:22.498014+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:06:22.498014+0000","last_undegraded":"2024-09-17T06:06:22.498014+0000","last_fullsized":"2024-09-17T06:06:22.498014+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:26.332180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500348+0000","last_change":"2024-09-17T06:06:14.876941+0000","last_active":"2024-09-17T06:06:22.500348+0000","last_peered":"2024-09-17T06:06:22.500348+0000","last_clean":"2024-09-17T06:06:22.500348+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:06:22.500348+0000","last_undegraded":"2024-09-17T06:06:22.500348+0000","last_fullsized":"2024-09-17T06:06:22.500348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:16.802718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500029+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:06:22.500029+0000","last_peered":"2024-09-17T06:06:22.500029+0000","last_clean":"2024-09-17T06:06:22.500029+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:06:22.500029+0000","last_undegraded":"2024-09-17T06:06:22.500029+0000","last_fullsized":"2024-09-17T06:06:22.500029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966721+0000","last_change":"2024-09-17T06:06:02.760496+0000","last_active":"2024-09-17T06:06:21.966721+0000","last_peered":"2024-09-17T06:06:21.966721+0000","last_clean":"2024-09-17T06:06:21.966721+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:06:21.966721+0000","last_undegraded":"2024-09-17T06:06:21.966721+0000","last_fullsized":"2024-09-17T06:06:21.966721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.085087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"60'3","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501464+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:06:22.501464+0000","last_peered":"2024-09-17T06:06:22.501464+0000","last_clean":"2024-09-17T06:06:22.501464+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:06:22.501464+0000","last_undegraded":"2024-09-17T06:06:22.501464+0000","last_fullsized":"2024-09-17T06:06:22.501464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969576+0000","last_change":"2024-09-17T06:06:02.772542+0000","last_active":"2024-09-17T06:06:21.969576+0000","last_peered":"2024-09-17T06:06:21.969576+0000","last_clean":"2024-09-17T06:06:21.969576+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:21.969576+0000","last_undegraded":"2024-09-17T06:06:21.969576+0000","last_fullsized":"2024-09-17T06:06:21.969576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:31.442644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968566+0000","last_change":"2024-09-17T06:06:02.762154+0000","last_active":"2024-09-17T06:06:21.968566+0000","last_peered":"2024-09-17T06:06:21.968566+0000","last_clean":"2024-09-17T06:06:21.968566+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:06:21.968566+0000","last_undegraded":"2024-09-17T06:06:21.968566+0000","last_fullsized":"2024-09-17T06:06:21.968566+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:56.087057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500504+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:06:22.500504+0000","last_peered":"2024-09-17T06:06:22.500504+0000","last_clean":"2024-09-17T06:06:22.500504+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:06:22.500504+0000","last_undegraded":"2024-09-17T06:06:22.500504+0000","last_fullsized":"2024-09-17T06:06:22.500504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499458+0000","last_change":"2024-09-17T06:06:02.747441+0000","last_active":"2024-09-17T06:06:22.499458+0000","last_peered":"2024-09-17T06:06:22.499458+0000","last_clean":"2024-09-17T06:06:22.499458+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:06:22.499458+0000","last_undegraded":"2024-09-17T06:06:22.499458+0000","last_fullsized":"2024-09-17T06:06:22.499458+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:56.535771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968309+0000","last_change":"2024-09-17T06:06:02.760042+0000","last_active":"2024-09-17T06:06:21.968309+0000","last_peered":"2024-09-17T06:06:21.968309+0000","last_clean":"2024-09-17T06:06:21.968309+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:06:21.968309+0000","last_undegraded":"2024-09-17T06:06:21.968309+0000","last_fullsized":"2024-09-17T06:06:21.968309+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:53.866107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501686+0000","last_change":"2024-09-17T06:06:02.772614+0000","last_active":"2024-09-17T06:06:22.501686+0000","last_peered":"2024-09-17T06:06:22.501686+0000","last_clean":"2024-09-17T06:06:22.501686+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:06:22.501686+0000","last_undegraded":"2024-09-17T06:06:22.501686+0000","last_fullsized":"2024-09-17T06:06:22.501686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:56.086542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"60'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501042+0000","last_change":"2024-09-17T06:06:02.763938+0000","last_active":"2024-09-17T06:06:22.501042+0000","last_peered":"2024-09-17T06:06:22.501042+0000","last_clean":"2024-09-17T06:06:22.501042+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:06:22.501042+0000","last_undegraded":"2024-09-17T06:06:22.501042+0000","last_fullsized":"2024-09-17T06:06:22.501042+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:09.262608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969558+0000","last_change":"2024-09-17T06:06:02.764648+0000","last_active":"2024-09-17T06:06:21.969558+0000","last_peered":"2024-09-17T06:06:21.969558+0000","last_clean":"2024-09-17T06:06:21.969558+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:06:21.969558+0000","last_undegraded":"2024-09-17T06:06:21.969558+0000","last_fullsized":"2024-09-17T06:06:21.969558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:56.341325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499778+0000","last_change":"2024-09-17T06:06:14.877208+0000","last_active":"2024-09-17T06:06:22.499778+0000","last_peered":"2024-09-17T06:06:22.499778+0000","last_clean":"2024-09-17T06:06:22.499778+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:06:22.499778+0000","last_undegraded":"2024-09-17T06:06:22.499778+0000","last_fullsized":"2024-09-17T06:06:22.499778+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:16.547077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967926+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:06:21.967926+0000","last_peered":"2024-09-17T06:06:21.967926+0000","last_clean":"2024-09-17T06:06:21.967926+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:06:21.967926+0000","last_undegraded":"2024-09-17T06:06:21.967926+0000","last_fullsized":"2024-09-17T06:06:21.967926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969187+0000","last_change":"2024-09-17T06:06:02.777996+0000","last_active":"2024-09-17T06:06:21.969187+0000","last_peered":"2024-09-17T06:06:21.969187+0000","last_clean":"2024-09-17T06:06:21.969187+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:06:21.969187+0000","last_undegraded":"2024-09-17T06:06:21.969187+0000","last_fullsized":"2024-09-17T06:06:21.969187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:04.148545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498555+0000","last_change":"2024-09-17T06:06:14.859614+0000","last_active":"2024-09-17T06:06:22.498555+0000","last_peered":"2024-09-17T06:06:22.498555+0000","last_clean":"2024-09-17T06:06:22.498555+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:06:22.498555+0000","last_undegraded":"2024-09-17T06:06:22.498555+0000","last_fullsized":"2024-09-17T06:06:22.498555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.132428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966735+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:06:21.966735+0000","last_peered":"2024-09-17T06:06:21.966735+0000","last_clean":"2024-09-17T06:06:21.966735+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:06:21.966735+0000","last_undegraded":"2024-09-17T06:06:21.966735+0000","last_fullsized":"2024-09-17T06:06:21.966735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967279+0000","last_change":"2024-09-17T06:06:02.773038+0000","last_active":"2024-09-17T06:06:21.967279+0000","last_peered":"2024-09-17T06:06:21.967279+0000","last_clean":"2024-09-17T06:06:21.967279+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:06:21.967279+0000","last_undegraded":"2024-09-17T06:06:21.967279+0000","last_fullsized":"2024-09-17T06:06:21.967279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:24.833172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967355+0000","last_change":"2024-09-17T06:06:02.742391+0000","last_active":"2024-09-17T06:06:21.967355+0000","last_peered":"2024-09-17T06:06:21.967355+0000","last_clean":"2024-09-17T06:06:21.967355+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:06:21.967355+0000","last_undegraded":"2024-09-17T06:06:21.967355+0000","last_fullsized":"2024-09-17T06:06:21.967355+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:18.282190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499601+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:06:22.499601+0000","last_peered":"2024-09-17T06:06:22.499601+0000","last_clean":"2024-09-17T06:06:22.499601+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:06:22.499601+0000","last_undegraded":"2024-09-17T06:06:22.499601+0000","last_fullsized":"2024-09-17T06:06:22.499601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.973250+0000","last_change":"2024-09-17T06:06:02.760965+0000","last_active":"2024-09-17T06:06:21.973250+0000","last_peered":"2024-09-17T06:06:21.973250+0000","last_clean":"2024-09-17T06:06:21.973250+0000","last_became_active":"2024-09-17T06:06:02.755335+0000","last_became_peered":"2024-09-17T06:06:02.755335+0000","last_unstale":"2024-09-17T06:06:21.973250+0000","last_undegraded":"2024-09-17T06:06:21.973250+0000","last_fullsized":"2024-09-17T06:06:21.973250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:49.568290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500258+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:06:22.500258+0000","last_peered":"2024-09-17T06:06:22.500258+0000","last_clean":"2024-09-17T06:06:22.500258+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:06:22.500258+0000","last_undegraded":"2024-09-17T06:06:22.500258+0000","last_fullsized":"2024-09-17T06:06:22.500258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"61'3","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503161+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:06:22.503161+0000","last_peered":"2024-09-17T06:06:22.503161+0000","last_clean":"2024-09-17T06:06:22.503161+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:06:22.503161+0000","last_undegraded":"2024-09-17T06:06:22.503161+0000","last_fullsized":"2024-09-17T06:06:22.503161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967557+0000","last_change":"2024-09-17T06:06:02.770140+0000","last_active":"2024-09-17T06:06:21.967557+0000","last_peered":"2024-09-17T06:06:21.967557+0000","last_clean":"2024-09-17T06:06:21.967557+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:06:21.967557+0000","last_undegraded":"2024-09-17T06:06:21.967557+0000","last_fullsized":"2024-09-17T06:06:21.967557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:35.888277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500583+0000","last_change":"2024-09-17T06:06:14.875548+0000","last_active":"2024-09-17T06:06:22.500583+0000","last_peered":"2024-09-17T06:06:22.500583+0000","last_clean":"2024-09-17T06:06:22.500583+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:06:22.500583+0000","last_undegraded":"2024-09-17T06:06:22.500583+0000","last_fullsized":"2024-09-17T06:06:22.500583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:24.521256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967487+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:06:21.967487+0000","last_peered":"2024-09-17T06:06:21.967487+0000","last_clean":"2024-09-17T06:06:21.967487+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:06:21.967487+0000","last_undegraded":"2024-09-17T06:06:21.967487+0000","last_fullsized":"2024-09-17T06:06:21.967487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498066+0000","last_change":"2024-09-17T06:06:14.876736+0000","last_active":"2024-09-17T06:06:22.498066+0000","last_peered":"2024-09-17T06:06:22.498066+0000","last_clean":"2024-09-17T06:06:22.498066+0000","last_became_active":"2024-09-17T06:06:14.875773+0000","last_became_peered":"2024-09-17T06:06:14.875773+0000","last_unstale":"2024-09-17T06:06:22.498066+0000","last_undegraded":"2024-09-17T06:06:22.498066+0000","last_fullsized":"2024-09-17T06:06:22.498066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:52.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968114+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:06:21.968114+0000","last_peered":"2024-09-17T06:06:21.968114+0000","last_clean":"2024-09-17T06:06:21.968114+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:06:21.968114+0000","last_undegraded":"2024-09-17T06:06:21.968114+0000","last_fullsized":"2024-09-17T06:06:21.968114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501976+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:06:22.501976+0000","last_peered":"2024-09-17T06:06:22.501976+0000","last_clean":"2024-09-17T06:06:22.501976+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:06:22.501976+0000","last_undegraded":"2024-09-17T06:06:22.501976+0000","last_fullsized":"2024-09-17T06:06:22.501976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499225+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:06:22.499225+0000","last_peered":"2024-09-17T06:06:22.499225+0000","last_clean":"2024-09-17T06:06:22.499225+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:06:22.499225+0000","last_undegraded":"2024-09-17T06:06:22.499225+0000","last_fullsized":"2024-09-17T06:06:22.499225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970494+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:06:21.970494+0000","last_peered":"2024-09-17T06:06:21.970494+0000","last_clean":"2024-09-17T06:06:21.970494+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:06:21.970494+0000","last_undegraded":"2024-09-17T06:06:21.970494+0000","last_fullsized":"2024-09-17T06:06:21.970494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968198+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:06:21.968198+0000","last_peered":"2024-09-17T06:06:21.968198+0000","last_clean":"2024-09-17T06:06:21.968198+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:06:21.968198+0000","last_undegraded":"2024-09-17T06:06:21.968198+0000","last_fullsized":"2024-09-17T06:06:21.968198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967191+0000","last_change":"2024-09-17T06:06:02.750734+0000","last_active":"2024-09-17T06:06:21.967191+0000","last_peered":"2024-09-17T06:06:21.967191+0000","last_clean":"2024-09-17T06:06:21.967191+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:06:21.967191+0000","last_undegraded":"2024-09-17T06:06:21.967191+0000","last_fullsized":"2024-09-17T06:06:21.967191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:55.436212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968677+0000","last_change":"2024-09-17T06:06:02.780406+0000","last_active":"2024-09-17T06:06:21.968677+0000","last_peered":"2024-09-17T06:06:21.968677+0000","last_clean":"2024-09-17T06:06:21.968677+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:06:21.968677+0000","last_undegraded":"2024-09-17T06:06:21.968677+0000","last_fullsized":"2024-09-17T06:06:21.968677+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:34.785782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971985+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:06:21.971985+0000","last_peered":"2024-09-17T06:06:21.971985+0000","last_clean":"2024-09-17T06:06:21.971985+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:06:21.971985+0000","last_undegraded":"2024-09-17T06:06:21.971985+0000","last_fullsized":"2024-09-17T06:06:21.971985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967920+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:06:21.967920+0000","last_peered":"2024-09-17T06:06:21.967920+0000","last_clean":"2024-09-17T06:06:21.967920+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:06:21.967920+0000","last_undegraded":"2024-09-17T06:06:21.967920+0000","last_fullsized":"2024-09-17T06:06:21.967920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966724+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:06:21.966724+0000","last_peered":"2024-09-17T06:06:21.966724+0000","last_clean":"2024-09-17T06:06:21.966724+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:06:21.966724+0000","last_undegraded":"2024-09-17T06:06:21.966724+0000","last_fullsized":"2024-09-17T06:06:21.966724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"62'4","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498551+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:06:22.498551+0000","last_peered":"2024-09-17T06:06:22.498551+0000","last_clean":"2024-09-17T06:06:22.498551+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:06:22.498551+0000","last_undegraded":"2024-09-17T06:06:22.498551+0000","last_fullsized":"2024-09-17T06:06:22.498551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967511+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:06:21.967511+0000","last_peered":"2024-09-17T06:06:21.967511+0000","last_clean":"2024-09-17T06:06:21.967511+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:06:21.967511+0000","last_undegraded":"2024-09-17T06:06:21.967511+0000","last_fullsized":"2024-09-17T06:06:21.967511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499330+0000","last_change":"2024-09-17T06:06:02.775030+0000","last_active":"2024-09-17T06:06:22.499330+0000","last_peered":"2024-09-17T06:06:22.499330+0000","last_clean":"2024-09-17T06:06:22.499330+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:06:22.499330+0000","last_undegraded":"2024-09-17T06:06:22.499330+0000","last_fullsized":"2024-09-17T06:06:22.499330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:56.086542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499602+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:06:22.499602+0000","last_peered":"2024-09-17T06:06:22.499602+0000","last_clean":"2024-09-17T06:06:22.499602+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:06:22.499602+0000","last_undegraded":"2024-09-17T06:06:22.499602+0000","last_fullsized":"2024-09-17T06:06:22.499602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500801+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:06:22.500801+0000","last_peered":"2024-09-17T06:06:22.500801+0000","last_clean":"2024-09-17T06:06:22.500801+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:06:22.500801+0000","last_undegraded":"2024-09-17T06:06:22.500801+0000","last_fullsized":"2024-09-17T06:06:22.500801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499284+0000","last_change":"2024-09-17T06:06:14.863098+0000","last_active":"2024-09-17T06:06:22.499284+0000","last_peered":"2024-09-17T06:06:22.499284+0000","last_clean":"2024-09-17T06:06:22.499284+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:06:22.499284+0000","last_undegraded":"2024-09-17T06:06:22.499284+0000","last_fullsized":"2024-09-17T06:06:22.499284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:43.199274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969649+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:06:21.969649+0000","last_peered":"2024-09-17T06:06:21.969649+0000","last_clean":"2024-09-17T06:06:21.969649+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:06:21.969649+0000","last_undegraded":"2024-09-17T06:06:21.969649+0000","last_fullsized":"2024-09-17T06:06:21.969649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":229,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503185+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:06:22.503185+0000","last_peered":"2024-09-17T06:06:22.503185+0000","last_clean":"2024-09-17T06:06:22.503185+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:06:22.503185+0000","last_undegraded":"2024-09-17T06:06:22.503185+0000","last_fullsized":"2024-09-17T06:06:22.503185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502700+0000","last_change":"2024-09-17T06:06:02.751844+0000","last_active":"2024-09-17T06:06:22.502700+0000","last_peered":"2024-09-17T06:06:22.502700+0000","last_clean":"2024-09-17T06:06:22.502700+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:06:22.502700+0000","last_undegraded":"2024-09-17T06:06:22.502700+0000","last_fullsized":"2024-09-17T06:06:22.502700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:29.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":115,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499586+0000","last_change":"2024-09-17T06:04:49.135526+0000","last_active":"2024-09-17T06:06:22.499586+0000","last_peered":"2024-09-17T06:06:22.499586+0000","last_clean":"2024-09-17T06:06:22.499586+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:06:22.499586+0000","last_undegraded":"2024-09-17T06:06:22.499586+0000","last_fullsized":"2024-09-17T06:06:22.499586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:45.338884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499366+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:06:22.499366+0000","last_peered":"2024-09-17T06:06:22.499366+0000","last_clean":"2024-09-17T06:06:22.499366+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:06:22.499366+0000","last_undegraded":"2024-09-17T06:06:22.499366+0000","last_fullsized":"2024-09-17T06:06:22.499366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501381+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:06:22.501381+0000","last_peered":"2024-09-17T06:06:22.501381+0000","last_clean":"2024-09-17T06:06:22.501381+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:06:22.501381+0000","last_undegraded":"2024-09-17T06:06:22.501381+0000","last_fullsized":"2024-09-17T06:06:22.501381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969729+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:06:21.969729+0000","last_peered":"2024-09-17T06:06:21.969729+0000","last_clean":"2024-09-17T06:06:21.969729+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:06:21.969729+0000","last_undegraded":"2024-09-17T06:06:21.969729+0000","last_fullsized":"2024-09-17T06:06:21.969729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968279+0000","last_change":"2024-09-17T06:06:02.750773+0000","last_active":"2024-09-17T06:06:21.968279+0000","last_peered":"2024-09-17T06:06:21.968279+0000","last_clean":"2024-09-17T06:06:21.968279+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:06:21.968279+0000","last_undegraded":"2024-09-17T06:06:21.968279+0000","last_fullsized":"2024-09-17T06:06:21.968279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:40.847404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499847+0000","last_change":"2024-09-17T06:06:02.772644+0000","last_active":"2024-09-17T06:06:22.499847+0000","last_peered":"2024-09-17T06:06:22.499847+0000","last_clean":"2024-09-17T06:06:22.499847+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:06:22.499847+0000","last_undegraded":"2024-09-17T06:06:22.499847+0000","last_fullsized":"2024-09-17T06:06:22.499847+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:29.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503650+0000","last_change":"2024-09-17T06:06:02.743237+0000","last_active":"2024-09-17T06:06:22.503650+0000","last_peered":"2024-09-17T06:06:22.503650+0000","last_clean":"2024-09-17T06:06:22.503650+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:06:22.503650+0000","last_undegraded":"2024-09-17T06:06:22.503650+0000","last_fullsized":"2024-09-17T06:06:22.503650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:21.599408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499049+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:06:22.499049+0000","last_peered":"2024-09-17T06:06:22.499049+0000","last_clean":"2024-09-17T06:06:22.499049+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:06:22.499049+0000","last_undegraded":"2024-09-17T06:06:22.499049+0000","last_fullsized":"2024-09-17T06:06:22.499049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970374+0000","last_change":"2024-09-17T06:06:02.749776+0000","last_active":"2024-09-17T06:06:21.970374+0000","last_peered":"2024-09-17T06:06:21.970374+0000","last_clean":"2024-09-17T06:06:21.970374+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:06:21.970374+0000","last_undegraded":"2024-09-17T06:06:21.970374+0000","last_fullsized":"2024-09-17T06:06:21.970374+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:14.070869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501629+0000","last_change":"2024-09-17T06:06:02.743241+0000","last_active":"2024-09-17T06:06:22.501629+0000","last_peered":"2024-09-17T06:06:22.501629+0000","last_clean":"2024-09-17T06:06:22.501629+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:06:22.501629+0000","last_undegraded":"2024-09-17T06:06:22.501629+0000","last_fullsized":"2024-09-17T06:06:22.501629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:24.945633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.972191+0000","last_change":"2024-09-17T06:06:02.747970+0000","last_active":"2024-09-17T06:06:21.972191+0000","last_peered":"2024-09-17T06:06:21.972191+0000","last_clean":"2024-09-17T06:06:21.972191+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:06:21.972191+0000","last_undegraded":"2024-09-17T06:06:21.972191+0000","last_fullsized":"2024-09-17T06:06:21.972191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:01.251626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967658+0000","last_change":"2024-09-17T06:06:02.765641+0000","last_active":"2024-09-17T06:06:21.967658+0000","last_peered":"2024-09-17T06:06:21.967658+0000","last_clean":"2024-09-17T06:06:21.967658+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:06:21.967658+0000","last_undegraded":"2024-09-17T06:06:21.967658+0000","last_fullsized":"2024-09-17T06:06:21.967658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:45.801441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499985+0000","last_change":"2024-09-17T06:06:02.771427+0000","last_active":"2024-09-17T06:06:22.499985+0000","last_peered":"2024-09-17T06:06:22.499985+0000","last_clean":"2024-09-17T06:06:22.499985+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:06:22.499985+0000","last_undegraded":"2024-09-17T06:06:22.499985+0000","last_fullsized":"2024-09-17T06:06:22.499985+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.132428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"62'9","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498339+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:06:22.498339+0000","last_peered":"2024-09-17T06:06:22.498339+0000","last_clean":"2024-09-17T06:06:22.498339+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:06:22.498339+0000","last_undegraded":"2024-09-17T06:06:22.498339+0000","last_fullsized":"2024-09-17T06:06:22.498339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499947+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:06:22.499947+0000","last_peered":"2024-09-17T06:06:22.499947+0000","last_clean":"2024-09-17T06:06:22.499947+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:06:22.499947+0000","last_undegraded":"2024-09-17T06:06:22.499947+0000","last_fullsized":"2024-09-17T06:06:22.499947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500874+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:06:22.500874+0000","last_peered":"2024-09-17T06:06:22.500874+0000","last_clean":"2024-09-17T06:06:22.500874+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:06:22.500874+0000","last_undegraded":"2024-09-17T06:06:22.500874+0000","last_fullsized":"2024-09-17T06:06:22.500874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501556+0000","last_change":"2024-09-17T06:06:02.772623+0000","last_active":"2024-09-17T06:06:22.501556+0000","last_peered":"2024-09-17T06:06:22.501556+0000","last_clean":"2024-09-17T06:06:22.501556+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:22.501556+0000","last_undegraded":"2024-09-17T06:06:22.501556+0000","last_fullsized":"2024-09-17T06:06:22.501556+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:53.767911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500282+0000","last_change":"2024-09-17T06:06:14.883260+0000","last_active":"2024-09-17T06:06:22.500282+0000","last_peered":"2024-09-17T06:06:22.500282+0000","last_clean":"2024-09-17T06:06:22.500282+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:06:22.500282+0000","last_undegraded":"2024-09-17T06:06:22.500282+0000","last_fullsized":"2024-09-17T06:06:22.500282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:01.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500541+0000","last_change":"2024-09-17T06:06:02.767610+0000","last_active":"2024-09-17T06:06:22.500541+0000","last_peered":"2024-09-17T06:06:22.500541+0000","last_clean":"2024-09-17T06:06:22.500541+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:06:22.500541+0000","last_undegraded":"2024-09-17T06:06:22.500541+0000","last_fullsized":"2024-09-17T06:06:22.500541+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:54.779217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971807+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:06:21.971807+0000","last_peered":"2024-09-17T06:06:21.971807+0000","last_clean":"2024-09-17T06:06:21.971807+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:06:21.971807+0000","last_undegraded":"2024-09-17T06:06:21.971807+0000","last_fullsized":"2024-09-17T06:06:21.971807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500284+0000","last_change":"2024-09-17T06:06:15.372083+0000","last_active":"2024-09-17T06:06:22.500284+0000","last_peered":"2024-09-17T06:06:22.500284+0000","last_clean":"2024-09-17T06:06:22.500284+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:06:22.500284+0000","last_undegraded":"2024-09-17T06:06:22.500284+0000","last_fullsized":"2024-09-17T06:06:22.500284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:53.468260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499925+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:06:22.499925+0000","last_peered":"2024-09-17T06:06:22.499925+0000","last_clean":"2024-09-17T06:06:22.499925+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:06:22.499925+0000","last_undegraded":"2024-09-17T06:06:22.499925+0000","last_fullsized":"2024-09-17T06:06:22.499925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499766+0000","last_change":"2024-09-17T06:06:02.772342+0000","last_active":"2024-09-17T06:06:22.499766+0000","last_peered":"2024-09-17T06:06:22.499766+0000","last_clean":"2024-09-17T06:06:22.499766+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:06:22.499766+0000","last_undegraded":"2024-09-17T06:06:22.499766+0000","last_fullsized":"2024-09-17T06:06:22.499766+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:36.591645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970221+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:06:21.970221+0000","last_peered":"2024-09-17T06:06:21.970221+0000","last_clean":"2024-09-17T06:06:21.970221+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:06:21.970221+0000","last_undegraded":"2024-09-17T06:06:21.970221+0000","last_fullsized":"2024-09-17T06:06:21.970221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501138+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:06:22.501138+0000","last_peered":"2024-09-17T06:06:22.501138+0000","last_clean":"2024-09-17T06:06:22.501138+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:06:22.501138+0000","last_undegraded":"2024-09-17T06:06:22.501138+0000","last_fullsized":"2024-09-17T06:06:22.501138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"62'22","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502689+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:06:22.502689+0000","last_peered":"2024-09-17T06:06:22.502689+0000","last_clean":"2024-09-17T06:06:22.502689+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:06:22.502689+0000","last_undegraded":"2024-09-17T06:06:22.502689+0000","last_fullsized":"2024-09-17T06:06:22.502689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36089,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967727+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:06:21.967727+0000","last_peered":"2024-09-17T06:06:21.967727+0000","last_clean":"2024-09-17T06:06:21.967727+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:06:21.967727+0000","last_undegraded":"2024-09-17T06:06:21.967727+0000","last_fullsized":"2024-09-17T06:06:21.967727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968706+0000","last_change":"2024-09-17T06:06:02.778195+0000","last_active":"2024-09-17T06:06:21.968706+0000","last_peered":"2024-09-17T06:06:21.968706+0000","last_clean":"2024-09-17T06:06:21.968706+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:06:21.968706+0000","last_undegraded":"2024-09-17T06:06:21.968706+0000","last_fullsized":"2024-09-17T06:06:21.968706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:41.521760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"62'7","reported_seq":116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970857+0000","last_change":"2024-09-17T06:05:20.635633+0000","last_active":"2024-09-17T06:06:21.970857+0000","last_peered":"2024-09-17T06:06:21.970857+0000","last_clean":"2024-09-17T06:06:21.970857+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:06:21.970857+0000","last_undegraded":"2024-09-17T06:06:21.970857+0000","last_fullsized":"2024-09-17T06:06:21.970857+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:42.262918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968250+0000","last_change":"2024-09-17T06:06:02.762076+0000","last_active":"2024-09-17T06:06:21.968250+0000","last_peered":"2024-09-17T06:06:21.968250+0000","last_clean":"2024-09-17T06:06:21.968250+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:06:21.968250+0000","last_undegraded":"2024-09-17T06:06:21.968250+0000","last_fullsized":"2024-09-17T06:06:21.968250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:12.436619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500283+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:06:22.500283+0000","last_peered":"2024-09-17T06:06:22.500283+0000","last_clean":"2024-09-17T06:06:22.500283+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:06:22.500283+0000","last_undegraded":"2024-09-17T06:06:22.500283+0000","last_fullsized":"2024-09-17T06:06:22.500283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970773+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:06:21.970773+0000","last_peered":"2024-09-17T06:06:21.970773+0000","last_clean":"2024-09-17T06:06:21.970773+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:06:21.970773+0000","last_undegraded":"2024-09-17T06:06:21.970773+0000","last_fullsized":"2024-09-17T06:06:21.970773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498209+0000","last_change":"2024-09-17T06:06:14.879517+0000","last_active":"2024-09-17T06:06:22.498209+0000","last_peered":"2024-09-17T06:06:22.498209+0000","last_clean":"2024-09-17T06:06:22.498209+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:06:22.498209+0000","last_undegraded":"2024-09-17T06:06:22.498209+0000","last_fullsized":"2024-09-17T06:06:22.498209+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:59.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970474+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:06:21.970474+0000","last_peered":"2024-09-17T06:06:21.970474+0000","last_clean":"2024-09-17T06:06:21.970474+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:06:21.970474+0000","last_undegraded":"2024-09-17T06:06:21.970474+0000","last_fullsized":"2024-09-17T06:06:21.970474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502906+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:06:22.502906+0000","last_peered":"2024-09-17T06:06:22.502906+0000","last_clean":"2024-09-17T06:06:22.502906+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:06:22.502906+0000","last_undegraded":"2024-09-17T06:06:22.502906+0000","last_fullsized":"2024-09-17T06:06:22.502906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498392+0000","last_change":"2024-09-17T06:06:14.881955+0000","last_active":"2024-09-17T06:06:22.498392+0000","last_peered":"2024-09-17T06:06:22.498392+0000","last_clean":"2024-09-17T06:06:22.498392+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:06:22.498392+0000","last_undegraded":"2024-09-17T06:06:22.498392+0000","last_fullsized":"2024-09-17T06:06:22.498392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:31.787475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499845+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:06:22.499845+0000","last_peered":"2024-09-17T06:06:22.499845+0000","last_clean":"2024-09-17T06:06:22.499845+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:06:22.499845+0000","last_undegraded":"2024-09-17T06:06:22.499845+0000","last_fullsized":"2024-09-17T06:06:22.499845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966528+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:06:21.966528+0000","last_peered":"2024-09-17T06:06:21.966528+0000","last_clean":"2024-09-17T06:06:21.966528+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:06:21.966528+0000","last_undegraded":"2024-09-17T06:06:21.966528+0000","last_fullsized":"2024-09-17T06:06:21.966528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971203+0000","last_change":"2024-09-17T06:06:02.751465+0000","last_active":"2024-09-17T06:06:21.971203+0000","last_peered":"2024-09-17T06:06:21.971203+0000","last_clean":"2024-09-17T06:06:21.971203+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:06:21.971203+0000","last_undegraded":"2024-09-17T06:06:21.971203+0000","last_fullsized":"2024-09-17T06:06:21.971203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:15.399241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502473+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:06:22.502473+0000","last_peered":"2024-09-17T06:06:22.502473+0000","last_clean":"2024-09-17T06:06:22.502473+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:06:22.502473+0000","last_undegraded":"2024-09-17T06:06:22.502473+0000","last_fullsized":"2024-09-17T06:06:22.502473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498349+0000","last_change":"2024-09-17T06:06:14.876329+0000","last_active":"2024-09-17T06:06:22.498349+0000","last_peered":"2024-09-17T06:06:22.498349+0000","last_clean":"2024-09-17T06:06:22.498349+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:06:22.498349+0000","last_undegraded":"2024-09-17T06:06:22.498349+0000","last_fullsized":"2024-09-17T06:06:22.498349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:44.076246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498558+0000","last_change":"2024-09-17T06:06:14.883367+0000","last_active":"2024-09-17T06:06:22.498558+0000","last_peered":"2024-09-17T06:06:22.498558+0000","last_clean":"2024-09-17T06:06:22.498558+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:06:22.498558+0000","last_undegraded":"2024-09-17T06:06:22.498558+0000","last_fullsized":"2024-09-17T06:06:22.498558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:34.486361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501858+0000","last_change":"2024-09-17T06:06:02.753865+0000","last_active":"2024-09-17T06:06:22.501858+0000","last_peered":"2024-09-17T06:06:22.501858+0000","last_clean":"2024-09-17T06:06:22.501858+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:06:22.501858+0000","last_undegraded":"2024-09-17T06:06:22.501858+0000","last_fullsized":"2024-09-17T06:06:22.501858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:02.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499621+0000","last_change":"2024-09-17T06:06:02.774846+0000","last_active":"2024-09-17T06:06:22.499621+0000","last_peered":"2024-09-17T06:06:22.499621+0000","last_clean":"2024-09-17T06:06:22.499621+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:06:22.499621+0000","last_undegraded":"2024-09-17T06:06:22.499621+0000","last_fullsized":"2024-09-17T06:06:22.499621+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:03.871862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499002+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:06:22.499002+0000","last_peered":"2024-09-17T06:06:22.499002+0000","last_clean":"2024-09-17T06:06:22.499002+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:06:22.499002+0000","last_undegraded":"2024-09-17T06:06:22.499002+0000","last_fullsized":"2024-09-17T06:06:22.499002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499917+0000","last_change":"2024-09-17T06:06:14.874567+0000","last_active":"2024-09-17T06:06:22.499917+0000","last_peered":"2024-09-17T06:06:22.499917+0000","last_clean":"2024-09-17T06:06:22.499917+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:06:22.499917+0000","last_undegraded":"2024-09-17T06:06:22.499917+0000","last_fullsized":"2024-09-17T06:06:22.499917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:16.000785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967382+0000","last_change":"2024-09-17T06:06:02.747397+0000","last_active":"2024-09-17T06:06:21.967382+0000","last_peered":"2024-09-17T06:06:21.967382+0000","last_clean":"2024-09-17T06:06:21.967382+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:06:21.967382+0000","last_undegraded":"2024-09-17T06:06:21.967382+0000","last_fullsized":"2024-09-17T06:06:21.967382+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:35.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500463+0000","last_change":"2024-09-17T06:06:15.371993+0000","last_active":"2024-09-17T06:06:22.500463+0000","last_peered":"2024-09-17T06:06:22.500463+0000","last_clean":"2024-09-17T06:06:22.500463+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:06:22.500463+0000","last_undegraded":"2024-09-17T06:06:22.500463+0000","last_fullsized":"2024-09-17T06:06:22.500463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:36.359097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500526+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:06:22.500526+0000","last_peered":"2024-09-17T06:06:22.500526+0000","last_clean":"2024-09-17T06:06:22.500526+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:06:22.500526+0000","last_undegraded":"2024-09-17T06:06:22.500526+0000","last_fullsized":"2024-09-17T06:06:22.500526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498498+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:06:22.498498+0000","last_peered":"2024-09-17T06:06:22.498498+0000","last_clean":"2024-09-17T06:06:22.498498+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:06:22.498498+0000","last_undegraded":"2024-09-17T06:06:22.498498+0000","last_fullsized":"2024-09-17T06:06:22.498498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971737+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:06:21.971737+0000","last_peered":"2024-09-17T06:06:21.971737+0000","last_clean":"2024-09-17T06:06:21.971737+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:06:21.971737+0000","last_undegraded":"2024-09-17T06:06:21.971737+0000","last_fullsized":"2024-09-17T06:06:21.971737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499487+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:06:22.499487+0000","last_peered":"2024-09-17T06:06:22.499487+0000","last_clean":"2024-09-17T06:06:22.499487+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:06:22.499487+0000","last_undegraded":"2024-09-17T06:06:22.499487+0000","last_fullsized":"2024-09-17T06:06:22.499487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500584+0000","last_change":"2024-09-17T06:06:14.862875+0000","last_active":"2024-09-17T06:06:22.500584+0000","last_peered":"2024-09-17T06:06:22.500584+0000","last_clean":"2024-09-17T06:06:22.500584+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:06:22.500584+0000","last_undegraded":"2024-09-17T06:06:22.500584+0000","last_fullsized":"2024-09-17T06:06:22.500584+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:58.805589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968100+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:06:21.968100+0000","last_peered":"2024-09-17T06:06:21.968100+0000","last_clean":"2024-09-17T06:06:21.968100+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:06:21.968100+0000","last_undegraded":"2024-09-17T06:06:21.968100+0000","last_fullsized":"2024-09-17T06:06:21.968100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503297+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:06:22.503297+0000","last_peered":"2024-09-17T06:06:22.503297+0000","last_clean":"2024-09-17T06:06:22.503297+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:06:22.503297+0000","last_undegraded":"2024-09-17T06:06:22.503297+0000","last_fullsized":"2024-09-17T06:06:22.503297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500454+0000","last_change":"2024-09-17T06:06:14.869993+0000","last_active":"2024-09-17T06:06:22.500454+0000","last_peered":"2024-09-17T06:06:22.500454+0000","last_clean":"2024-09-17T06:06:22.500454+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:06:22.500454+0000","last_undegraded":"2024-09-17T06:06:22.500454+0000","last_fullsized":"2024-09-17T06:06:22.500454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:10.143503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970030+0000","last_change":"2024-09-17T06:05:13.535655+0000","last_active":"2024-09-17T06:06:21.970030+0000","last_peered":"2024-09-17T06:06:21.970030+0000","last_clean":"2024-09-17T06:06:21.970030+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:06:21.970030+0000","last_undegraded":"2024-09-17T06:06:21.970030+0000","last_fullsized":"2024-09-17T06:06:21.970030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:26.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498284+0000","last_change":"2024-09-17T06:06:14.862354+0000","last_active":"2024-09-17T06:06:22.498284+0000","last_peered":"2024-09-17T06:06:22.498284+0000","last_clean":"2024-09-17T06:06:22.498284+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:06:22.498284+0000","last_undegraded":"2024-09-17T06:06:22.498284+0000","last_fullsized":"2024-09-17T06:06:22.498284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:57.348056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971525+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:06:21.971525+0000","last_peered":"2024-09-17T06:06:21.971525+0000","last_clean":"2024-09-17T06:06:21.971525+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:06:21.971525+0000","last_undegraded":"2024-09-17T06:06:21.971525+0000","last_fullsized":"2024-09-17T06:06:21.971525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499344+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:06:22.499344+0000","last_peered":"2024-09-17T06:06:22.499344+0000","last_clean":"2024-09-17T06:06:22.499344+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:06:22.499344+0000","last_undegraded":"2024-09-17T06:06:22.499344+0000","last_fullsized":"2024-09-17T06:06:22.499344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502328+0000","last_change":"2024-09-17T06:06:02.781690+0000","last_active":"2024-09-17T06:06:22.502328+0000","last_peered":"2024-09-17T06:06:22.502328+0000","last_clean":"2024-09-17T06:06:22.502328+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:06:22.502328+0000","last_undegraded":"2024-09-17T06:06:22.502328+0000","last_fullsized":"2024-09-17T06:06:22.502328+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:50.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501757+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:06:22.501757+0000","last_peered":"2024-09-17T06:06:22.501757+0000","last_clean":"2024-09-17T06:06:22.501757+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:06:22.501757+0000","last_undegraded":"2024-09-17T06:06:22.501757+0000","last_fullsized":"2024-09-17T06:06:22.501757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498856+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:06:22.498856+0000","last_peered":"2024-09-17T06:06:22.498856+0000","last_clean":"2024-09-17T06:06:22.498856+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:06:22.498856+0000","last_undegraded":"2024-09-17T06:06:22.498856+0000","last_fullsized":"2024-09-17T06:06:22.498856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971569+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:06:21.971569+0000","last_peered":"2024-09-17T06:06:21.971569+0000","last_clean":"2024-09-17T06:06:21.971569+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:06:21.971569+0000","last_undegraded":"2024-09-17T06:06:21.971569+0000","last_fullsized":"2024-09-17T06:06:21.971569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970919+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:06:21.970919+0000","last_peered":"2024-09-17T06:06:21.970919+0000","last_clean":"2024-09-17T06:06:21.970919+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:06:21.970919+0000","last_undegraded":"2024-09-17T06:06:21.970919+0000","last_fullsized":"2024-09-17T06:06:21.970919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966576+0000","last_change":"2024-09-17T06:06:02.777396+0000","last_active":"2024-09-17T06:06:21.966576+0000","last_peered":"2024-09-17T06:06:21.966576+0000","last_clean":"2024-09-17T06:06:21.966576+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:06:21.966576+0000","last_undegraded":"2024-09-17T06:06:21.966576+0000","last_fullsized":"2024-09-17T06:06:21.966576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:28.787647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"60'1","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499808+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:06:22.499808+0000","last_peered":"2024-09-17T06:06:22.499808+0000","last_clean":"2024-09-17T06:06:22.499808+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:06:22.499808+0000","last_undegraded":"2024-09-17T06:06:22.499808+0000","last_fullsized":"2024-09-17T06:06:22.499808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499641+0000","last_change":"2024-09-17T06:06:14.882860+0000","last_active":"2024-09-17T06:06:22.499641+0000","last_peered":"2024-09-17T06:06:22.499641+0000","last_clean":"2024-09-17T06:06:22.499641+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:06:22.499641+0000","last_undegraded":"2024-09-17T06:06:22.499641+0000","last_fullsized":"2024-09-17T06:06:22.499641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:07.158141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968950+0000","last_change":"2024-09-17T06:06:02.776605+0000","last_active":"2024-09-17T06:06:21.968950+0000","last_peered":"2024-09-17T06:06:21.968950+0000","last_clean":"2024-09-17T06:06:21.968950+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:06:21.968950+0000","last_undegraded":"2024-09-17T06:06:21.968950+0000","last_fullsized":"2024-09-17T06:06:21.968950+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:55.566930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502403+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:06:22.502403+0000","last_peered":"2024-09-17T06:06:22.502403+0000","last_clean":"2024-09-17T06:06:22.502403+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:06:22.502403+0000","last_undegraded":"2024-09-17T06:06:22.502403+0000","last_fullsized":"2024-09-17T06:06:22.502403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503103+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:06:22.503103+0000","last_peered":"2024-09-17T06:06:22.503103+0000","last_clean":"2024-09-17T06:06:22.503103+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:06:22.503103+0000","last_undegraded":"2024-09-17T06:06:22.503103+0000","last_fullsized":"2024-09-17T06:06:22.503103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503661+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:06:22.503661+0000","last_peered":"2024-09-17T06:06:22.503661+0000","last_clean":"2024-09-17T06:06:22.503661+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:06:22.503661+0000","last_undegraded":"2024-09-17T06:06:22.503661+0000","last_fullsized":"2024-09-17T06:06:22.503661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498069+0000","last_change":"2024-09-17T06:06:14.863779+0000","last_active":"2024-09-17T06:06:22.498069+0000","last_peered":"2024-09-17T06:06:22.498069+0000","last_clean":"2024-09-17T06:06:22.498069+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:06:22.498069+0000","last_undegraded":"2024-09-17T06:06:22.498069+0000","last_fullsized":"2024-09-17T06:06:22.498069+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:41.626998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499779+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:06:22.499779+0000","last_peered":"2024-09-17T06:06:22.499779+0000","last_clean":"2024-09-17T06:06:22.499779+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:06:22.499779+0000","last_undegraded":"2024-09-17T06:06:22.499779+0000","last_fullsized":"2024-09-17T06:06:22.499779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971457+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:06:21.971457+0000","last_peered":"2024-09-17T06:06:21.971457+0000","last_clean":"2024-09-17T06:06:21.971457+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:06:21.971457+0000","last_undegraded":"2024-09-17T06:06:21.971457+0000","last_fullsized":"2024-09-17T06:06:21.971457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500165+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:06:22.500165+0000","last_peered":"2024-09-17T06:06:22.500165+0000","last_clean":"2024-09-17T06:06:22.500165+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:06:22.500165+0000","last_undegraded":"2024-09-17T06:06:22.500165+0000","last_fullsized":"2024-09-17T06:06:22.500165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969403+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:06:21.969403+0000","last_peered":"2024-09-17T06:06:21.969403+0000","last_clean":"2024-09-17T06:06:21.969403+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:06:21.969403+0000","last_undegraded":"2024-09-17T06:06:21.969403+0000","last_fullsized":"2024-09-17T06:06:21.969403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499697+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:06:22.499697+0000","last_peered":"2024-09-17T06:06:22.499697+0000","last_clean":"2024-09-17T06:06:22.499697+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:06:22.499697+0000","last_undegraded":"2024-09-17T06:06:22.499697+0000","last_fullsized":"2024-09-17T06:06:22.499697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967340+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:06:21.967340+0000","last_peered":"2024-09-17T06:06:21.967340+0000","last_clean":"2024-09-17T06:06:21.967340+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:06:21.967340+0000","last_undegraded":"2024-09-17T06:06:21.967340+0000","last_fullsized":"2024-09-17T06:06:21.967340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503415+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:06:22.503415+0000","last_peered":"2024-09-17T06:06:22.503415+0000","last_clean":"2024-09-17T06:06:22.503415+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:06:22.503415+0000","last_undegraded":"2024-09-17T06:06:22.503415+0000","last_fullsized":"2024-09-17T06:06:22.503415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37299,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":84,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":74598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":523332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":937984,"data_stored":487243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1556480,"data_stored":1084902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28540,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343300,"statfs":{"total":96636764160,"available":96607539200,"internally_reserved":0,"allocated":1544192,"data_stored":1084756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":522920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906950,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28992,"kb_used_data":936,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342848,"statfs":{"total":96636764160,"available":96607076352,"internally_reserved":0,"allocated":958464,"data_stored":493932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":493876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542177,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":950272,"data_stored":493896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:06:25.796 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:06:25.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.976+0000 7ff5cd96d640 1 -- 172.21.15.122:0/3258565885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5b4003a40 msgr2=0x7ff5b4003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.976+0000 7ff5cd96d640 1 --2- 172.21.15.122:0/3258565885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5b4003a40 0x7ff5b4003eb0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8001dc0 tx=0x7ff5b801cb30 comp rx=0 tx=0).stop 2024-09-17T06:06:25.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.976+0000 7ff5c77fe640 1 -- 172.21.15.122:0/3258565885 reap_dead start 2024-09-17T06:06:25.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.976+0000 7ff5cd96d640 1 -- 172.21.15.122:0/3258565885 shutdown_connections 2024-09-17T06:06:25.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.976+0000 7ff5cd96d640 1 -- 172.21.15.122:0/3258565885 >> 172.21.15.122:0/3258565885 conn(0x7ff5c80726c0 msgr2=0x7ff5c8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:25.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.976+0000 7ff5cd96d640 1 -- 172.21.15.122:0/3258565885 shutdown_connections 2024-09-17T06:06:25.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.976+0000 7ff5cd96d640 1 -- 172.21.15.122:0/3258565885 wait complete. 2024-09-17T06:06:25.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5cd96d640 1 Processor -- start 2024-09-17T06:06:25.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5cd96d640 1 -- start start 2024-09-17T06:06:25.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5cd96d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b4003a40 0x7ff5c80afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.982 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5cd96d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff5c81f1f30 0x7ff5c8148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5cd96d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5c8153590 0x7ff5c80c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5cd96d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c806ce90 con 0x7ff5c8153590 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5cd96d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c8159ac0 con 0x7ff5b4003a40 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5cd96d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff5c80b05e0 con 0x7ff5c81f1f30 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5c77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5c8153590 0x7ff5c80c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5c77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5c8153590 0x7ff5c80c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54676/0 (socket says 172.21.15.122:54676) 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5c77fe640 1 -- 172.21.15.122:0/1886969392 learned_addr learned my addr 172.21.15.122:0/1886969392 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5c77fe640 1 -- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff5c81f1f30 msgr2=0x7ff5c8148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5c67fc640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff5c81f1f30 0x7ff5c8148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5c6ffd640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b4003a40 0x7ff5c80afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5c77fe640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff5c81f1f30 0x7ff5c8148560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5c77fe640 1 -- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b4003a40 msgr2=0x7ff5c80afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5c77fe640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b4003a40 0x7ff5c80afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:25.983 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5c77fe640 1 -- 172.21.15.122:0/1886969392 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c80b0110 con 0x7ff5c8153590 2024-09-17T06:06:25.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5c77fe640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5c8153590 0x7ff5c80c3780 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80c9270 tx=0x7ff5c000f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:25.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5bffff640 1 -- 172.21.15.122:0/1886969392 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0007cb0 con 0x7ff5c8153590 2024-09-17T06:06:25.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5bffff640 1 -- 172.21.15.122:0/1886969392 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5c000a0d0 con 0x7ff5c8153590 2024-09-17T06:06:25.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5cd96d640 1 -- 172.21.15.122:0/1886969392 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c80add20 con 0x7ff5c8153590 2024-09-17T06:06:25.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5bffff640 1 -- 172.21.15.122:0/1886969392 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000a520 con 0x7ff5c8153590 2024-09-17T06:06:25.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5cd96d640 1 -- 172.21.15.122:0/1886969392 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c8146b80 con 0x7ff5c8153590 2024-09-17T06:06:25.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.980+0000 7ff5cd96d640 1 -- 172.21.15.122:0/1886969392 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5c81f2420 con 0x7ff5c8153590 2024-09-17T06:06:25.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.984+0000 7ff5bffff640 1 -- 172.21.15.122:0/1886969392 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff5c0015030 con 0x7ff5c8153590 2024-09-17T06:06:25.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.984+0000 7ff5bffff640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff5a8073200 0x7ff5a8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:25.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.984+0000 7ff5bffff640 1 -- 172.21.15.122:0/1886969392 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7ff5c00965e0 con 0x7ff5c8153590 2024-09-17T06:06:25.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.984+0000 7ff5c6ffd640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff5a8073200 0x7ff5a8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:25.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.984+0000 7ff5c6ffd640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff5a8073200 0x7ff5a8075710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80aa000 tx=0x7ff5b80a7040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:25.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:25.988+0000 7ff5bffff640 1 -- 172.21.15.122:0/1886969392 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff5c00611e0 con 0x7ff5c8153590 2024-09-17T06:06:26.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.140+0000 7ff5cd96d640 1 -- 172.21.15.122:0/1886969392 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5c81500b0 con 0x7ff5a8073200 2024-09-17T06:06:26.157 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.156+0000 7ff5bffff640 1 -- 172.21.15.122:0/1886969392 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332688 (secure 0 0 0) 0x7ff5c81500b0 con 0x7ff5a8073200 2024-09-17T06:06:26.161 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:06:26.163 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:06:26.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.160+0000 7ff5cd96d640 1 -- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff5a8073200 msgr2=0x7ff5a8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:26.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.160+0000 7ff5cd96d640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff5a8073200 0x7ff5a8075710 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80aa000 tx=0x7ff5b80a7040 comp rx=0 tx=0).stop 2024-09-17T06:06:26.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.160+0000 7ff5cd96d640 1 -- 172.21.15.122:0/1886969392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5c8153590 msgr2=0x7ff5c80c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:26.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.160+0000 7ff5cd96d640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5c8153590 0x7ff5c80c3780 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80c9270 tx=0x7ff5c000f820 comp rx=0 tx=0).stop 2024-09-17T06:06:26.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.160+0000 7ff5cd96d640 1 -- 172.21.15.122:0/1886969392 shutdown_connections 2024-09-17T06:06:26.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.160+0000 7ff5cd96d640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5c8153590 0x7ff5c80c3780 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.160+0000 7ff5cd96d640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff5c81f1f30 0x7ff5c8148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.160+0000 7ff5cd96d640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff5a8073200 0x7ff5a8075710 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.160+0000 7ff5cd96d640 1 --2- 172.21.15.122:0/1886969392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b4003a40 0x7ff5c80afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.160+0000 7ff5cd96d640 1 -- 172.21.15.122:0/1886969392 >> 172.21.15.122:0/1886969392 conn(0x7ff5c80726c0 msgr2=0x7ff5c814eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:26.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.160+0000 7ff5cd96d640 1 -- 172.21.15.122:0/1886969392 shutdown_connections 2024-09-17T06:06:26.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.160+0000 7ff5cd96d640 1 -- 172.21.15.122:0/1886969392 wait complete. 2024-09-17T06:06:26.182 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-17T06:06:25.569528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627667,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":187,"num_write_kb":1697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234232,"kb_used_data":8652,"kb_used_omap":17,"kb_used_meta":225390,"kb_avail":754740488,"statfs":{"total":773094113280,"available":772854259712,"internally_reserved":0,"allocated":8859648,"data_stored":5184857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":230800109},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002756"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500455+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:06:22.500455+0000","last_peered":"2024-09-17T06:06:22.500455+0000","last_clean":"2024-09-17T06:06:22.500455+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:06:22.500455+0000","last_undegraded":"2024-09-17T06:06:22.500455+0000","last_fullsized":"2024-09-17T06:06:22.500455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499776+0000","last_change":"2024-09-17T06:06:14.882867+0000","last_active":"2024-09-17T06:06:22.499776+0000","last_peered":"2024-09-17T06:06:22.499776+0000","last_clean":"2024-09-17T06:06:22.499776+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:06:22.499776+0000","last_undegraded":"2024-09-17T06:06:22.499776+0000","last_fullsized":"2024-09-17T06:06:22.499776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:30.856555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498014+0000","last_change":"2024-09-17T06:06:15.369420+0000","last_active":"2024-09-17T06:06:22.498014+0000","last_peered":"2024-09-17T06:06:22.498014+0000","last_clean":"2024-09-17T06:06:22.498014+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:06:22.498014+0000","last_undegraded":"2024-09-17T06:06:22.498014+0000","last_fullsized":"2024-09-17T06:06:22.498014+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:26.332180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500348+0000","last_change":"2024-09-17T06:06:14.876941+0000","last_active":"2024-09-17T06:06:22.500348+0000","last_peered":"2024-09-17T06:06:22.500348+0000","last_clean":"2024-09-17T06:06:22.500348+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:06:22.500348+0000","last_undegraded":"2024-09-17T06:06:22.500348+0000","last_fullsized":"2024-09-17T06:06:22.500348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:16.802718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500029+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:06:22.500029+0000","last_peered":"2024-09-17T06:06:22.500029+0000","last_clean":"2024-09-17T06:06:22.500029+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:06:22.500029+0000","last_undegraded":"2024-09-17T06:06:22.500029+0000","last_fullsized":"2024-09-17T06:06:22.500029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966721+0000","last_change":"2024-09-17T06:06:02.760496+0000","last_active":"2024-09-17T06:06:21.966721+0000","last_peered":"2024-09-17T06:06:21.966721+0000","last_clean":"2024-09-17T06:06:21.966721+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:06:21.966721+0000","last_undegraded":"2024-09-17T06:06:21.966721+0000","last_fullsized":"2024-09-17T06:06:21.966721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.085087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"60'3","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501464+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:06:22.501464+0000","last_peered":"2024-09-17T06:06:22.501464+0000","last_clean":"2024-09-17T06:06:22.501464+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:06:22.501464+0000","last_undegraded":"2024-09-17T06:06:22.501464+0000","last_fullsized":"2024-09-17T06:06:22.501464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969576+0000","last_change":"2024-09-17T06:06:02.772542+0000","last_active":"2024-09-17T06:06:21.969576+0000","last_peered":"2024-09-17T06:06:21.969576+0000","last_clean":"2024-09-17T06:06:21.969576+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:21.969576+0000","last_undegraded":"2024-09-17T06:06:21.969576+0000","last_fullsized":"2024-09-17T06:06:21.969576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:31.442644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968566+0000","last_change":"2024-09-17T06:06:02.762154+0000","last_active":"2024-09-17T06:06:21.968566+0000","last_peered":"2024-09-17T06:06:21.968566+0000","last_clean":"2024-09-17T06:06:21.968566+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:06:21.968566+0000","last_undegraded":"2024-09-17T06:06:21.968566+0000","last_fullsized":"2024-09-17T06:06:21.968566+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:56.087057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500504+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:06:22.500504+0000","last_peered":"2024-09-17T06:06:22.500504+0000","last_clean":"2024-09-17T06:06:22.500504+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:06:22.500504+0000","last_undegraded":"2024-09-17T06:06:22.500504+0000","last_fullsized":"2024-09-17T06:06:22.500504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499458+0000","last_change":"2024-09-17T06:06:02.747441+0000","last_active":"2024-09-17T06:06:22.499458+0000","last_peered":"2024-09-17T06:06:22.499458+0000","last_clean":"2024-09-17T06:06:22.499458+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:06:22.499458+0000","last_undegraded":"2024-09-17T06:06:22.499458+0000","last_fullsized":"2024-09-17T06:06:22.499458+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:56.535771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968309+0000","last_change":"2024-09-17T06:06:02.760042+0000","last_active":"2024-09-17T06:06:21.968309+0000","last_peered":"2024-09-17T06:06:21.968309+0000","last_clean":"2024-09-17T06:06:21.968309+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:06:21.968309+0000","last_undegraded":"2024-09-17T06:06:21.968309+0000","last_fullsized":"2024-09-17T06:06:21.968309+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:53.866107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501686+0000","last_change":"2024-09-17T06:06:02.772614+0000","last_active":"2024-09-17T06:06:22.501686+0000","last_peered":"2024-09-17T06:06:22.501686+0000","last_clean":"2024-09-17T06:06:22.501686+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:06:22.501686+0000","last_undegraded":"2024-09-17T06:06:22.501686+0000","last_fullsized":"2024-09-17T06:06:22.501686+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:56.086542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"60'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501042+0000","last_change":"2024-09-17T06:06:02.763938+0000","last_active":"2024-09-17T06:06:22.501042+0000","last_peered":"2024-09-17T06:06:22.501042+0000","last_clean":"2024-09-17T06:06:22.501042+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:06:22.501042+0000","last_undegraded":"2024-09-17T06:06:22.501042+0000","last_fullsized":"2024-09-17T06:06:22.501042+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:09.262608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969558+0000","last_change":"2024-09-17T06:06:02.764648+0000","last_active":"2024-09-17T06:06:21.969558+0000","last_peered":"2024-09-17T06:06:21.969558+0000","last_clean":"2024-09-17T06:06:21.969558+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:06:21.969558+0000","last_undegraded":"2024-09-17T06:06:21.969558+0000","last_fullsized":"2024-09-17T06:06:21.969558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:56.341325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499778+0000","last_change":"2024-09-17T06:06:14.877208+0000","last_active":"2024-09-17T06:06:22.499778+0000","last_peered":"2024-09-17T06:06:22.499778+0000","last_clean":"2024-09-17T06:06:22.499778+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:06:22.499778+0000","last_undegraded":"2024-09-17T06:06:22.499778+0000","last_fullsized":"2024-09-17T06:06:22.499778+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:16.547077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967926+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:06:21.967926+0000","last_peered":"2024-09-17T06:06:21.967926+0000","last_clean":"2024-09-17T06:06:21.967926+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:06:21.967926+0000","last_undegraded":"2024-09-17T06:06:21.967926+0000","last_fullsized":"2024-09-17T06:06:21.967926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969187+0000","last_change":"2024-09-17T06:06:02.777996+0000","last_active":"2024-09-17T06:06:21.969187+0000","last_peered":"2024-09-17T06:06:21.969187+0000","last_clean":"2024-09-17T06:06:21.969187+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:06:21.969187+0000","last_undegraded":"2024-09-17T06:06:21.969187+0000","last_fullsized":"2024-09-17T06:06:21.969187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:04.148545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498555+0000","last_change":"2024-09-17T06:06:14.859614+0000","last_active":"2024-09-17T06:06:22.498555+0000","last_peered":"2024-09-17T06:06:22.498555+0000","last_clean":"2024-09-17T06:06:22.498555+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:06:22.498555+0000","last_undegraded":"2024-09-17T06:06:22.498555+0000","last_fullsized":"2024-09-17T06:06:22.498555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.132428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966735+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:06:21.966735+0000","last_peered":"2024-09-17T06:06:21.966735+0000","last_clean":"2024-09-17T06:06:21.966735+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:06:21.966735+0000","last_undegraded":"2024-09-17T06:06:21.966735+0000","last_fullsized":"2024-09-17T06:06:21.966735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967279+0000","last_change":"2024-09-17T06:06:02.773038+0000","last_active":"2024-09-17T06:06:21.967279+0000","last_peered":"2024-09-17T06:06:21.967279+0000","last_clean":"2024-09-17T06:06:21.967279+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:06:21.967279+0000","last_undegraded":"2024-09-17T06:06:21.967279+0000","last_fullsized":"2024-09-17T06:06:21.967279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:24.833172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967355+0000","last_change":"2024-09-17T06:06:02.742391+0000","last_active":"2024-09-17T06:06:21.967355+0000","last_peered":"2024-09-17T06:06:21.967355+0000","last_clean":"2024-09-17T06:06:21.967355+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:06:21.967355+0000","last_undegraded":"2024-09-17T06:06:21.967355+0000","last_fullsized":"2024-09-17T06:06:21.967355+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:18.282190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499601+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:06:22.499601+0000","last_peered":"2024-09-17T06:06:22.499601+0000","last_clean":"2024-09-17T06:06:22.499601+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:06:22.499601+0000","last_undegraded":"2024-09-17T06:06:22.499601+0000","last_fullsized":"2024-09-17T06:06:22.499601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.973250+0000","last_change":"2024-09-17T06:06:02.760965+0000","last_active":"2024-09-17T06:06:21.973250+0000","last_peered":"2024-09-17T06:06:21.973250+0000","last_clean":"2024-09-17T06:06:21.973250+0000","last_became_active":"2024-09-17T06:06:02.755335+0000","last_became_peered":"2024-09-17T06:06:02.755335+0000","last_unstale":"2024-09-17T06:06:21.973250+0000","last_undegraded":"2024-09-17T06:06:21.973250+0000","last_fullsized":"2024-09-17T06:06:21.973250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:49.568290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500258+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:06:22.500258+0000","last_peered":"2024-09-17T06:06:22.500258+0000","last_clean":"2024-09-17T06:06:22.500258+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:06:22.500258+0000","last_undegraded":"2024-09-17T06:06:22.500258+0000","last_fullsized":"2024-09-17T06:06:22.500258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"61'3","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503161+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:06:22.503161+0000","last_peered":"2024-09-17T06:06:22.503161+0000","last_clean":"2024-09-17T06:06:22.503161+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:06:22.503161+0000","last_undegraded":"2024-09-17T06:06:22.503161+0000","last_fullsized":"2024-09-17T06:06:22.503161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967557+0000","last_change":"2024-09-17T06:06:02.770140+0000","last_active":"2024-09-17T06:06:21.967557+0000","last_peered":"2024-09-17T06:06:21.967557+0000","last_clean":"2024-09-17T06:06:21.967557+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:06:21.967557+0000","last_undegraded":"2024-09-17T06:06:21.967557+0000","last_fullsized":"2024-09-17T06:06:21.967557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:35.888277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500583+0000","last_change":"2024-09-17T06:06:14.875548+0000","last_active":"2024-09-17T06:06:22.500583+0000","last_peered":"2024-09-17T06:06:22.500583+0000","last_clean":"2024-09-17T06:06:22.500583+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:06:22.500583+0000","last_undegraded":"2024-09-17T06:06:22.500583+0000","last_fullsized":"2024-09-17T06:06:22.500583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:24.521256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967487+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:06:21.967487+0000","last_peered":"2024-09-17T06:06:21.967487+0000","last_clean":"2024-09-17T06:06:21.967487+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:06:21.967487+0000","last_undegraded":"2024-09-17T06:06:21.967487+0000","last_fullsized":"2024-09-17T06:06:21.967487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498066+0000","last_change":"2024-09-17T06:06:14.876736+0000","last_active":"2024-09-17T06:06:22.498066+0000","last_peered":"2024-09-17T06:06:22.498066+0000","last_clean":"2024-09-17T06:06:22.498066+0000","last_became_active":"2024-09-17T06:06:14.875773+0000","last_became_peered":"2024-09-17T06:06:14.875773+0000","last_unstale":"2024-09-17T06:06:22.498066+0000","last_undegraded":"2024-09-17T06:06:22.498066+0000","last_fullsized":"2024-09-17T06:06:22.498066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:52.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968114+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:06:21.968114+0000","last_peered":"2024-09-17T06:06:21.968114+0000","last_clean":"2024-09-17T06:06:21.968114+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:06:21.968114+0000","last_undegraded":"2024-09-17T06:06:21.968114+0000","last_fullsized":"2024-09-17T06:06:21.968114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501976+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:06:22.501976+0000","last_peered":"2024-09-17T06:06:22.501976+0000","last_clean":"2024-09-17T06:06:22.501976+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:06:22.501976+0000","last_undegraded":"2024-09-17T06:06:22.501976+0000","last_fullsized":"2024-09-17T06:06:22.501976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499225+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:06:22.499225+0000","last_peered":"2024-09-17T06:06:22.499225+0000","last_clean":"2024-09-17T06:06:22.499225+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:06:22.499225+0000","last_undegraded":"2024-09-17T06:06:22.499225+0000","last_fullsized":"2024-09-17T06:06:22.499225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970494+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:06:21.970494+0000","last_peered":"2024-09-17T06:06:21.970494+0000","last_clean":"2024-09-17T06:06:21.970494+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:06:21.970494+0000","last_undegraded":"2024-09-17T06:06:21.970494+0000","last_fullsized":"2024-09-17T06:06:21.970494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968198+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:06:21.968198+0000","last_peered":"2024-09-17T06:06:21.968198+0000","last_clean":"2024-09-17T06:06:21.968198+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:06:21.968198+0000","last_undegraded":"2024-09-17T06:06:21.968198+0000","last_fullsized":"2024-09-17T06:06:21.968198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967191+0000","last_change":"2024-09-17T06:06:02.750734+0000","last_active":"2024-09-17T06:06:21.967191+0000","last_peered":"2024-09-17T06:06:21.967191+0000","last_clean":"2024-09-17T06:06:21.967191+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:06:21.967191+0000","last_undegraded":"2024-09-17T06:06:21.967191+0000","last_fullsized":"2024-09-17T06:06:21.967191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:55.436212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968677+0000","last_change":"2024-09-17T06:06:02.780406+0000","last_active":"2024-09-17T06:06:21.968677+0000","last_peered":"2024-09-17T06:06:21.968677+0000","last_clean":"2024-09-17T06:06:21.968677+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:06:21.968677+0000","last_undegraded":"2024-09-17T06:06:21.968677+0000","last_fullsized":"2024-09-17T06:06:21.968677+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:34.785782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971985+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:06:21.971985+0000","last_peered":"2024-09-17T06:06:21.971985+0000","last_clean":"2024-09-17T06:06:21.971985+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:06:21.971985+0000","last_undegraded":"2024-09-17T06:06:21.971985+0000","last_fullsized":"2024-09-17T06:06:21.971985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967920+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:06:21.967920+0000","last_peered":"2024-09-17T06:06:21.967920+0000","last_clean":"2024-09-17T06:06:21.967920+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:06:21.967920+0000","last_undegraded":"2024-09-17T06:06:21.967920+0000","last_fullsized":"2024-09-17T06:06:21.967920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966724+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:06:21.966724+0000","last_peered":"2024-09-17T06:06:21.966724+0000","last_clean":"2024-09-17T06:06:21.966724+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:06:21.966724+0000","last_undegraded":"2024-09-17T06:06:21.966724+0000","last_fullsized":"2024-09-17T06:06:21.966724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"62'4","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498551+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:06:22.498551+0000","last_peered":"2024-09-17T06:06:22.498551+0000","last_clean":"2024-09-17T06:06:22.498551+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:06:22.498551+0000","last_undegraded":"2024-09-17T06:06:22.498551+0000","last_fullsized":"2024-09-17T06:06:22.498551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967511+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:06:21.967511+0000","last_peered":"2024-09-17T06:06:21.967511+0000","last_clean":"2024-09-17T06:06:21.967511+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:06:21.967511+0000","last_undegraded":"2024-09-17T06:06:21.967511+0000","last_fullsized":"2024-09-17T06:06:21.967511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499330+0000","last_change":"2024-09-17T06:06:02.775030+0000","last_active":"2024-09-17T06:06:22.499330+0000","last_peered":"2024-09-17T06:06:22.499330+0000","last_clean":"2024-09-17T06:06:22.499330+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:06:22.499330+0000","last_undegraded":"2024-09-17T06:06:22.499330+0000","last_fullsized":"2024-09-17T06:06:22.499330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:56.086542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499602+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:06:22.499602+0000","last_peered":"2024-09-17T06:06:22.499602+0000","last_clean":"2024-09-17T06:06:22.499602+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:06:22.499602+0000","last_undegraded":"2024-09-17T06:06:22.499602+0000","last_fullsized":"2024-09-17T06:06:22.499602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500801+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:06:22.500801+0000","last_peered":"2024-09-17T06:06:22.500801+0000","last_clean":"2024-09-17T06:06:22.500801+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:06:22.500801+0000","last_undegraded":"2024-09-17T06:06:22.500801+0000","last_fullsized":"2024-09-17T06:06:22.500801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499284+0000","last_change":"2024-09-17T06:06:14.863098+0000","last_active":"2024-09-17T06:06:22.499284+0000","last_peered":"2024-09-17T06:06:22.499284+0000","last_clean":"2024-09-17T06:06:22.499284+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:06:22.499284+0000","last_undegraded":"2024-09-17T06:06:22.499284+0000","last_fullsized":"2024-09-17T06:06:22.499284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:43.199274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969649+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:06:21.969649+0000","last_peered":"2024-09-17T06:06:21.969649+0000","last_clean":"2024-09-17T06:06:21.969649+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:06:21.969649+0000","last_undegraded":"2024-09-17T06:06:21.969649+0000","last_fullsized":"2024-09-17T06:06:21.969649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":229,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503185+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:06:22.503185+0000","last_peered":"2024-09-17T06:06:22.503185+0000","last_clean":"2024-09-17T06:06:22.503185+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:06:22.503185+0000","last_undegraded":"2024-09-17T06:06:22.503185+0000","last_fullsized":"2024-09-17T06:06:22.503185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502700+0000","last_change":"2024-09-17T06:06:02.751844+0000","last_active":"2024-09-17T06:06:22.502700+0000","last_peered":"2024-09-17T06:06:22.502700+0000","last_clean":"2024-09-17T06:06:22.502700+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:06:22.502700+0000","last_undegraded":"2024-09-17T06:06:22.502700+0000","last_fullsized":"2024-09-17T06:06:22.502700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:29.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":115,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499586+0000","last_change":"2024-09-17T06:04:49.135526+0000","last_active":"2024-09-17T06:06:22.499586+0000","last_peered":"2024-09-17T06:06:22.499586+0000","last_clean":"2024-09-17T06:06:22.499586+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:06:22.499586+0000","last_undegraded":"2024-09-17T06:06:22.499586+0000","last_fullsized":"2024-09-17T06:06:22.499586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:45.338884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499366+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:06:22.499366+0000","last_peered":"2024-09-17T06:06:22.499366+0000","last_clean":"2024-09-17T06:06:22.499366+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:06:22.499366+0000","last_undegraded":"2024-09-17T06:06:22.499366+0000","last_fullsized":"2024-09-17T06:06:22.499366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501381+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:06:22.501381+0000","last_peered":"2024-09-17T06:06:22.501381+0000","last_clean":"2024-09-17T06:06:22.501381+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:06:22.501381+0000","last_undegraded":"2024-09-17T06:06:22.501381+0000","last_fullsized":"2024-09-17T06:06:22.501381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969729+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:06:21.969729+0000","last_peered":"2024-09-17T06:06:21.969729+0000","last_clean":"2024-09-17T06:06:21.969729+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:06:21.969729+0000","last_undegraded":"2024-09-17T06:06:21.969729+0000","last_fullsized":"2024-09-17T06:06:21.969729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968279+0000","last_change":"2024-09-17T06:06:02.750773+0000","last_active":"2024-09-17T06:06:21.968279+0000","last_peered":"2024-09-17T06:06:21.968279+0000","last_clean":"2024-09-17T06:06:21.968279+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:06:21.968279+0000","last_undegraded":"2024-09-17T06:06:21.968279+0000","last_fullsized":"2024-09-17T06:06:21.968279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:40.847404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499847+0000","last_change":"2024-09-17T06:06:02.772644+0000","last_active":"2024-09-17T06:06:22.499847+0000","last_peered":"2024-09-17T06:06:22.499847+0000","last_clean":"2024-09-17T06:06:22.499847+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:06:22.499847+0000","last_undegraded":"2024-09-17T06:06:22.499847+0000","last_fullsized":"2024-09-17T06:06:22.499847+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:29.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503650+0000","last_change":"2024-09-17T06:06:02.743237+0000","last_active":"2024-09-17T06:06:22.503650+0000","last_peered":"2024-09-17T06:06:22.503650+0000","last_clean":"2024-09-17T06:06:22.503650+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:06:22.503650+0000","last_undegraded":"2024-09-17T06:06:22.503650+0000","last_fullsized":"2024-09-17T06:06:22.503650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:21.599408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499049+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:06:22.499049+0000","last_peered":"2024-09-17T06:06:22.499049+0000","last_clean":"2024-09-17T06:06:22.499049+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:06:22.499049+0000","last_undegraded":"2024-09-17T06:06:22.499049+0000","last_fullsized":"2024-09-17T06:06:22.499049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970374+0000","last_change":"2024-09-17T06:06:02.749776+0000","last_active":"2024-09-17T06:06:21.970374+0000","last_peered":"2024-09-17T06:06:21.970374+0000","last_clean":"2024-09-17T06:06:21.970374+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:06:21.970374+0000","last_undegraded":"2024-09-17T06:06:21.970374+0000","last_fullsized":"2024-09-17T06:06:21.970374+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:14.070869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501629+0000","last_change":"2024-09-17T06:06:02.743241+0000","last_active":"2024-09-17T06:06:22.501629+0000","last_peered":"2024-09-17T06:06:22.501629+0000","last_clean":"2024-09-17T06:06:22.501629+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:06:22.501629+0000","last_undegraded":"2024-09-17T06:06:22.501629+0000","last_fullsized":"2024-09-17T06:06:22.501629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:24.945633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.972191+0000","last_change":"2024-09-17T06:06:02.747970+0000","last_active":"2024-09-17T06:06:21.972191+0000","last_peered":"2024-09-17T06:06:21.972191+0000","last_clean":"2024-09-17T06:06:21.972191+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:06:21.972191+0000","last_undegraded":"2024-09-17T06:06:21.972191+0000","last_fullsized":"2024-09-17T06:06:21.972191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:01.251626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967658+0000","last_change":"2024-09-17T06:06:02.765641+0000","last_active":"2024-09-17T06:06:21.967658+0000","last_peered":"2024-09-17T06:06:21.967658+0000","last_clean":"2024-09-17T06:06:21.967658+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:06:21.967658+0000","last_undegraded":"2024-09-17T06:06:21.967658+0000","last_fullsized":"2024-09-17T06:06:21.967658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:45.801441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499985+0000","last_change":"2024-09-17T06:06:02.771427+0000","last_active":"2024-09-17T06:06:22.499985+0000","last_peered":"2024-09-17T06:06:22.499985+0000","last_clean":"2024-09-17T06:06:22.499985+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:06:22.499985+0000","last_undegraded":"2024-09-17T06:06:22.499985+0000","last_fullsized":"2024-09-17T06:06:22.499985+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.132428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"62'9","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498339+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:06:22.498339+0000","last_peered":"2024-09-17T06:06:22.498339+0000","last_clean":"2024-09-17T06:06:22.498339+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:06:22.498339+0000","last_undegraded":"2024-09-17T06:06:22.498339+0000","last_fullsized":"2024-09-17T06:06:22.498339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499947+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:06:22.499947+0000","last_peered":"2024-09-17T06:06:22.499947+0000","last_clean":"2024-09-17T06:06:22.499947+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:06:22.499947+0000","last_undegraded":"2024-09-17T06:06:22.499947+0000","last_fullsized":"2024-09-17T06:06:22.499947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500874+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:06:22.500874+0000","last_peered":"2024-09-17T06:06:22.500874+0000","last_clean":"2024-09-17T06:06:22.500874+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:06:22.500874+0000","last_undegraded":"2024-09-17T06:06:22.500874+0000","last_fullsized":"2024-09-17T06:06:22.500874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501556+0000","last_change":"2024-09-17T06:06:02.772623+0000","last_active":"2024-09-17T06:06:22.501556+0000","last_peered":"2024-09-17T06:06:22.501556+0000","last_clean":"2024-09-17T06:06:22.501556+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:22.501556+0000","last_undegraded":"2024-09-17T06:06:22.501556+0000","last_fullsized":"2024-09-17T06:06:22.501556+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:53.767911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500282+0000","last_change":"2024-09-17T06:06:14.883260+0000","last_active":"2024-09-17T06:06:22.500282+0000","last_peered":"2024-09-17T06:06:22.500282+0000","last_clean":"2024-09-17T06:06:22.500282+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:06:22.500282+0000","last_undegraded":"2024-09-17T06:06:22.500282+0000","last_fullsized":"2024-09-17T06:06:22.500282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:01.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500541+0000","last_change":"2024-09-17T06:06:02.767610+0000","last_active":"2024-09-17T06:06:22.500541+0000","last_peered":"2024-09-17T06:06:22.500541+0000","last_clean":"2024-09-17T06:06:22.500541+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:06:22.500541+0000","last_undegraded":"2024-09-17T06:06:22.500541+0000","last_fullsized":"2024-09-17T06:06:22.500541+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:54.779217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971807+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:06:21.971807+0000","last_peered":"2024-09-17T06:06:21.971807+0000","last_clean":"2024-09-17T06:06:21.971807+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:06:21.971807+0000","last_undegraded":"2024-09-17T06:06:21.971807+0000","last_fullsized":"2024-09-17T06:06:21.971807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500284+0000","last_change":"2024-09-17T06:06:15.372083+0000","last_active":"2024-09-17T06:06:22.500284+0000","last_peered":"2024-09-17T06:06:22.500284+0000","last_clean":"2024-09-17T06:06:22.500284+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:06:22.500284+0000","last_undegraded":"2024-09-17T06:06:22.500284+0000","last_fullsized":"2024-09-17T06:06:22.500284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:53.468260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499925+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:06:22.499925+0000","last_peered":"2024-09-17T06:06:22.499925+0000","last_clean":"2024-09-17T06:06:22.499925+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:06:22.499925+0000","last_undegraded":"2024-09-17T06:06:22.499925+0000","last_fullsized":"2024-09-17T06:06:22.499925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499766+0000","last_change":"2024-09-17T06:06:02.772342+0000","last_active":"2024-09-17T06:06:22.499766+0000","last_peered":"2024-09-17T06:06:22.499766+0000","last_clean":"2024-09-17T06:06:22.499766+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:06:22.499766+0000","last_undegraded":"2024-09-17T06:06:22.499766+0000","last_fullsized":"2024-09-17T06:06:22.499766+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:36.591645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970221+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:06:21.970221+0000","last_peered":"2024-09-17T06:06:21.970221+0000","last_clean":"2024-09-17T06:06:21.970221+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:06:21.970221+0000","last_undegraded":"2024-09-17T06:06:21.970221+0000","last_fullsized":"2024-09-17T06:06:21.970221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501138+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:06:22.501138+0000","last_peered":"2024-09-17T06:06:22.501138+0000","last_clean":"2024-09-17T06:06:22.501138+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:06:22.501138+0000","last_undegraded":"2024-09-17T06:06:22.501138+0000","last_fullsized":"2024-09-17T06:06:22.501138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"62'22","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502689+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:06:22.502689+0000","last_peered":"2024-09-17T06:06:22.502689+0000","last_clean":"2024-09-17T06:06:22.502689+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:06:22.502689+0000","last_undegraded":"2024-09-17T06:06:22.502689+0000","last_fullsized":"2024-09-17T06:06:22.502689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36089,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967727+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:06:21.967727+0000","last_peered":"2024-09-17T06:06:21.967727+0000","last_clean":"2024-09-17T06:06:21.967727+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:06:21.967727+0000","last_undegraded":"2024-09-17T06:06:21.967727+0000","last_fullsized":"2024-09-17T06:06:21.967727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968706+0000","last_change":"2024-09-17T06:06:02.778195+0000","last_active":"2024-09-17T06:06:21.968706+0000","last_peered":"2024-09-17T06:06:21.968706+0000","last_clean":"2024-09-17T06:06:21.968706+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:06:21.968706+0000","last_undegraded":"2024-09-17T06:06:21.968706+0000","last_fullsized":"2024-09-17T06:06:21.968706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:41.521760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"62'7","reported_seq":116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970857+0000","last_change":"2024-09-17T06:05:20.635633+0000","last_active":"2024-09-17T06:06:21.970857+0000","last_peered":"2024-09-17T06:06:21.970857+0000","last_clean":"2024-09-17T06:06:21.970857+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:06:21.970857+0000","last_undegraded":"2024-09-17T06:06:21.970857+0000","last_fullsized":"2024-09-17T06:06:21.970857+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:42.262918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968250+0000","last_change":"2024-09-17T06:06:02.762076+0000","last_active":"2024-09-17T06:06:21.968250+0000","last_peered":"2024-09-17T06:06:21.968250+0000","last_clean":"2024-09-17T06:06:21.968250+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:06:21.968250+0000","last_undegraded":"2024-09-17T06:06:21.968250+0000","last_fullsized":"2024-09-17T06:06:21.968250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:12.436619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500283+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:06:22.500283+0000","last_peered":"2024-09-17T06:06:22.500283+0000","last_clean":"2024-09-17T06:06:22.500283+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:06:22.500283+0000","last_undegraded":"2024-09-17T06:06:22.500283+0000","last_fullsized":"2024-09-17T06:06:22.500283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970773+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:06:21.970773+0000","last_peered":"2024-09-17T06:06:21.970773+0000","last_clean":"2024-09-17T06:06:21.970773+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:06:21.970773+0000","last_undegraded":"2024-09-17T06:06:21.970773+0000","last_fullsized":"2024-09-17T06:06:21.970773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498209+0000","last_change":"2024-09-17T06:06:14.879517+0000","last_active":"2024-09-17T06:06:22.498209+0000","last_peered":"2024-09-17T06:06:22.498209+0000","last_clean":"2024-09-17T06:06:22.498209+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:06:22.498209+0000","last_undegraded":"2024-09-17T06:06:22.498209+0000","last_fullsized":"2024-09-17T06:06:22.498209+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:59.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970474+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:06:21.970474+0000","last_peered":"2024-09-17T06:06:21.970474+0000","last_clean":"2024-09-17T06:06:21.970474+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:06:21.970474+0000","last_undegraded":"2024-09-17T06:06:21.970474+0000","last_fullsized":"2024-09-17T06:06:21.970474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502906+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:06:22.502906+0000","last_peered":"2024-09-17T06:06:22.502906+0000","last_clean":"2024-09-17T06:06:22.502906+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:06:22.502906+0000","last_undegraded":"2024-09-17T06:06:22.502906+0000","last_fullsized":"2024-09-17T06:06:22.502906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498392+0000","last_change":"2024-09-17T06:06:14.881955+0000","last_active":"2024-09-17T06:06:22.498392+0000","last_peered":"2024-09-17T06:06:22.498392+0000","last_clean":"2024-09-17T06:06:22.498392+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:06:22.498392+0000","last_undegraded":"2024-09-17T06:06:22.498392+0000","last_fullsized":"2024-09-17T06:06:22.498392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:31.787475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499845+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:06:22.499845+0000","last_peered":"2024-09-17T06:06:22.499845+0000","last_clean":"2024-09-17T06:06:22.499845+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:06:22.499845+0000","last_undegraded":"2024-09-17T06:06:22.499845+0000","last_fullsized":"2024-09-17T06:06:22.499845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966528+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:06:21.966528+0000","last_peered":"2024-09-17T06:06:21.966528+0000","last_clean":"2024-09-17T06:06:21.966528+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:06:21.966528+0000","last_undegraded":"2024-09-17T06:06:21.966528+0000","last_fullsized":"2024-09-17T06:06:21.966528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971203+0000","last_change":"2024-09-17T06:06:02.751465+0000","last_active":"2024-09-17T06:06:21.971203+0000","last_peered":"2024-09-17T06:06:21.971203+0000","last_clean":"2024-09-17T06:06:21.971203+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:06:21.971203+0000","last_undegraded":"2024-09-17T06:06:21.971203+0000","last_fullsized":"2024-09-17T06:06:21.971203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:15.399241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502473+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:06:22.502473+0000","last_peered":"2024-09-17T06:06:22.502473+0000","last_clean":"2024-09-17T06:06:22.502473+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:06:22.502473+0000","last_undegraded":"2024-09-17T06:06:22.502473+0000","last_fullsized":"2024-09-17T06:06:22.502473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498349+0000","last_change":"2024-09-17T06:06:14.876329+0000","last_active":"2024-09-17T06:06:22.498349+0000","last_peered":"2024-09-17T06:06:22.498349+0000","last_clean":"2024-09-17T06:06:22.498349+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:06:22.498349+0000","last_undegraded":"2024-09-17T06:06:22.498349+0000","last_fullsized":"2024-09-17T06:06:22.498349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:44.076246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498558+0000","last_change":"2024-09-17T06:06:14.883367+0000","last_active":"2024-09-17T06:06:22.498558+0000","last_peered":"2024-09-17T06:06:22.498558+0000","last_clean":"2024-09-17T06:06:22.498558+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:06:22.498558+0000","last_undegraded":"2024-09-17T06:06:22.498558+0000","last_fullsized":"2024-09-17T06:06:22.498558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:34.486361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501858+0000","last_change":"2024-09-17T06:06:02.753865+0000","last_active":"2024-09-17T06:06:22.501858+0000","last_peered":"2024-09-17T06:06:22.501858+0000","last_clean":"2024-09-17T06:06:22.501858+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:06:22.501858+0000","last_undegraded":"2024-09-17T06:06:22.501858+0000","last_fullsized":"2024-09-17T06:06:22.501858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:02.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499621+0000","last_change":"2024-09-17T06:06:02.774846+0000","last_active":"2024-09-17T06:06:22.499621+0000","last_peered":"2024-09-17T06:06:22.499621+0000","last_clean":"2024-09-17T06:06:22.499621+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:06:22.499621+0000","last_undegraded":"2024-09-17T06:06:22.499621+0000","last_fullsized":"2024-09-17T06:06:22.499621+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:03.871862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499002+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:06:22.499002+0000","last_peered":"2024-09-17T06:06:22.499002+0000","last_clean":"2024-09-17T06:06:22.499002+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:06:22.499002+0000","last_undegraded":"2024-09-17T06:06:22.499002+0000","last_fullsized":"2024-09-17T06:06:22.499002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499917+0000","last_change":"2024-09-17T06:06:14.874567+0000","last_active":"2024-09-17T06:06:22.499917+0000","last_peered":"2024-09-17T06:06:22.499917+0000","last_clean":"2024-09-17T06:06:22.499917+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:06:22.499917+0000","last_undegraded":"2024-09-17T06:06:22.499917+0000","last_fullsized":"2024-09-17T06:06:22.499917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:16.000785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967382+0000","last_change":"2024-09-17T06:06:02.747397+0000","last_active":"2024-09-17T06:06:21.967382+0000","last_peered":"2024-09-17T06:06:21.967382+0000","last_clean":"2024-09-17T06:06:21.967382+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:06:21.967382+0000","last_undegraded":"2024-09-17T06:06:21.967382+0000","last_fullsized":"2024-09-17T06:06:21.967382+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:35.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500463+0000","last_change":"2024-09-17T06:06:15.371993+0000","last_active":"2024-09-17T06:06:22.500463+0000","last_peered":"2024-09-17T06:06:22.500463+0000","last_clean":"2024-09-17T06:06:22.500463+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:06:22.500463+0000","last_undegraded":"2024-09-17T06:06:22.500463+0000","last_fullsized":"2024-09-17T06:06:22.500463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:36.359097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500526+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:06:22.500526+0000","last_peered":"2024-09-17T06:06:22.500526+0000","last_clean":"2024-09-17T06:06:22.500526+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:06:22.500526+0000","last_undegraded":"2024-09-17T06:06:22.500526+0000","last_fullsized":"2024-09-17T06:06:22.500526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498498+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:06:22.498498+0000","last_peered":"2024-09-17T06:06:22.498498+0000","last_clean":"2024-09-17T06:06:22.498498+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:06:22.498498+0000","last_undegraded":"2024-09-17T06:06:22.498498+0000","last_fullsized":"2024-09-17T06:06:22.498498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971737+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:06:21.971737+0000","last_peered":"2024-09-17T06:06:21.971737+0000","last_clean":"2024-09-17T06:06:21.971737+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:06:21.971737+0000","last_undegraded":"2024-09-17T06:06:21.971737+0000","last_fullsized":"2024-09-17T06:06:21.971737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499487+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:06:22.499487+0000","last_peered":"2024-09-17T06:06:22.499487+0000","last_clean":"2024-09-17T06:06:22.499487+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:06:22.499487+0000","last_undegraded":"2024-09-17T06:06:22.499487+0000","last_fullsized":"2024-09-17T06:06:22.499487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500584+0000","last_change":"2024-09-17T06:06:14.862875+0000","last_active":"2024-09-17T06:06:22.500584+0000","last_peered":"2024-09-17T06:06:22.500584+0000","last_clean":"2024-09-17T06:06:22.500584+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:06:22.500584+0000","last_undegraded":"2024-09-17T06:06:22.500584+0000","last_fullsized":"2024-09-17T06:06:22.500584+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:58.805589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968100+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:06:21.968100+0000","last_peered":"2024-09-17T06:06:21.968100+0000","last_clean":"2024-09-17T06:06:21.968100+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:06:21.968100+0000","last_undegraded":"2024-09-17T06:06:21.968100+0000","last_fullsized":"2024-09-17T06:06:21.968100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503297+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:06:22.503297+0000","last_peered":"2024-09-17T06:06:22.503297+0000","last_clean":"2024-09-17T06:06:22.503297+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:06:22.503297+0000","last_undegraded":"2024-09-17T06:06:22.503297+0000","last_fullsized":"2024-09-17T06:06:22.503297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500454+0000","last_change":"2024-09-17T06:06:14.869993+0000","last_active":"2024-09-17T06:06:22.500454+0000","last_peered":"2024-09-17T06:06:22.500454+0000","last_clean":"2024-09-17T06:06:22.500454+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:06:22.500454+0000","last_undegraded":"2024-09-17T06:06:22.500454+0000","last_fullsized":"2024-09-17T06:06:22.500454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:10.143503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970030+0000","last_change":"2024-09-17T06:05:13.535655+0000","last_active":"2024-09-17T06:06:21.970030+0000","last_peered":"2024-09-17T06:06:21.970030+0000","last_clean":"2024-09-17T06:06:21.970030+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:06:21.970030+0000","last_undegraded":"2024-09-17T06:06:21.970030+0000","last_fullsized":"2024-09-17T06:06:21.970030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:26.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498284+0000","last_change":"2024-09-17T06:06:14.862354+0000","last_active":"2024-09-17T06:06:22.498284+0000","last_peered":"2024-09-17T06:06:22.498284+0000","last_clean":"2024-09-17T06:06:22.498284+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:06:22.498284+0000","last_undegraded":"2024-09-17T06:06:22.498284+0000","last_fullsized":"2024-09-17T06:06:22.498284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:57.348056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971525+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:06:21.971525+0000","last_peered":"2024-09-17T06:06:21.971525+0000","last_clean":"2024-09-17T06:06:21.971525+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:06:21.971525+0000","last_undegraded":"2024-09-17T06:06:21.971525+0000","last_fullsized":"2024-09-17T06:06:21.971525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499344+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:06:22.499344+0000","last_peered":"2024-09-17T06:06:22.499344+0000","last_clean":"2024-09-17T06:06:22.499344+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:06:22.499344+0000","last_undegraded":"2024-09-17T06:06:22.499344+0000","last_fullsized":"2024-09-17T06:06:22.499344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502328+0000","last_change":"2024-09-17T06:06:02.781690+0000","last_active":"2024-09-17T06:06:22.502328+0000","last_peered":"2024-09-17T06:06:22.502328+0000","last_clean":"2024-09-17T06:06:22.502328+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:06:22.502328+0000","last_undegraded":"2024-09-17T06:06:22.502328+0000","last_fullsized":"2024-09-17T06:06:22.502328+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:50.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501757+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:06:22.501757+0000","last_peered":"2024-09-17T06:06:22.501757+0000","last_clean":"2024-09-17T06:06:22.501757+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:06:22.501757+0000","last_undegraded":"2024-09-17T06:06:22.501757+0000","last_fullsized":"2024-09-17T06:06:22.501757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498856+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:06:22.498856+0000","last_peered":"2024-09-17T06:06:22.498856+0000","last_clean":"2024-09-17T06:06:22.498856+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:06:22.498856+0000","last_undegraded":"2024-09-17T06:06:22.498856+0000","last_fullsized":"2024-09-17T06:06:22.498856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971569+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:06:21.971569+0000","last_peered":"2024-09-17T06:06:21.971569+0000","last_clean":"2024-09-17T06:06:21.971569+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:06:21.971569+0000","last_undegraded":"2024-09-17T06:06:21.971569+0000","last_fullsized":"2024-09-17T06:06:21.971569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970919+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:06:21.970919+0000","last_peered":"2024-09-17T06:06:21.970919+0000","last_clean":"2024-09-17T06:06:21.970919+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:06:21.970919+0000","last_undegraded":"2024-09-17T06:06:21.970919+0000","last_fullsized":"2024-09-17T06:06:21.970919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966576+0000","last_change":"2024-09-17T06:06:02.777396+0000","last_active":"2024-09-17T06:06:21.966576+0000","last_peered":"2024-09-17T06:06:21.966576+0000","last_clean":"2024-09-17T06:06:21.966576+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:06:21.966576+0000","last_undegraded":"2024-09-17T06:06:21.966576+0000","last_fullsized":"2024-09-17T06:06:21.966576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:28.787647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"60'1","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499808+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:06:22.499808+0000","last_peered":"2024-09-17T06:06:22.499808+0000","last_clean":"2024-09-17T06:06:22.499808+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:06:22.499808+0000","last_undegraded":"2024-09-17T06:06:22.499808+0000","last_fullsized":"2024-09-17T06:06:22.499808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499641+0000","last_change":"2024-09-17T06:06:14.882860+0000","last_active":"2024-09-17T06:06:22.499641+0000","last_peered":"2024-09-17T06:06:22.499641+0000","last_clean":"2024-09-17T06:06:22.499641+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:06:22.499641+0000","last_undegraded":"2024-09-17T06:06:22.499641+0000","last_fullsized":"2024-09-17T06:06:22.499641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:07.158141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968950+0000","last_change":"2024-09-17T06:06:02.776605+0000","last_active":"2024-09-17T06:06:21.968950+0000","last_peered":"2024-09-17T06:06:21.968950+0000","last_clean":"2024-09-17T06:06:21.968950+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:06:21.968950+0000","last_undegraded":"2024-09-17T06:06:21.968950+0000","last_fullsized":"2024-09-17T06:06:21.968950+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:55.566930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502403+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:06:22.502403+0000","last_peered":"2024-09-17T06:06:22.502403+0000","last_clean":"2024-09-17T06:06:22.502403+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:06:22.502403+0000","last_undegraded":"2024-09-17T06:06:22.502403+0000","last_fullsized":"2024-09-17T06:06:22.502403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503103+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:06:22.503103+0000","last_peered":"2024-09-17T06:06:22.503103+0000","last_clean":"2024-09-17T06:06:22.503103+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:06:22.503103+0000","last_undegraded":"2024-09-17T06:06:22.503103+0000","last_fullsized":"2024-09-17T06:06:22.503103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503661+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:06:22.503661+0000","last_peered":"2024-09-17T06:06:22.503661+0000","last_clean":"2024-09-17T06:06:22.503661+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:06:22.503661+0000","last_undegraded":"2024-09-17T06:06:22.503661+0000","last_fullsized":"2024-09-17T06:06:22.503661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498069+0000","last_change":"2024-09-17T06:06:14.863779+0000","last_active":"2024-09-17T06:06:22.498069+0000","last_peered":"2024-09-17T06:06:22.498069+0000","last_clean":"2024-09-17T06:06:22.498069+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:06:22.498069+0000","last_undegraded":"2024-09-17T06:06:22.498069+0000","last_fullsized":"2024-09-17T06:06:22.498069+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:41.626998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499779+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:06:22.499779+0000","last_peered":"2024-09-17T06:06:22.499779+0000","last_clean":"2024-09-17T06:06:22.499779+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:06:22.499779+0000","last_undegraded":"2024-09-17T06:06:22.499779+0000","last_fullsized":"2024-09-17T06:06:22.499779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971457+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:06:21.971457+0000","last_peered":"2024-09-17T06:06:21.971457+0000","last_clean":"2024-09-17T06:06:21.971457+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:06:21.971457+0000","last_undegraded":"2024-09-17T06:06:21.971457+0000","last_fullsized":"2024-09-17T06:06:21.971457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500165+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:06:22.500165+0000","last_peered":"2024-09-17T06:06:22.500165+0000","last_clean":"2024-09-17T06:06:22.500165+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:06:22.500165+0000","last_undegraded":"2024-09-17T06:06:22.500165+0000","last_fullsized":"2024-09-17T06:06:22.500165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969403+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:06:21.969403+0000","last_peered":"2024-09-17T06:06:21.969403+0000","last_clean":"2024-09-17T06:06:21.969403+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:06:21.969403+0000","last_undegraded":"2024-09-17T06:06:21.969403+0000","last_fullsized":"2024-09-17T06:06:21.969403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499697+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:06:22.499697+0000","last_peered":"2024-09-17T06:06:22.499697+0000","last_clean":"2024-09-17T06:06:22.499697+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:06:22.499697+0000","last_undegraded":"2024-09-17T06:06:22.499697+0000","last_fullsized":"2024-09-17T06:06:22.499697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967340+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:06:21.967340+0000","last_peered":"2024-09-17T06:06:21.967340+0000","last_clean":"2024-09-17T06:06:21.967340+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:06:21.967340+0000","last_undegraded":"2024-09-17T06:06:21.967340+0000","last_fullsized":"2024-09-17T06:06:21.967340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503415+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:06:22.503415+0000","last_peered":"2024-09-17T06:06:22.503415+0000","last_clean":"2024-09-17T06:06:22.503415+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:06:22.503415+0000","last_undegraded":"2024-09-17T06:06:22.503415+0000","last_fullsized":"2024-09-17T06:06:22.503415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37299,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":84,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":74598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":523332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":937984,"data_stored":487243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1556480,"data_stored":1084902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28540,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343300,"statfs":{"total":96636764160,"available":96607539200,"internally_reserved":0,"allocated":1544192,"data_stored":1084756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":522920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906950,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28992,"kb_used_data":936,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342848,"statfs":{"total":96636764160,"available":96607076352,"internally_reserved":0,"allocated":958464,"data_stored":493932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":493876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542177,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":950272,"data_stored":493896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:06:26.187 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-17T06:06:26.187 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-17T06:06:26.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.376+0000 7f6142129640 1 -- 172.21.15.122:0/1755213050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6124004d50 msgr2=0x7f61240051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:26.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.376+0000 7f6142129640 1 --2- 172.21.15.122:0/1755213050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6124004d50 0x7f61240051a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6134009e00 tx=0x7f613401d150 comp rx=0 tx=0).stop 2024-09-17T06:06:26.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.376+0000 7f613bfff640 1 -- 172.21.15.122:0/1755213050 reap_dead start 2024-09-17T06:06:26.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.376+0000 7f6142129640 1 -- 172.21.15.122:0/1755213050 shutdown_connections 2024-09-17T06:06:26.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.376+0000 7f6142129640 1 -- 172.21.15.122:0/1755213050 >> 172.21.15.122:0/1755213050 conn(0x7f613c070e40 msgr2=0x7f613c071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:26.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.376+0000 7f6142129640 1 -- 172.21.15.122:0/1755213050 shutdown_connections 2024-09-17T06:06:26.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.376+0000 7f6142129640 1 -- 172.21.15.122:0/1755213050 wait complete. 2024-09-17T06:06:26.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.376+0000 7f6142129640 1 Processor -- start 2024-09-17T06:06:26.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.376+0000 7f6142129640 1 -- start start 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6142129640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6124004d50 0x7f613c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6142129640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613c14c720 0x7f613c145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6142129640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c14cb30 0x7f613c145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6142129640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f613c0cb860 con 0x7f613c14c720 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6142129640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f613c159c40 con 0x7f613c14cb30 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6142129640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f613c15a160 con 0x7f6124004d50 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f613affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613c14c720 0x7f613c145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f613affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613c14c720 0x7f613c145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54696/0 (socket says 172.21.15.122:54696) 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f613affd640 1 -- 172.21.15.122:0/1406529470 learned_addr learned my addr 172.21.15.122:0/1406529470 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f613b7fe640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6124004d50 0x7f613c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f613bfff640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c14cb30 0x7f613c145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f613affd640 1 -- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6124004d50 msgr2=0x7f613c150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:26.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f613affd640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6124004d50 0x7f613c150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f613affd640 1 -- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c14cb30 msgr2=0x7f613c145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:26.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f613affd640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c14cb30 0x7f613c145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f613affd640 1 -- 172.21.15.122:0/1406529470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c1514e0 con 0x7f613c14c720 2024-09-17T06:06:26.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f613bfff640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c14cb30 0x7f613c145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:26.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f613affd640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613c14c720 0x7f613c145000 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f613000fa30 tx=0x7f613000fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:26.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6123fff640 1 -- 172.21.15.122:0/1406529470 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613000bd10 con 0x7f613c14c720 2024-09-17T06:06:26.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6123fff640 1 -- 172.21.15.122:0/1406529470 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6130004030 con 0x7f613c14c720 2024-09-17T06:06:26.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6123fff640 1 -- 172.21.15.122:0/1406529470 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130004460 con 0x7f613c14c720 2024-09-17T06:06:26.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6142129640 1 -- 172.21.15.122:0/1406529470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613c0c7790 con 0x7f613c14c720 2024-09-17T06:06:26.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6142129640 1 -- 172.21.15.122:0/1406529470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613c0c8470 con 0x7f613c14c720 2024-09-17T06:06:26.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6142129640 1 -- 172.21.15.122:0/1406529470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f613c0c4040 con 0x7f613c14c720 2024-09-17T06:06:26.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.380+0000 7f6123fff640 1 -- 172.21.15.122:0/1406529470 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6130003600 con 0x7f613c14c720 2024-09-17T06:06:26.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.384+0000 7f6123fff640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6128073200 0x7f6128075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:26.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.384+0000 7f6123fff640 1 -- 172.21.15.122:0/1406529470 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f6130094f60 con 0x7f613c14c720 2024-09-17T06:06:26.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.384+0000 7f613b7fe640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6128073200 0x7f6128075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:26.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.384+0000 7f613b7fe640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6128073200 0x7f6128075710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f612c001c10 tx=0x7f612c001ba0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:26.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.388+0000 7f6123fff640 1 -- 172.21.15.122:0/1406529470 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f613005f630 con 0x7f613c14c720 2024-09-17T06:06:26.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.544+0000 7f6142129640 1 -- 172.21.15.122:0/1406529470 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"} v 0) -- 0x7f613c072890 con 0x7f613c14c720 2024-09-17T06:06:26.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.548+0000 7f6123fff640 1 -- 172.21.15.122:0/1406529470 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]=0 v38) ==== 118+0+0 (secure 0 0 0) 0x7f6130064060 con 0x7f613c14c720 2024-09-17T06:06:26.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.552+0000 7f6142129640 1 -- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6128073200 msgr2=0x7f6128075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:26.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.552+0000 7f6142129640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6128073200 0x7f6128075710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f612c001c10 tx=0x7f612c001ba0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.552+0000 7f6142129640 1 -- 172.21.15.122:0/1406529470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613c14c720 msgr2=0x7f613c145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:26.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.552+0000 7f6142129640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613c14c720 0x7f613c145000 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f613000fa30 tx=0x7f613000fef0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.552+0000 7f6142129640 1 -- 172.21.15.122:0/1406529470 shutdown_connections 2024-09-17T06:06:26.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.552+0000 7f6142129640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6128073200 0x7f6128075710 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.552+0000 7f6142129640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f613c14cb30 0x7f613c145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.552+0000 7f6142129640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613c14c720 0x7f613c145000 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.552+0000 7f6142129640 1 --2- 172.21.15.122:0/1406529470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6124004d50 0x7f613c150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.552+0000 7f6142129640 1 -- 172.21.15.122:0/1406529470 >> 172.21.15.122:0/1406529470 conn(0x7f613c070e40 msgr2=0x7f613c0cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:26.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.552+0000 7f6142129640 1 -- 172.21.15.122:0/1406529470 shutdown_connections 2024-09-17T06:06:26.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.552+0000 7f6142129640 1 -- 172.21.15.122:0/1406529470 wait complete. 2024-09-17T06:06:26.577 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-17T06:06:26.586 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-17T06:06:26.586 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:06:26.586 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T06:06:26.592 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:06:26.592 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T06:06:26.641 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T06:06:26.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.836+0000 7efdb56bb640 1 -- 172.21.15.122:0/3091381218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb0158150 msgr2=0x7efdb0152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:26.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.836+0000 7efdb56bb640 1 --2- 172.21.15.122:0/3091381218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb0158150 0x7efdb0152240 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efdb00ca270 tx=0x7efda001ccf0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.836+0000 7efdb56bb640 1 -- 172.21.15.122:0/3091381218 shutdown_connections 2024-09-17T06:06:26.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.836+0000 7efdb56bb640 1 --2- 172.21.15.122:0/3091381218 >> v2:172.21.15.173:3300/0 conn(0x7efdb00c29c0 0x7efdb00c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.836+0000 7efdb56bb640 1 --2- 172.21.15.122:0/3091381218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb0158150 0x7efdb0152240 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.836+0000 7efdb56bb640 1 -- 172.21.15.122:0/3091381218 >> 172.21.15.122:0/3091381218 conn(0x7efdb00ca380 msgr2=0x7efdb00ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:26.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.836+0000 7efdb56bb640 1 -- 172.21.15.122:0/3091381218 shutdown_connections 2024-09-17T06:06:26.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.836+0000 7efdb56bb640 1 -- 172.21.15.122:0/3091381218 wait complete. 2024-09-17T06:06:26.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdb56bb640 1 Processor -- start 2024-09-17T06:06:26.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdb56bb640 1 -- start start 2024-09-17T06:06:26.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdb56bb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb00c29c0 0x7efdb014d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:26.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdb56bb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb00c2dd0 0x7efdb00ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:26.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdb56bb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb0158150 0x7efdb0137110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:26.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdb56bb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efdb006ff60 con 0x7efdb0158150 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdb56bb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efdb0152780 con 0x7efdb00c2dd0 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdb56bb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7efdb014da10 con 0x7efdb00c29c0 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdaf7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb0158150 0x7efdb0137110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdaf7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb0158150 0x7efdb0137110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54712/0 (socket says 172.21.15.122:54712) 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdaf7fe640 1 -- 172.21.15.122:0/1451891668 learned_addr learned my addr 172.21.15.122:0/1451891668 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdae7fc640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb00c2dd0 0x7efdb00ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdaeffd640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb00c29c0 0x7efdb014d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdaf7fe640 1 -- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb00c29c0 msgr2=0x7efdb014d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdaf7fe640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb00c29c0 0x7efdb014d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdaf7fe640 1 -- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb00c2dd0 msgr2=0x7efdb00ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdaf7fe640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb00c2dd0 0x7efdb00ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdaf7fe640 1 -- 172.21.15.122:0/1451891668 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb014f5e0 con 0x7efdb0158150 2024-09-17T06:06:26.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdae7fc640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb00c2dd0 0x7efdb00ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:26.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdaf7fe640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb0158150 0x7efdb0137110 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7efda800b470 tx=0x7efda800b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:26.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efd977fe640 1 -- 172.21.15.122:0/1451891668 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8015020 con 0x7efdb0158150 2024-09-17T06:06:26.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efd977fe640 1 -- 172.21.15.122:0/1451891668 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efda8011920 con 0x7efdb0158150 2024-09-17T06:06:26.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efd977fe640 1 -- 172.21.15.122:0/1451891668 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8011d70 con 0x7efdb0158150 2024-09-17T06:06:26.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdb56bb640 1 -- 172.21.15.122:0/1451891668 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb006d8a0 con 0x7efdb0158150 2024-09-17T06:06:26.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.840+0000 7efdb56bb640 1 -- 172.21.15.122:0/1451891668 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb00c7ce0 con 0x7efdb0158150 2024-09-17T06:06:26.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.844+0000 7efdb56bb640 1 -- 172.21.15.122:0/1451891668 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb00728c0 con 0x7efdb0158150 2024-09-17T06:06:26.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.844+0000 7efd977fe640 1 -- 172.21.15.122:0/1451891668 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efda8018020 con 0x7efdb0158150 2024-09-17T06:06:26.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.844+0000 7efd977fe640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd9c073230 0x7efd9c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:26.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.844+0000 7efd977fe640 1 -- 172.21.15.122:0/1451891668 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7efda80942e0 con 0x7efdb0158150 2024-09-17T06:06:26.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.844+0000 7efdaeffd640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd9c073230 0x7efd9c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:26.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.844+0000 7efdaeffd640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd9c073230 0x7efd9c075740 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efda00af000 tx=0x7efda001b530 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:26.850 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:26.848+0000 7efd977fe640 1 -- 172.21.15.122:0/1451891668 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efda801f020 con 0x7efdb0158150 2024-09-17T06:06:27.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.012+0000 7efdb56bb640 1 -- 172.21.15.122:0/1451891668 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efdb01577f0 con 0x7efdb0158150 2024-09-17T06:06:27.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.012+0000 7efd977fe640 1 -- 172.21.15.122:0/1451891668 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) ==== 80+0+0 (secure 0 0 0) 0x7efda805f000 con 0x7efdb0158150 2024-09-17T06:06:27.015 INFO:teuthology.orchestra.run.smithi122.stderr:listed 0 entries 2024-09-17T06:06:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.016+0000 7efdb56bb640 1 -- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd9c073230 msgr2=0x7efd9c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.016+0000 7efdb56bb640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd9c073230 0x7efd9c075740 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efda00af000 tx=0x7efda001b530 comp rx=0 tx=0).stop 2024-09-17T06:06:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.016+0000 7efdb56bb640 1 -- 172.21.15.122:0/1451891668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb0158150 msgr2=0x7efdb0137110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.016+0000 7efdb56bb640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb0158150 0x7efdb0137110 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7efda800b470 tx=0x7efda800b930 comp rx=0 tx=0).stop 2024-09-17T06:06:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.016+0000 7efdb56bb640 1 -- 172.21.15.122:0/1451891668 shutdown_connections 2024-09-17T06:06:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.016+0000 7efdb56bb640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdb0158150 0x7efdb0137110 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.016+0000 7efdb56bb640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7efd9c073230 0x7efd9c075740 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.016+0000 7efdb56bb640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb00c2dd0 0x7efdb00ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.016+0000 7efdb56bb640 1 --2- 172.21.15.122:0/1451891668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdb00c29c0 0x7efdb014d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.016+0000 7efdb56bb640 1 -- 172.21.15.122:0/1451891668 >> 172.21.15.122:0/1451891668 conn(0x7efdb00ca380 msgr2=0x7efdb00c3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.016+0000 7efdb56bb640 1 -- 172.21.15.122:0/1451891668 shutdown_connections 2024-09-17T06:06:27.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.016+0000 7efdb56bb640 1 -- 172.21.15.122:0/1451891668 wait complete. 2024-09-17T06:06:27.038 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-17T06:06:27.038 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T06:06:27.043 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T06:06:27.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 -- 172.21.15.122:0/169021984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55080ccdb0 msgr2=0x7f55080cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:27.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 --2- 172.21.15.122:0/169021984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55080ccdb0 0x7f55080cc1e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f550806f0c0 tx=0x7f550401c830 comp rx=0 tx=0).stop 2024-09-17T06:06:27.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 -- 172.21.15.122:0/169021984 shutdown_connections 2024-09-17T06:06:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 --2- 172.21.15.122:0/169021984 >> v2:172.21.15.173:3300/0 conn(0x7f55080cbb40 0x7f550815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 --2- 172.21.15.122:0/169021984 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f550806dab0 0x7f55080cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 --2- 172.21.15.122:0/169021984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55080ccdb0 0x7f55080cc1e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 -- 172.21.15.122:0/169021984 >> 172.21.15.122:0/169021984 conn(0x7f550808d450 msgr2=0x7f550806ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 -- 172.21.15.122:0/169021984 shutdown_connections 2024-09-17T06:06:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 -- 172.21.15.122:0/169021984 wait complete. 2024-09-17T06:06:27.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 Processor -- start 2024-09-17T06:06:27.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 -- start start 2024-09-17T06:06:27.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f550806dab0 0x7f55081f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:27.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55080cbb40 0x7f550815d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:27.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55080ccdb0 0x7f550814a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:27.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f550806ff20 con 0x7f550806dab0 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5508155970 con 0x7f55080cbb40 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550fde9640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f55080700a0 con 0x7f55080ccdb0 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550db85640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f550806dab0 0x7f55081f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550db85640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f550806dab0 0x7f55081f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54728/0 (socket says 172.21.15.122:54728) 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550db85640 1 -- 172.21.15.122:0/310809226 learned_addr learned my addr 172.21.15.122:0/310809226 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550d384640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55080cbb40 0x7f550815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550e386640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55080ccdb0 0x7f550814a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550db85640 1 -- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55080ccdb0 msgr2=0x7f550814a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550db85640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55080ccdb0 0x7f550814a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550db85640 1 -- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55080cbb40 msgr2=0x7f550815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550db85640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55080cbb40 0x7f550815d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550db85640 1 -- 172.21.15.122:0/310809226 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55081f4f60 con 0x7f550806dab0 2024-09-17T06:06:27.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550d384640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55080cbb40 0x7f550815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:27.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.236+0000 7f550db85640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f550806dab0 0x7f55081f5700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f550401aee0 tx=0x7f55040a5640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:27.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.240+0000 7f54fe7fc640 1 -- 172.21.15.122:0/310809226 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55040bb070 con 0x7f550806dab0 2024-09-17T06:06:27.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.240+0000 7f54fe7fc640 1 -- 172.21.15.122:0/310809226 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55040043b0 con 0x7f550806dab0 2024-09-17T06:06:27.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.240+0000 7f550fde9640 1 -- 172.21.15.122:0/310809226 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55081f5c40 con 0x7f550806dab0 2024-09-17T06:06:27.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.240+0000 7f54fe7fc640 1 -- 172.21.15.122:0/310809226 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55040b2040 con 0x7f550806dab0 2024-09-17T06:06:27.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.240+0000 7f550fde9640 1 -- 172.21.15.122:0/310809226 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5508155f80 con 0x7f550806dab0 2024-09-17T06:06:27.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.240+0000 7f550fde9640 1 -- 172.21.15.122:0/310809226 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550815b470 con 0x7f550806dab0 2024-09-17T06:06:27.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.240+0000 7f54fe7fc640 1 -- 172.21.15.122:0/310809226 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f55040be070 con 0x7f550806dab0 2024-09-17T06:06:27.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.240+0000 7f54fe7fc640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f54ec073230 0x7f54ec075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:27.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.240+0000 7f54fe7fc640 1 -- 172.21.15.122:0/310809226 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f550412deb0 con 0x7f550806dab0 2024-09-17T06:06:27.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.240+0000 7f550d384640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f54ec073230 0x7f54ec075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:27.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.240+0000 7f550d384640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f54ec073230 0x7f54ec075740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f54f8005fd0 tx=0x7f54f8005d60 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:27.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.244+0000 7f54fe7fc640 1 -- 172.21.15.122:0/310809226 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f55081f4f60 con 0x7f550806dab0 2024-09-17T06:06:27.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.420+0000 7f550fde9640 1 -- 172.21.15.122:0/310809226 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f55080cb920 con 0x7f550806dab0 2024-09-17T06:06:27.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.420+0000 7f54fe7fc640 1 -- 172.21.15.122:0/310809226 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) ==== 80+0+0 (secure 0 0 0) 0x7f55040164b0 con 0x7f550806dab0 2024-09-17T06:06:27.422 INFO:teuthology.orchestra.run.smithi122.stderr:listed 0 entries 2024-09-17T06:06:27.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.424+0000 7f550fde9640 1 -- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f54ec073230 msgr2=0x7f54ec075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:27.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.424+0000 7f550fde9640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f54ec073230 0x7f54ec075740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f54f8005fd0 tx=0x7f54f8005d60 comp rx=0 tx=0).stop 2024-09-17T06:06:27.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.424+0000 7f550fde9640 1 -- 172.21.15.122:0/310809226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f550806dab0 msgr2=0x7f55081f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:27.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.424+0000 7f550fde9640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f550806dab0 0x7f55081f5700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f550401aee0 tx=0x7f55040a5640 comp rx=0 tx=0).stop 2024-09-17T06:06:27.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.424+0000 7f550fde9640 1 -- 172.21.15.122:0/310809226 shutdown_connections 2024-09-17T06:06:27.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.424+0000 7f550fde9640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55080ccdb0 0x7f550814a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.424+0000 7f550fde9640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f54ec073230 0x7f54ec075740 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.424+0000 7f550fde9640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55080cbb40 0x7f550815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.424+0000 7f550fde9640 1 --2- 172.21.15.122:0/310809226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f550806dab0 0x7f55081f5700 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:27.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.424+0000 7f550fde9640 1 -- 172.21.15.122:0/310809226 >> 172.21.15.122:0/310809226 conn(0x7f550808d450 msgr2=0x7f5508153bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:27.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.424+0000 7f550fde9640 1 -- 172.21.15.122:0/310809226 shutdown_connections 2024-09-17T06:06:27.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:27.424+0000 7f550fde9640 1 -- 172.21.15.122:0/310809226 wait complete. 2024-09-17T06:06:27.445 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi122.front.sepia.ceph.com... 2024-09-17T06:06:27.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:06:27.445 DEBUG:teuthology.orchestra.run.smithi122:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T06:06:27.456 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi122.stderr:ceph-fuse[37080]: fuse finished with error 0 and tester_r 0 2024-09-17T06:06:27.457 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:06:33.559 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T06:06:33.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:06:33.559 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T06:06:33.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:06:33.567 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-09-17T06:06:33.617 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T06:06:33.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:06:33.618 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T06:06:33.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T06:06:33.677 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link delete ceph-brx 2024-09-17T06:06:33.874 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T06:06:33.883 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T06:06:33.884 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:06:34.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 -- 172.21.15.122:0/385982327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2078004010 msgr2=0x7f2078004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 --2- 172.21.15.122:0/385982327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2078004010 0x7f2078004810 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2084001660 tx=0x7f208401c780 comp rx=0 tx=0).stop 2024-09-17T06:06:34.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f208ffff640 1 -- 172.21.15.122:0/385982327 reap_dead start 2024-09-17T06:06:34.048 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 -- 172.21.15.122:0/385982327 shutdown_connections 2024-09-17T06:06:34.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 -- 172.21.15.122:0/385982327 >> 172.21.15.122:0/385982327 conn(0x7f209008d450 msgr2=0x7f209006ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:34.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 -- 172.21.15.122:0/385982327 shutdown_connections 2024-09-17T06:06:34.049 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 -- 172.21.15.122:0/385982327 wait complete. 2024-09-17T06:06:34.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 Processor -- start 2024-09-17T06:06:34.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 -- start start 2024-09-17T06:06:34.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2078004010 0x7f20901563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:34.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2090158600 0x7f20900d1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:34.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f209014cb10 0x7f20901522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:34.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f20900cca70 con 0x7f2090158600 2024-09-17T06:06:34.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20900cc8f0 con 0x7f209014cb10 2024-09-17T06:06:34.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f2095ffc640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f2090167510 con 0x7f2078004010 2024-09-17T06:06:34.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f208effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2090158600 0x7f20900d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:34.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f208effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2090158600 0x7f20900d1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54742/0 (socket says 172.21.15.122:54742) 2024-09-17T06:06:34.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f208effd640 1 -- 172.21.15.122:0/92799278 learned_addr learned my addr 172.21.15.122:0/92799278 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:34.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.048+0000 7f208f7fe640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2078004010 0x7f20901563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:34.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f208ffff640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f209014cb10 0x7f20901522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:34.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f208effd640 1 -- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2078004010 msgr2=0x7f20901563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f208effd640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2078004010 0x7f20901563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f208effd640 1 -- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f209014cb10 msgr2=0x7f20901522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f208effd640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f209014cb10 0x7f20901522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f208effd640 1 -- 172.21.15.122:0/92799278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2090156900 con 0x7f2090158600 2024-09-17T06:06:34.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f208ffff640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f209014cb10 0x7f20901522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:34.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f208effd640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2090158600 0x7f20900d1220 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2084000c10 tx=0x7f2084003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:34.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f2077fff640 1 -- 172.21.15.122:0/92799278 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20840ad070 con 0x7f2090158600 2024-09-17T06:06:34.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f2077fff640 1 -- 172.21.15.122:0/92799278 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2084006500 con 0x7f2090158600 2024-09-17T06:06:34.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f2095ffc640 1 -- 172.21.15.122:0/92799278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2090155f70 con 0x7f2090158600 2024-09-17T06:06:34.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f2077fff640 1 -- 172.21.15.122:0/92799278 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20840012b0 con 0x7f2090158600 2024-09-17T06:06:34.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f2095ffc640 1 -- 172.21.15.122:0/92799278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20901f8950 con 0x7f2090158600 2024-09-17T06:06:34.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f2095ffc640 1 -- 172.21.15.122:0/92799278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209015b470 con 0x7f2090158600 2024-09-17T06:06:34.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f2077fff640 1 -- 172.21.15.122:0/92799278 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f20840a76a0 con 0x7f2090158600 2024-09-17T06:06:34.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f2077fff640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f207c073230 0x7f207c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:34.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f2077fff640 1 -- 172.21.15.122:0/92799278 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f208412e4d0 con 0x7f2090158600 2024-09-17T06:06:34.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f208f7fe640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f207c073230 0x7f207c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:34.055 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.052+0000 7f208f7fe640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f207c073230 0x7f207c075740 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f20800018b0 tx=0x7f2080000ee0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:34.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.056+0000 7f2077fff640 1 -- 172.21.15.122:0/92799278 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2084016490 con 0x7f2090158600 2024-09-17T06:06:34.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.224+0000 7f2095ffc640 1 -- 172.21.15.122:0/92799278 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2090164ad0 con 0x7f207c073230 2024-09-17T06:06:34.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.240+0000 7f2077fff640 1 -- 172.21.15.122:0/92799278 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332881 (secure 0 0 0) 0x7f2090164ad0 con 0x7f207c073230 2024-09-17T06:06:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:06:34.248 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:06:34.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.248+0000 7f2095ffc640 1 -- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f207c073230 msgr2=0x7f207c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.248+0000 7f2095ffc640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f207c073230 0x7f207c075740 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f20800018b0 tx=0x7f2080000ee0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.248+0000 7f2095ffc640 1 -- 172.21.15.122:0/92799278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2090158600 msgr2=0x7f20900d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.248+0000 7f2095ffc640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2090158600 0x7f20900d1220 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2084000c10 tx=0x7f2084003c80 comp rx=0 tx=0).stop 2024-09-17T06:06:34.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.248+0000 7f2095ffc640 1 -- 172.21.15.122:0/92799278 shutdown_connections 2024-09-17T06:06:34.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.248+0000 7f2095ffc640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f207c073230 0x7f207c075740 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.248+0000 7f2095ffc640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f209014cb10 0x7f20901522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.248+0000 7f2095ffc640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2090158600 0x7f20900d1220 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.248+0000 7f2095ffc640 1 --2- 172.21.15.122:0/92799278 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2078004010 0x7f20901563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.248+0000 7f2095ffc640 1 -- 172.21.15.122:0/92799278 >> 172.21.15.122:0/92799278 conn(0x7f209008d450 msgr2=0x7f2090151af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:34.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.248+0000 7f2095ffc640 1 -- 172.21.15.122:0/92799278 shutdown_connections 2024-09-17T06:06:34.250 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.248+0000 7f2095ffc640 1 -- 172.21.15.122:0/92799278 wait complete. 2024-09-17T06:06:34.270 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-17T06:06:33.572936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":656,"ondisk_log_size":656,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242544,"kb_used_data":8688,"kb_used_omap":17,"kb_used_meta":233710,"kb_avail":754732176,"statfs":{"total":773094113280,"available":772845748224,"internally_reserved":0,"allocated":8896512,"data_stored":5206280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":239319789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.608481"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500455+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:06:22.500455+0000","last_peered":"2024-09-17T06:06:22.500455+0000","last_clean":"2024-09-17T06:06:22.500455+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:06:22.500455+0000","last_undegraded":"2024-09-17T06:06:22.500455+0000","last_fullsized":"2024-09-17T06:06:22.500455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.522869+0000","last_change":"2024-09-17T06:06:14.882867+0000","last_active":"2024-09-17T06:06:27.522869+0000","last_peered":"2024-09-17T06:06:27.522869+0000","last_clean":"2024-09-17T06:06:27.522869+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:06:27.522869+0000","last_undegraded":"2024-09-17T06:06:27.522869+0000","last_fullsized":"2024-09-17T06:06:27.522869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:30.856555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498014+0000","last_change":"2024-09-17T06:06:15.369420+0000","last_active":"2024-09-17T06:06:22.498014+0000","last_peered":"2024-09-17T06:06:22.498014+0000","last_clean":"2024-09-17T06:06:22.498014+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:06:22.498014+0000","last_undegraded":"2024-09-17T06:06:22.498014+0000","last_fullsized":"2024-09-17T06:06:22.498014+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:26.332180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500348+0000","last_change":"2024-09-17T06:06:14.876941+0000","last_active":"2024-09-17T06:06:22.500348+0000","last_peered":"2024-09-17T06:06:22.500348+0000","last_clean":"2024-09-17T06:06:22.500348+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:06:22.500348+0000","last_undegraded":"2024-09-17T06:06:22.500348+0000","last_fullsized":"2024-09-17T06:06:22.500348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:16.802718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.559750+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:06:27.559750+0000","last_peered":"2024-09-17T06:06:27.559750+0000","last_clean":"2024-09-17T06:06:27.559750+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:06:27.559750+0000","last_undegraded":"2024-09-17T06:06:27.559750+0000","last_fullsized":"2024-09-17T06:06:27.559750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966721+0000","last_change":"2024-09-17T06:06:02.760496+0000","last_active":"2024-09-17T06:06:21.966721+0000","last_peered":"2024-09-17T06:06:21.966721+0000","last_clean":"2024-09-17T06:06:21.966721+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:06:21.966721+0000","last_undegraded":"2024-09-17T06:06:21.966721+0000","last_fullsized":"2024-09-17T06:06:21.966721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.085087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"60'3","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501464+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:06:22.501464+0000","last_peered":"2024-09-17T06:06:22.501464+0000","last_clean":"2024-09-17T06:06:22.501464+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:06:22.501464+0000","last_undegraded":"2024-09-17T06:06:22.501464+0000","last_fullsized":"2024-09-17T06:06:22.501464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568851+0000","last_change":"2024-09-17T06:06:02.772542+0000","last_active":"2024-09-17T06:06:27.568851+0000","last_peered":"2024-09-17T06:06:27.568851+0000","last_clean":"2024-09-17T06:06:27.568851+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:27.568851+0000","last_undegraded":"2024-09-17T06:06:27.568851+0000","last_fullsized":"2024-09-17T06:06:27.568851+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:31.442644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968566+0000","last_change":"2024-09-17T06:06:02.762154+0000","last_active":"2024-09-17T06:06:21.968566+0000","last_peered":"2024-09-17T06:06:21.968566+0000","last_clean":"2024-09-17T06:06:21.968566+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:06:21.968566+0000","last_undegraded":"2024-09-17T06:06:21.968566+0000","last_fullsized":"2024-09-17T06:06:21.968566+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:56.087057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500504+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:06:22.500504+0000","last_peered":"2024-09-17T06:06:22.500504+0000","last_clean":"2024-09-17T06:06:22.500504+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:06:22.500504+0000","last_undegraded":"2024-09-17T06:06:22.500504+0000","last_fullsized":"2024-09-17T06:06:22.500504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.549485+0000","last_change":"2024-09-17T06:06:02.747441+0000","last_active":"2024-09-17T06:06:27.549485+0000","last_peered":"2024-09-17T06:06:27.549485+0000","last_clean":"2024-09-17T06:06:27.549485+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:06:27.549485+0000","last_undegraded":"2024-09-17T06:06:27.549485+0000","last_fullsized":"2024-09-17T06:06:27.549485+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:56.535771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968309+0000","last_change":"2024-09-17T06:06:02.760042+0000","last_active":"2024-09-17T06:06:21.968309+0000","last_peered":"2024-09-17T06:06:21.968309+0000","last_clean":"2024-09-17T06:06:21.968309+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:06:21.968309+0000","last_undegraded":"2024-09-17T06:06:21.968309+0000","last_fullsized":"2024-09-17T06:06:21.968309+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:53.866107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.555668+0000","last_change":"2024-09-17T06:06:02.772614+0000","last_active":"2024-09-17T06:06:27.555668+0000","last_peered":"2024-09-17T06:06:27.555668+0000","last_clean":"2024-09-17T06:06:27.555668+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:06:27.555668+0000","last_undegraded":"2024-09-17T06:06:27.555668+0000","last_fullsized":"2024-09-17T06:06:27.555668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:56.086542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"60'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501042+0000","last_change":"2024-09-17T06:06:02.763938+0000","last_active":"2024-09-17T06:06:22.501042+0000","last_peered":"2024-09-17T06:06:22.501042+0000","last_clean":"2024-09-17T06:06:22.501042+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:06:22.501042+0000","last_undegraded":"2024-09-17T06:06:22.501042+0000","last_fullsized":"2024-09-17T06:06:22.501042+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:09.262608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969558+0000","last_change":"2024-09-17T06:06:02.764648+0000","last_active":"2024-09-17T06:06:21.969558+0000","last_peered":"2024-09-17T06:06:21.969558+0000","last_clean":"2024-09-17T06:06:21.969558+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:06:21.969558+0000","last_undegraded":"2024-09-17T06:06:21.969558+0000","last_fullsized":"2024-09-17T06:06:21.969558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:56.341325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.536106+0000","last_change":"2024-09-17T06:06:14.877208+0000","last_active":"2024-09-17T06:06:27.536106+0000","last_peered":"2024-09-17T06:06:27.536106+0000","last_clean":"2024-09-17T06:06:27.536106+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:06:27.536106+0000","last_undegraded":"2024-09-17T06:06:27.536106+0000","last_fullsized":"2024-09-17T06:06:27.536106+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:16.547077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967926+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:06:21.967926+0000","last_peered":"2024-09-17T06:06:21.967926+0000","last_clean":"2024-09-17T06:06:21.967926+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:06:21.967926+0000","last_undegraded":"2024-09-17T06:06:21.967926+0000","last_fullsized":"2024-09-17T06:06:21.967926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969187+0000","last_change":"2024-09-17T06:06:02.777996+0000","last_active":"2024-09-17T06:06:21.969187+0000","last_peered":"2024-09-17T06:06:21.969187+0000","last_clean":"2024-09-17T06:06:21.969187+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:06:21.969187+0000","last_undegraded":"2024-09-17T06:06:21.969187+0000","last_fullsized":"2024-09-17T06:06:21.969187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:04.148545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.502605+0000","last_change":"2024-09-17T06:06:14.859614+0000","last_active":"2024-09-17T06:06:27.502605+0000","last_peered":"2024-09-17T06:06:27.502605+0000","last_clean":"2024-09-17T06:06:27.502605+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:06:27.502605+0000","last_undegraded":"2024-09-17T06:06:27.502605+0000","last_fullsized":"2024-09-17T06:06:27.502605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.132428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966735+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:06:21.966735+0000","last_peered":"2024-09-17T06:06:21.966735+0000","last_clean":"2024-09-17T06:06:21.966735+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:06:21.966735+0000","last_undegraded":"2024-09-17T06:06:21.966735+0000","last_fullsized":"2024-09-17T06:06:21.966735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967353+0000","last_change":"2024-09-17T06:06:02.773038+0000","last_active":"2024-09-17T06:06:21.967353+0000","last_peered":"2024-09-17T06:06:21.967353+0000","last_clean":"2024-09-17T06:06:21.967353+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:06:21.967353+0000","last_undegraded":"2024-09-17T06:06:21.967353+0000","last_fullsized":"2024-09-17T06:06:21.967353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:24.833172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.539183+0000","last_change":"2024-09-17T06:06:02.742391+0000","last_active":"2024-09-17T06:06:27.539183+0000","last_peered":"2024-09-17T06:06:27.539183+0000","last_clean":"2024-09-17T06:06:27.539183+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:06:27.539183+0000","last_undegraded":"2024-09-17T06:06:27.539183+0000","last_fullsized":"2024-09-17T06:06:27.539183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:18.282190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499601+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:06:22.499601+0000","last_peered":"2024-09-17T06:06:22.499601+0000","last_clean":"2024-09-17T06:06:22.499601+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:06:22.499601+0000","last_undegraded":"2024-09-17T06:06:22.499601+0000","last_fullsized":"2024-09-17T06:06:22.499601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.973250+0000","last_change":"2024-09-17T06:06:02.760965+0000","last_active":"2024-09-17T06:06:21.973250+0000","last_peered":"2024-09-17T06:06:21.973250+0000","last_clean":"2024-09-17T06:06:21.973250+0000","last_became_active":"2024-09-17T06:06:02.755335+0000","last_became_peered":"2024-09-17T06:06:02.755335+0000","last_unstale":"2024-09-17T06:06:21.973250+0000","last_undegraded":"2024-09-17T06:06:21.973250+0000","last_fullsized":"2024-09-17T06:06:21.973250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:49.568290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.530774+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:06:27.530774+0000","last_peered":"2024-09-17T06:06:27.530774+0000","last_clean":"2024-09-17T06:06:27.530774+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:06:27.530774+0000","last_undegraded":"2024-09-17T06:06:27.530774+0000","last_fullsized":"2024-09-17T06:06:27.530774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"61'3","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503161+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:06:22.503161+0000","last_peered":"2024-09-17T06:06:22.503161+0000","last_clean":"2024-09-17T06:06:22.503161+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:06:22.503161+0000","last_undegraded":"2024-09-17T06:06:22.503161+0000","last_fullsized":"2024-09-17T06:06:22.503161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967557+0000","last_change":"2024-09-17T06:06:02.770140+0000","last_active":"2024-09-17T06:06:21.967557+0000","last_peered":"2024-09-17T06:06:21.967557+0000","last_clean":"2024-09-17T06:06:21.967557+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:06:21.967557+0000","last_undegraded":"2024-09-17T06:06:21.967557+0000","last_fullsized":"2024-09-17T06:06:21.967557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:35.888277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.556341+0000","last_change":"2024-09-17T06:06:14.875548+0000","last_active":"2024-09-17T06:06:27.556341+0000","last_peered":"2024-09-17T06:06:27.556341+0000","last_clean":"2024-09-17T06:06:27.556341+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:06:27.556341+0000","last_undegraded":"2024-09-17T06:06:27.556341+0000","last_fullsized":"2024-09-17T06:06:27.556341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:24.521256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967487+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:06:21.967487+0000","last_peered":"2024-09-17T06:06:21.967487+0000","last_clean":"2024-09-17T06:06:21.967487+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:06:21.967487+0000","last_undegraded":"2024-09-17T06:06:21.967487+0000","last_fullsized":"2024-09-17T06:06:21.967487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498066+0000","last_change":"2024-09-17T06:06:14.876736+0000","last_active":"2024-09-17T06:06:22.498066+0000","last_peered":"2024-09-17T06:06:22.498066+0000","last_clean":"2024-09-17T06:06:22.498066+0000","last_became_active":"2024-09-17T06:06:14.875773+0000","last_became_peered":"2024-09-17T06:06:14.875773+0000","last_unstale":"2024-09-17T06:06:22.498066+0000","last_undegraded":"2024-09-17T06:06:22.498066+0000","last_fullsized":"2024-09-17T06:06:22.498066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:52.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.504990+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:06:27.504990+0000","last_peered":"2024-09-17T06:06:27.504990+0000","last_clean":"2024-09-17T06:06:27.504990+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:06:27.504990+0000","last_undegraded":"2024-09-17T06:06:27.504990+0000","last_fullsized":"2024-09-17T06:06:27.504990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501976+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:06:22.501976+0000","last_peered":"2024-09-17T06:06:22.501976+0000","last_clean":"2024-09-17T06:06:22.501976+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:06:22.501976+0000","last_undegraded":"2024-09-17T06:06:22.501976+0000","last_fullsized":"2024-09-17T06:06:22.501976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499225+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:06:22.499225+0000","last_peered":"2024-09-17T06:06:22.499225+0000","last_clean":"2024-09-17T06:06:22.499225+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:06:22.499225+0000","last_undegraded":"2024-09-17T06:06:22.499225+0000","last_fullsized":"2024-09-17T06:06:22.499225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.549748+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:06:27.549748+0000","last_peered":"2024-09-17T06:06:27.549748+0000","last_clean":"2024-09-17T06:06:27.549748+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:06:27.549748+0000","last_undegraded":"2024-09-17T06:06:27.549748+0000","last_fullsized":"2024-09-17T06:06:27.549748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968198+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:06:21.968198+0000","last_peered":"2024-09-17T06:06:21.968198+0000","last_clean":"2024-09-17T06:06:21.968198+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:06:21.968198+0000","last_undegraded":"2024-09-17T06:06:21.968198+0000","last_fullsized":"2024-09-17T06:06:21.968198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967191+0000","last_change":"2024-09-17T06:06:02.750734+0000","last_active":"2024-09-17T06:06:21.967191+0000","last_peered":"2024-09-17T06:06:21.967191+0000","last_clean":"2024-09-17T06:06:21.967191+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:06:21.967191+0000","last_undegraded":"2024-09-17T06:06:21.967191+0000","last_fullsized":"2024-09-17T06:06:21.967191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:55.436212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.547264+0000","last_change":"2024-09-17T06:06:02.780406+0000","last_active":"2024-09-17T06:06:27.547264+0000","last_peered":"2024-09-17T06:06:27.547264+0000","last_clean":"2024-09-17T06:06:27.547264+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:06:27.547264+0000","last_undegraded":"2024-09-17T06:06:27.547264+0000","last_fullsized":"2024-09-17T06:06:27.547264+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:34.785782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971985+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:06:21.971985+0000","last_peered":"2024-09-17T06:06:21.971985+0000","last_clean":"2024-09-17T06:06:21.971985+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:06:21.971985+0000","last_undegraded":"2024-09-17T06:06:21.971985+0000","last_fullsized":"2024-09-17T06:06:21.971985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967920+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:06:21.967920+0000","last_peered":"2024-09-17T06:06:21.967920+0000","last_clean":"2024-09-17T06:06:21.967920+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:06:21.967920+0000","last_undegraded":"2024-09-17T06:06:21.967920+0000","last_fullsized":"2024-09-17T06:06:21.967920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.494802+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:06:27.494802+0000","last_peered":"2024-09-17T06:06:27.494802+0000","last_clean":"2024-09-17T06:06:27.494802+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:06:27.494802+0000","last_undegraded":"2024-09-17T06:06:27.494802+0000","last_fullsized":"2024-09-17T06:06:27.494802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"62'4","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498551+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:06:22.498551+0000","last_peered":"2024-09-17T06:06:22.498551+0000","last_clean":"2024-09-17T06:06:22.498551+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:06:22.498551+0000","last_undegraded":"2024-09-17T06:06:22.498551+0000","last_fullsized":"2024-09-17T06:06:22.498551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967511+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:06:21.967511+0000","last_peered":"2024-09-17T06:06:21.967511+0000","last_clean":"2024-09-17T06:06:21.967511+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:06:21.967511+0000","last_undegraded":"2024-09-17T06:06:21.967511+0000","last_fullsized":"2024-09-17T06:06:21.967511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.545291+0000","last_change":"2024-09-17T06:06:02.775030+0000","last_active":"2024-09-17T06:06:27.545291+0000","last_peered":"2024-09-17T06:06:27.545291+0000","last_clean":"2024-09-17T06:06:27.545291+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:06:27.545291+0000","last_undegraded":"2024-09-17T06:06:27.545291+0000","last_fullsized":"2024-09-17T06:06:27.545291+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:56.086542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499602+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:06:22.499602+0000","last_peered":"2024-09-17T06:06:22.499602+0000","last_clean":"2024-09-17T06:06:22.499602+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:06:22.499602+0000","last_undegraded":"2024-09-17T06:06:22.499602+0000","last_fullsized":"2024-09-17T06:06:22.499602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500801+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:06:22.500801+0000","last_peered":"2024-09-17T06:06:22.500801+0000","last_clean":"2024-09-17T06:06:22.500801+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:06:22.500801+0000","last_undegraded":"2024-09-17T06:06:22.500801+0000","last_fullsized":"2024-09-17T06:06:22.500801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.500084+0000","last_change":"2024-09-17T06:06:14.863098+0000","last_active":"2024-09-17T06:06:27.500084+0000","last_peered":"2024-09-17T06:06:27.500084+0000","last_clean":"2024-09-17T06:06:27.500084+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:06:27.500084+0000","last_undegraded":"2024-09-17T06:06:27.500084+0000","last_fullsized":"2024-09-17T06:06:27.500084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:43.199274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969649+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:06:21.969649+0000","last_peered":"2024-09-17T06:06:21.969649+0000","last_clean":"2024-09-17T06:06:21.969649+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:06:21.969649+0000","last_undegraded":"2024-09-17T06:06:21.969649+0000","last_fullsized":"2024-09-17T06:06:21.969649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":229,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503185+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:06:22.503185+0000","last_peered":"2024-09-17T06:06:22.503185+0000","last_clean":"2024-09-17T06:06:22.503185+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:06:22.503185+0000","last_undegraded":"2024-09-17T06:06:22.503185+0000","last_fullsized":"2024-09-17T06:06:22.503185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502700+0000","last_change":"2024-09-17T06:06:02.751844+0000","last_active":"2024-09-17T06:06:22.502700+0000","last_peered":"2024-09-17T06:06:22.502700+0000","last_clean":"2024-09-17T06:06:22.502700+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:06:22.502700+0000","last_undegraded":"2024-09-17T06:06:22.502700+0000","last_fullsized":"2024-09-17T06:06:22.502700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:29.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.565234+0000","last_change":"2024-09-17T06:04:49.135526+0000","last_active":"2024-09-17T06:06:27.565234+0000","last_peered":"2024-09-17T06:06:27.565234+0000","last_clean":"2024-09-17T06:06:27.565234+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:06:27.565234+0000","last_undegraded":"2024-09-17T06:06:27.565234+0000","last_fullsized":"2024-09-17T06:06:27.565234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:45.338884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499366+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:06:22.499366+0000","last_peered":"2024-09-17T06:06:22.499366+0000","last_clean":"2024-09-17T06:06:22.499366+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:06:22.499366+0000","last_undegraded":"2024-09-17T06:06:22.499366+0000","last_fullsized":"2024-09-17T06:06:22.499366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501381+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:06:22.501381+0000","last_peered":"2024-09-17T06:06:22.501381+0000","last_clean":"2024-09-17T06:06:22.501381+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:06:22.501381+0000","last_undegraded":"2024-09-17T06:06:22.501381+0000","last_fullsized":"2024-09-17T06:06:22.501381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.548759+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:06:27.548759+0000","last_peered":"2024-09-17T06:06:27.548759+0000","last_clean":"2024-09-17T06:06:27.548759+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:06:27.548759+0000","last_undegraded":"2024-09-17T06:06:27.548759+0000","last_fullsized":"2024-09-17T06:06:27.548759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968279+0000","last_change":"2024-09-17T06:06:02.750773+0000","last_active":"2024-09-17T06:06:21.968279+0000","last_peered":"2024-09-17T06:06:21.968279+0000","last_clean":"2024-09-17T06:06:21.968279+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:06:21.968279+0000","last_undegraded":"2024-09-17T06:06:21.968279+0000","last_fullsized":"2024-09-17T06:06:21.968279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:40.847404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499934+0000","last_change":"2024-09-17T06:06:02.772644+0000","last_active":"2024-09-17T06:06:22.499934+0000","last_peered":"2024-09-17T06:06:22.499934+0000","last_clean":"2024-09-17T06:06:22.499934+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:06:22.499934+0000","last_undegraded":"2024-09-17T06:06:22.499934+0000","last_fullsized":"2024-09-17T06:06:22.499934+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:29.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568314+0000","last_change":"2024-09-17T06:06:02.743237+0000","last_active":"2024-09-17T06:06:27.568314+0000","last_peered":"2024-09-17T06:06:27.568314+0000","last_clean":"2024-09-17T06:06:27.568314+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:06:27.568314+0000","last_undegraded":"2024-09-17T06:06:27.568314+0000","last_fullsized":"2024-09-17T06:06:27.568314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:21.599408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499049+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:06:22.499049+0000","last_peered":"2024-09-17T06:06:22.499049+0000","last_clean":"2024-09-17T06:06:22.499049+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:06:22.499049+0000","last_undegraded":"2024-09-17T06:06:22.499049+0000","last_fullsized":"2024-09-17T06:06:22.499049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970549+0000","last_change":"2024-09-17T06:06:02.749776+0000","last_active":"2024-09-17T06:06:21.970549+0000","last_peered":"2024-09-17T06:06:21.970549+0000","last_clean":"2024-09-17T06:06:21.970549+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:06:21.970549+0000","last_undegraded":"2024-09-17T06:06:21.970549+0000","last_fullsized":"2024-09-17T06:06:21.970549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:14.070869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568383+0000","last_change":"2024-09-17T06:06:02.743241+0000","last_active":"2024-09-17T06:06:27.568383+0000","last_peered":"2024-09-17T06:06:27.568383+0000","last_clean":"2024-09-17T06:06:27.568383+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:06:27.568383+0000","last_undegraded":"2024-09-17T06:06:27.568383+0000","last_fullsized":"2024-09-17T06:06:27.568383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:24.945633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.972191+0000","last_change":"2024-09-17T06:06:02.747970+0000","last_active":"2024-09-17T06:06:21.972191+0000","last_peered":"2024-09-17T06:06:21.972191+0000","last_clean":"2024-09-17T06:06:21.972191+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:06:21.972191+0000","last_undegraded":"2024-09-17T06:06:21.972191+0000","last_fullsized":"2024-09-17T06:06:21.972191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:01.251626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967658+0000","last_change":"2024-09-17T06:06:02.765641+0000","last_active":"2024-09-17T06:06:21.967658+0000","last_peered":"2024-09-17T06:06:21.967658+0000","last_clean":"2024-09-17T06:06:21.967658+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:06:21.967658+0000","last_undegraded":"2024-09-17T06:06:21.967658+0000","last_fullsized":"2024-09-17T06:06:21.967658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:45.801441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568079+0000","last_change":"2024-09-17T06:06:02.771427+0000","last_active":"2024-09-17T06:06:27.568079+0000","last_peered":"2024-09-17T06:06:27.568079+0000","last_clean":"2024-09-17T06:06:27.568079+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:06:27.568079+0000","last_undegraded":"2024-09-17T06:06:27.568079+0000","last_fullsized":"2024-09-17T06:06:27.568079+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.132428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"62'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498400+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:06:22.498400+0000","last_peered":"2024-09-17T06:06:22.498400+0000","last_clean":"2024-09-17T06:06:22.498400+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:06:22.498400+0000","last_undegraded":"2024-09-17T06:06:22.498400+0000","last_fullsized":"2024-09-17T06:06:22.498400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499947+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:06:22.499947+0000","last_peered":"2024-09-17T06:06:22.499947+0000","last_clean":"2024-09-17T06:06:22.499947+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:06:22.499947+0000","last_undegraded":"2024-09-17T06:06:22.499947+0000","last_fullsized":"2024-09-17T06:06:22.499947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.518926+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:06:27.518926+0000","last_peered":"2024-09-17T06:06:27.518926+0000","last_clean":"2024-09-17T06:06:27.518926+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:06:27.518926+0000","last_undegraded":"2024-09-17T06:06:27.518926+0000","last_fullsized":"2024-09-17T06:06:27.518926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501692+0000","last_change":"2024-09-17T06:06:02.772623+0000","last_active":"2024-09-17T06:06:22.501692+0000","last_peered":"2024-09-17T06:06:22.501692+0000","last_clean":"2024-09-17T06:06:22.501692+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:22.501692+0000","last_undegraded":"2024-09-17T06:06:22.501692+0000","last_fullsized":"2024-09-17T06:06:22.501692+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:53.767911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500282+0000","last_change":"2024-09-17T06:06:14.883260+0000","last_active":"2024-09-17T06:06:22.500282+0000","last_peered":"2024-09-17T06:06:22.500282+0000","last_clean":"2024-09-17T06:06:22.500282+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:06:22.500282+0000","last_undegraded":"2024-09-17T06:06:22.500282+0000","last_fullsized":"2024-09-17T06:06:22.500282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:01.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568687+0000","last_change":"2024-09-17T06:06:02.767610+0000","last_active":"2024-09-17T06:06:27.568687+0000","last_peered":"2024-09-17T06:06:27.568687+0000","last_clean":"2024-09-17T06:06:27.568687+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:06:27.568687+0000","last_undegraded":"2024-09-17T06:06:27.568687+0000","last_fullsized":"2024-09-17T06:06:27.568687+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:54.779217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971946+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:06:21.971946+0000","last_peered":"2024-09-17T06:06:21.971946+0000","last_clean":"2024-09-17T06:06:21.971946+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:06:21.971946+0000","last_undegraded":"2024-09-17T06:06:21.971946+0000","last_fullsized":"2024-09-17T06:06:21.971946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500361+0000","last_change":"2024-09-17T06:06:15.372083+0000","last_active":"2024-09-17T06:06:22.500361+0000","last_peered":"2024-09-17T06:06:22.500361+0000","last_clean":"2024-09-17T06:06:22.500361+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:06:22.500361+0000","last_undegraded":"2024-09-17T06:06:22.500361+0000","last_fullsized":"2024-09-17T06:06:22.500361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:53.468260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.554841+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:06:27.554841+0000","last_peered":"2024-09-17T06:06:27.554841+0000","last_clean":"2024-09-17T06:06:27.554841+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:06:27.554841+0000","last_undegraded":"2024-09-17T06:06:27.554841+0000","last_fullsized":"2024-09-17T06:06:27.554841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500005+0000","last_change":"2024-09-17T06:06:02.772342+0000","last_active":"2024-09-17T06:06:22.500005+0000","last_peered":"2024-09-17T06:06:22.500005+0000","last_clean":"2024-09-17T06:06:22.500005+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:06:22.500005+0000","last_undegraded":"2024-09-17T06:06:22.500005+0000","last_fullsized":"2024-09-17T06:06:22.500005+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:36.591645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970221+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:06:21.970221+0000","last_peered":"2024-09-17T06:06:21.970221+0000","last_clean":"2024-09-17T06:06:21.970221+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:06:21.970221+0000","last_undegraded":"2024-09-17T06:06:21.970221+0000","last_fullsized":"2024-09-17T06:06:21.970221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.561793+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:06:27.561793+0000","last_peered":"2024-09-17T06:06:27.561793+0000","last_clean":"2024-09-17T06:06:27.561793+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:06:27.561793+0000","last_undegraded":"2024-09-17T06:06:27.561793+0000","last_fullsized":"2024-09-17T06:06:27.561793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.522395+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:06:27.522395+0000","last_peered":"2024-09-17T06:06:27.522395+0000","last_clean":"2024-09-17T06:06:27.522395+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:06:27.522395+0000","last_undegraded":"2024-09-17T06:06:27.522395+0000","last_fullsized":"2024-09-17T06:06:27.522395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967772+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:06:21.967772+0000","last_peered":"2024-09-17T06:06:21.967772+0000","last_clean":"2024-09-17T06:06:21.967772+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:06:21.967772+0000","last_undegraded":"2024-09-17T06:06:21.967772+0000","last_fullsized":"2024-09-17T06:06:21.967772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.566590+0000","last_change":"2024-09-17T06:06:02.778195+0000","last_active":"2024-09-17T06:06:27.566590+0000","last_peered":"2024-09-17T06:06:27.566590+0000","last_clean":"2024-09-17T06:06:27.566590+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:06:27.566590+0000","last_undegraded":"2024-09-17T06:06:27.566590+0000","last_fullsized":"2024-09-17T06:06:27.566590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:41.521760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"62'7","reported_seq":116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970857+0000","last_change":"2024-09-17T06:05:20.635633+0000","last_active":"2024-09-17T06:06:21.970857+0000","last_peered":"2024-09-17T06:06:21.970857+0000","last_clean":"2024-09-17T06:06:21.970857+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:06:21.970857+0000","last_undegraded":"2024-09-17T06:06:21.970857+0000","last_fullsized":"2024-09-17T06:06:21.970857+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:42.262918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968250+0000","last_change":"2024-09-17T06:06:02.762076+0000","last_active":"2024-09-17T06:06:21.968250+0000","last_peered":"2024-09-17T06:06:21.968250+0000","last_clean":"2024-09-17T06:06:21.968250+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:06:21.968250+0000","last_undegraded":"2024-09-17T06:06:21.968250+0000","last_fullsized":"2024-09-17T06:06:21.968250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:12.436619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.559649+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:06:27.559649+0000","last_peered":"2024-09-17T06:06:27.559649+0000","last_clean":"2024-09-17T06:06:27.559649+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:06:27.559649+0000","last_undegraded":"2024-09-17T06:06:27.559649+0000","last_fullsized":"2024-09-17T06:06:27.559649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970773+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:06:21.970773+0000","last_peered":"2024-09-17T06:06:21.970773+0000","last_clean":"2024-09-17T06:06:21.970773+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:06:21.970773+0000","last_undegraded":"2024-09-17T06:06:21.970773+0000","last_fullsized":"2024-09-17T06:06:21.970773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498270+0000","last_change":"2024-09-17T06:06:14.879517+0000","last_active":"2024-09-17T06:06:22.498270+0000","last_peered":"2024-09-17T06:06:22.498270+0000","last_clean":"2024-09-17T06:06:22.498270+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:06:22.498270+0000","last_undegraded":"2024-09-17T06:06:22.498270+0000","last_fullsized":"2024-09-17T06:06:22.498270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:59.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574456+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:06:27.574456+0000","last_peered":"2024-09-17T06:06:27.574456+0000","last_clean":"2024-09-17T06:06:27.574456+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:06:27.574456+0000","last_undegraded":"2024-09-17T06:06:27.574456+0000","last_fullsized":"2024-09-17T06:06:27.574456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503060+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:06:22.503060+0000","last_peered":"2024-09-17T06:06:22.503060+0000","last_clean":"2024-09-17T06:06:22.503060+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:06:22.503060+0000","last_undegraded":"2024-09-17T06:06:22.503060+0000","last_fullsized":"2024-09-17T06:06:22.503060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498442+0000","last_change":"2024-09-17T06:06:14.881955+0000","last_active":"2024-09-17T06:06:22.498442+0000","last_peered":"2024-09-17T06:06:22.498442+0000","last_clean":"2024-09-17T06:06:22.498442+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:06:22.498442+0000","last_undegraded":"2024-09-17T06:06:22.498442+0000","last_fullsized":"2024-09-17T06:06:22.498442+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:31.787475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499845+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:06:22.499845+0000","last_peered":"2024-09-17T06:06:22.499845+0000","last_clean":"2024-09-17T06:06:22.499845+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:06:22.499845+0000","last_undegraded":"2024-09-17T06:06:22.499845+0000","last_fullsized":"2024-09-17T06:06:22.499845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.542676+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:06:27.542676+0000","last_peered":"2024-09-17T06:06:27.542676+0000","last_clean":"2024-09-17T06:06:27.542676+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:06:27.542676+0000","last_undegraded":"2024-09-17T06:06:27.542676+0000","last_fullsized":"2024-09-17T06:06:27.542676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971203+0000","last_change":"2024-09-17T06:06:02.751465+0000","last_active":"2024-09-17T06:06:21.971203+0000","last_peered":"2024-09-17T06:06:21.971203+0000","last_clean":"2024-09-17T06:06:21.971203+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:06:21.971203+0000","last_undegraded":"2024-09-17T06:06:21.971203+0000","last_fullsized":"2024-09-17T06:06:21.971203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:15.399241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502473+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:06:22.502473+0000","last_peered":"2024-09-17T06:06:22.502473+0000","last_clean":"2024-09-17T06:06:22.502473+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:06:22.502473+0000","last_undegraded":"2024-09-17T06:06:22.502473+0000","last_fullsized":"2024-09-17T06:06:22.502473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.537111+0000","last_change":"2024-09-17T06:06:14.876329+0000","last_active":"2024-09-17T06:06:27.537111+0000","last_peered":"2024-09-17T06:06:27.537111+0000","last_clean":"2024-09-17T06:06:27.537111+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:06:27.537111+0000","last_undegraded":"2024-09-17T06:06:27.537111+0000","last_fullsized":"2024-09-17T06:06:27.537111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:44.076246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498602+0000","last_change":"2024-09-17T06:06:14.883367+0000","last_active":"2024-09-17T06:06:22.498602+0000","last_peered":"2024-09-17T06:06:22.498602+0000","last_clean":"2024-09-17T06:06:22.498602+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:06:22.498602+0000","last_undegraded":"2024-09-17T06:06:22.498602+0000","last_fullsized":"2024-09-17T06:06:22.498602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:34.486361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501858+0000","last_change":"2024-09-17T06:06:02.753865+0000","last_active":"2024-09-17T06:06:22.501858+0000","last_peered":"2024-09-17T06:06:22.501858+0000","last_clean":"2024-09-17T06:06:22.501858+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:06:22.501858+0000","last_undegraded":"2024-09-17T06:06:22.501858+0000","last_fullsized":"2024-09-17T06:06:22.501858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:02.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.547358+0000","last_change":"2024-09-17T06:06:02.774846+0000","last_active":"2024-09-17T06:06:27.547358+0000","last_peered":"2024-09-17T06:06:27.547358+0000","last_clean":"2024-09-17T06:06:27.547358+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:06:27.547358+0000","last_undegraded":"2024-09-17T06:06:27.547358+0000","last_fullsized":"2024-09-17T06:06:27.547358+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:03.871862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499002+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:06:22.499002+0000","last_peered":"2024-09-17T06:06:22.499002+0000","last_clean":"2024-09-17T06:06:22.499002+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:06:22.499002+0000","last_undegraded":"2024-09-17T06:06:22.499002+0000","last_fullsized":"2024-09-17T06:06:22.499002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499917+0000","last_change":"2024-09-17T06:06:14.874567+0000","last_active":"2024-09-17T06:06:22.499917+0000","last_peered":"2024-09-17T06:06:22.499917+0000","last_clean":"2024-09-17T06:06:22.499917+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:06:22.499917+0000","last_undegraded":"2024-09-17T06:06:22.499917+0000","last_fullsized":"2024-09-17T06:06:22.499917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:16.000785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.555058+0000","last_change":"2024-09-17T06:06:02.747397+0000","last_active":"2024-09-17T06:06:27.555058+0000","last_peered":"2024-09-17T06:06:27.555058+0000","last_clean":"2024-09-17T06:06:27.555058+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:06:27.555058+0000","last_undegraded":"2024-09-17T06:06:27.555058+0000","last_fullsized":"2024-09-17T06:06:27.555058+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:35.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500463+0000","last_change":"2024-09-17T06:06:15.371993+0000","last_active":"2024-09-17T06:06:22.500463+0000","last_peered":"2024-09-17T06:06:22.500463+0000","last_clean":"2024-09-17T06:06:22.500463+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:06:22.500463+0000","last_undegraded":"2024-09-17T06:06:22.500463+0000","last_fullsized":"2024-09-17T06:06:22.500463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:36.359097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.551299+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:06:27.551299+0000","last_peered":"2024-09-17T06:06:27.551299+0000","last_clean":"2024-09-17T06:06:27.551299+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:06:27.551299+0000","last_undegraded":"2024-09-17T06:06:27.551299+0000","last_fullsized":"2024-09-17T06:06:27.551299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.563391+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:06:27.563391+0000","last_peered":"2024-09-17T06:06:27.563391+0000","last_clean":"2024-09-17T06:06:27.563391+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:06:27.563391+0000","last_undegraded":"2024-09-17T06:06:27.563391+0000","last_fullsized":"2024-09-17T06:06:27.563391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.552660+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:06:27.552660+0000","last_peered":"2024-09-17T06:06:27.552660+0000","last_clean":"2024-09-17T06:06:27.552660+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:06:27.552660+0000","last_undegraded":"2024-09-17T06:06:27.552660+0000","last_fullsized":"2024-09-17T06:06:27.552660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.527615+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:06:27.527615+0000","last_peered":"2024-09-17T06:06:27.527615+0000","last_clean":"2024-09-17T06:06:27.527615+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:06:27.527615+0000","last_undegraded":"2024-09-17T06:06:27.527615+0000","last_fullsized":"2024-09-17T06:06:27.527615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.548572+0000","last_change":"2024-09-17T06:06:14.862875+0000","last_active":"2024-09-17T06:06:27.548572+0000","last_peered":"2024-09-17T06:06:27.548572+0000","last_clean":"2024-09-17T06:06:27.548572+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:06:27.548572+0000","last_undegraded":"2024-09-17T06:06:27.548572+0000","last_fullsized":"2024-09-17T06:06:27.548572+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:58.805589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.531497+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:06:27.531497+0000","last_peered":"2024-09-17T06:06:27.531497+0000","last_clean":"2024-09-17T06:06:27.531497+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:06:27.531497+0000","last_undegraded":"2024-09-17T06:06:27.531497+0000","last_fullsized":"2024-09-17T06:06:27.531497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.573178+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:06:27.573178+0000","last_peered":"2024-09-17T06:06:27.573178+0000","last_clean":"2024-09-17T06:06:27.573178+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:06:27.573178+0000","last_undegraded":"2024-09-17T06:06:27.573178+0000","last_fullsized":"2024-09-17T06:06:27.573178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.519555+0000","last_change":"2024-09-17T06:06:14.869993+0000","last_active":"2024-09-17T06:06:27.519555+0000","last_peered":"2024-09-17T06:06:27.519555+0000","last_clean":"2024-09-17T06:06:27.519555+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:06:27.519555+0000","last_undegraded":"2024-09-17T06:06:27.519555+0000","last_fullsized":"2024-09-17T06:06:27.519555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:10.143503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.552477+0000","last_change":"2024-09-17T06:05:13.535655+0000","last_active":"2024-09-17T06:06:27.552477+0000","last_peered":"2024-09-17T06:06:27.552477+0000","last_clean":"2024-09-17T06:06:27.552477+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:06:27.552477+0000","last_undegraded":"2024-09-17T06:06:27.552477+0000","last_fullsized":"2024-09-17T06:06:27.552477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:26.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.547204+0000","last_change":"2024-09-17T06:06:14.862354+0000","last_active":"2024-09-17T06:06:27.547204+0000","last_peered":"2024-09-17T06:06:27.547204+0000","last_clean":"2024-09-17T06:06:27.547204+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:06:27.547204+0000","last_undegraded":"2024-09-17T06:06:27.547204+0000","last_fullsized":"2024-09-17T06:06:27.547204+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:57.348056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574065+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:06:27.574065+0000","last_peered":"2024-09-17T06:06:27.574065+0000","last_clean":"2024-09-17T06:06:27.574065+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:06:27.574065+0000","last_undegraded":"2024-09-17T06:06:27.574065+0000","last_fullsized":"2024-09-17T06:06:27.574065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.536183+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:06:27.536183+0000","last_peered":"2024-09-17T06:06:27.536183+0000","last_clean":"2024-09-17T06:06:27.536183+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:06:27.536183+0000","last_undegraded":"2024-09-17T06:06:27.536183+0000","last_fullsized":"2024-09-17T06:06:27.536183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.557127+0000","last_change":"2024-09-17T06:06:02.781690+0000","last_active":"2024-09-17T06:06:27.557127+0000","last_peered":"2024-09-17T06:06:27.557127+0000","last_clean":"2024-09-17T06:06:27.557127+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:06:27.557127+0000","last_undegraded":"2024-09-17T06:06:27.557127+0000","last_fullsized":"2024-09-17T06:06:27.557127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:50.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.544249+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:06:27.544249+0000","last_peered":"2024-09-17T06:06:27.544249+0000","last_clean":"2024-09-17T06:06:27.544249+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:06:27.544249+0000","last_undegraded":"2024-09-17T06:06:27.544249+0000","last_fullsized":"2024-09-17T06:06:27.544249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.551918+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:06:27.551918+0000","last_peered":"2024-09-17T06:06:27.551918+0000","last_clean":"2024-09-17T06:06:27.551918+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:06:27.551918+0000","last_undegraded":"2024-09-17T06:06:27.551918+0000","last_fullsized":"2024-09-17T06:06:27.551918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574667+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:06:27.574667+0000","last_peered":"2024-09-17T06:06:27.574667+0000","last_clean":"2024-09-17T06:06:27.574667+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:06:27.574667+0000","last_undegraded":"2024-09-17T06:06:27.574667+0000","last_fullsized":"2024-09-17T06:06:27.574667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.553238+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:06:27.553238+0000","last_peered":"2024-09-17T06:06:27.553238+0000","last_clean":"2024-09-17T06:06:27.553238+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:06:27.553238+0000","last_undegraded":"2024-09-17T06:06:27.553238+0000","last_fullsized":"2024-09-17T06:06:27.553238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.532776+0000","last_change":"2024-09-17T06:06:02.777396+0000","last_active":"2024-09-17T06:06:27.532776+0000","last_peered":"2024-09-17T06:06:27.532776+0000","last_clean":"2024-09-17T06:06:27.532776+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:06:27.532776+0000","last_undegraded":"2024-09-17T06:06:27.532776+0000","last_fullsized":"2024-09-17T06:06:27.532776+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:28.787647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.543210+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:06:27.543210+0000","last_peered":"2024-09-17T06:06:27.543210+0000","last_clean":"2024-09-17T06:06:27.543210+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:06:27.543210+0000","last_undegraded":"2024-09-17T06:06:27.543210+0000","last_fullsized":"2024-09-17T06:06:27.543210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.551462+0000","last_change":"2024-09-17T06:06:14.882860+0000","last_active":"2024-09-17T06:06:27.551462+0000","last_peered":"2024-09-17T06:06:27.551462+0000","last_clean":"2024-09-17T06:06:27.551462+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:06:27.551462+0000","last_undegraded":"2024-09-17T06:06:27.551462+0000","last_fullsized":"2024-09-17T06:06:27.551462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:07.158141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.558120+0000","last_change":"2024-09-17T06:06:02.776605+0000","last_active":"2024-09-17T06:06:27.558120+0000","last_peered":"2024-09-17T06:06:27.558120+0000","last_clean":"2024-09-17T06:06:27.558120+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:06:27.558120+0000","last_undegraded":"2024-09-17T06:06:27.558120+0000","last_fullsized":"2024-09-17T06:06:27.558120+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:55.566930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.561965+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:06:27.561965+0000","last_peered":"2024-09-17T06:06:27.561965+0000","last_clean":"2024-09-17T06:06:27.561965+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:06:27.561965+0000","last_undegraded":"2024-09-17T06:06:27.561965+0000","last_fullsized":"2024-09-17T06:06:27.561965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.564023+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:06:27.564023+0000","last_peered":"2024-09-17T06:06:27.564023+0000","last_clean":"2024-09-17T06:06:27.564023+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:06:27.564023+0000","last_undegraded":"2024-09-17T06:06:27.564023+0000","last_fullsized":"2024-09-17T06:06:27.564023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.573527+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:06:27.573527+0000","last_peered":"2024-09-17T06:06:27.573527+0000","last_clean":"2024-09-17T06:06:27.573527+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:06:27.573527+0000","last_undegraded":"2024-09-17T06:06:27.573527+0000","last_fullsized":"2024-09-17T06:06:27.573527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.553454+0000","last_change":"2024-09-17T06:06:14.863779+0000","last_active":"2024-09-17T06:06:27.553454+0000","last_peered":"2024-09-17T06:06:27.553454+0000","last_clean":"2024-09-17T06:06:27.553454+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:06:27.553454+0000","last_undegraded":"2024-09-17T06:06:27.553454+0000","last_fullsized":"2024-09-17T06:06:27.553454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:41.626998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.527586+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:06:27.527586+0000","last_peered":"2024-09-17T06:06:27.527586+0000","last_clean":"2024-09-17T06:06:27.527586+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:06:27.527586+0000","last_undegraded":"2024-09-17T06:06:27.527586+0000","last_fullsized":"2024-09-17T06:06:27.527586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.553590+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:06:27.553590+0000","last_peered":"2024-09-17T06:06:27.553590+0000","last_clean":"2024-09-17T06:06:27.553590+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:06:27.553590+0000","last_undegraded":"2024-09-17T06:06:27.553590+0000","last_fullsized":"2024-09-17T06:06:27.553590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.554203+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:06:27.554203+0000","last_peered":"2024-09-17T06:06:27.554203+0000","last_clean":"2024-09-17T06:06:27.554203+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:06:27.554203+0000","last_undegraded":"2024-09-17T06:06:27.554203+0000","last_fullsized":"2024-09-17T06:06:27.554203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.554038+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:06:27.554038+0000","last_peered":"2024-09-17T06:06:27.554038+0000","last_clean":"2024-09-17T06:06:27.554038+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:06:27.554038+0000","last_undegraded":"2024-09-17T06:06:27.554038+0000","last_fullsized":"2024-09-17T06:06:27.554038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.541975+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:06:27.541975+0000","last_peered":"2024-09-17T06:06:27.541975+0000","last_clean":"2024-09-17T06:06:27.541975+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:06:27.541975+0000","last_undegraded":"2024-09-17T06:06:27.541975+0000","last_fullsized":"2024-09-17T06:06:27.541975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.492171+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:06:27.492171+0000","last_peered":"2024-09-17T06:06:27.492171+0000","last_clean":"2024-09-17T06:06:27.492171+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:06:27.492171+0000","last_undegraded":"2024-09-17T06:06:27.492171+0000","last_fullsized":"2024-09-17T06:06:27.492171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.569630+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:06:27.569630+0000","last_peered":"2024-09-17T06:06:27.569630+0000","last_clean":"2024-09-17T06:06:27.569630+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:06:27.569630+0000","last_undegraded":"2024-09-17T06:06:27.569630+0000","last_fullsized":"2024-09-17T06:06:27.569630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":995328,"data_stored":530556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":494218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1556480,"data_stored":1084902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1544192,"data_stored":1084756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":530144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906952,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28984,"kb_used_data":936,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342856,"statfs":{"total":96636764160,"available":96607084544,"internally_reserved":0,"allocated":958464,"data_stored":493932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":493876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":950272,"data_stored":493896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:06:34.276 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:06:34.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.468+0000 7f1426989640 1 -- 172.21.15.122:0/3343587692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f140c004810 msgr2=0x7f140c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.468+0000 7f1426989640 1 --2- 172.21.15.122:0/3343587692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f140c004810 0x7f140c004c20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1408009b30 tx=0x7f140801d270 comp rx=0 tx=0).stop 2024-09-17T06:06:34.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.468+0000 7f1424f26640 1 -- 172.21.15.122:0/3343587692 reap_dead start 2024-09-17T06:06:34.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.468+0000 7f1426989640 1 -- 172.21.15.122:0/3343587692 shutdown_connections 2024-09-17T06:06:34.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.468+0000 7f1426989640 1 -- 172.21.15.122:0/3343587692 >> 172.21.15.122:0/3343587692 conn(0x7f14200746d0 msgr2=0x7f1420074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:34.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.468+0000 7f1426989640 1 -- 172.21.15.122:0/3343587692 shutdown_connections 2024-09-17T06:06:34.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.468+0000 7f1426989640 1 -- 172.21.15.122:0/3343587692 wait complete. 2024-09-17T06:06:34.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f1426989640 1 Processor -- start 2024-09-17T06:06:34.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f1426989640 1 -- start start 2024-09-17T06:06:34.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f1426989640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f140c004810 0x7f1420151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:34.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f1426989640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14201f4f60 0x7f14200cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:34.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f1426989640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1420140fd0 0x7f14201413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:34.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f1426989640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f14200c7880 con 0x7f14201f4f60 2024-09-17T06:06:34.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f1426989640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14200c75a0 con 0x7f1420140fd0 2024-09-17T06:06:34.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f1426989640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f14200c7b60 con 0x7f140c004810 2024-09-17T06:06:34.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f14177fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14201f4f60 0x7f14200cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:34.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f14177fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14201f4f60 0x7f14200cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54756/0 (socket says 172.21.15.122:54756) 2024-09-17T06:06:34.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f14177fe640 1 -- 172.21.15.122:0/1547610681 learned_addr learned my addr 172.21.15.122:0/1547610681 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:34.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f141ffff640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f140c004810 0x7f1420151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:34.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f1424f26640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1420140fd0 0x7f14201413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:34.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f14177fe640 1 -- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f140c004810 msgr2=0x7f1420151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f14177fe640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f140c004810 0x7f1420151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f14177fe640 1 -- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1420140fd0 msgr2=0x7f14201413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f14177fe640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1420140fd0 0x7f14201413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f14177fe640 1 -- 172.21.15.122:0/1547610681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1420158880 con 0x7f14201f4f60 2024-09-17T06:06:34.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f1424f26640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1420140fd0 0x7f14201413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:34.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f14177fe640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14201f4f60 0x7f14200cb090 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f140801d0a0 tx=0x7f1408005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:34.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f141d7fa640 1 -- 172.21.15.122:0/1547610681 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14080b1040 con 0x7f14201f4f60 2024-09-17T06:06:34.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f141d7fa640 1 -- 172.21.15.122:0/1547610681 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14080ac400 con 0x7f14201f4f60 2024-09-17T06:06:34.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f1426989640 1 -- 172.21.15.122:0/1547610681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14200ca9c0 con 0x7f14201f4f60 2024-09-17T06:06:34.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f141d7fa640 1 -- 172.21.15.122:0/1547610681 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14080aca10 con 0x7f14201f4f60 2024-09-17T06:06:34.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.472+0000 7f1426989640 1 -- 172.21.15.122:0/1547610681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14201547d0 con 0x7f14201f4f60 2024-09-17T06:06:34.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.476+0000 7f1426989640 1 -- 172.21.15.122:0/1547610681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1420154a10 con 0x7f14201f4f60 2024-09-17T06:06:34.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.476+0000 7f141d7fa640 1 -- 172.21.15.122:0/1547610681 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f14080be020 con 0x7f14201f4f60 2024-09-17T06:06:34.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.476+0000 7f141d7fa640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1400073230 0x7f1400075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:34.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.476+0000 7f141d7fa640 1 -- 172.21.15.122:0/1547610681 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f140812f8d0 con 0x7f14201f4f60 2024-09-17T06:06:34.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.476+0000 7f141ffff640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1400073230 0x7f1400075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:34.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.476+0000 7f141ffff640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1400073230 0x7f1400075740 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1410001870 tx=0x7f1410001620 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:34.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.480+0000 7f141d7fa640 1 -- 172.21.15.122:0/1547610681 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1420154a10 con 0x7f14201f4f60 2024-09-17T06:06:34.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.648+0000 7f1426989640 1 -- 172.21.15.122:0/1547610681 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f142015a8e0 con 0x7f1400073230 2024-09-17T06:06:34.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.664+0000 7f141d7fa640 1 -- 172.21.15.122:0/1547610681 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332881 (secure 0 0 0) 0x7f142015a8e0 con 0x7f1400073230 2024-09-17T06:06:34.669 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:06:34.672 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:06:34.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.668+0000 7f1426989640 1 -- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1400073230 msgr2=0x7f1400075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.668+0000 7f1426989640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1400073230 0x7f1400075740 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1410001870 tx=0x7f1410001620 comp rx=0 tx=0).stop 2024-09-17T06:06:34.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.668+0000 7f1426989640 1 -- 172.21.15.122:0/1547610681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14201f4f60 msgr2=0x7f14200cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.668+0000 7f1426989640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14201f4f60 0x7f14200cb090 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f140801d0a0 tx=0x7f1408005640 comp rx=0 tx=0).stop 2024-09-17T06:06:34.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.668+0000 7f1426989640 1 -- 172.21.15.122:0/1547610681 shutdown_connections 2024-09-17T06:06:34.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.668+0000 7f1426989640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1400073230 0x7f1400075740 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.668+0000 7f1426989640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1420140fd0 0x7f14201413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.668+0000 7f1426989640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14201f4f60 0x7f14200cb090 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.668+0000 7f1426989640 1 --2- 172.21.15.122:0/1547610681 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f140c004810 0x7f1420151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.668+0000 7f1426989640 1 -- 172.21.15.122:0/1547610681 >> 172.21.15.122:0/1547610681 conn(0x7f14200746d0 msgr2=0x7f1420074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:34.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.668+0000 7f1426989640 1 -- 172.21.15.122:0/1547610681 shutdown_connections 2024-09-17T06:06:34.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.668+0000 7f1426989640 1 -- 172.21.15.122:0/1547610681 wait complete. 2024-09-17T06:06:34.691 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-17T06:06:33.572936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":656,"ondisk_log_size":656,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242544,"kb_used_data":8688,"kb_used_omap":17,"kb_used_meta":233710,"kb_avail":754732176,"statfs":{"total":773094113280,"available":772845748224,"internally_reserved":0,"allocated":8896512,"data_stored":5206280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":239319789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.608481"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500455+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:06:22.500455+0000","last_peered":"2024-09-17T06:06:22.500455+0000","last_clean":"2024-09-17T06:06:22.500455+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:06:22.500455+0000","last_undegraded":"2024-09-17T06:06:22.500455+0000","last_fullsized":"2024-09-17T06:06:22.500455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.522869+0000","last_change":"2024-09-17T06:06:14.882867+0000","last_active":"2024-09-17T06:06:27.522869+0000","last_peered":"2024-09-17T06:06:27.522869+0000","last_clean":"2024-09-17T06:06:27.522869+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:06:27.522869+0000","last_undegraded":"2024-09-17T06:06:27.522869+0000","last_fullsized":"2024-09-17T06:06:27.522869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:30.856555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498014+0000","last_change":"2024-09-17T06:06:15.369420+0000","last_active":"2024-09-17T06:06:22.498014+0000","last_peered":"2024-09-17T06:06:22.498014+0000","last_clean":"2024-09-17T06:06:22.498014+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:06:22.498014+0000","last_undegraded":"2024-09-17T06:06:22.498014+0000","last_fullsized":"2024-09-17T06:06:22.498014+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:26.332180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500348+0000","last_change":"2024-09-17T06:06:14.876941+0000","last_active":"2024-09-17T06:06:22.500348+0000","last_peered":"2024-09-17T06:06:22.500348+0000","last_clean":"2024-09-17T06:06:22.500348+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:06:22.500348+0000","last_undegraded":"2024-09-17T06:06:22.500348+0000","last_fullsized":"2024-09-17T06:06:22.500348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:16.802718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.559750+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:06:27.559750+0000","last_peered":"2024-09-17T06:06:27.559750+0000","last_clean":"2024-09-17T06:06:27.559750+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:06:27.559750+0000","last_undegraded":"2024-09-17T06:06:27.559750+0000","last_fullsized":"2024-09-17T06:06:27.559750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966721+0000","last_change":"2024-09-17T06:06:02.760496+0000","last_active":"2024-09-17T06:06:21.966721+0000","last_peered":"2024-09-17T06:06:21.966721+0000","last_clean":"2024-09-17T06:06:21.966721+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:06:21.966721+0000","last_undegraded":"2024-09-17T06:06:21.966721+0000","last_fullsized":"2024-09-17T06:06:21.966721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.085087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"60'3","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501464+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:06:22.501464+0000","last_peered":"2024-09-17T06:06:22.501464+0000","last_clean":"2024-09-17T06:06:22.501464+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:06:22.501464+0000","last_undegraded":"2024-09-17T06:06:22.501464+0000","last_fullsized":"2024-09-17T06:06:22.501464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568851+0000","last_change":"2024-09-17T06:06:02.772542+0000","last_active":"2024-09-17T06:06:27.568851+0000","last_peered":"2024-09-17T06:06:27.568851+0000","last_clean":"2024-09-17T06:06:27.568851+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:27.568851+0000","last_undegraded":"2024-09-17T06:06:27.568851+0000","last_fullsized":"2024-09-17T06:06:27.568851+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:31.442644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968566+0000","last_change":"2024-09-17T06:06:02.762154+0000","last_active":"2024-09-17T06:06:21.968566+0000","last_peered":"2024-09-17T06:06:21.968566+0000","last_clean":"2024-09-17T06:06:21.968566+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:06:21.968566+0000","last_undegraded":"2024-09-17T06:06:21.968566+0000","last_fullsized":"2024-09-17T06:06:21.968566+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:56.087057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500504+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:06:22.500504+0000","last_peered":"2024-09-17T06:06:22.500504+0000","last_clean":"2024-09-17T06:06:22.500504+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:06:22.500504+0000","last_undegraded":"2024-09-17T06:06:22.500504+0000","last_fullsized":"2024-09-17T06:06:22.500504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.549485+0000","last_change":"2024-09-17T06:06:02.747441+0000","last_active":"2024-09-17T06:06:27.549485+0000","last_peered":"2024-09-17T06:06:27.549485+0000","last_clean":"2024-09-17T06:06:27.549485+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:06:27.549485+0000","last_undegraded":"2024-09-17T06:06:27.549485+0000","last_fullsized":"2024-09-17T06:06:27.549485+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:56.535771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968309+0000","last_change":"2024-09-17T06:06:02.760042+0000","last_active":"2024-09-17T06:06:21.968309+0000","last_peered":"2024-09-17T06:06:21.968309+0000","last_clean":"2024-09-17T06:06:21.968309+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:06:21.968309+0000","last_undegraded":"2024-09-17T06:06:21.968309+0000","last_fullsized":"2024-09-17T06:06:21.968309+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:53.866107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.555668+0000","last_change":"2024-09-17T06:06:02.772614+0000","last_active":"2024-09-17T06:06:27.555668+0000","last_peered":"2024-09-17T06:06:27.555668+0000","last_clean":"2024-09-17T06:06:27.555668+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:06:27.555668+0000","last_undegraded":"2024-09-17T06:06:27.555668+0000","last_fullsized":"2024-09-17T06:06:27.555668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:56.086542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"60'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501042+0000","last_change":"2024-09-17T06:06:02.763938+0000","last_active":"2024-09-17T06:06:22.501042+0000","last_peered":"2024-09-17T06:06:22.501042+0000","last_clean":"2024-09-17T06:06:22.501042+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:06:22.501042+0000","last_undegraded":"2024-09-17T06:06:22.501042+0000","last_fullsized":"2024-09-17T06:06:22.501042+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:09.262608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969558+0000","last_change":"2024-09-17T06:06:02.764648+0000","last_active":"2024-09-17T06:06:21.969558+0000","last_peered":"2024-09-17T06:06:21.969558+0000","last_clean":"2024-09-17T06:06:21.969558+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:06:21.969558+0000","last_undegraded":"2024-09-17T06:06:21.969558+0000","last_fullsized":"2024-09-17T06:06:21.969558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:56.341325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.536106+0000","last_change":"2024-09-17T06:06:14.877208+0000","last_active":"2024-09-17T06:06:27.536106+0000","last_peered":"2024-09-17T06:06:27.536106+0000","last_clean":"2024-09-17T06:06:27.536106+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:06:27.536106+0000","last_undegraded":"2024-09-17T06:06:27.536106+0000","last_fullsized":"2024-09-17T06:06:27.536106+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:16.547077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967926+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:06:21.967926+0000","last_peered":"2024-09-17T06:06:21.967926+0000","last_clean":"2024-09-17T06:06:21.967926+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:06:21.967926+0000","last_undegraded":"2024-09-17T06:06:21.967926+0000","last_fullsized":"2024-09-17T06:06:21.967926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969187+0000","last_change":"2024-09-17T06:06:02.777996+0000","last_active":"2024-09-17T06:06:21.969187+0000","last_peered":"2024-09-17T06:06:21.969187+0000","last_clean":"2024-09-17T06:06:21.969187+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:06:21.969187+0000","last_undegraded":"2024-09-17T06:06:21.969187+0000","last_fullsized":"2024-09-17T06:06:21.969187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:04.148545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.502605+0000","last_change":"2024-09-17T06:06:14.859614+0000","last_active":"2024-09-17T06:06:27.502605+0000","last_peered":"2024-09-17T06:06:27.502605+0000","last_clean":"2024-09-17T06:06:27.502605+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:06:27.502605+0000","last_undegraded":"2024-09-17T06:06:27.502605+0000","last_fullsized":"2024-09-17T06:06:27.502605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.132428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966735+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:06:21.966735+0000","last_peered":"2024-09-17T06:06:21.966735+0000","last_clean":"2024-09-17T06:06:21.966735+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:06:21.966735+0000","last_undegraded":"2024-09-17T06:06:21.966735+0000","last_fullsized":"2024-09-17T06:06:21.966735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967353+0000","last_change":"2024-09-17T06:06:02.773038+0000","last_active":"2024-09-17T06:06:21.967353+0000","last_peered":"2024-09-17T06:06:21.967353+0000","last_clean":"2024-09-17T06:06:21.967353+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:06:21.967353+0000","last_undegraded":"2024-09-17T06:06:21.967353+0000","last_fullsized":"2024-09-17T06:06:21.967353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:24.833172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.539183+0000","last_change":"2024-09-17T06:06:02.742391+0000","last_active":"2024-09-17T06:06:27.539183+0000","last_peered":"2024-09-17T06:06:27.539183+0000","last_clean":"2024-09-17T06:06:27.539183+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:06:27.539183+0000","last_undegraded":"2024-09-17T06:06:27.539183+0000","last_fullsized":"2024-09-17T06:06:27.539183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:18.282190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499601+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:06:22.499601+0000","last_peered":"2024-09-17T06:06:22.499601+0000","last_clean":"2024-09-17T06:06:22.499601+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:06:22.499601+0000","last_undegraded":"2024-09-17T06:06:22.499601+0000","last_fullsized":"2024-09-17T06:06:22.499601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.973250+0000","last_change":"2024-09-17T06:06:02.760965+0000","last_active":"2024-09-17T06:06:21.973250+0000","last_peered":"2024-09-17T06:06:21.973250+0000","last_clean":"2024-09-17T06:06:21.973250+0000","last_became_active":"2024-09-17T06:06:02.755335+0000","last_became_peered":"2024-09-17T06:06:02.755335+0000","last_unstale":"2024-09-17T06:06:21.973250+0000","last_undegraded":"2024-09-17T06:06:21.973250+0000","last_fullsized":"2024-09-17T06:06:21.973250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:49.568290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.530774+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:06:27.530774+0000","last_peered":"2024-09-17T06:06:27.530774+0000","last_clean":"2024-09-17T06:06:27.530774+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:06:27.530774+0000","last_undegraded":"2024-09-17T06:06:27.530774+0000","last_fullsized":"2024-09-17T06:06:27.530774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"61'3","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503161+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:06:22.503161+0000","last_peered":"2024-09-17T06:06:22.503161+0000","last_clean":"2024-09-17T06:06:22.503161+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:06:22.503161+0000","last_undegraded":"2024-09-17T06:06:22.503161+0000","last_fullsized":"2024-09-17T06:06:22.503161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967557+0000","last_change":"2024-09-17T06:06:02.770140+0000","last_active":"2024-09-17T06:06:21.967557+0000","last_peered":"2024-09-17T06:06:21.967557+0000","last_clean":"2024-09-17T06:06:21.967557+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:06:21.967557+0000","last_undegraded":"2024-09-17T06:06:21.967557+0000","last_fullsized":"2024-09-17T06:06:21.967557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:35.888277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.556341+0000","last_change":"2024-09-17T06:06:14.875548+0000","last_active":"2024-09-17T06:06:27.556341+0000","last_peered":"2024-09-17T06:06:27.556341+0000","last_clean":"2024-09-17T06:06:27.556341+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:06:27.556341+0000","last_undegraded":"2024-09-17T06:06:27.556341+0000","last_fullsized":"2024-09-17T06:06:27.556341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:24.521256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967487+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:06:21.967487+0000","last_peered":"2024-09-17T06:06:21.967487+0000","last_clean":"2024-09-17T06:06:21.967487+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:06:21.967487+0000","last_undegraded":"2024-09-17T06:06:21.967487+0000","last_fullsized":"2024-09-17T06:06:21.967487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498066+0000","last_change":"2024-09-17T06:06:14.876736+0000","last_active":"2024-09-17T06:06:22.498066+0000","last_peered":"2024-09-17T06:06:22.498066+0000","last_clean":"2024-09-17T06:06:22.498066+0000","last_became_active":"2024-09-17T06:06:14.875773+0000","last_became_peered":"2024-09-17T06:06:14.875773+0000","last_unstale":"2024-09-17T06:06:22.498066+0000","last_undegraded":"2024-09-17T06:06:22.498066+0000","last_fullsized":"2024-09-17T06:06:22.498066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:52.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.504990+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:06:27.504990+0000","last_peered":"2024-09-17T06:06:27.504990+0000","last_clean":"2024-09-17T06:06:27.504990+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:06:27.504990+0000","last_undegraded":"2024-09-17T06:06:27.504990+0000","last_fullsized":"2024-09-17T06:06:27.504990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501976+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:06:22.501976+0000","last_peered":"2024-09-17T06:06:22.501976+0000","last_clean":"2024-09-17T06:06:22.501976+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:06:22.501976+0000","last_undegraded":"2024-09-17T06:06:22.501976+0000","last_fullsized":"2024-09-17T06:06:22.501976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499225+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:06:22.499225+0000","last_peered":"2024-09-17T06:06:22.499225+0000","last_clean":"2024-09-17T06:06:22.499225+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:06:22.499225+0000","last_undegraded":"2024-09-17T06:06:22.499225+0000","last_fullsized":"2024-09-17T06:06:22.499225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.549748+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:06:27.549748+0000","last_peered":"2024-09-17T06:06:27.549748+0000","last_clean":"2024-09-17T06:06:27.549748+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:06:27.549748+0000","last_undegraded":"2024-09-17T06:06:27.549748+0000","last_fullsized":"2024-09-17T06:06:27.549748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968198+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:06:21.968198+0000","last_peered":"2024-09-17T06:06:21.968198+0000","last_clean":"2024-09-17T06:06:21.968198+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:06:21.968198+0000","last_undegraded":"2024-09-17T06:06:21.968198+0000","last_fullsized":"2024-09-17T06:06:21.968198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967191+0000","last_change":"2024-09-17T06:06:02.750734+0000","last_active":"2024-09-17T06:06:21.967191+0000","last_peered":"2024-09-17T06:06:21.967191+0000","last_clean":"2024-09-17T06:06:21.967191+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:06:21.967191+0000","last_undegraded":"2024-09-17T06:06:21.967191+0000","last_fullsized":"2024-09-17T06:06:21.967191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:55.436212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.547264+0000","last_change":"2024-09-17T06:06:02.780406+0000","last_active":"2024-09-17T06:06:27.547264+0000","last_peered":"2024-09-17T06:06:27.547264+0000","last_clean":"2024-09-17T06:06:27.547264+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:06:27.547264+0000","last_undegraded":"2024-09-17T06:06:27.547264+0000","last_fullsized":"2024-09-17T06:06:27.547264+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:34.785782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971985+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:06:21.971985+0000","last_peered":"2024-09-17T06:06:21.971985+0000","last_clean":"2024-09-17T06:06:21.971985+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:06:21.971985+0000","last_undegraded":"2024-09-17T06:06:21.971985+0000","last_fullsized":"2024-09-17T06:06:21.971985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967920+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:06:21.967920+0000","last_peered":"2024-09-17T06:06:21.967920+0000","last_clean":"2024-09-17T06:06:21.967920+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:06:21.967920+0000","last_undegraded":"2024-09-17T06:06:21.967920+0000","last_fullsized":"2024-09-17T06:06:21.967920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.494802+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:06:27.494802+0000","last_peered":"2024-09-17T06:06:27.494802+0000","last_clean":"2024-09-17T06:06:27.494802+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:06:27.494802+0000","last_undegraded":"2024-09-17T06:06:27.494802+0000","last_fullsized":"2024-09-17T06:06:27.494802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"62'4","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498551+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:06:22.498551+0000","last_peered":"2024-09-17T06:06:22.498551+0000","last_clean":"2024-09-17T06:06:22.498551+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:06:22.498551+0000","last_undegraded":"2024-09-17T06:06:22.498551+0000","last_fullsized":"2024-09-17T06:06:22.498551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967511+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:06:21.967511+0000","last_peered":"2024-09-17T06:06:21.967511+0000","last_clean":"2024-09-17T06:06:21.967511+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:06:21.967511+0000","last_undegraded":"2024-09-17T06:06:21.967511+0000","last_fullsized":"2024-09-17T06:06:21.967511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.545291+0000","last_change":"2024-09-17T06:06:02.775030+0000","last_active":"2024-09-17T06:06:27.545291+0000","last_peered":"2024-09-17T06:06:27.545291+0000","last_clean":"2024-09-17T06:06:27.545291+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:06:27.545291+0000","last_undegraded":"2024-09-17T06:06:27.545291+0000","last_fullsized":"2024-09-17T06:06:27.545291+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:56.086542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499602+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:06:22.499602+0000","last_peered":"2024-09-17T06:06:22.499602+0000","last_clean":"2024-09-17T06:06:22.499602+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:06:22.499602+0000","last_undegraded":"2024-09-17T06:06:22.499602+0000","last_fullsized":"2024-09-17T06:06:22.499602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500801+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:06:22.500801+0000","last_peered":"2024-09-17T06:06:22.500801+0000","last_clean":"2024-09-17T06:06:22.500801+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:06:22.500801+0000","last_undegraded":"2024-09-17T06:06:22.500801+0000","last_fullsized":"2024-09-17T06:06:22.500801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.500084+0000","last_change":"2024-09-17T06:06:14.863098+0000","last_active":"2024-09-17T06:06:27.500084+0000","last_peered":"2024-09-17T06:06:27.500084+0000","last_clean":"2024-09-17T06:06:27.500084+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:06:27.500084+0000","last_undegraded":"2024-09-17T06:06:27.500084+0000","last_fullsized":"2024-09-17T06:06:27.500084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:43.199274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969649+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:06:21.969649+0000","last_peered":"2024-09-17T06:06:21.969649+0000","last_clean":"2024-09-17T06:06:21.969649+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:06:21.969649+0000","last_undegraded":"2024-09-17T06:06:21.969649+0000","last_fullsized":"2024-09-17T06:06:21.969649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":229,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503185+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:06:22.503185+0000","last_peered":"2024-09-17T06:06:22.503185+0000","last_clean":"2024-09-17T06:06:22.503185+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:06:22.503185+0000","last_undegraded":"2024-09-17T06:06:22.503185+0000","last_fullsized":"2024-09-17T06:06:22.503185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502700+0000","last_change":"2024-09-17T06:06:02.751844+0000","last_active":"2024-09-17T06:06:22.502700+0000","last_peered":"2024-09-17T06:06:22.502700+0000","last_clean":"2024-09-17T06:06:22.502700+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:06:22.502700+0000","last_undegraded":"2024-09-17T06:06:22.502700+0000","last_fullsized":"2024-09-17T06:06:22.502700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:29.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.565234+0000","last_change":"2024-09-17T06:04:49.135526+0000","last_active":"2024-09-17T06:06:27.565234+0000","last_peered":"2024-09-17T06:06:27.565234+0000","last_clean":"2024-09-17T06:06:27.565234+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:06:27.565234+0000","last_undegraded":"2024-09-17T06:06:27.565234+0000","last_fullsized":"2024-09-17T06:06:27.565234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:45.338884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499366+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:06:22.499366+0000","last_peered":"2024-09-17T06:06:22.499366+0000","last_clean":"2024-09-17T06:06:22.499366+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:06:22.499366+0000","last_undegraded":"2024-09-17T06:06:22.499366+0000","last_fullsized":"2024-09-17T06:06:22.499366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501381+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:06:22.501381+0000","last_peered":"2024-09-17T06:06:22.501381+0000","last_clean":"2024-09-17T06:06:22.501381+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:06:22.501381+0000","last_undegraded":"2024-09-17T06:06:22.501381+0000","last_fullsized":"2024-09-17T06:06:22.501381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.548759+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:06:27.548759+0000","last_peered":"2024-09-17T06:06:27.548759+0000","last_clean":"2024-09-17T06:06:27.548759+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:06:27.548759+0000","last_undegraded":"2024-09-17T06:06:27.548759+0000","last_fullsized":"2024-09-17T06:06:27.548759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968279+0000","last_change":"2024-09-17T06:06:02.750773+0000","last_active":"2024-09-17T06:06:21.968279+0000","last_peered":"2024-09-17T06:06:21.968279+0000","last_clean":"2024-09-17T06:06:21.968279+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:06:21.968279+0000","last_undegraded":"2024-09-17T06:06:21.968279+0000","last_fullsized":"2024-09-17T06:06:21.968279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:40.847404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499934+0000","last_change":"2024-09-17T06:06:02.772644+0000","last_active":"2024-09-17T06:06:22.499934+0000","last_peered":"2024-09-17T06:06:22.499934+0000","last_clean":"2024-09-17T06:06:22.499934+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:06:22.499934+0000","last_undegraded":"2024-09-17T06:06:22.499934+0000","last_fullsized":"2024-09-17T06:06:22.499934+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:29.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568314+0000","last_change":"2024-09-17T06:06:02.743237+0000","last_active":"2024-09-17T06:06:27.568314+0000","last_peered":"2024-09-17T06:06:27.568314+0000","last_clean":"2024-09-17T06:06:27.568314+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:06:27.568314+0000","last_undegraded":"2024-09-17T06:06:27.568314+0000","last_fullsized":"2024-09-17T06:06:27.568314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:21.599408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499049+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:06:22.499049+0000","last_peered":"2024-09-17T06:06:22.499049+0000","last_clean":"2024-09-17T06:06:22.499049+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:06:22.499049+0000","last_undegraded":"2024-09-17T06:06:22.499049+0000","last_fullsized":"2024-09-17T06:06:22.499049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970549+0000","last_change":"2024-09-17T06:06:02.749776+0000","last_active":"2024-09-17T06:06:21.970549+0000","last_peered":"2024-09-17T06:06:21.970549+0000","last_clean":"2024-09-17T06:06:21.970549+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:06:21.970549+0000","last_undegraded":"2024-09-17T06:06:21.970549+0000","last_fullsized":"2024-09-17T06:06:21.970549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:14.070869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568383+0000","last_change":"2024-09-17T06:06:02.743241+0000","last_active":"2024-09-17T06:06:27.568383+0000","last_peered":"2024-09-17T06:06:27.568383+0000","last_clean":"2024-09-17T06:06:27.568383+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:06:27.568383+0000","last_undegraded":"2024-09-17T06:06:27.568383+0000","last_fullsized":"2024-09-17T06:06:27.568383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:24.945633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.972191+0000","last_change":"2024-09-17T06:06:02.747970+0000","last_active":"2024-09-17T06:06:21.972191+0000","last_peered":"2024-09-17T06:06:21.972191+0000","last_clean":"2024-09-17T06:06:21.972191+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:06:21.972191+0000","last_undegraded":"2024-09-17T06:06:21.972191+0000","last_fullsized":"2024-09-17T06:06:21.972191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:01.251626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967658+0000","last_change":"2024-09-17T06:06:02.765641+0000","last_active":"2024-09-17T06:06:21.967658+0000","last_peered":"2024-09-17T06:06:21.967658+0000","last_clean":"2024-09-17T06:06:21.967658+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:06:21.967658+0000","last_undegraded":"2024-09-17T06:06:21.967658+0000","last_fullsized":"2024-09-17T06:06:21.967658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:45.801441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568079+0000","last_change":"2024-09-17T06:06:02.771427+0000","last_active":"2024-09-17T06:06:27.568079+0000","last_peered":"2024-09-17T06:06:27.568079+0000","last_clean":"2024-09-17T06:06:27.568079+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:06:27.568079+0000","last_undegraded":"2024-09-17T06:06:27.568079+0000","last_fullsized":"2024-09-17T06:06:27.568079+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.132428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"62'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498400+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:06:22.498400+0000","last_peered":"2024-09-17T06:06:22.498400+0000","last_clean":"2024-09-17T06:06:22.498400+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:06:22.498400+0000","last_undegraded":"2024-09-17T06:06:22.498400+0000","last_fullsized":"2024-09-17T06:06:22.498400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499947+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:06:22.499947+0000","last_peered":"2024-09-17T06:06:22.499947+0000","last_clean":"2024-09-17T06:06:22.499947+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:06:22.499947+0000","last_undegraded":"2024-09-17T06:06:22.499947+0000","last_fullsized":"2024-09-17T06:06:22.499947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.518926+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:06:27.518926+0000","last_peered":"2024-09-17T06:06:27.518926+0000","last_clean":"2024-09-17T06:06:27.518926+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:06:27.518926+0000","last_undegraded":"2024-09-17T06:06:27.518926+0000","last_fullsized":"2024-09-17T06:06:27.518926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501692+0000","last_change":"2024-09-17T06:06:02.772623+0000","last_active":"2024-09-17T06:06:22.501692+0000","last_peered":"2024-09-17T06:06:22.501692+0000","last_clean":"2024-09-17T06:06:22.501692+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:22.501692+0000","last_undegraded":"2024-09-17T06:06:22.501692+0000","last_fullsized":"2024-09-17T06:06:22.501692+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:53.767911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500282+0000","last_change":"2024-09-17T06:06:14.883260+0000","last_active":"2024-09-17T06:06:22.500282+0000","last_peered":"2024-09-17T06:06:22.500282+0000","last_clean":"2024-09-17T06:06:22.500282+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:06:22.500282+0000","last_undegraded":"2024-09-17T06:06:22.500282+0000","last_fullsized":"2024-09-17T06:06:22.500282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:01.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568687+0000","last_change":"2024-09-17T06:06:02.767610+0000","last_active":"2024-09-17T06:06:27.568687+0000","last_peered":"2024-09-17T06:06:27.568687+0000","last_clean":"2024-09-17T06:06:27.568687+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:06:27.568687+0000","last_undegraded":"2024-09-17T06:06:27.568687+0000","last_fullsized":"2024-09-17T06:06:27.568687+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:54.779217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971946+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:06:21.971946+0000","last_peered":"2024-09-17T06:06:21.971946+0000","last_clean":"2024-09-17T06:06:21.971946+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:06:21.971946+0000","last_undegraded":"2024-09-17T06:06:21.971946+0000","last_fullsized":"2024-09-17T06:06:21.971946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500361+0000","last_change":"2024-09-17T06:06:15.372083+0000","last_active":"2024-09-17T06:06:22.500361+0000","last_peered":"2024-09-17T06:06:22.500361+0000","last_clean":"2024-09-17T06:06:22.500361+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:06:22.500361+0000","last_undegraded":"2024-09-17T06:06:22.500361+0000","last_fullsized":"2024-09-17T06:06:22.500361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:53.468260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.554841+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:06:27.554841+0000","last_peered":"2024-09-17T06:06:27.554841+0000","last_clean":"2024-09-17T06:06:27.554841+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:06:27.554841+0000","last_undegraded":"2024-09-17T06:06:27.554841+0000","last_fullsized":"2024-09-17T06:06:27.554841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500005+0000","last_change":"2024-09-17T06:06:02.772342+0000","last_active":"2024-09-17T06:06:22.500005+0000","last_peered":"2024-09-17T06:06:22.500005+0000","last_clean":"2024-09-17T06:06:22.500005+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:06:22.500005+0000","last_undegraded":"2024-09-17T06:06:22.500005+0000","last_fullsized":"2024-09-17T06:06:22.500005+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:36.591645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970221+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:06:21.970221+0000","last_peered":"2024-09-17T06:06:21.970221+0000","last_clean":"2024-09-17T06:06:21.970221+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:06:21.970221+0000","last_undegraded":"2024-09-17T06:06:21.970221+0000","last_fullsized":"2024-09-17T06:06:21.970221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.561793+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:06:27.561793+0000","last_peered":"2024-09-17T06:06:27.561793+0000","last_clean":"2024-09-17T06:06:27.561793+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:06:27.561793+0000","last_undegraded":"2024-09-17T06:06:27.561793+0000","last_fullsized":"2024-09-17T06:06:27.561793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.522395+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:06:27.522395+0000","last_peered":"2024-09-17T06:06:27.522395+0000","last_clean":"2024-09-17T06:06:27.522395+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:06:27.522395+0000","last_undegraded":"2024-09-17T06:06:27.522395+0000","last_fullsized":"2024-09-17T06:06:27.522395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967772+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:06:21.967772+0000","last_peered":"2024-09-17T06:06:21.967772+0000","last_clean":"2024-09-17T06:06:21.967772+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:06:21.967772+0000","last_undegraded":"2024-09-17T06:06:21.967772+0000","last_fullsized":"2024-09-17T06:06:21.967772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.566590+0000","last_change":"2024-09-17T06:06:02.778195+0000","last_active":"2024-09-17T06:06:27.566590+0000","last_peered":"2024-09-17T06:06:27.566590+0000","last_clean":"2024-09-17T06:06:27.566590+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:06:27.566590+0000","last_undegraded":"2024-09-17T06:06:27.566590+0000","last_fullsized":"2024-09-17T06:06:27.566590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:41.521760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"62'7","reported_seq":116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970857+0000","last_change":"2024-09-17T06:05:20.635633+0000","last_active":"2024-09-17T06:06:21.970857+0000","last_peered":"2024-09-17T06:06:21.970857+0000","last_clean":"2024-09-17T06:06:21.970857+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:06:21.970857+0000","last_undegraded":"2024-09-17T06:06:21.970857+0000","last_fullsized":"2024-09-17T06:06:21.970857+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:42.262918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968250+0000","last_change":"2024-09-17T06:06:02.762076+0000","last_active":"2024-09-17T06:06:21.968250+0000","last_peered":"2024-09-17T06:06:21.968250+0000","last_clean":"2024-09-17T06:06:21.968250+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:06:21.968250+0000","last_undegraded":"2024-09-17T06:06:21.968250+0000","last_fullsized":"2024-09-17T06:06:21.968250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:12.436619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.559649+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:06:27.559649+0000","last_peered":"2024-09-17T06:06:27.559649+0000","last_clean":"2024-09-17T06:06:27.559649+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:06:27.559649+0000","last_undegraded":"2024-09-17T06:06:27.559649+0000","last_fullsized":"2024-09-17T06:06:27.559649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970773+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:06:21.970773+0000","last_peered":"2024-09-17T06:06:21.970773+0000","last_clean":"2024-09-17T06:06:21.970773+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:06:21.970773+0000","last_undegraded":"2024-09-17T06:06:21.970773+0000","last_fullsized":"2024-09-17T06:06:21.970773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498270+0000","last_change":"2024-09-17T06:06:14.879517+0000","last_active":"2024-09-17T06:06:22.498270+0000","last_peered":"2024-09-17T06:06:22.498270+0000","last_clean":"2024-09-17T06:06:22.498270+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:06:22.498270+0000","last_undegraded":"2024-09-17T06:06:22.498270+0000","last_fullsized":"2024-09-17T06:06:22.498270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:59.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574456+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:06:27.574456+0000","last_peered":"2024-09-17T06:06:27.574456+0000","last_clean":"2024-09-17T06:06:27.574456+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:06:27.574456+0000","last_undegraded":"2024-09-17T06:06:27.574456+0000","last_fullsized":"2024-09-17T06:06:27.574456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503060+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:06:22.503060+0000","last_peered":"2024-09-17T06:06:22.503060+0000","last_clean":"2024-09-17T06:06:22.503060+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:06:22.503060+0000","last_undegraded":"2024-09-17T06:06:22.503060+0000","last_fullsized":"2024-09-17T06:06:22.503060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498442+0000","last_change":"2024-09-17T06:06:14.881955+0000","last_active":"2024-09-17T06:06:22.498442+0000","last_peered":"2024-09-17T06:06:22.498442+0000","last_clean":"2024-09-17T06:06:22.498442+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:06:22.498442+0000","last_undegraded":"2024-09-17T06:06:22.498442+0000","last_fullsized":"2024-09-17T06:06:22.498442+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:31.787475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499845+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:06:22.499845+0000","last_peered":"2024-09-17T06:06:22.499845+0000","last_clean":"2024-09-17T06:06:22.499845+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:06:22.499845+0000","last_undegraded":"2024-09-17T06:06:22.499845+0000","last_fullsized":"2024-09-17T06:06:22.499845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.542676+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:06:27.542676+0000","last_peered":"2024-09-17T06:06:27.542676+0000","last_clean":"2024-09-17T06:06:27.542676+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:06:27.542676+0000","last_undegraded":"2024-09-17T06:06:27.542676+0000","last_fullsized":"2024-09-17T06:06:27.542676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971203+0000","last_change":"2024-09-17T06:06:02.751465+0000","last_active":"2024-09-17T06:06:21.971203+0000","last_peered":"2024-09-17T06:06:21.971203+0000","last_clean":"2024-09-17T06:06:21.971203+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:06:21.971203+0000","last_undegraded":"2024-09-17T06:06:21.971203+0000","last_fullsized":"2024-09-17T06:06:21.971203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:15.399241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502473+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:06:22.502473+0000","last_peered":"2024-09-17T06:06:22.502473+0000","last_clean":"2024-09-17T06:06:22.502473+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:06:22.502473+0000","last_undegraded":"2024-09-17T06:06:22.502473+0000","last_fullsized":"2024-09-17T06:06:22.502473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.537111+0000","last_change":"2024-09-17T06:06:14.876329+0000","last_active":"2024-09-17T06:06:27.537111+0000","last_peered":"2024-09-17T06:06:27.537111+0000","last_clean":"2024-09-17T06:06:27.537111+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:06:27.537111+0000","last_undegraded":"2024-09-17T06:06:27.537111+0000","last_fullsized":"2024-09-17T06:06:27.537111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:44.076246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498602+0000","last_change":"2024-09-17T06:06:14.883367+0000","last_active":"2024-09-17T06:06:22.498602+0000","last_peered":"2024-09-17T06:06:22.498602+0000","last_clean":"2024-09-17T06:06:22.498602+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:06:22.498602+0000","last_undegraded":"2024-09-17T06:06:22.498602+0000","last_fullsized":"2024-09-17T06:06:22.498602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:34.486361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501858+0000","last_change":"2024-09-17T06:06:02.753865+0000","last_active":"2024-09-17T06:06:22.501858+0000","last_peered":"2024-09-17T06:06:22.501858+0000","last_clean":"2024-09-17T06:06:22.501858+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:06:22.501858+0000","last_undegraded":"2024-09-17T06:06:22.501858+0000","last_fullsized":"2024-09-17T06:06:22.501858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:02.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.547358+0000","last_change":"2024-09-17T06:06:02.774846+0000","last_active":"2024-09-17T06:06:27.547358+0000","last_peered":"2024-09-17T06:06:27.547358+0000","last_clean":"2024-09-17T06:06:27.547358+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:06:27.547358+0000","last_undegraded":"2024-09-17T06:06:27.547358+0000","last_fullsized":"2024-09-17T06:06:27.547358+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:03.871862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499002+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:06:22.499002+0000","last_peered":"2024-09-17T06:06:22.499002+0000","last_clean":"2024-09-17T06:06:22.499002+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:06:22.499002+0000","last_undegraded":"2024-09-17T06:06:22.499002+0000","last_fullsized":"2024-09-17T06:06:22.499002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499917+0000","last_change":"2024-09-17T06:06:14.874567+0000","last_active":"2024-09-17T06:06:22.499917+0000","last_peered":"2024-09-17T06:06:22.499917+0000","last_clean":"2024-09-17T06:06:22.499917+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:06:22.499917+0000","last_undegraded":"2024-09-17T06:06:22.499917+0000","last_fullsized":"2024-09-17T06:06:22.499917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:16.000785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.555058+0000","last_change":"2024-09-17T06:06:02.747397+0000","last_active":"2024-09-17T06:06:27.555058+0000","last_peered":"2024-09-17T06:06:27.555058+0000","last_clean":"2024-09-17T06:06:27.555058+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:06:27.555058+0000","last_undegraded":"2024-09-17T06:06:27.555058+0000","last_fullsized":"2024-09-17T06:06:27.555058+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:35.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500463+0000","last_change":"2024-09-17T06:06:15.371993+0000","last_active":"2024-09-17T06:06:22.500463+0000","last_peered":"2024-09-17T06:06:22.500463+0000","last_clean":"2024-09-17T06:06:22.500463+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:06:22.500463+0000","last_undegraded":"2024-09-17T06:06:22.500463+0000","last_fullsized":"2024-09-17T06:06:22.500463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:36.359097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.551299+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:06:27.551299+0000","last_peered":"2024-09-17T06:06:27.551299+0000","last_clean":"2024-09-17T06:06:27.551299+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:06:27.551299+0000","last_undegraded":"2024-09-17T06:06:27.551299+0000","last_fullsized":"2024-09-17T06:06:27.551299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.563391+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:06:27.563391+0000","last_peered":"2024-09-17T06:06:27.563391+0000","last_clean":"2024-09-17T06:06:27.563391+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:06:27.563391+0000","last_undegraded":"2024-09-17T06:06:27.563391+0000","last_fullsized":"2024-09-17T06:06:27.563391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.552660+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:06:27.552660+0000","last_peered":"2024-09-17T06:06:27.552660+0000","last_clean":"2024-09-17T06:06:27.552660+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:06:27.552660+0000","last_undegraded":"2024-09-17T06:06:27.552660+0000","last_fullsized":"2024-09-17T06:06:27.552660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.527615+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:06:27.527615+0000","last_peered":"2024-09-17T06:06:27.527615+0000","last_clean":"2024-09-17T06:06:27.527615+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:06:27.527615+0000","last_undegraded":"2024-09-17T06:06:27.527615+0000","last_fullsized":"2024-09-17T06:06:27.527615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.548572+0000","last_change":"2024-09-17T06:06:14.862875+0000","last_active":"2024-09-17T06:06:27.548572+0000","last_peered":"2024-09-17T06:06:27.548572+0000","last_clean":"2024-09-17T06:06:27.548572+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:06:27.548572+0000","last_undegraded":"2024-09-17T06:06:27.548572+0000","last_fullsized":"2024-09-17T06:06:27.548572+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:58.805589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.531497+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:06:27.531497+0000","last_peered":"2024-09-17T06:06:27.531497+0000","last_clean":"2024-09-17T06:06:27.531497+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:06:27.531497+0000","last_undegraded":"2024-09-17T06:06:27.531497+0000","last_fullsized":"2024-09-17T06:06:27.531497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.573178+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:06:27.573178+0000","last_peered":"2024-09-17T06:06:27.573178+0000","last_clean":"2024-09-17T06:06:27.573178+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:06:27.573178+0000","last_undegraded":"2024-09-17T06:06:27.573178+0000","last_fullsized":"2024-09-17T06:06:27.573178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.519555+0000","last_change":"2024-09-17T06:06:14.869993+0000","last_active":"2024-09-17T06:06:27.519555+0000","last_peered":"2024-09-17T06:06:27.519555+0000","last_clean":"2024-09-17T06:06:27.519555+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:06:27.519555+0000","last_undegraded":"2024-09-17T06:06:27.519555+0000","last_fullsized":"2024-09-17T06:06:27.519555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:10.143503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.552477+0000","last_change":"2024-09-17T06:05:13.535655+0000","last_active":"2024-09-17T06:06:27.552477+0000","last_peered":"2024-09-17T06:06:27.552477+0000","last_clean":"2024-09-17T06:06:27.552477+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:06:27.552477+0000","last_undegraded":"2024-09-17T06:06:27.552477+0000","last_fullsized":"2024-09-17T06:06:27.552477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:26.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.547204+0000","last_change":"2024-09-17T06:06:14.862354+0000","last_active":"2024-09-17T06:06:27.547204+0000","last_peered":"2024-09-17T06:06:27.547204+0000","last_clean":"2024-09-17T06:06:27.547204+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:06:27.547204+0000","last_undegraded":"2024-09-17T06:06:27.547204+0000","last_fullsized":"2024-09-17T06:06:27.547204+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:57.348056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574065+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:06:27.574065+0000","last_peered":"2024-09-17T06:06:27.574065+0000","last_clean":"2024-09-17T06:06:27.574065+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:06:27.574065+0000","last_undegraded":"2024-09-17T06:06:27.574065+0000","last_fullsized":"2024-09-17T06:06:27.574065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.536183+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:06:27.536183+0000","last_peered":"2024-09-17T06:06:27.536183+0000","last_clean":"2024-09-17T06:06:27.536183+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:06:27.536183+0000","last_undegraded":"2024-09-17T06:06:27.536183+0000","last_fullsized":"2024-09-17T06:06:27.536183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.557127+0000","last_change":"2024-09-17T06:06:02.781690+0000","last_active":"2024-09-17T06:06:27.557127+0000","last_peered":"2024-09-17T06:06:27.557127+0000","last_clean":"2024-09-17T06:06:27.557127+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:06:27.557127+0000","last_undegraded":"2024-09-17T06:06:27.557127+0000","last_fullsized":"2024-09-17T06:06:27.557127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:50.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.544249+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:06:27.544249+0000","last_peered":"2024-09-17T06:06:27.544249+0000","last_clean":"2024-09-17T06:06:27.544249+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:06:27.544249+0000","last_undegraded":"2024-09-17T06:06:27.544249+0000","last_fullsized":"2024-09-17T06:06:27.544249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.551918+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:06:27.551918+0000","last_peered":"2024-09-17T06:06:27.551918+0000","last_clean":"2024-09-17T06:06:27.551918+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:06:27.551918+0000","last_undegraded":"2024-09-17T06:06:27.551918+0000","last_fullsized":"2024-09-17T06:06:27.551918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574667+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:06:27.574667+0000","last_peered":"2024-09-17T06:06:27.574667+0000","last_clean":"2024-09-17T06:06:27.574667+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:06:27.574667+0000","last_undegraded":"2024-09-17T06:06:27.574667+0000","last_fullsized":"2024-09-17T06:06:27.574667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.553238+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:06:27.553238+0000","last_peered":"2024-09-17T06:06:27.553238+0000","last_clean":"2024-09-17T06:06:27.553238+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:06:27.553238+0000","last_undegraded":"2024-09-17T06:06:27.553238+0000","last_fullsized":"2024-09-17T06:06:27.553238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.532776+0000","last_change":"2024-09-17T06:06:02.777396+0000","last_active":"2024-09-17T06:06:27.532776+0000","last_peered":"2024-09-17T06:06:27.532776+0000","last_clean":"2024-09-17T06:06:27.532776+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:06:27.532776+0000","last_undegraded":"2024-09-17T06:06:27.532776+0000","last_fullsized":"2024-09-17T06:06:27.532776+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:28.787647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.543210+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:06:27.543210+0000","last_peered":"2024-09-17T06:06:27.543210+0000","last_clean":"2024-09-17T06:06:27.543210+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:06:27.543210+0000","last_undegraded":"2024-09-17T06:06:27.543210+0000","last_fullsized":"2024-09-17T06:06:27.543210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.551462+0000","last_change":"2024-09-17T06:06:14.882860+0000","last_active":"2024-09-17T06:06:27.551462+0000","last_peered":"2024-09-17T06:06:27.551462+0000","last_clean":"2024-09-17T06:06:27.551462+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:06:27.551462+0000","last_undegraded":"2024-09-17T06:06:27.551462+0000","last_fullsized":"2024-09-17T06:06:27.551462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:07.158141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.558120+0000","last_change":"2024-09-17T06:06:02.776605+0000","last_active":"2024-09-17T06:06:27.558120+0000","last_peered":"2024-09-17T06:06:27.558120+0000","last_clean":"2024-09-17T06:06:27.558120+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:06:27.558120+0000","last_undegraded":"2024-09-17T06:06:27.558120+0000","last_fullsized":"2024-09-17T06:06:27.558120+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:55.566930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.561965+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:06:27.561965+0000","last_peered":"2024-09-17T06:06:27.561965+0000","last_clean":"2024-09-17T06:06:27.561965+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:06:27.561965+0000","last_undegraded":"2024-09-17T06:06:27.561965+0000","last_fullsized":"2024-09-17T06:06:27.561965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.564023+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:06:27.564023+0000","last_peered":"2024-09-17T06:06:27.564023+0000","last_clean":"2024-09-17T06:06:27.564023+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:06:27.564023+0000","last_undegraded":"2024-09-17T06:06:27.564023+0000","last_fullsized":"2024-09-17T06:06:27.564023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.573527+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:06:27.573527+0000","last_peered":"2024-09-17T06:06:27.573527+0000","last_clean":"2024-09-17T06:06:27.573527+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:06:27.573527+0000","last_undegraded":"2024-09-17T06:06:27.573527+0000","last_fullsized":"2024-09-17T06:06:27.573527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.553454+0000","last_change":"2024-09-17T06:06:14.863779+0000","last_active":"2024-09-17T06:06:27.553454+0000","last_peered":"2024-09-17T06:06:27.553454+0000","last_clean":"2024-09-17T06:06:27.553454+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:06:27.553454+0000","last_undegraded":"2024-09-17T06:06:27.553454+0000","last_fullsized":"2024-09-17T06:06:27.553454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:41.626998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.527586+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:06:27.527586+0000","last_peered":"2024-09-17T06:06:27.527586+0000","last_clean":"2024-09-17T06:06:27.527586+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:06:27.527586+0000","last_undegraded":"2024-09-17T06:06:27.527586+0000","last_fullsized":"2024-09-17T06:06:27.527586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.553590+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:06:27.553590+0000","last_peered":"2024-09-17T06:06:27.553590+0000","last_clean":"2024-09-17T06:06:27.553590+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:06:27.553590+0000","last_undegraded":"2024-09-17T06:06:27.553590+0000","last_fullsized":"2024-09-17T06:06:27.553590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.554203+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:06:27.554203+0000","last_peered":"2024-09-17T06:06:27.554203+0000","last_clean":"2024-09-17T06:06:27.554203+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:06:27.554203+0000","last_undegraded":"2024-09-17T06:06:27.554203+0000","last_fullsized":"2024-09-17T06:06:27.554203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.554038+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:06:27.554038+0000","last_peered":"2024-09-17T06:06:27.554038+0000","last_clean":"2024-09-17T06:06:27.554038+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:06:27.554038+0000","last_undegraded":"2024-09-17T06:06:27.554038+0000","last_fullsized":"2024-09-17T06:06:27.554038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.541975+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:06:27.541975+0000","last_peered":"2024-09-17T06:06:27.541975+0000","last_clean":"2024-09-17T06:06:27.541975+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:06:27.541975+0000","last_undegraded":"2024-09-17T06:06:27.541975+0000","last_fullsized":"2024-09-17T06:06:27.541975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.492171+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:06:27.492171+0000","last_peered":"2024-09-17T06:06:27.492171+0000","last_clean":"2024-09-17T06:06:27.492171+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:06:27.492171+0000","last_undegraded":"2024-09-17T06:06:27.492171+0000","last_fullsized":"2024-09-17T06:06:27.492171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.569630+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:06:27.569630+0000","last_peered":"2024-09-17T06:06:27.569630+0000","last_clean":"2024-09-17T06:06:27.569630+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:06:27.569630+0000","last_undegraded":"2024-09-17T06:06:27.569630+0000","last_fullsized":"2024-09-17T06:06:27.569630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":995328,"data_stored":530556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":494218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1556480,"data_stored":1084902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1544192,"data_stored":1084756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":530144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906952,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28984,"kb_used_data":936,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342856,"statfs":{"total":96636764160,"available":96607084544,"internally_reserved":0,"allocated":958464,"data_stored":493932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":493876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":950272,"data_stored":493896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:06:34.697 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T06:06:34.697 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:06:34.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.892+0000 7f7b2740f640 1 -- 172.21.15.122:0/3647215307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b2015bf20 msgr2=0x7f7b20072870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.892+0000 7f7b2740f640 1 --2- 172.21.15.122:0/3647215307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b2015bf20 0x7f7b20072870 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7b20073d30 tx=0x7f7b1801cb80 comp rx=0 tx=0).stop 2024-09-17T06:06:34.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.892+0000 7f7b2740f640 1 -- 172.21.15.122:0/3647215307 shutdown_connections 2024-09-17T06:06:34.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.892+0000 7f7b2740f640 1 --2- 172.21.15.122:0/3647215307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b2015bf20 0x7f7b20072870 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.892+0000 7f7b2740f640 1 --2- 172.21.15.122:0/3647215307 >> v2:172.21.15.173:3300/0 conn(0x7f7b200c8df0 0x7f7b20072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.892+0000 7f7b2740f640 1 -- 172.21.15.122:0/3647215307 >> 172.21.15.122:0/3647215307 conn(0x7f7b200746d0 msgr2=0x7f7b20074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:34.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.892+0000 7f7b2740f640 1 -- 172.21.15.122:0/3647215307 shutdown_connections 2024-09-17T06:06:34.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.892+0000 7f7b2740f640 1 -- 172.21.15.122:0/3647215307 wait complete. 2024-09-17T06:06:34.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.892+0000 7f7b2740f640 1 Processor -- start 2024-09-17T06:06:34.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.892+0000 7f7b2740f640 1 -- start start 2024-09-17T06:06:34.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b2740f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b200c68d0 0x7f7b201f8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:34.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b2740f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b200c8df0 0x7f7b200c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:34.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b2740f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b2015bf20 0x7f7b2013de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b2740f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7b20152540 con 0x7f7b200c68d0 2024-09-17T06:06:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b2740f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7b200c9f70 con 0x7f7b200c8df0 2024-09-17T06:06:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b2740f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7b201526c0 con 0x7f7b2015bf20 2024-09-17T06:06:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b251ab640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b200c68d0 0x7f7b201f8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b251ab640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b200c68d0 0x7f7b201f8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56422/0 (socket says 172.21.15.122:56422) 2024-09-17T06:06:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b251ab640 1 -- 172.21.15.122:0/4066423636 learned_addr learned my addr 172.21.15.122:0/4066423636 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b249aa640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b200c8df0 0x7f7b200c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b251ab640 1 -- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b2015bf20 msgr2=0x7f7b2013de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b259ac640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b2015bf20 0x7f7b2013de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b251ab640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b2015bf20 0x7f7b2013de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b251ab640 1 -- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b200c8df0 msgr2=0x7f7b200c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:34.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b251ab640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b200c8df0 0x7f7b200c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b251ab640 1 -- 172.21.15.122:0/4066423636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b201f81b0 con 0x7f7b200c68d0 2024-09-17T06:06:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b249aa640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b200c8df0 0x7f7b200c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b259ac640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b2015bf20 0x7f7b2013de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b251ab640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b200c68d0 0x7f7b201f8c90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c9f0 tx=0x7f7b1c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b15ffb640 1 -- 172.21.15.122:0/4066423636 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c007bb0 con 0x7f7b200c68d0 2024-09-17T06:06:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b15ffb640 1 -- 172.21.15.122:0/4066423636 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b1c007e40 con 0x7f7b200c68d0 2024-09-17T06:06:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b15ffb640 1 -- 172.21.15.122:0/4066423636 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00f690 con 0x7f7b200c68d0 2024-09-17T06:06:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b2740f640 1 -- 172.21.15.122:0/4066423636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b201f8490 con 0x7f7b200c68d0 2024-09-17T06:06:34.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b2740f640 1 -- 172.21.15.122:0/4066423636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b201431b0 con 0x7f7b200c68d0 2024-09-17T06:06:34.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b2740f640 1 -- 172.21.15.122:0/4066423636 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2015b810 con 0x7f7b200c68d0 2024-09-17T06:06:34.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.896+0000 7f7b15ffb640 1 -- 172.21.15.122:0/4066423636 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7b1c00f830 con 0x7f7b200c68d0 2024-09-17T06:06:34.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.900+0000 7f7b15ffb640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7b04073200 0x7f7b04075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:34.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.900+0000 7f7b15ffb640 1 -- 172.21.15.122:0/4066423636 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f7b1c094d20 con 0x7f7b200c68d0 2024-09-17T06:06:34.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.900+0000 7f7b249aa640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7b04073200 0x7f7b04075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:34.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.900+0000 7f7b249aa640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7b04073200 0x7f7b04075710 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7b20152240 tx=0x7f7b10009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:34.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:34.904+0000 7f7b15ffb640 1 -- 172.21.15.122:0/4066423636 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7b1c014030 con 0x7f7b200c68d0 2024-09-17T06:06:35.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.068+0000 7f7b2740f640 1 -- 172.21.15.122:0/4066423636 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b20161ff0 con 0x7f7b04073200 2024-09-17T06:06:35.087 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.088+0000 7f7b15ffb640 1 -- 172.21.15.122:0/4066423636 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332881 (secure 0 0 0) 0x7f7b20161ff0 con 0x7f7b04073200 2024-09-17T06:06:35.092 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:06:35.094 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:06:35.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.092+0000 7f7b2740f640 1 -- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7b04073200 msgr2=0x7f7b04075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:35.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.092+0000 7f7b2740f640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7b04073200 0x7f7b04075710 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7b20152240 tx=0x7f7b10009040 comp rx=0 tx=0).stop 2024-09-17T06:06:35.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.092+0000 7f7b2740f640 1 -- 172.21.15.122:0/4066423636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b200c68d0 msgr2=0x7f7b201f8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:35.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.092+0000 7f7b2740f640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b200c68d0 0x7f7b201f8c90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c9f0 tx=0x7f7b1c00ceb0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.092+0000 7f7b2740f640 1 -- 172.21.15.122:0/4066423636 shutdown_connections 2024-09-17T06:06:35.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.092+0000 7f7b2740f640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b2015bf20 0x7f7b2013de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.092+0000 7f7b2740f640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7b04073200 0x7f7b04075710 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.092+0000 7f7b2740f640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b200c8df0 0x7f7b200c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.092+0000 7f7b2740f640 1 --2- 172.21.15.122:0/4066423636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b200c68d0 0x7f7b201f8c90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.092+0000 7f7b2740f640 1 -- 172.21.15.122:0/4066423636 >> 172.21.15.122:0/4066423636 conn(0x7f7b200746d0 msgr2=0x7f7b200c9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:35.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.092+0000 7f7b2740f640 1 -- 172.21.15.122:0/4066423636 shutdown_connections 2024-09-17T06:06:35.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.092+0000 7f7b2740f640 1 -- 172.21.15.122:0/4066423636 wait complete. 2024-09-17T06:06:35.114 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-17T06:06:33.572936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":656,"ondisk_log_size":656,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242544,"kb_used_data":8688,"kb_used_omap":17,"kb_used_meta":233710,"kb_avail":754732176,"statfs":{"total":773094113280,"available":772845748224,"internally_reserved":0,"allocated":8896512,"data_stored":5206280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":239319789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.608481"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500455+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:06:22.500455+0000","last_peered":"2024-09-17T06:06:22.500455+0000","last_clean":"2024-09-17T06:06:22.500455+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:06:22.500455+0000","last_undegraded":"2024-09-17T06:06:22.500455+0000","last_fullsized":"2024-09-17T06:06:22.500455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.522869+0000","last_change":"2024-09-17T06:06:14.882867+0000","last_active":"2024-09-17T06:06:27.522869+0000","last_peered":"2024-09-17T06:06:27.522869+0000","last_clean":"2024-09-17T06:06:27.522869+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:06:27.522869+0000","last_undegraded":"2024-09-17T06:06:27.522869+0000","last_fullsized":"2024-09-17T06:06:27.522869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:30.856555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498014+0000","last_change":"2024-09-17T06:06:15.369420+0000","last_active":"2024-09-17T06:06:22.498014+0000","last_peered":"2024-09-17T06:06:22.498014+0000","last_clean":"2024-09-17T06:06:22.498014+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:06:22.498014+0000","last_undegraded":"2024-09-17T06:06:22.498014+0000","last_fullsized":"2024-09-17T06:06:22.498014+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:26.332180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500348+0000","last_change":"2024-09-17T06:06:14.876941+0000","last_active":"2024-09-17T06:06:22.500348+0000","last_peered":"2024-09-17T06:06:22.500348+0000","last_clean":"2024-09-17T06:06:22.500348+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:06:22.500348+0000","last_undegraded":"2024-09-17T06:06:22.500348+0000","last_fullsized":"2024-09-17T06:06:22.500348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:16.802718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.559750+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:06:27.559750+0000","last_peered":"2024-09-17T06:06:27.559750+0000","last_clean":"2024-09-17T06:06:27.559750+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:06:27.559750+0000","last_undegraded":"2024-09-17T06:06:27.559750+0000","last_fullsized":"2024-09-17T06:06:27.559750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966721+0000","last_change":"2024-09-17T06:06:02.760496+0000","last_active":"2024-09-17T06:06:21.966721+0000","last_peered":"2024-09-17T06:06:21.966721+0000","last_clean":"2024-09-17T06:06:21.966721+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:06:21.966721+0000","last_undegraded":"2024-09-17T06:06:21.966721+0000","last_fullsized":"2024-09-17T06:06:21.966721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.085087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"60'3","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501464+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:06:22.501464+0000","last_peered":"2024-09-17T06:06:22.501464+0000","last_clean":"2024-09-17T06:06:22.501464+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:06:22.501464+0000","last_undegraded":"2024-09-17T06:06:22.501464+0000","last_fullsized":"2024-09-17T06:06:22.501464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568851+0000","last_change":"2024-09-17T06:06:02.772542+0000","last_active":"2024-09-17T06:06:27.568851+0000","last_peered":"2024-09-17T06:06:27.568851+0000","last_clean":"2024-09-17T06:06:27.568851+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:27.568851+0000","last_undegraded":"2024-09-17T06:06:27.568851+0000","last_fullsized":"2024-09-17T06:06:27.568851+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:31.442644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968566+0000","last_change":"2024-09-17T06:06:02.762154+0000","last_active":"2024-09-17T06:06:21.968566+0000","last_peered":"2024-09-17T06:06:21.968566+0000","last_clean":"2024-09-17T06:06:21.968566+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:06:21.968566+0000","last_undegraded":"2024-09-17T06:06:21.968566+0000","last_fullsized":"2024-09-17T06:06:21.968566+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:56.087057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500504+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:06:22.500504+0000","last_peered":"2024-09-17T06:06:22.500504+0000","last_clean":"2024-09-17T06:06:22.500504+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:06:22.500504+0000","last_undegraded":"2024-09-17T06:06:22.500504+0000","last_fullsized":"2024-09-17T06:06:22.500504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.549485+0000","last_change":"2024-09-17T06:06:02.747441+0000","last_active":"2024-09-17T06:06:27.549485+0000","last_peered":"2024-09-17T06:06:27.549485+0000","last_clean":"2024-09-17T06:06:27.549485+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:06:27.549485+0000","last_undegraded":"2024-09-17T06:06:27.549485+0000","last_fullsized":"2024-09-17T06:06:27.549485+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:56.535771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968309+0000","last_change":"2024-09-17T06:06:02.760042+0000","last_active":"2024-09-17T06:06:21.968309+0000","last_peered":"2024-09-17T06:06:21.968309+0000","last_clean":"2024-09-17T06:06:21.968309+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:06:21.968309+0000","last_undegraded":"2024-09-17T06:06:21.968309+0000","last_fullsized":"2024-09-17T06:06:21.968309+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:53.866107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.555668+0000","last_change":"2024-09-17T06:06:02.772614+0000","last_active":"2024-09-17T06:06:27.555668+0000","last_peered":"2024-09-17T06:06:27.555668+0000","last_clean":"2024-09-17T06:06:27.555668+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:06:27.555668+0000","last_undegraded":"2024-09-17T06:06:27.555668+0000","last_fullsized":"2024-09-17T06:06:27.555668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:56.086542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"60'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501042+0000","last_change":"2024-09-17T06:06:02.763938+0000","last_active":"2024-09-17T06:06:22.501042+0000","last_peered":"2024-09-17T06:06:22.501042+0000","last_clean":"2024-09-17T06:06:22.501042+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:06:22.501042+0000","last_undegraded":"2024-09-17T06:06:22.501042+0000","last_fullsized":"2024-09-17T06:06:22.501042+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:09.262608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969558+0000","last_change":"2024-09-17T06:06:02.764648+0000","last_active":"2024-09-17T06:06:21.969558+0000","last_peered":"2024-09-17T06:06:21.969558+0000","last_clean":"2024-09-17T06:06:21.969558+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:06:21.969558+0000","last_undegraded":"2024-09-17T06:06:21.969558+0000","last_fullsized":"2024-09-17T06:06:21.969558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:56.341325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.536106+0000","last_change":"2024-09-17T06:06:14.877208+0000","last_active":"2024-09-17T06:06:27.536106+0000","last_peered":"2024-09-17T06:06:27.536106+0000","last_clean":"2024-09-17T06:06:27.536106+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:06:27.536106+0000","last_undegraded":"2024-09-17T06:06:27.536106+0000","last_fullsized":"2024-09-17T06:06:27.536106+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:16.547077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967926+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:06:21.967926+0000","last_peered":"2024-09-17T06:06:21.967926+0000","last_clean":"2024-09-17T06:06:21.967926+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:06:21.967926+0000","last_undegraded":"2024-09-17T06:06:21.967926+0000","last_fullsized":"2024-09-17T06:06:21.967926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969187+0000","last_change":"2024-09-17T06:06:02.777996+0000","last_active":"2024-09-17T06:06:21.969187+0000","last_peered":"2024-09-17T06:06:21.969187+0000","last_clean":"2024-09-17T06:06:21.969187+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:06:21.969187+0000","last_undegraded":"2024-09-17T06:06:21.969187+0000","last_fullsized":"2024-09-17T06:06:21.969187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:04.148545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.502605+0000","last_change":"2024-09-17T06:06:14.859614+0000","last_active":"2024-09-17T06:06:27.502605+0000","last_peered":"2024-09-17T06:06:27.502605+0000","last_clean":"2024-09-17T06:06:27.502605+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:06:27.502605+0000","last_undegraded":"2024-09-17T06:06:27.502605+0000","last_fullsized":"2024-09-17T06:06:27.502605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.132428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966735+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:06:21.966735+0000","last_peered":"2024-09-17T06:06:21.966735+0000","last_clean":"2024-09-17T06:06:21.966735+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:06:21.966735+0000","last_undegraded":"2024-09-17T06:06:21.966735+0000","last_fullsized":"2024-09-17T06:06:21.966735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967353+0000","last_change":"2024-09-17T06:06:02.773038+0000","last_active":"2024-09-17T06:06:21.967353+0000","last_peered":"2024-09-17T06:06:21.967353+0000","last_clean":"2024-09-17T06:06:21.967353+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:06:21.967353+0000","last_undegraded":"2024-09-17T06:06:21.967353+0000","last_fullsized":"2024-09-17T06:06:21.967353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:24.833172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.539183+0000","last_change":"2024-09-17T06:06:02.742391+0000","last_active":"2024-09-17T06:06:27.539183+0000","last_peered":"2024-09-17T06:06:27.539183+0000","last_clean":"2024-09-17T06:06:27.539183+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:06:27.539183+0000","last_undegraded":"2024-09-17T06:06:27.539183+0000","last_fullsized":"2024-09-17T06:06:27.539183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:18.282190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499601+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:06:22.499601+0000","last_peered":"2024-09-17T06:06:22.499601+0000","last_clean":"2024-09-17T06:06:22.499601+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:06:22.499601+0000","last_undegraded":"2024-09-17T06:06:22.499601+0000","last_fullsized":"2024-09-17T06:06:22.499601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.973250+0000","last_change":"2024-09-17T06:06:02.760965+0000","last_active":"2024-09-17T06:06:21.973250+0000","last_peered":"2024-09-17T06:06:21.973250+0000","last_clean":"2024-09-17T06:06:21.973250+0000","last_became_active":"2024-09-17T06:06:02.755335+0000","last_became_peered":"2024-09-17T06:06:02.755335+0000","last_unstale":"2024-09-17T06:06:21.973250+0000","last_undegraded":"2024-09-17T06:06:21.973250+0000","last_fullsized":"2024-09-17T06:06:21.973250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:49.568290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.530774+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:06:27.530774+0000","last_peered":"2024-09-17T06:06:27.530774+0000","last_clean":"2024-09-17T06:06:27.530774+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:06:27.530774+0000","last_undegraded":"2024-09-17T06:06:27.530774+0000","last_fullsized":"2024-09-17T06:06:27.530774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"61'3","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503161+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:06:22.503161+0000","last_peered":"2024-09-17T06:06:22.503161+0000","last_clean":"2024-09-17T06:06:22.503161+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:06:22.503161+0000","last_undegraded":"2024-09-17T06:06:22.503161+0000","last_fullsized":"2024-09-17T06:06:22.503161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967557+0000","last_change":"2024-09-17T06:06:02.770140+0000","last_active":"2024-09-17T06:06:21.967557+0000","last_peered":"2024-09-17T06:06:21.967557+0000","last_clean":"2024-09-17T06:06:21.967557+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:06:21.967557+0000","last_undegraded":"2024-09-17T06:06:21.967557+0000","last_fullsized":"2024-09-17T06:06:21.967557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:35.888277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.556341+0000","last_change":"2024-09-17T06:06:14.875548+0000","last_active":"2024-09-17T06:06:27.556341+0000","last_peered":"2024-09-17T06:06:27.556341+0000","last_clean":"2024-09-17T06:06:27.556341+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:06:27.556341+0000","last_undegraded":"2024-09-17T06:06:27.556341+0000","last_fullsized":"2024-09-17T06:06:27.556341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:24.521256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967487+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:06:21.967487+0000","last_peered":"2024-09-17T06:06:21.967487+0000","last_clean":"2024-09-17T06:06:21.967487+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:06:21.967487+0000","last_undegraded":"2024-09-17T06:06:21.967487+0000","last_fullsized":"2024-09-17T06:06:21.967487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498066+0000","last_change":"2024-09-17T06:06:14.876736+0000","last_active":"2024-09-17T06:06:22.498066+0000","last_peered":"2024-09-17T06:06:22.498066+0000","last_clean":"2024-09-17T06:06:22.498066+0000","last_became_active":"2024-09-17T06:06:14.875773+0000","last_became_peered":"2024-09-17T06:06:14.875773+0000","last_unstale":"2024-09-17T06:06:22.498066+0000","last_undegraded":"2024-09-17T06:06:22.498066+0000","last_fullsized":"2024-09-17T06:06:22.498066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:52.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.504990+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:06:27.504990+0000","last_peered":"2024-09-17T06:06:27.504990+0000","last_clean":"2024-09-17T06:06:27.504990+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:06:27.504990+0000","last_undegraded":"2024-09-17T06:06:27.504990+0000","last_fullsized":"2024-09-17T06:06:27.504990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501976+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:06:22.501976+0000","last_peered":"2024-09-17T06:06:22.501976+0000","last_clean":"2024-09-17T06:06:22.501976+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:06:22.501976+0000","last_undegraded":"2024-09-17T06:06:22.501976+0000","last_fullsized":"2024-09-17T06:06:22.501976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499225+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:06:22.499225+0000","last_peered":"2024-09-17T06:06:22.499225+0000","last_clean":"2024-09-17T06:06:22.499225+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:06:22.499225+0000","last_undegraded":"2024-09-17T06:06:22.499225+0000","last_fullsized":"2024-09-17T06:06:22.499225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.549748+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:06:27.549748+0000","last_peered":"2024-09-17T06:06:27.549748+0000","last_clean":"2024-09-17T06:06:27.549748+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:06:27.549748+0000","last_undegraded":"2024-09-17T06:06:27.549748+0000","last_fullsized":"2024-09-17T06:06:27.549748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968198+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:06:21.968198+0000","last_peered":"2024-09-17T06:06:21.968198+0000","last_clean":"2024-09-17T06:06:21.968198+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:06:21.968198+0000","last_undegraded":"2024-09-17T06:06:21.968198+0000","last_fullsized":"2024-09-17T06:06:21.968198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967191+0000","last_change":"2024-09-17T06:06:02.750734+0000","last_active":"2024-09-17T06:06:21.967191+0000","last_peered":"2024-09-17T06:06:21.967191+0000","last_clean":"2024-09-17T06:06:21.967191+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:06:21.967191+0000","last_undegraded":"2024-09-17T06:06:21.967191+0000","last_fullsized":"2024-09-17T06:06:21.967191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:55.436212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.547264+0000","last_change":"2024-09-17T06:06:02.780406+0000","last_active":"2024-09-17T06:06:27.547264+0000","last_peered":"2024-09-17T06:06:27.547264+0000","last_clean":"2024-09-17T06:06:27.547264+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:06:27.547264+0000","last_undegraded":"2024-09-17T06:06:27.547264+0000","last_fullsized":"2024-09-17T06:06:27.547264+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:34.785782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971985+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:06:21.971985+0000","last_peered":"2024-09-17T06:06:21.971985+0000","last_clean":"2024-09-17T06:06:21.971985+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:06:21.971985+0000","last_undegraded":"2024-09-17T06:06:21.971985+0000","last_fullsized":"2024-09-17T06:06:21.971985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967920+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:06:21.967920+0000","last_peered":"2024-09-17T06:06:21.967920+0000","last_clean":"2024-09-17T06:06:21.967920+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:06:21.967920+0000","last_undegraded":"2024-09-17T06:06:21.967920+0000","last_fullsized":"2024-09-17T06:06:21.967920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.494802+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:06:27.494802+0000","last_peered":"2024-09-17T06:06:27.494802+0000","last_clean":"2024-09-17T06:06:27.494802+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:06:27.494802+0000","last_undegraded":"2024-09-17T06:06:27.494802+0000","last_fullsized":"2024-09-17T06:06:27.494802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"62'4","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498551+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:06:22.498551+0000","last_peered":"2024-09-17T06:06:22.498551+0000","last_clean":"2024-09-17T06:06:22.498551+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:06:22.498551+0000","last_undegraded":"2024-09-17T06:06:22.498551+0000","last_fullsized":"2024-09-17T06:06:22.498551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967511+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:06:21.967511+0000","last_peered":"2024-09-17T06:06:21.967511+0000","last_clean":"2024-09-17T06:06:21.967511+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:06:21.967511+0000","last_undegraded":"2024-09-17T06:06:21.967511+0000","last_fullsized":"2024-09-17T06:06:21.967511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.545291+0000","last_change":"2024-09-17T06:06:02.775030+0000","last_active":"2024-09-17T06:06:27.545291+0000","last_peered":"2024-09-17T06:06:27.545291+0000","last_clean":"2024-09-17T06:06:27.545291+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:06:27.545291+0000","last_undegraded":"2024-09-17T06:06:27.545291+0000","last_fullsized":"2024-09-17T06:06:27.545291+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:56.086542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499602+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:06:22.499602+0000","last_peered":"2024-09-17T06:06:22.499602+0000","last_clean":"2024-09-17T06:06:22.499602+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:06:22.499602+0000","last_undegraded":"2024-09-17T06:06:22.499602+0000","last_fullsized":"2024-09-17T06:06:22.499602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500801+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:06:22.500801+0000","last_peered":"2024-09-17T06:06:22.500801+0000","last_clean":"2024-09-17T06:06:22.500801+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:06:22.500801+0000","last_undegraded":"2024-09-17T06:06:22.500801+0000","last_fullsized":"2024-09-17T06:06:22.500801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.500084+0000","last_change":"2024-09-17T06:06:14.863098+0000","last_active":"2024-09-17T06:06:27.500084+0000","last_peered":"2024-09-17T06:06:27.500084+0000","last_clean":"2024-09-17T06:06:27.500084+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:06:27.500084+0000","last_undegraded":"2024-09-17T06:06:27.500084+0000","last_fullsized":"2024-09-17T06:06:27.500084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:43.199274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969649+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:06:21.969649+0000","last_peered":"2024-09-17T06:06:21.969649+0000","last_clean":"2024-09-17T06:06:21.969649+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:06:21.969649+0000","last_undegraded":"2024-09-17T06:06:21.969649+0000","last_fullsized":"2024-09-17T06:06:21.969649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":229,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503185+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:06:22.503185+0000","last_peered":"2024-09-17T06:06:22.503185+0000","last_clean":"2024-09-17T06:06:22.503185+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:06:22.503185+0000","last_undegraded":"2024-09-17T06:06:22.503185+0000","last_fullsized":"2024-09-17T06:06:22.503185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502700+0000","last_change":"2024-09-17T06:06:02.751844+0000","last_active":"2024-09-17T06:06:22.502700+0000","last_peered":"2024-09-17T06:06:22.502700+0000","last_clean":"2024-09-17T06:06:22.502700+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:06:22.502700+0000","last_undegraded":"2024-09-17T06:06:22.502700+0000","last_fullsized":"2024-09-17T06:06:22.502700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:29.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.565234+0000","last_change":"2024-09-17T06:04:49.135526+0000","last_active":"2024-09-17T06:06:27.565234+0000","last_peered":"2024-09-17T06:06:27.565234+0000","last_clean":"2024-09-17T06:06:27.565234+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:06:27.565234+0000","last_undegraded":"2024-09-17T06:06:27.565234+0000","last_fullsized":"2024-09-17T06:06:27.565234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:45.338884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499366+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:06:22.499366+0000","last_peered":"2024-09-17T06:06:22.499366+0000","last_clean":"2024-09-17T06:06:22.499366+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:06:22.499366+0000","last_undegraded":"2024-09-17T06:06:22.499366+0000","last_fullsized":"2024-09-17T06:06:22.499366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501381+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:06:22.501381+0000","last_peered":"2024-09-17T06:06:22.501381+0000","last_clean":"2024-09-17T06:06:22.501381+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:06:22.501381+0000","last_undegraded":"2024-09-17T06:06:22.501381+0000","last_fullsized":"2024-09-17T06:06:22.501381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.548759+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:06:27.548759+0000","last_peered":"2024-09-17T06:06:27.548759+0000","last_clean":"2024-09-17T06:06:27.548759+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:06:27.548759+0000","last_undegraded":"2024-09-17T06:06:27.548759+0000","last_fullsized":"2024-09-17T06:06:27.548759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968279+0000","last_change":"2024-09-17T06:06:02.750773+0000","last_active":"2024-09-17T06:06:21.968279+0000","last_peered":"2024-09-17T06:06:21.968279+0000","last_clean":"2024-09-17T06:06:21.968279+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:06:21.968279+0000","last_undegraded":"2024-09-17T06:06:21.968279+0000","last_fullsized":"2024-09-17T06:06:21.968279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:40.847404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499934+0000","last_change":"2024-09-17T06:06:02.772644+0000","last_active":"2024-09-17T06:06:22.499934+0000","last_peered":"2024-09-17T06:06:22.499934+0000","last_clean":"2024-09-17T06:06:22.499934+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:06:22.499934+0000","last_undegraded":"2024-09-17T06:06:22.499934+0000","last_fullsized":"2024-09-17T06:06:22.499934+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:29.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568314+0000","last_change":"2024-09-17T06:06:02.743237+0000","last_active":"2024-09-17T06:06:27.568314+0000","last_peered":"2024-09-17T06:06:27.568314+0000","last_clean":"2024-09-17T06:06:27.568314+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:06:27.568314+0000","last_undegraded":"2024-09-17T06:06:27.568314+0000","last_fullsized":"2024-09-17T06:06:27.568314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:21.599408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499049+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:06:22.499049+0000","last_peered":"2024-09-17T06:06:22.499049+0000","last_clean":"2024-09-17T06:06:22.499049+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:06:22.499049+0000","last_undegraded":"2024-09-17T06:06:22.499049+0000","last_fullsized":"2024-09-17T06:06:22.499049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970549+0000","last_change":"2024-09-17T06:06:02.749776+0000","last_active":"2024-09-17T06:06:21.970549+0000","last_peered":"2024-09-17T06:06:21.970549+0000","last_clean":"2024-09-17T06:06:21.970549+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:06:21.970549+0000","last_undegraded":"2024-09-17T06:06:21.970549+0000","last_fullsized":"2024-09-17T06:06:21.970549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:14.070869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568383+0000","last_change":"2024-09-17T06:06:02.743241+0000","last_active":"2024-09-17T06:06:27.568383+0000","last_peered":"2024-09-17T06:06:27.568383+0000","last_clean":"2024-09-17T06:06:27.568383+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:06:27.568383+0000","last_undegraded":"2024-09-17T06:06:27.568383+0000","last_fullsized":"2024-09-17T06:06:27.568383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:24.945633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.972191+0000","last_change":"2024-09-17T06:06:02.747970+0000","last_active":"2024-09-17T06:06:21.972191+0000","last_peered":"2024-09-17T06:06:21.972191+0000","last_clean":"2024-09-17T06:06:21.972191+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:06:21.972191+0000","last_undegraded":"2024-09-17T06:06:21.972191+0000","last_fullsized":"2024-09-17T06:06:21.972191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:01.251626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967658+0000","last_change":"2024-09-17T06:06:02.765641+0000","last_active":"2024-09-17T06:06:21.967658+0000","last_peered":"2024-09-17T06:06:21.967658+0000","last_clean":"2024-09-17T06:06:21.967658+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:06:21.967658+0000","last_undegraded":"2024-09-17T06:06:21.967658+0000","last_fullsized":"2024-09-17T06:06:21.967658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:45.801441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568079+0000","last_change":"2024-09-17T06:06:02.771427+0000","last_active":"2024-09-17T06:06:27.568079+0000","last_peered":"2024-09-17T06:06:27.568079+0000","last_clean":"2024-09-17T06:06:27.568079+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:06:27.568079+0000","last_undegraded":"2024-09-17T06:06:27.568079+0000","last_fullsized":"2024-09-17T06:06:27.568079+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.132428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"62'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498400+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:06:22.498400+0000","last_peered":"2024-09-17T06:06:22.498400+0000","last_clean":"2024-09-17T06:06:22.498400+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:06:22.498400+0000","last_undegraded":"2024-09-17T06:06:22.498400+0000","last_fullsized":"2024-09-17T06:06:22.498400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499947+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:06:22.499947+0000","last_peered":"2024-09-17T06:06:22.499947+0000","last_clean":"2024-09-17T06:06:22.499947+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:06:22.499947+0000","last_undegraded":"2024-09-17T06:06:22.499947+0000","last_fullsized":"2024-09-17T06:06:22.499947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:20.518879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.518926+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:06:27.518926+0000","last_peered":"2024-09-17T06:06:27.518926+0000","last_clean":"2024-09-17T06:06:27.518926+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:06:27.518926+0000","last_undegraded":"2024-09-17T06:06:27.518926+0000","last_fullsized":"2024-09-17T06:06:27.518926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501692+0000","last_change":"2024-09-17T06:06:02.772623+0000","last_active":"2024-09-17T06:06:22.501692+0000","last_peered":"2024-09-17T06:06:22.501692+0000","last_clean":"2024-09-17T06:06:22.501692+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:22.501692+0000","last_undegraded":"2024-09-17T06:06:22.501692+0000","last_fullsized":"2024-09-17T06:06:22.501692+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:53.767911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500282+0000","last_change":"2024-09-17T06:06:14.883260+0000","last_active":"2024-09-17T06:06:22.500282+0000","last_peered":"2024-09-17T06:06:22.500282+0000","last_clean":"2024-09-17T06:06:22.500282+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:06:22.500282+0000","last_undegraded":"2024-09-17T06:06:22.500282+0000","last_fullsized":"2024-09-17T06:06:22.500282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:01.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568687+0000","last_change":"2024-09-17T06:06:02.767610+0000","last_active":"2024-09-17T06:06:27.568687+0000","last_peered":"2024-09-17T06:06:27.568687+0000","last_clean":"2024-09-17T06:06:27.568687+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:06:27.568687+0000","last_undegraded":"2024-09-17T06:06:27.568687+0000","last_fullsized":"2024-09-17T06:06:27.568687+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:54.779217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971946+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:06:21.971946+0000","last_peered":"2024-09-17T06:06:21.971946+0000","last_clean":"2024-09-17T06:06:21.971946+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:06:21.971946+0000","last_undegraded":"2024-09-17T06:06:21.971946+0000","last_fullsized":"2024-09-17T06:06:21.971946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500361+0000","last_change":"2024-09-17T06:06:15.372083+0000","last_active":"2024-09-17T06:06:22.500361+0000","last_peered":"2024-09-17T06:06:22.500361+0000","last_clean":"2024-09-17T06:06:22.500361+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:06:22.500361+0000","last_undegraded":"2024-09-17T06:06:22.500361+0000","last_fullsized":"2024-09-17T06:06:22.500361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:53.468260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.554841+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:06:27.554841+0000","last_peered":"2024-09-17T06:06:27.554841+0000","last_clean":"2024-09-17T06:06:27.554841+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:06:27.554841+0000","last_undegraded":"2024-09-17T06:06:27.554841+0000","last_fullsized":"2024-09-17T06:06:27.554841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500005+0000","last_change":"2024-09-17T06:06:02.772342+0000","last_active":"2024-09-17T06:06:22.500005+0000","last_peered":"2024-09-17T06:06:22.500005+0000","last_clean":"2024-09-17T06:06:22.500005+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:06:22.500005+0000","last_undegraded":"2024-09-17T06:06:22.500005+0000","last_fullsized":"2024-09-17T06:06:22.500005+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:36.591645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970221+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:06:21.970221+0000","last_peered":"2024-09-17T06:06:21.970221+0000","last_clean":"2024-09-17T06:06:21.970221+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:06:21.970221+0000","last_undegraded":"2024-09-17T06:06:21.970221+0000","last_fullsized":"2024-09-17T06:06:21.970221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.561793+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:06:27.561793+0000","last_peered":"2024-09-17T06:06:27.561793+0000","last_clean":"2024-09-17T06:06:27.561793+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:06:27.561793+0000","last_undegraded":"2024-09-17T06:06:27.561793+0000","last_fullsized":"2024-09-17T06:06:27.561793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.522395+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:06:27.522395+0000","last_peered":"2024-09-17T06:06:27.522395+0000","last_clean":"2024-09-17T06:06:27.522395+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:06:27.522395+0000","last_undegraded":"2024-09-17T06:06:27.522395+0000","last_fullsized":"2024-09-17T06:06:27.522395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967772+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:06:21.967772+0000","last_peered":"2024-09-17T06:06:21.967772+0000","last_clean":"2024-09-17T06:06:21.967772+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:06:21.967772+0000","last_undegraded":"2024-09-17T06:06:21.967772+0000","last_fullsized":"2024-09-17T06:06:21.967772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.566590+0000","last_change":"2024-09-17T06:06:02.778195+0000","last_active":"2024-09-17T06:06:27.566590+0000","last_peered":"2024-09-17T06:06:27.566590+0000","last_clean":"2024-09-17T06:06:27.566590+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:06:27.566590+0000","last_undegraded":"2024-09-17T06:06:27.566590+0000","last_fullsized":"2024-09-17T06:06:27.566590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:41.521760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"62'7","reported_seq":116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970857+0000","last_change":"2024-09-17T06:05:20.635633+0000","last_active":"2024-09-17T06:06:21.970857+0000","last_peered":"2024-09-17T06:06:21.970857+0000","last_clean":"2024-09-17T06:06:21.970857+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:06:21.970857+0000","last_undegraded":"2024-09-17T06:06:21.970857+0000","last_fullsized":"2024-09-17T06:06:21.970857+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:42.262918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968250+0000","last_change":"2024-09-17T06:06:02.762076+0000","last_active":"2024-09-17T06:06:21.968250+0000","last_peered":"2024-09-17T06:06:21.968250+0000","last_clean":"2024-09-17T06:06:21.968250+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:06:21.968250+0000","last_undegraded":"2024-09-17T06:06:21.968250+0000","last_fullsized":"2024-09-17T06:06:21.968250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:12.436619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.559649+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:06:27.559649+0000","last_peered":"2024-09-17T06:06:27.559649+0000","last_clean":"2024-09-17T06:06:27.559649+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:06:27.559649+0000","last_undegraded":"2024-09-17T06:06:27.559649+0000","last_fullsized":"2024-09-17T06:06:27.559649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:48.811803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970773+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:06:21.970773+0000","last_peered":"2024-09-17T06:06:21.970773+0000","last_clean":"2024-09-17T06:06:21.970773+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:06:21.970773+0000","last_undegraded":"2024-09-17T06:06:21.970773+0000","last_fullsized":"2024-09-17T06:06:21.970773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498270+0000","last_change":"2024-09-17T06:06:14.879517+0000","last_active":"2024-09-17T06:06:22.498270+0000","last_peered":"2024-09-17T06:06:22.498270+0000","last_clean":"2024-09-17T06:06:22.498270+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:06:22.498270+0000","last_undegraded":"2024-09-17T06:06:22.498270+0000","last_fullsized":"2024-09-17T06:06:22.498270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:59.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574456+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:06:27.574456+0000","last_peered":"2024-09-17T06:06:27.574456+0000","last_clean":"2024-09-17T06:06:27.574456+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:06:27.574456+0000","last_undegraded":"2024-09-17T06:06:27.574456+0000","last_fullsized":"2024-09-17T06:06:27.574456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503060+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:06:22.503060+0000","last_peered":"2024-09-17T06:06:22.503060+0000","last_clean":"2024-09-17T06:06:22.503060+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:06:22.503060+0000","last_undegraded":"2024-09-17T06:06:22.503060+0000","last_fullsized":"2024-09-17T06:06:22.503060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498442+0000","last_change":"2024-09-17T06:06:14.881955+0000","last_active":"2024-09-17T06:06:22.498442+0000","last_peered":"2024-09-17T06:06:22.498442+0000","last_clean":"2024-09-17T06:06:22.498442+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:06:22.498442+0000","last_undegraded":"2024-09-17T06:06:22.498442+0000","last_fullsized":"2024-09-17T06:06:22.498442+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:31.787475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499845+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:06:22.499845+0000","last_peered":"2024-09-17T06:06:22.499845+0000","last_clean":"2024-09-17T06:06:22.499845+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:06:22.499845+0000","last_undegraded":"2024-09-17T06:06:22.499845+0000","last_fullsized":"2024-09-17T06:06:22.499845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.542676+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:06:27.542676+0000","last_peered":"2024-09-17T06:06:27.542676+0000","last_clean":"2024-09-17T06:06:27.542676+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:06:27.542676+0000","last_undegraded":"2024-09-17T06:06:27.542676+0000","last_fullsized":"2024-09-17T06:06:27.542676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971203+0000","last_change":"2024-09-17T06:06:02.751465+0000","last_active":"2024-09-17T06:06:21.971203+0000","last_peered":"2024-09-17T06:06:21.971203+0000","last_clean":"2024-09-17T06:06:21.971203+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:06:21.971203+0000","last_undegraded":"2024-09-17T06:06:21.971203+0000","last_fullsized":"2024-09-17T06:06:21.971203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:15.399241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502473+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:06:22.502473+0000","last_peered":"2024-09-17T06:06:22.502473+0000","last_clean":"2024-09-17T06:06:22.502473+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:06:22.502473+0000","last_undegraded":"2024-09-17T06:06:22.502473+0000","last_fullsized":"2024-09-17T06:06:22.502473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.537111+0000","last_change":"2024-09-17T06:06:14.876329+0000","last_active":"2024-09-17T06:06:27.537111+0000","last_peered":"2024-09-17T06:06:27.537111+0000","last_clean":"2024-09-17T06:06:27.537111+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:06:27.537111+0000","last_undegraded":"2024-09-17T06:06:27.537111+0000","last_fullsized":"2024-09-17T06:06:27.537111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:44.076246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498602+0000","last_change":"2024-09-17T06:06:14.883367+0000","last_active":"2024-09-17T06:06:22.498602+0000","last_peered":"2024-09-17T06:06:22.498602+0000","last_clean":"2024-09-17T06:06:22.498602+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:06:22.498602+0000","last_undegraded":"2024-09-17T06:06:22.498602+0000","last_fullsized":"2024-09-17T06:06:22.498602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:34.486361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501858+0000","last_change":"2024-09-17T06:06:02.753865+0000","last_active":"2024-09-17T06:06:22.501858+0000","last_peered":"2024-09-17T06:06:22.501858+0000","last_clean":"2024-09-17T06:06:22.501858+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:06:22.501858+0000","last_undegraded":"2024-09-17T06:06:22.501858+0000","last_fullsized":"2024-09-17T06:06:22.501858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:02.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.547358+0000","last_change":"2024-09-17T06:06:02.774846+0000","last_active":"2024-09-17T06:06:27.547358+0000","last_peered":"2024-09-17T06:06:27.547358+0000","last_clean":"2024-09-17T06:06:27.547358+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:06:27.547358+0000","last_undegraded":"2024-09-17T06:06:27.547358+0000","last_fullsized":"2024-09-17T06:06:27.547358+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:03.871862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499002+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:06:22.499002+0000","last_peered":"2024-09-17T06:06:22.499002+0000","last_clean":"2024-09-17T06:06:22.499002+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:06:22.499002+0000","last_undegraded":"2024-09-17T06:06:22.499002+0000","last_fullsized":"2024-09-17T06:06:22.499002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499917+0000","last_change":"2024-09-17T06:06:14.874567+0000","last_active":"2024-09-17T06:06:22.499917+0000","last_peered":"2024-09-17T06:06:22.499917+0000","last_clean":"2024-09-17T06:06:22.499917+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:06:22.499917+0000","last_undegraded":"2024-09-17T06:06:22.499917+0000","last_fullsized":"2024-09-17T06:06:22.499917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:16.000785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.555058+0000","last_change":"2024-09-17T06:06:02.747397+0000","last_active":"2024-09-17T06:06:27.555058+0000","last_peered":"2024-09-17T06:06:27.555058+0000","last_clean":"2024-09-17T06:06:27.555058+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:06:27.555058+0000","last_undegraded":"2024-09-17T06:06:27.555058+0000","last_fullsized":"2024-09-17T06:06:27.555058+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:35.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500463+0000","last_change":"2024-09-17T06:06:15.371993+0000","last_active":"2024-09-17T06:06:22.500463+0000","last_peered":"2024-09-17T06:06:22.500463+0000","last_clean":"2024-09-17T06:06:22.500463+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:06:22.500463+0000","last_undegraded":"2024-09-17T06:06:22.500463+0000","last_fullsized":"2024-09-17T06:06:22.500463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:36.359097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.551299+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:06:27.551299+0000","last_peered":"2024-09-17T06:06:27.551299+0000","last_clean":"2024-09-17T06:06:27.551299+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:06:27.551299+0000","last_undegraded":"2024-09-17T06:06:27.551299+0000","last_fullsized":"2024-09-17T06:06:27.551299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.563391+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:06:27.563391+0000","last_peered":"2024-09-17T06:06:27.563391+0000","last_clean":"2024-09-17T06:06:27.563391+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:06:27.563391+0000","last_undegraded":"2024-09-17T06:06:27.563391+0000","last_fullsized":"2024-09-17T06:06:27.563391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.552660+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:06:27.552660+0000","last_peered":"2024-09-17T06:06:27.552660+0000","last_clean":"2024-09-17T06:06:27.552660+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:06:27.552660+0000","last_undegraded":"2024-09-17T06:06:27.552660+0000","last_fullsized":"2024-09-17T06:06:27.552660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.527615+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:06:27.527615+0000","last_peered":"2024-09-17T06:06:27.527615+0000","last_clean":"2024-09-17T06:06:27.527615+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:06:27.527615+0000","last_undegraded":"2024-09-17T06:06:27.527615+0000","last_fullsized":"2024-09-17T06:06:27.527615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.548572+0000","last_change":"2024-09-17T06:06:14.862875+0000","last_active":"2024-09-17T06:06:27.548572+0000","last_peered":"2024-09-17T06:06:27.548572+0000","last_clean":"2024-09-17T06:06:27.548572+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:06:27.548572+0000","last_undegraded":"2024-09-17T06:06:27.548572+0000","last_fullsized":"2024-09-17T06:06:27.548572+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:58.805589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.531497+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:06:27.531497+0000","last_peered":"2024-09-17T06:06:27.531497+0000","last_clean":"2024-09-17T06:06:27.531497+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:06:27.531497+0000","last_undegraded":"2024-09-17T06:06:27.531497+0000","last_fullsized":"2024-09-17T06:06:27.531497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.573178+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:06:27.573178+0000","last_peered":"2024-09-17T06:06:27.573178+0000","last_clean":"2024-09-17T06:06:27.573178+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:06:27.573178+0000","last_undegraded":"2024-09-17T06:06:27.573178+0000","last_fullsized":"2024-09-17T06:06:27.573178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.519555+0000","last_change":"2024-09-17T06:06:14.869993+0000","last_active":"2024-09-17T06:06:27.519555+0000","last_peered":"2024-09-17T06:06:27.519555+0000","last_clean":"2024-09-17T06:06:27.519555+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:06:27.519555+0000","last_undegraded":"2024-09-17T06:06:27.519555+0000","last_fullsized":"2024-09-17T06:06:27.519555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:10.143503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.552477+0000","last_change":"2024-09-17T06:05:13.535655+0000","last_active":"2024-09-17T06:06:27.552477+0000","last_peered":"2024-09-17T06:06:27.552477+0000","last_clean":"2024-09-17T06:06:27.552477+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:06:27.552477+0000","last_undegraded":"2024-09-17T06:06:27.552477+0000","last_fullsized":"2024-09-17T06:06:27.552477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:26.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.547204+0000","last_change":"2024-09-17T06:06:14.862354+0000","last_active":"2024-09-17T06:06:27.547204+0000","last_peered":"2024-09-17T06:06:27.547204+0000","last_clean":"2024-09-17T06:06:27.547204+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:06:27.547204+0000","last_undegraded":"2024-09-17T06:06:27.547204+0000","last_fullsized":"2024-09-17T06:06:27.547204+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:57.348056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574065+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:06:27.574065+0000","last_peered":"2024-09-17T06:06:27.574065+0000","last_clean":"2024-09-17T06:06:27.574065+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:06:27.574065+0000","last_undegraded":"2024-09-17T06:06:27.574065+0000","last_fullsized":"2024-09-17T06:06:27.574065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.536183+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:06:27.536183+0000","last_peered":"2024-09-17T06:06:27.536183+0000","last_clean":"2024-09-17T06:06:27.536183+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:06:27.536183+0000","last_undegraded":"2024-09-17T06:06:27.536183+0000","last_fullsized":"2024-09-17T06:06:27.536183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.557127+0000","last_change":"2024-09-17T06:06:02.781690+0000","last_active":"2024-09-17T06:06:27.557127+0000","last_peered":"2024-09-17T06:06:27.557127+0000","last_clean":"2024-09-17T06:06:27.557127+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:06:27.557127+0000","last_undegraded":"2024-09-17T06:06:27.557127+0000","last_fullsized":"2024-09-17T06:06:27.557127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:50.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.544249+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:06:27.544249+0000","last_peered":"2024-09-17T06:06:27.544249+0000","last_clean":"2024-09-17T06:06:27.544249+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:06:27.544249+0000","last_undegraded":"2024-09-17T06:06:27.544249+0000","last_fullsized":"2024-09-17T06:06:27.544249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.551918+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:06:27.551918+0000","last_peered":"2024-09-17T06:06:27.551918+0000","last_clean":"2024-09-17T06:06:27.551918+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:06:27.551918+0000","last_undegraded":"2024-09-17T06:06:27.551918+0000","last_fullsized":"2024-09-17T06:06:27.551918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574667+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:06:27.574667+0000","last_peered":"2024-09-17T06:06:27.574667+0000","last_clean":"2024-09-17T06:06:27.574667+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:06:27.574667+0000","last_undegraded":"2024-09-17T06:06:27.574667+0000","last_fullsized":"2024-09-17T06:06:27.574667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.553238+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:06:27.553238+0000","last_peered":"2024-09-17T06:06:27.553238+0000","last_clean":"2024-09-17T06:06:27.553238+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:06:27.553238+0000","last_undegraded":"2024-09-17T06:06:27.553238+0000","last_fullsized":"2024-09-17T06:06:27.553238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.532776+0000","last_change":"2024-09-17T06:06:02.777396+0000","last_active":"2024-09-17T06:06:27.532776+0000","last_peered":"2024-09-17T06:06:27.532776+0000","last_clean":"2024-09-17T06:06:27.532776+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:06:27.532776+0000","last_undegraded":"2024-09-17T06:06:27.532776+0000","last_fullsized":"2024-09-17T06:06:27.532776+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:28.787647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.543210+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:06:27.543210+0000","last_peered":"2024-09-17T06:06:27.543210+0000","last_clean":"2024-09-17T06:06:27.543210+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:06:27.543210+0000","last_undegraded":"2024-09-17T06:06:27.543210+0000","last_fullsized":"2024-09-17T06:06:27.543210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.551462+0000","last_change":"2024-09-17T06:06:14.882860+0000","last_active":"2024-09-17T06:06:27.551462+0000","last_peered":"2024-09-17T06:06:27.551462+0000","last_clean":"2024-09-17T06:06:27.551462+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:06:27.551462+0000","last_undegraded":"2024-09-17T06:06:27.551462+0000","last_fullsized":"2024-09-17T06:06:27.551462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:07.158141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.558120+0000","last_change":"2024-09-17T06:06:02.776605+0000","last_active":"2024-09-17T06:06:27.558120+0000","last_peered":"2024-09-17T06:06:27.558120+0000","last_clean":"2024-09-17T06:06:27.558120+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:06:27.558120+0000","last_undegraded":"2024-09-17T06:06:27.558120+0000","last_fullsized":"2024-09-17T06:06:27.558120+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:55.566930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.561965+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:06:27.561965+0000","last_peered":"2024-09-17T06:06:27.561965+0000","last_clean":"2024-09-17T06:06:27.561965+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:06:27.561965+0000","last_undegraded":"2024-09-17T06:06:27.561965+0000","last_fullsized":"2024-09-17T06:06:27.561965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.564023+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:06:27.564023+0000","last_peered":"2024-09-17T06:06:27.564023+0000","last_clean":"2024-09-17T06:06:27.564023+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:06:27.564023+0000","last_undegraded":"2024-09-17T06:06:27.564023+0000","last_fullsized":"2024-09-17T06:06:27.564023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.573527+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:06:27.573527+0000","last_peered":"2024-09-17T06:06:27.573527+0000","last_clean":"2024-09-17T06:06:27.573527+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:06:27.573527+0000","last_undegraded":"2024-09-17T06:06:27.573527+0000","last_fullsized":"2024-09-17T06:06:27.573527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.553454+0000","last_change":"2024-09-17T06:06:14.863779+0000","last_active":"2024-09-17T06:06:27.553454+0000","last_peered":"2024-09-17T06:06:27.553454+0000","last_clean":"2024-09-17T06:06:27.553454+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:06:27.553454+0000","last_undegraded":"2024-09-17T06:06:27.553454+0000","last_fullsized":"2024-09-17T06:06:27.553454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:41.626998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.527586+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:06:27.527586+0000","last_peered":"2024-09-17T06:06:27.527586+0000","last_clean":"2024-09-17T06:06:27.527586+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:06:27.527586+0000","last_undegraded":"2024-09-17T06:06:27.527586+0000","last_fullsized":"2024-09-17T06:06:27.527586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.553590+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:06:27.553590+0000","last_peered":"2024-09-17T06:06:27.553590+0000","last_clean":"2024-09-17T06:06:27.553590+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:06:27.553590+0000","last_undegraded":"2024-09-17T06:06:27.553590+0000","last_fullsized":"2024-09-17T06:06:27.553590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.554203+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:06:27.554203+0000","last_peered":"2024-09-17T06:06:27.554203+0000","last_clean":"2024-09-17T06:06:27.554203+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:06:27.554203+0000","last_undegraded":"2024-09-17T06:06:27.554203+0000","last_fullsized":"2024-09-17T06:06:27.554203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.554038+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:06:27.554038+0000","last_peered":"2024-09-17T06:06:27.554038+0000","last_clean":"2024-09-17T06:06:27.554038+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:06:27.554038+0000","last_undegraded":"2024-09-17T06:06:27.554038+0000","last_fullsized":"2024-09-17T06:06:27.554038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.541975+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:06:27.541975+0000","last_peered":"2024-09-17T06:06:27.541975+0000","last_clean":"2024-09-17T06:06:27.541975+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:06:27.541975+0000","last_undegraded":"2024-09-17T06:06:27.541975+0000","last_fullsized":"2024-09-17T06:06:27.541975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.492171+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:06:27.492171+0000","last_peered":"2024-09-17T06:06:27.492171+0000","last_clean":"2024-09-17T06:06:27.492171+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:06:27.492171+0000","last_undegraded":"2024-09-17T06:06:27.492171+0000","last_fullsized":"2024-09-17T06:06:27.492171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.569630+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:06:27.569630+0000","last_peered":"2024-09-17T06:06:27.569630+0000","last_clean":"2024-09-17T06:06:27.569630+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:06:27.569630+0000","last_undegraded":"2024-09-17T06:06:27.569630+0000","last_fullsized":"2024-09-17T06:06:27.569630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":995328,"data_stored":530556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":494218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1556480,"data_stored":1084902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1544192,"data_stored":1084756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":530144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906952,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28984,"kb_used_data":936,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342856,"statfs":{"total":96636764160,"available":96607084544,"internally_reserved":0,"allocated":958464,"data_stored":493932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":493876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":950272,"data_stored":493896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:06:35.120 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:06:35.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.312+0000 7f337462d640 1 -- 172.21.15.122:0/2944836522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336c06dab0 msgr2=0x7f336c15b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:35.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.312+0000 7f337462d640 1 --2- 172.21.15.122:0/2944836522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336c06dab0 0x7f336c15b470 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f335c009900 tx=0x7f335c01c850 comp rx=0 tx=0).stop 2024-09-17T06:06:35.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.312+0000 7f337462d640 1 -- 172.21.15.122:0/2944836522 shutdown_connections 2024-09-17T06:06:35.314 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.312+0000 7f337462d640 1 --2- 172.21.15.122:0/2944836522 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f336c0cbb40 0x7f336c15b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.312+0000 7f337462d640 1 --2- 172.21.15.122:0/2944836522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336c06dab0 0x7f336c15b470 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.312+0000 7f337462d640 1 -- 172.21.15.122:0/2944836522 >> 172.21.15.122:0/2944836522 conn(0x7f336c08d450 msgr2=0x7f336c06ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:35.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.312+0000 7f337462d640 1 -- 172.21.15.122:0/2944836522 shutdown_connections 2024-09-17T06:06:35.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.312+0000 7f337462d640 1 -- 172.21.15.122:0/2944836522 wait complete. 2024-09-17T06:06:35.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.312+0000 7f337462d640 1 Processor -- start 2024-09-17T06:06:35.316 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.312+0000 7f337462d640 1 -- start start 2024-09-17T06:06:35.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f337462d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336c06dab0 0x7f336c14e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f337462d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f336c0cbb40 0x7f336c145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f337462d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f336c0ccdb0 0x7f336c146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f337462d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f336c0cca70 con 0x7f336c06dab0 2024-09-17T06:06:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f337462d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f336c0cc8f0 con 0x7f336c0ccdb0 2024-09-17T06:06:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f337462d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f336c168510 con 0x7f336c0cbb40 2024-09-17T06:06:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f33723c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336c06dab0 0x7f336c14e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f33723c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336c06dab0 0x7f336c14e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56434/0 (socket says 172.21.15.122:56434) 2024-09-17T06:06:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f33723c9640 1 -- 172.21.15.122:0/1612105432 learned_addr learned my addr 172.21.15.122:0/1612105432 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:35.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f3371bc8640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f336c0cbb40 0x7f336c145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:35.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f3372bca640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f336c0ccdb0 0x7f336c146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:35.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f33723c9640 1 -- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f336c0cbb40 msgr2=0x7f336c145b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:35.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f33723c9640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f336c0cbb40 0x7f336c145b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f33723c9640 1 -- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f336c0ccdb0 msgr2=0x7f336c146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:35.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f33723c9640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f336c0ccdb0 0x7f336c146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f33723c9640 1 -- 172.21.15.122:0/1612105432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c14d590 con 0x7f336c06dab0 2024-09-17T06:06:35.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f33723c9640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336c06dab0 0x7f336c14e860 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f336800b410 tx=0x7f336800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:35.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f3362ffd640 1 -- 172.21.15.122:0/1612105432 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368015030 con 0x7f336c06dab0 2024-09-17T06:06:35.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f3362ffd640 1 -- 172.21.15.122:0/1612105432 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3368004020 con 0x7f336c06dab0 2024-09-17T06:06:35.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f3362ffd640 1 -- 172.21.15.122:0/1612105432 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368004470 con 0x7f336c06dab0 2024-09-17T06:06:35.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f337462d640 1 -- 172.21.15.122:0/1612105432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336c142600 con 0x7f336c06dab0 2024-09-17T06:06:35.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f337462d640 1 -- 172.21.15.122:0/1612105432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f336c142e50 con 0x7f336c06dab0 2024-09-17T06:06:35.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f337462d640 1 -- 172.21.15.122:0/1612105432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f336c0cc1e0 con 0x7f336c06dab0 2024-09-17T06:06:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.316+0000 7f3362ffd640 1 -- 172.21.15.122:0/1612105432 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3368018070 con 0x7f336c06dab0 2024-09-17T06:06:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.320+0000 7f3362ffd640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3350073200 0x7f3350075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.320+0000 7f3362ffd640 1 -- 172.21.15.122:0/1612105432 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f3368094240 con 0x7f336c06dab0 2024-09-17T06:06:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.320+0000 7f3371bc8640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3350073200 0x7f3350075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:35.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.320+0000 7f3371bc8640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3350073200 0x7f3350075710 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f335c0af000 tx=0x7f335c01b090 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:35.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.324+0000 7f3362ffd640 1 -- 172.21.15.122:0/1612105432 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f336805eed0 con 0x7f336c06dab0 2024-09-17T06:06:35.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.492+0000 7f337462d640 1 -- 172.21.15.122:0/1612105432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f336c159b90 con 0x7f336c06dab0 2024-09-17T06:06:35.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f3362ffd640 1 -- 172.21.15.122:0/1612105432 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+19030 (secure 0 0 0) 0x7f336805e7d0 con 0x7f336c06dab0 2024-09-17T06:06:35.497 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:06:35.497 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":81,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:06:21.948320+0000","last_up_change":"2024-09-17T06:06:01.694374+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":44,"up_from":64,"up_thru":64,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6811","nonce":1065110369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6813","nonce":1065110369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6817","nonce":1065110369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6815","nonce":1065110369}]},"public_addr":"172.21.15.173:6811/1065110369","cluster_addr":"172.21.15.173:6813/1065110369","heartbeat_back_addr":"172.21.15.173:6817/1065110369","heartbeat_front_addr":"172.21.15.173:6815/1065110369","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":46},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.15","osds":[5,0]}],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":6,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:06:35.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f337462d640 1 -- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3350073200 msgr2=0x7f3350075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:35.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f337462d640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3350073200 0x7f3350075710 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f335c0af000 tx=0x7f335c01b090 comp rx=0 tx=0).stop 2024-09-17T06:06:35.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f337462d640 1 -- 172.21.15.122:0/1612105432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336c06dab0 msgr2=0x7f336c14e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:35.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f337462d640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336c06dab0 0x7f336c14e860 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f336800b410 tx=0x7f336800b8d0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f337462d640 1 -- 172.21.15.122:0/1612105432 shutdown_connections 2024-09-17T06:06:35.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f337462d640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f3350073200 0x7f3350075710 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f337462d640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f336c0ccdb0 0x7f336c146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f337462d640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f336c0cbb40 0x7f336c145b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f337462d640 1 --2- 172.21.15.122:0/1612105432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336c06dab0 0x7f336c14e860 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:35.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f337462d640 1 -- 172.21.15.122:0/1612105432 >> 172.21.15.122:0/1612105432 conn(0x7f336c08d450 msgr2=0x7f336c1591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:35.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f337462d640 1 -- 172.21.15.122:0/1612105432 shutdown_connections 2024-09-17T06:06:35.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:35.496+0000 7f337462d640 1 -- 172.21.15.122:0/1612105432 wait complete. 2024-09-17T06:06:35.685 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:06:35.687 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:06:36.522 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T06:06:36.522 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T06:06:36.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 -- 172.21.15.122:0/826800748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed40c6780 msgr2=0x7f4ed4159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:36.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 --2- 172.21.15.122:0/826800748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed40c6780 0x7f4ed4159b30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009840 tx=0x7f4ec401f010 comp rx=0 tx=0).stop 2024-09-17T06:06:36.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 -- 172.21.15.122:0/826800748 shutdown_connections 2024-09-17T06:06:36.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 --2- 172.21.15.122:0/826800748 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ed4153310 0x7f4ed415aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:36.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 --2- 172.21.15.122:0/826800748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed40c6780 0x7f4ed4159b30 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:36.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 -- 172.21.15.122:0/826800748 >> 172.21.15.122:0/826800748 conn(0x7f4ed40746d0 msgr2=0x7f4ed4074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:36.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 -- 172.21.15.122:0/826800748 shutdown_connections 2024-09-17T06:06:36.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 -- 172.21.15.122:0/826800748 wait complete. 2024-09-17T06:06:36.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 Processor -- start 2024-09-17T06:06:36.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 -- start start 2024-09-17T06:06:36.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ed40c6780 0x7f4ed41f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:36.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ed4152f00 0x7f4ed4146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed4153310 0x7f4ed4143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed415d470 con 0x7f4ed4153310 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed415d190 con 0x7f4ed40c6780 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4edac55640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4ed40b8cf0 con 0x7f4ed4152f00 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.696+0000 7f4ed91f2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed4153310 0x7f4ed4143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed91f2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed4153310 0x7f4ed4143e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56440/0 (socket says 172.21.15.122:56440) 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed91f2640 1 -- 172.21.15.122:0/2779696862 learned_addr learned my addr 172.21.15.122:0/2779696862 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed3fff640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ed4152f00 0x7f4ed4146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed89f1640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ed40c6780 0x7f4ed41f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed91f2640 1 -- 172.21.15.122:0/2779696862 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ed4152f00 msgr2=0x7f4ed4146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed91f2640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4ed4152f00 0x7f4ed4146dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed91f2640 1 -- 172.21.15.122:0/2779696862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ed40c6780 msgr2=0x7f4ed41f52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:36.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed91f2640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ed40c6780 0x7f4ed41f52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:36.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed91f2640 1 -- 172.21.15.122:0/2779696862 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed41f5830 con 0x7f4ed4153310 2024-09-17T06:06:36.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed91f2640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed4153310 0x7f4ed4143e60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00cae0 tx=0x7f4ecc0071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:36.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed17fa640 1 -- 172.21.15.122:0/2779696862 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc007da0 con 0x7f4ed4153310 2024-09-17T06:06:36.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed17fa640 1 -- 172.21.15.122:0/2779696862 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ecc004c20 con 0x7f4ed4153310 2024-09-17T06:06:36.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4edac55640 1 -- 172.21.15.122:0/2779696862 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed40c2c80 con 0x7f4ed4153310 2024-09-17T06:06:36.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed17fa640 1 -- 172.21.15.122:0/2779696862 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc005280 con 0x7f4ed4153310 2024-09-17T06:06:36.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4edac55640 1 -- 172.21.15.122:0/2779696862 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed40c29a0 con 0x7f4ed4153310 2024-09-17T06:06:36.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4edac55640 1 -- 172.21.15.122:0/2779696862 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ed4072a60 con 0x7f4ed4153310 2024-09-17T06:06:36.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed17fa640 1 -- 172.21.15.122:0/2779696862 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4ecc005420 con 0x7f4ed4153310 2024-09-17T06:06:36.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed17fa640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4ec0073200 0x7f4ec0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:36.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed17fa640 1 -- 172.21.15.122:0/2779696862 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f4ecc0952e0 con 0x7f4ed4153310 2024-09-17T06:06:36.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed17fa640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4ec007cce0 0x7f4ec007f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:36.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed17fa640 1 -- 172.21.15.122:0/2779696862 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ec007f8a0 con 0x7f4ec007cce0 2024-09-17T06:06:36.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed17fa640 1 -- 172.21.15.122:0/2779696862 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f4ecc095770 con 0x7f4ed4153310 2024-09-17T06:06:36.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed89f1640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4ec0073200 0x7f4ec0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:36.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed3fff640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4ec007cce0 0x7f4ec007f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:36.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.700+0000 7f4ed3fff640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4ec007cce0 0x7f4ec007f1d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:36.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.704+0000 7f4ed89f1640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4ec0073200 0x7f4ec0075710 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40b2000 tx=0x7f4ec401d850 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:36.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.704+0000 7f4ed17fa640 1 -- 172.21.15.122:0/2779696862 <== osd.0 v2:172.21.15.122:6824/776463314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ec007f8a0 con 0x7f4ec007cce0 2024-09-17T06:06:36.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4edac55640 1 -- 172.21.15.122:0/2779696862 --> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4ed40c3650 con 0x7f4ec007cce0 2024-09-17T06:06:36.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4ed17fa640 1 -- 172.21.15.122:0/2779696862 <== osd.0 v2:172.21.15.122:6824/776463314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4ed40c3650 con 0x7f4ec007cce0 2024-09-17T06:06:36.718 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:06:36.718 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T06:06:36.718 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:06:36.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4edac55640 1 -- 172.21.15.122:0/2779696862 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4ec007cce0 msgr2=0x7f4ec007f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:36.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4edac55640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.122:6824/776463314,v1:172.21.15.122:6825/776463314] conn(0x7f4ec007cce0 0x7f4ec007f1d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:36.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4edac55640 1 -- 172.21.15.122:0/2779696862 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4ec0073200 msgr2=0x7f4ec0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:36.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4edac55640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4ec0073200 0x7f4ec0075710 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40b2000 tx=0x7f4ec401d850 comp rx=0 tx=0).stop 2024-09-17T06:06:36.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4edac55640 1 -- 172.21.15.122:0/2779696862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed4153310 msgr2=0x7f4ed4143e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:36.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4edac55640 1 --2- 172.21.15.122:0/2779696862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ed4153310 0x7f4ed4143e60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00cae0 tx=0x7f4ecc0071c0 comp rx=0 tx=0).stop 2024-09-17T06:06:36.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4ed91f2640 1 -- 172.21.15.122:0/2779696862 reap_dead start 2024-09-17T06:06:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4edac55640 1 -- 172.21.15.122:0/2779696862 shutdown_connections 2024-09-17T06:06:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4edac55640 1 -- 172.21.15.122:0/2779696862 >> 172.21.15.122:0/2779696862 conn(0x7f4ed40746d0 msgr2=0x7f4ed415a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4edac55640 1 -- 172.21.15.122:0/2779696862 shutdown_connections 2024-09-17T06:06:36.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.716+0000 7f4edac55640 1 -- 172.21.15.122:0/2779696862 wait complete. 2024-09-17T06:06:36.738 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T06:06:36.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.888+0000 7fb929df1640 1 -- 172.21.15.122:0/1033034525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92414e140 msgr2=0x7fb924157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:36.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.888+0000 7fb929df1640 1 --2- 172.21.15.122:0/1033034525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92414e140 0x7fb924157790 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb914009840 tx=0x7fb91401c740 comp rx=0 tx=0).stop 2024-09-17T06:06:36.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.888+0000 7fb929df1640 1 -- 172.21.15.122:0/1033034525 shutdown_connections 2024-09-17T06:06:36.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.888+0000 7fb929df1640 1 --2- 172.21.15.122:0/1033034525 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9240cc640 0x7fb9240cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:36.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.888+0000 7fb929df1640 1 --2- 172.21.15.122:0/1033034525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92414e140 0x7fb924157790 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:36.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.888+0000 7fb929df1640 1 -- 172.21.15.122:0/1033034525 >> 172.21.15.122:0/1033034525 conn(0x7fb9240746d0 msgr2=0x7fb924074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:36.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.888+0000 7fb929df1640 1 -- 172.21.15.122:0/1033034525 shutdown_connections 2024-09-17T06:06:36.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.888+0000 7fb929df1640 1 -- 172.21.15.122:0/1033034525 wait complete. 2024-09-17T06:06:36.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb929df1640 1 Processor -- start 2024-09-17T06:06:36.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb929df1640 1 -- start start 2024-09-17T06:06:36.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb929df1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9240cc640 0x7fb92413fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:36.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb929df1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb92414e140 0x7fb924145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:36.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb929df1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb924150840 0x7fb924150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:36.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb929df1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb9240c9ff0 con 0x7fb9240cc640 2024-09-17T06:06:36.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb929df1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9240c9e70 con 0x7fb92414e140 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb929df1640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb924074310 con 0x7fb924150840 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb9237fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9240cc640 0x7fb92413fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb9237fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9240cc640 0x7fb92413fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56466/0 (socket says 172.21.15.122:56466) 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb9237fe640 1 -- 172.21.15.122:0/1695566261 learned_addr learned my addr 172.21.15.122:0/1695566261 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb923fff640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb924150840 0x7fb924150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb9237fe640 1 -- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb924150840 msgr2=0x7fb924150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb9237fe640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb924150840 0x7fb924150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb9237fe640 1 -- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb92414e140 msgr2=0x7fb924145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb922ffd640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb92414e140 0x7fb924145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb9237fe640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb92414e140 0x7fb924145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb9237fe640 1 -- 172.21.15.122:0/1695566261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb924140410 con 0x7fb9240cc640 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb923fff640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb924150840 0x7fb924150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb9237fe640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9240cc640 0x7fb92413fed0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb914009790 tx=0x7fb914005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:36.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb90bfff640 1 -- 172.21.15.122:0/1695566261 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140ad070 con 0x7fb9240cc640 2024-09-17T06:06:36.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb90bfff640 1 -- 172.21.15.122:0/1695566261 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9140aab20 con 0x7fb9240cc640 2024-09-17T06:06:36.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb929df1640 1 -- 172.21.15.122:0/1695566261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb924146330 con 0x7fb9240cc640 2024-09-17T06:06:36.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb90bfff640 1 -- 172.21.15.122:0/1695566261 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140046d0 con 0x7fb9240cc640 2024-09-17T06:06:36.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.892+0000 7fb929df1640 1 -- 172.21.15.122:0/1695566261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92413f6d0 con 0x7fb9240cc640 2024-09-17T06:06:36.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.896+0000 7fb929df1640 1 -- 172.21.15.122:0/1695566261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92414e600 con 0x7fb9240cc640 2024-09-17T06:06:36.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.896+0000 7fb90bfff640 1 -- 172.21.15.122:0/1695566261 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb9140b0070 con 0x7fb9240cc640 2024-09-17T06:06:36.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.896+0000 7fb90bfff640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb910073200 0x7fb910075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:36.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.896+0000 7fb90bfff640 1 -- 172.21.15.122:0/1695566261 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7fb91412eb30 con 0x7fb9240cc640 2024-09-17T06:06:36.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.896+0000 7fb922ffd640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb910073200 0x7fb910075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:36.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.896+0000 7fb922ffd640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb910073200 0x7fb910075710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb9241578e0 tx=0x7fb9180091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:36.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:36.900+0000 7fb90bfff640 1 -- 172.21.15.122:0/1695566261 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb9140b8070 con 0x7fb9240cc640 2024-09-17T06:06:37.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.076+0000 7fb929df1640 1 -- 172.21.15.122:0/1695566261 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb9240c4670 con 0x7fb910073200 2024-09-17T06:06:37.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.076+0000 7fb90bfff640 1 -- 172.21.15.122:0/1695566261 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb9240c4670 con 0x7fb910073200 2024-09-17T06:06:37.077 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T06:06:37.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.080+0000 7fb929df1640 1 -- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb910073200 msgr2=0x7fb910075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.080+0000 7fb929df1640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb910073200 0x7fb910075710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb9241578e0 tx=0x7fb9180091e0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.080+0000 7fb929df1640 1 -- 172.21.15.122:0/1695566261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9240cc640 msgr2=0x7fb92413fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.080+0000 7fb929df1640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9240cc640 0x7fb92413fed0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb914009790 tx=0x7fb914005750 comp rx=0 tx=0).stop 2024-09-17T06:06:37.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.080+0000 7fb929df1640 1 -- 172.21.15.122:0/1695566261 shutdown_connections 2024-09-17T06:06:37.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.080+0000 7fb929df1640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb924150840 0x7fb924150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.080+0000 7fb929df1640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb910073200 0x7fb910075710 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.080+0000 7fb929df1640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb92414e140 0x7fb924145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.080+0000 7fb929df1640 1 --2- 172.21.15.122:0/1695566261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9240cc640 0x7fb92413fed0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.080+0000 7fb929df1640 1 -- 172.21.15.122:0/1695566261 >> 172.21.15.122:0/1695566261 conn(0x7fb9240746d0 msgr2=0x7fb9240c4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:37.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.080+0000 7fb929df1640 1 -- 172.21.15.122:0/1695566261 shutdown_connections 2024-09-17T06:06:37.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.080+0000 7fb929df1640 1 -- 172.21.15.122:0/1695566261 wait complete. 2024-09-17T06:06:37.101 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T06:06:37.102 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T06:06:37.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.264+0000 7f1d575ab640 1 -- 172.21.15.122:0/3533861449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d3c003a10 msgr2=0x7f1d3c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.265 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.264+0000 7f1d575ab640 1 --2- 172.21.15.122:0/3533861449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d3c003a10 0x7f1d3c003e80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00c290 tx=0x7f1d4c01f790 comp rx=0 tx=0).stop 2024-09-17T06:06:37.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.264+0000 7f1d55b48640 1 -- 172.21.15.122:0/3533861449 reap_dead start 2024-09-17T06:06:37.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.264+0000 7f1d575ab640 1 -- 172.21.15.122:0/3533861449 shutdown_connections 2024-09-17T06:06:37.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.264+0000 7f1d575ab640 1 -- 172.21.15.122:0/3533861449 >> 172.21.15.122:0/3533861449 conn(0x7f1d5008ccd0 msgr2=0x7f1d5008d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:37.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.264+0000 7f1d575ab640 1 -- 172.21.15.122:0/3533861449 shutdown_connections 2024-09-17T06:06:37.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.264+0000 7f1d575ab640 1 -- 172.21.15.122:0/3533861449 wait complete. 2024-09-17T06:06:37.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.264+0000 7f1d575ab640 1 Processor -- start 2024-09-17T06:06:37.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.264+0000 7f1d575ab640 1 -- start start 2024-09-17T06:06:37.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d575ab640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d3c003a10 0x7f1d5014f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d575ab640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d50150cb0 0x7f1d5014b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d575ab640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d5014b920 0x7f1d500b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d575ab640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5015eb40 con 0x7f1d3c003a10 2024-09-17T06:06:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d575ab640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1d500ccec0 con 0x7f1d5014b920 2024-09-17T06:06:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d575ab640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1d500c5ea0 con 0x7f1d50150cb0 2024-09-17T06:06:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d55347640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d3c003a10 0x7f1d5014f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d55347640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d3c003a10 0x7f1d5014f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56478/0 (socket says 172.21.15.122:56478) 2024-09-17T06:06:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d55347640 1 -- 172.21.15.122:0/971937014 learned_addr learned my addr 172.21.15.122:0/971937014 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d54b46640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d50150cb0 0x7f1d5014b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d55347640 1 -- 172.21.15.122:0/971937014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d50150cb0 msgr2=0x7f1d5014b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d55b48640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d5014b920 0x7f1d500b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d55347640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d50150cb0 0x7f1d5014b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d55347640 1 -- 172.21.15.122:0/971937014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d5014b920 msgr2=0x7f1d500b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d55347640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d5014b920 0x7f1d500b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d55347640 1 -- 172.21.15.122:0/971937014 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d50156eb0 con 0x7f1d3c003a10 2024-09-17T06:06:37.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d54b46640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d50150cb0 0x7f1d5014b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:37.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d55347640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d3c003a10 0x7f1d5014f5c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0ae040 tx=0x7f1d4c001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:37.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d45ffb640 1 -- 172.21.15.122:0/971937014 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c006400 con 0x7f1d3c003a10 2024-09-17T06:06:37.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d45ffb640 1 -- 172.21.15.122:0/971937014 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d4c003600 con 0x7f1d3c003a10 2024-09-17T06:06:37.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d575ab640 1 -- 172.21.15.122:0/971937014 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5015dff0 con 0x7f1d3c003a10 2024-09-17T06:06:37.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d45ffb640 1 -- 172.21.15.122:0/971937014 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c003a30 con 0x7f1d3c003a10 2024-09-17T06:06:37.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d575ab640 1 -- 172.21.15.122:0/971937014 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5015e290 con 0x7f1d3c003a10 2024-09-17T06:06:37.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d575ab640 1 -- 172.21.15.122:0/971937014 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1d50155c20 con 0x7f1d3c003a10 2024-09-17T06:06:37.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d45ffb640 1 -- 172.21.15.122:0/971937014 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1d4c0ab070 con 0x7f1d3c003a10 2024-09-17T06:06:37.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.268+0000 7f1d45ffb640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d34073200 0x7f1d34075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.272+0000 7f1d45ffb640 1 -- 172.21.15.122:0/971937014 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f1d4c132e40 con 0x7f1d3c003a10 2024-09-17T06:06:37.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.272+0000 7f1d45ffb640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f1d3407cce0 0x7f1d3407f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.272+0000 7f1d45ffb640 1 -- 172.21.15.122:0/971937014 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d3407f8a0 con 0x7f1d3407cce0 2024-09-17T06:06:37.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.272+0000 7f1d45ffb640 1 -- 172.21.15.122:0/971937014 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f1d4c1332d0 con 0x7f1d3c003a10 2024-09-17T06:06:37.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.272+0000 7f1d54b46640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d34073200 0x7f1d34075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.272+0000 7f1d55b48640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f1d3407cce0 0x7f1d3407f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.272+0000 7f1d55b48640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f1d3407cce0 0x7f1d3407f1d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:37.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.272+0000 7f1d54b46640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d34073200 0x7f1d34075710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1d40005ec0 tx=0x7f1d400091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:37.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.272+0000 7f1d45ffb640 1 -- 172.21.15.122:0/971937014 <== osd.1 v2:172.21.15.122:6800/2272556556 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1d3407f8a0 con 0x7f1d3407cce0 2024-09-17T06:06:37.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d575ab640 1 -- 172.21.15.122:0/971937014 --> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1d500c5a60 con 0x7f1d3407cce0 2024-09-17T06:06:37.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d45ffb640 1 -- 172.21.15.122:0/971937014 <== osd.1 v2:172.21.15.122:6800/2272556556 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1d500c5a60 con 0x7f1d3407cce0 2024-09-17T06:06:37.287 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:06:37.287 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T06:06:37.287 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:06:37.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d575ab640 1 -- 172.21.15.122:0/971937014 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f1d3407cce0 msgr2=0x7f1d3407f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d575ab640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.122:6800/2272556556,v1:172.21.15.122:6801/2272556556] conn(0x7f1d3407cce0 0x7f1d3407f1d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d575ab640 1 -- 172.21.15.122:0/971937014 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d34073200 msgr2=0x7f1d34075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d575ab640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f1d34073200 0x7f1d34075710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1d40005ec0 tx=0x7f1d400091e0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d575ab640 1 -- 172.21.15.122:0/971937014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d3c003a10 msgr2=0x7f1d5014f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d575ab640 1 --2- 172.21.15.122:0/971937014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d3c003a10 0x7f1d5014f5c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0ae040 tx=0x7f1d4c001d40 comp rx=0 tx=0).stop 2024-09-17T06:06:37.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d55b48640 1 -- 172.21.15.122:0/971937014 reap_dead start 2024-09-17T06:06:37.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d575ab640 1 -- 172.21.15.122:0/971937014 shutdown_connections 2024-09-17T06:06:37.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d575ab640 1 -- 172.21.15.122:0/971937014 >> 172.21.15.122:0/971937014 conn(0x7f1d5008ccd0 msgr2=0x7f1d5006ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:37.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d575ab640 1 -- 172.21.15.122:0/971937014 shutdown_connections 2024-09-17T06:06:37.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.284+0000 7f1d575ab640 1 -- 172.21.15.122:0/971937014 wait complete. 2024-09-17T06:06:37.307 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T06:06:37.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.460+0000 7f34263b7640 1 -- 172.21.15.122:0/2314025304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34200b2c00 msgr2=0x7f34200c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.460+0000 7f34263b7640 1 --2- 172.21.15.122:0/2314025304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34200b2c00 0x7f34200c9ba0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3410009840 tx=0x7f341001f010 comp rx=0 tx=0).stop 2024-09-17T06:06:37.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.460+0000 7f34263b7640 1 -- 172.21.15.122:0/2314025304 shutdown_connections 2024-09-17T06:06:37.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.460+0000 7f34263b7640 1 --2- 172.21.15.122:0/2314025304 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34201523b0 0x7f3420162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.460+0000 7f34263b7640 1 --2- 172.21.15.122:0/2314025304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34200b2c00 0x7f34200c9ba0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.460+0000 7f34263b7640 1 -- 172.21.15.122:0/2314025304 >> 172.21.15.122:0/2314025304 conn(0x7f3420072fe0 msgr2=0x7f34200733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:37.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.460+0000 7f34263b7640 1 -- 172.21.15.122:0/2314025304 shutdown_connections 2024-09-17T06:06:37.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.460+0000 7f34263b7640 1 -- 172.21.15.122:0/2314025304 wait complete. 2024-09-17T06:06:37.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.460+0000 7f34263b7640 1 Processor -- start 2024-09-17T06:06:37.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.460+0000 7f34263b7640 1 -- start start 2024-09-17T06:06:37.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f34263b7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34200b2c00 0x7f34201efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f34263b7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34201523b0 0x7f34201474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f34263b7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342015b6b0 0x7f3420153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f34263b7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f34201527c0 con 0x7f34201523b0 2024-09-17T06:06:37.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f34263b7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f342006f740 con 0x7f342015b6b0 2024-09-17T06:06:37.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f34263b7640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f34200c8d80 con 0x7f34200b2c00 2024-09-17T06:06:37.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34201523b0 0x7f34201474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34201523b0 0x7f34201474c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56510/0 (socket says 172.21.15.122:56510) 2024-09-17T06:06:37.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341f7fe640 1 -- 172.21.15.122:0/181937330 learned_addr learned my addr 172.21.15.122:0/181937330 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:37.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341ffff640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34200b2c00 0x7f34201efdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341f7fe640 1 -- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34200b2c00 msgr2=0x7f34201efdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341f7fe640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34200b2c00 0x7f34201efdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f3424954640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342015b6b0 0x7f3420153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341f7fe640 1 -- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342015b6b0 msgr2=0x7f3420153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341f7fe640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342015b6b0 0x7f3420153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341f7fe640 1 -- 172.21.15.122:0/181937330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34200ce5b0 con 0x7f34201523b0 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341ffff640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34200b2c00 0x7f34201efdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341f7fe640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34201523b0 0x7f34201474c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f341400c3f0 tx=0x7f341400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341cff9640 1 -- 172.21.15.122:0/181937330 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3414011790 con 0x7f34201523b0 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341cff9640 1 -- 172.21.15.122:0/181937330 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3414017070 con 0x7f34201523b0 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f34263b7640 1 -- 172.21.15.122:0/181937330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34200cbb20 con 0x7f34201523b0 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341cff9640 1 -- 172.21.15.122:0/181937330 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3414011ce0 con 0x7f34201523b0 2024-09-17T06:06:37.466 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f34263b7640 1 -- 172.21.15.122:0/181937330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34200cc0e0 con 0x7f34201523b0 2024-09-17T06:06:37.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f34263b7640 1 -- 172.21.15.122:0/181937330 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34200c90c0 con 0x7f34201523b0 2024-09-17T06:06:37.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341cff9640 1 -- 172.21.15.122:0/181937330 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f341401c460 con 0x7f34201523b0 2024-09-17T06:06:37.467 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341cff9640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f340c073200 0x7f340c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341cff9640 1 -- 172.21.15.122:0/181937330 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f34140943b0 con 0x7f34201523b0 2024-09-17T06:06:37.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.464+0000 7f341ffff640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f340c073200 0x7f340c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.468+0000 7f341ffff640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f340c073200 0x7f340c075710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f34100b2000 tx=0x7f341001d850 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:37.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.472+0000 7f341cff9640 1 -- 172.21.15.122:0/181937330 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f341405f040 con 0x7f34201523b0 2024-09-17T06:06:37.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.640+0000 7f34263b7640 1 -- 172.21.15.122:0/181937330 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f3420152a90 con 0x7f340c073200 2024-09-17T06:06:37.644 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f341cff9640 1 -- 172.21.15.122:0/181937330 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f34100040c0 con 0x7f340c073200 2024-09-17T06:06:37.645 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T06:06:37.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f34263b7640 1 -- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f340c073200 msgr2=0x7f340c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.647 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f34263b7640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f340c073200 0x7f340c075710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f34100b2000 tx=0x7f341001d850 comp rx=0 tx=0).stop 2024-09-17T06:06:37.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f34263b7640 1 -- 172.21.15.122:0/181937330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34201523b0 msgr2=0x7f34201474c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f34263b7640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34201523b0 0x7f34201474c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f341400c3f0 tx=0x7f341400c8b0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f34263b7640 1 -- 172.21.15.122:0/181937330 shutdown_connections 2024-09-17T06:06:37.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f34263b7640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f340c073200 0x7f340c075710 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f34263b7640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342015b6b0 0x7f3420153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f34263b7640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34201523b0 0x7f34201474c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f34263b7640 1 --2- 172.21.15.122:0/181937330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f34200b2c00 0x7f34201efdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f34263b7640 1 -- 172.21.15.122:0/181937330 >> 172.21.15.122:0/181937330 conn(0x7f3420072fe0 msgr2=0x7f3420068fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:37.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f34263b7640 1 -- 172.21.15.122:0/181937330 shutdown_connections 2024-09-17T06:06:37.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.644+0000 7f34263b7640 1 -- 172.21.15.122:0/181937330 wait complete. 2024-09-17T06:06:37.669 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T06:06:37.669 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T06:06:37.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.832+0000 7ff87247c640 1 -- 172.21.15.122:0/215451406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c0caaa0 msgr2=0x7ff86c1533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.832+0000 7ff87247c640 1 --2- 172.21.15.122:0/215451406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c0caaa0 0x7ff86c1533d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0ca6f0 tx=0x7ff86001c820 comp rx=0 tx=0).stop 2024-09-17T06:06:37.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.832+0000 7ff87247c640 1 -- 172.21.15.122:0/215451406 shutdown_connections 2024-09-17T06:06:37.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.832+0000 7ff87247c640 1 --2- 172.21.15.122:0/215451406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c0caaa0 0x7ff86c1533d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.832+0000 7ff87247c640 1 -- 172.21.15.122:0/215451406 >> 172.21.15.122:0/215451406 conn(0x7ff86c0ce830 msgr2=0x7ff86c0cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.832+0000 7ff87247c640 1 -- 172.21.15.122:0/215451406 shutdown_connections 2024-09-17T06:06:37.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.832+0000 7ff87247c640 1 -- 172.21.15.122:0/215451406 wait complete. 2024-09-17T06:06:37.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.832+0000 7ff87247c640 1 Processor -- start 2024-09-17T06:06:37.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.832+0000 7ff87247c640 1 -- start start 2024-09-17T06:06:37.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff87247c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c08c5e0 0x7ff86c156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff87247c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff86c0caaa0 0x7ff86c155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff87247c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff86c159080 0x7ff86c149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff87247c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c0729e0 con 0x7ff86c08c5e0 2024-09-17T06:06:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff87247c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c072860 con 0x7ff86c0caaa0 2024-09-17T06:06:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff87247c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff86c0c4540 con 0x7ff86c159080 2024-09-17T06:06:37.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff86bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c08c5e0 0x7ff86c156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff86bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c08c5e0 0x7ff86c156540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56528/0 (socket says 172.21.15.122:56528) 2024-09-17T06:06:37.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff86bfff640 1 -- 172.21.15.122:0/2522400452 learned_addr learned my addr 172.21.15.122:0/2522400452 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:37.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff870a19640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff86c159080 0x7ff86c149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff86b7fe640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff86c0caaa0 0x7ff86c155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff86bfff640 1 -- 172.21.15.122:0/2522400452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff86c159080 msgr2=0x7ff86c149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff86bfff640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff86c159080 0x7ff86c149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff86bfff640 1 -- 172.21.15.122:0/2522400452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff86c0caaa0 msgr2=0x7ff86c155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff86bfff640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff86c0caaa0 0x7ff86c155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff86bfff640 1 -- 172.21.15.122:0/2522400452 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86c155770 con 0x7ff86c08c5e0 2024-09-17T06:06:37.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff86b7fe640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff86c0caaa0 0x7ff86c155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:37.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff86bfff640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c08c5e0 0x7ff86c156540 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00c730 tx=0x7ff85c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:37.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff868ff9640 1 -- 172.21.15.122:0/2522400452 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c016020 con 0x7ff86c08c5e0 2024-09-17T06:06:37.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff868ff9640 1 -- 172.21.15.122:0/2522400452 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff85c00a950 con 0x7ff86c08c5e0 2024-09-17T06:06:37.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff868ff9640 1 -- 172.21.15.122:0/2522400452 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c00ada0 con 0x7ff86c08c5e0 2024-09-17T06:06:37.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff87247c640 1 -- 172.21.15.122:0/2522400452 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86c14c8a0 con 0x7ff86c08c5e0 2024-09-17T06:06:37.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff87247c640 1 -- 172.21.15.122:0/2522400452 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff86c153cf0 con 0x7ff86c08c5e0 2024-09-17T06:06:37.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff87247c640 1 -- 172.21.15.122:0/2522400452 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff86c1533d0 con 0x7ff86c08c5e0 2024-09-17T06:06:37.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.836+0000 7ff868ff9640 1 -- 172.21.15.122:0/2522400452 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff85c019020 con 0x7ff86c08c5e0 2024-09-17T06:06:37.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.840+0000 7ff868ff9640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff858073200 0x7ff858075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.840+0000 7ff868ff9640 1 -- 172.21.15.122:0/2522400452 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7ff85c094ba0 con 0x7ff86c08c5e0 2024-09-17T06:06:37.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.840+0000 7ff868ff9640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff85807cce0 0x7ff85807f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:37.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.840+0000 7ff868ff9640 1 -- 172.21.15.122:0/2522400452 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff85c016e50 con 0x7ff85807cce0 2024-09-17T06:06:37.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.840+0000 7ff868ff9640 1 -- 172.21.15.122:0/2522400452 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7ff85c095030 con 0x7ff86c08c5e0 2024-09-17T06:06:37.848 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.840+0000 7ff86b7fe640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff858073200 0x7ff858075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.840+0000 7ff870a19640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff85807cce0 0x7ff85807f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:37.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.840+0000 7ff870a19640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff85807cce0 0x7ff85807f1d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:37.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.840+0000 7ff86b7fe640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff858073200 0x7ff858075710 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff8600af000 tx=0x7ff86001b060 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:37.849 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.840+0000 7ff868ff9640 1 -- 172.21.15.122:0/2522400452 <== osd.2 v2:172.21.15.122:6816/1205784459 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff85c016e50 con 0x7ff85807cce0 2024-09-17T06:06:37.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff87247c640 1 -- 172.21.15.122:0/2522400452 --> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff86c072540 con 0x7ff85807cce0 2024-09-17T06:06:37.854 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff868ff9640 1 -- 172.21.15.122:0/2522400452 <== osd.2 v2:172.21.15.122:6816/1205784459 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff86c072540 con 0x7ff85807cce0 2024-09-17T06:06:37.855 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:06:37.855 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T06:06:37.855 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:06:37.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff87247c640 1 -- 172.21.15.122:0/2522400452 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff85807cce0 msgr2=0x7ff85807f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff87247c640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.122:6816/1205784459,v1:172.21.15.122:6817/1205784459] conn(0x7ff85807cce0 0x7ff85807f1d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff87247c640 1 -- 172.21.15.122:0/2522400452 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff858073200 msgr2=0x7ff858075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff87247c640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff858073200 0x7ff858075710 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff8600af000 tx=0x7ff86001b060 comp rx=0 tx=0).stop 2024-09-17T06:06:37.857 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff87247c640 1 -- 172.21.15.122:0/2522400452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c08c5e0 msgr2=0x7ff86c156540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:37.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff87247c640 1 --2- 172.21.15.122:0/2522400452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff86c08c5e0 0x7ff86c156540 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00c730 tx=0x7ff85c00cbf0 comp rx=0 tx=0).stop 2024-09-17T06:06:37.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff870a19640 1 -- 172.21.15.122:0/2522400452 reap_dead start 2024-09-17T06:06:37.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff87247c640 1 -- 172.21.15.122:0/2522400452 shutdown_connections 2024-09-17T06:06:37.858 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff87247c640 1 -- 172.21.15.122:0/2522400452 >> 172.21.15.122:0/2522400452 conn(0x7ff86c0ce830 msgr2=0x7ff86c158110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:37.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff87247c640 1 -- 172.21.15.122:0/2522400452 shutdown_connections 2024-09-17T06:06:37.859 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:37.852+0000 7ff87247c640 1 -- 172.21.15.122:0/2522400452 wait complete. 2024-09-17T06:06:37.875 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T06:06:38.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.012+0000 7fcf872e2640 1 -- 172.21.15.122:0/4182464704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf80152f00 msgr2=0x7fcf80072270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.012+0000 7fcf872e2640 1 --2- 172.21.15.122:0/4182464704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf80152f00 0x7fcf80072270 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcf800c3a80 tx=0x7fcf7001f0b0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.012+0000 7fcf872e2640 1 -- 172.21.15.122:0/4182464704 shutdown_connections 2024-09-17T06:06:38.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.012+0000 7fcf872e2640 1 --2- 172.21.15.122:0/4182464704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf80153310 0x7fcf800727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.012+0000 7fcf872e2640 1 --2- 172.21.15.122:0/4182464704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf80152f00 0x7fcf80072270 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.012+0000 7fcf872e2640 1 --2- 172.21.15.122:0/4182464704 >> v2:172.21.15.173:3300/0 conn(0x7fcf800c6780 0x7fcf80159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.012+0000 7fcf872e2640 1 -- 172.21.15.122:0/4182464704 >> 172.21.15.122:0/4182464704 conn(0x7fcf800746d0 msgr2=0x7fcf80074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:38.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.012+0000 7fcf872e2640 1 -- 172.21.15.122:0/4182464704 shutdown_connections 2024-09-17T06:06:38.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.012+0000 7fcf872e2640 1 -- 172.21.15.122:0/4182464704 wait complete. 2024-09-17T06:06:38.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf872e2640 1 Processor -- start 2024-09-17T06:06:38.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf872e2640 1 -- start start 2024-09-17T06:06:38.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf872e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf800c6780 0x7fcf800ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf872e2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf80152f00 0x7fcf801e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf872e2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf80153310 0x7fcf80147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf872e2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8015d470 con 0x7fcf800c6780 2024-09-17T06:06:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf872e2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8015d190 con 0x7fcf80152f00 2024-09-17T06:06:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf872e2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fcf800b8cf0 con 0x7fcf80153310 2024-09-17T06:06:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf8507e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf800c6780 0x7fcf800ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf8507e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf800c6780 0x7fcf800ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56538/0 (socket says 172.21.15.122:56538) 2024-09-17T06:06:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf8507e640 1 -- 172.21.15.122:0/408948971 learned_addr learned my addr 172.21.15.122:0/408948971 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf8587f640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf80153310 0x7fcf80147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf8487d640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf80152f00 0x7fcf801e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf8507e640 1 -- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf80153310 msgr2=0x7fcf80147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf8507e640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf80153310 0x7fcf80147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf8507e640 1 -- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf80152f00 msgr2=0x7fcf801e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf8507e640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf80152f00 0x7fcf801e4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf8507e640 1 -- 172.21.15.122:0/408948971 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf800cd2a0 con 0x7fcf800c6780 2024-09-17T06:06:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf8507e640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf800c6780 0x7fcf800ccd60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00c9f0 tx=0x7fcf7c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf75ffb640 1 -- 172.21.15.122:0/408948971 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c007bb0 con 0x7fcf800c6780 2024-09-17T06:06:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf75ffb640 1 -- 172.21.15.122:0/408948971 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf7c007e40 con 0x7fcf800c6780 2024-09-17T06:06:38.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf872e2640 1 -- 172.21.15.122:0/408948971 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf801539a0 con 0x7fcf800c6780 2024-09-17T06:06:38.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf75ffb640 1 -- 172.21.15.122:0/408948971 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00f690 con 0x7fcf800c6780 2024-09-17T06:06:38.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf872e2640 1 -- 172.21.15.122:0/408948971 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf800cc560 con 0x7fcf800c6780 2024-09-17T06:06:38.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.016+0000 7fcf872e2640 1 -- 172.21.15.122:0/408948971 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf800c7fa0 con 0x7fcf800c6780 2024-09-17T06:06:38.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.020+0000 7fcf75ffb640 1 -- 172.21.15.122:0/408948971 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcf7c005020 con 0x7fcf800c6780 2024-09-17T06:06:38.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.020+0000 7fcf75ffb640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf64073200 0x7fcf64075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.020+0000 7fcf75ffb640 1 -- 172.21.15.122:0/408948971 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7fcf7c095240 con 0x7fcf800c6780 2024-09-17T06:06:38.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.020+0000 7fcf8487d640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf64073200 0x7fcf64075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.020+0000 7fcf8487d640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf64073200 0x7fcf64075710 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcf700b2000 tx=0x7fcf7001d8f0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:38.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.024+0000 7fcf75ffb640 1 -- 172.21.15.122:0/408948971 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fcf7c026080 con 0x7fcf800c6780 2024-09-17T06:06:38.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.196+0000 7fcf872e2640 1 -- 172.21.15.122:0/408948971 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fcf80153cf0 con 0x7fcf64073200 2024-09-17T06:06:38.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.196+0000 7fcf75ffb640 1 -- 172.21.15.122:0/408948971 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcf80153cf0 con 0x7fcf64073200 2024-09-17T06:06:38.198 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T06:06:38.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.200+0000 7fcf872e2640 1 -- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf64073200 msgr2=0x7fcf64075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.200+0000 7fcf872e2640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf64073200 0x7fcf64075710 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcf700b2000 tx=0x7fcf7001d8f0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.200+0000 7fcf872e2640 1 -- 172.21.15.122:0/408948971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf800c6780 msgr2=0x7fcf800ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.200+0000 7fcf872e2640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf800c6780 0x7fcf800ccd60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00c9f0 tx=0x7fcf7c00ceb0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.200+0000 7fcf872e2640 1 -- 172.21.15.122:0/408948971 shutdown_connections 2024-09-17T06:06:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.200+0000 7fcf872e2640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf80153310 0x7fcf80147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.200+0000 7fcf872e2640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fcf64073200 0x7fcf64075710 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.200+0000 7fcf872e2640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf80152f00 0x7fcf801e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.200+0000 7fcf872e2640 1 --2- 172.21.15.122:0/408948971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf800c6780 0x7fcf800ccd60 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.200+0000 7fcf872e2640 1 -- 172.21.15.122:0/408948971 >> 172.21.15.122:0/408948971 conn(0x7fcf800746d0 msgr2=0x7fcf80151e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.200+0000 7fcf872e2640 1 -- 172.21.15.122:0/408948971 shutdown_connections 2024-09-17T06:06:38.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.200+0000 7fcf872e2640 1 -- 172.21.15.122:0/408948971 wait complete. 2024-09-17T06:06:38.222 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T06:06:38.222 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T06:06:38.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.376+0000 7fd3788de640 1 -- 172.21.15.122:0/634415048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd37414e9e0 msgr2=0x7fd37415b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.376+0000 7fd3788de640 1 --2- 172.21.15.122:0/634415048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd37414e9e0 0x7fd37415b7b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd368009840 tx=0x7fd36801f010 comp rx=0 tx=0).stop 2024-09-17T06:06:38.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 -- 172.21.15.122:0/634415048 shutdown_connections 2024-09-17T06:06:38.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 --2- 172.21.15.122:0/634415048 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd37415bcf0 0x7fd374162900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 --2- 172.21.15.122:0/634415048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd37414e9e0 0x7fd37415b7b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 -- 172.21.15.122:0/634415048 >> 172.21.15.122:0/634415048 conn(0x7fd3740746d0 msgr2=0x7fd374074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:38.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 -- 172.21.15.122:0/634415048 shutdown_connections 2024-09-17T06:06:38.380 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 -- 172.21.15.122:0/634415048 wait complete. 2024-09-17T06:06:38.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 Processor -- start 2024-09-17T06:06:38.381 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 -- start start 2024-09-17T06:06:38.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3740c67a0 0x7fd37415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd37414e9e0 0x7fd374143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd37415bcf0 0x7fd3740c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd374158a70 con 0x7fd37415bcf0 2024-09-17T06:06:38.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd374158790 con 0x7fd3740c67a0 2024-09-17T06:06:38.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd374158d50 con 0x7fd37414e9e0 2024-09-17T06:06:38.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd372d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd37415bcf0 0x7fd3740c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd372d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd37415bcf0 0x7fd3740c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56552/0 (socket says 172.21.15.122:56552) 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd372d9d640 1 -- 172.21.15.122:0/367097216 learned_addr learned my addr 172.21.15.122:0/367097216 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd371d9b640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd37414e9e0 0x7fd374143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd372d9d640 1 -- 172.21.15.122:0/367097216 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd37414e9e0 msgr2=0x7fd374143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd372d9d640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd37414e9e0 0x7fd374143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd372d9d640 1 -- 172.21.15.122:0/367097216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3740c67a0 msgr2=0x7fd37415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd37259c640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3740c67a0 0x7fd37415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd372d9d640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3740c67a0 0x7fd37415adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd372d9d640 1 -- 172.21.15.122:0/367097216 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37414aaa0 con 0x7fd37415bcf0 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd372d9d640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd37415bcf0 0x7fd3740c9560 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00cb10 tx=0x7fd36c007220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd362ffd640 1 -- 172.21.15.122:0/367097216 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c007dd0 con 0x7fd37415bcf0 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd362ffd640 1 -- 172.21.15.122:0/367097216 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd36c003ab0 con 0x7fd37415bcf0 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd362ffd640 1 -- 172.21.15.122:0/367097216 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c004030 con 0x7fd37415bcf0 2024-09-17T06:06:38.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.380+0000 7fd3788de640 1 -- 172.21.15.122:0/367097216 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37414a340 con 0x7fd37415bcf0 2024-09-17T06:06:38.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd3788de640 1 -- 172.21.15.122:0/367097216 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd374152870 con 0x7fd37415bcf0 2024-09-17T06:06:38.386 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd3788de640 1 -- 172.21.15.122:0/367097216 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd374143850 con 0x7fd37415bcf0 2024-09-17T06:06:38.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd362ffd640 1 -- 172.21.15.122:0/367097216 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd36c0041d0 con 0x7fd37415bcf0 2024-09-17T06:06:38.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd362ffd640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd354073200 0x7fd354075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd362ffd640 1 -- 172.21.15.122:0/367097216 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7fd36c095010 con 0x7fd37415bcf0 2024-09-17T06:06:38.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd362ffd640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd35407cce0 0x7fd35407f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd362ffd640 1 -- 172.21.15.122:0/367097216 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd35407f8a0 con 0x7fd35407cce0 2024-09-17T06:06:38.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd362ffd640 1 -- 172.21.15.122:0/367097216 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fd36c09c050 con 0x7fd37415bcf0 2024-09-17T06:06:38.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd37259c640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd354073200 0x7fd354075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd371d9b640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd35407cce0 0x7fd35407f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd371d9b640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd35407cce0 0x7fd35407f1d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:38.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd37259c640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd354073200 0x7fd354075710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd364000f70 tx=0x7fd364009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:38.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.384+0000 7fd362ffd640 1 -- 172.21.15.122:0/367097216 <== osd.3 v2:172.21.15.122:6808/3198016774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd35407f8a0 con 0x7fd35407cce0 2024-09-17T06:06:38.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd3788de640 1 -- 172.21.15.122:0/367097216 --> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd374152540 con 0x7fd35407cce0 2024-09-17T06:06:38.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd362ffd640 1 -- 172.21.15.122:0/367097216 <== osd.3 v2:172.21.15.122:6808/3198016774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd374152540 con 0x7fd35407cce0 2024-09-17T06:06:38.400 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:06:38.400 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T06:06:38.400 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:06:38.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd3788de640 1 -- 172.21.15.122:0/367097216 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd35407cce0 msgr2=0x7fd35407f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd3788de640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.122:6808/3198016774,v1:172.21.15.122:6809/3198016774] conn(0x7fd35407cce0 0x7fd35407f1d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd3788de640 1 -- 172.21.15.122:0/367097216 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd354073200 msgr2=0x7fd354075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd3788de640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd354073200 0x7fd354075710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd364000f70 tx=0x7fd364009040 comp rx=0 tx=0).stop 2024-09-17T06:06:38.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd3788de640 1 -- 172.21.15.122:0/367097216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd37415bcf0 msgr2=0x7fd3740c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd3788de640 1 --2- 172.21.15.122:0/367097216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd37415bcf0 0x7fd3740c9560 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00cb10 tx=0x7fd36c007220 comp rx=0 tx=0).stop 2024-09-17T06:06:38.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd372d9d640 1 -- 172.21.15.122:0/367097216 reap_dead start 2024-09-17T06:06:38.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd3788de640 1 -- 172.21.15.122:0/367097216 shutdown_connections 2024-09-17T06:06:38.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd3788de640 1 -- 172.21.15.122:0/367097216 >> 172.21.15.122:0/367097216 conn(0x7fd3740746d0 msgr2=0x7fd374155df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:38.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd3788de640 1 -- 172.21.15.122:0/367097216 shutdown_connections 2024-09-17T06:06:38.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.400+0000 7fd3788de640 1 -- 172.21.15.122:0/367097216 wait complete. 2024-09-17T06:06:38.419 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T06:06:38.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.568+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1193876908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3c80cc640 msgr2=0x7fb3c80cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.568+0000 7fb3ceee2640 1 --2- 172.21.15.122:0/1193876908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3c80cc640 0x7fb3c80cca50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8158900 tx=0x7fb3b401c8c0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.568+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1193876908 shutdown_connections 2024-09-17T06:06:38.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.568+0000 7fb3ceee2640 1 --2- 172.21.15.122:0/1193876908 >> v2:172.21.15.173:3300/0 conn(0x7fb3c80ccf90 0x7fb3c8162110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.568+0000 7fb3ceee2640 1 --2- 172.21.15.122:0/1193876908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3c80cc640 0x7fb3c80cca50 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.568+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1193876908 >> 172.21.15.122:0/1193876908 conn(0x7fb3c80746d0 msgr2=0x7fb3c8074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:38.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.568+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1193876908 shutdown_connections 2024-09-17T06:06:38.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.568+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1193876908 wait complete. 2024-09-17T06:06:38.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.568+0000 7fb3ceee2640 1 Processor -- start 2024-09-17T06:06:38.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.568+0000 7fb3ceee2640 1 -- start start 2024-09-17T06:06:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ceee2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3c80cc640 0x7fb3c8165840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ceee2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3c814e140 0x7fb3c8165fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ceee2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3c81f7a90 0x7fb3c813f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ceee2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c80c9ff0 con 0x7fb3c80cc640 2024-09-17T06:06:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ceee2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c80c9e70 con 0x7fb3c814e140 2024-09-17T06:06:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ceee2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c8074310 con 0x7fb3c81f7a90 2024-09-17T06:06:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ccc7e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3c80cc640 0x7fb3c8165840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ccc7e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3c80cc640 0x7fb3c8165840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56578/0 (socket says 172.21.15.122:56578) 2024-09-17T06:06:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ccc7e640 1 -- 172.21.15.122:0/1949229797 learned_addr learned my addr 172.21.15.122:0/1949229797 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:38.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3cd47f640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3c81f7a90 0x7fb3c813f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3c7fff640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3c814e140 0x7fb3c8165fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ccc7e640 1 -- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3c81f7a90 msgr2=0x7fb3c813f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ccc7e640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3c81f7a90 0x7fb3c813f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ccc7e640 1 -- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3c814e140 msgr2=0x7fb3c8165fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ccc7e640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3c814e140 0x7fb3c8165fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ccc7e640 1 -- 172.21.15.122:0/1949229797 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c81f8630 con 0x7fb3c80cc640 2024-09-17T06:06:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ccc7e640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3c80cc640 0x7fb3c8165840 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00b410 tx=0x7fb3bc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3c57fa640 1 -- 172.21.15.122:0/1949229797 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc015020 con 0x7fb3c80cc640 2024-09-17T06:06:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3c57fa640 1 -- 172.21.15.122:0/1949229797 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3bc011920 con 0x7fb3c80cc640 2024-09-17T06:06:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1949229797 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c8157a50 con 0x7fb3c80cc640 2024-09-17T06:06:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3c57fa640 1 -- 172.21.15.122:0/1949229797 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc011d70 con 0x7fb3c80cc640 2024-09-17T06:06:38.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1949229797 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c8140b70 con 0x7fb3c80cc640 2024-09-17T06:06:38.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1949229797 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c8157c70 con 0x7fb3c80cc640 2024-09-17T06:06:38.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.572+0000 7fb3c57fa640 1 -- 172.21.15.122:0/1949229797 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb3bc018020 con 0x7fb3c80cc640 2024-09-17T06:06:38.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.576+0000 7fb3c57fa640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb3ac073200 0x7fb3ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.576 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.576+0000 7fb3c57fa640 1 -- 172.21.15.122:0/1949229797 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7fb3bc094590 con 0x7fb3c80cc640 2024-09-17T06:06:38.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.576+0000 7fb3c7fff640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb3ac073200 0x7fb3ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.576+0000 7fb3c7fff640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb3ac073200 0x7fb3ac075710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40af000 tx=0x7fb3b401b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:38.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.580+0000 7fb3c57fa640 1 -- 172.21.15.122:0/1949229797 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb3bc01f020 con 0x7fb3c80cc640 2024-09-17T06:06:38.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.756+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1949229797 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb3c814e550 con 0x7fb3ac073200 2024-09-17T06:06:38.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.756+0000 7fb3c57fa640 1 -- 172.21.15.122:0/1949229797 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb3c814e550 con 0x7fb3ac073200 2024-09-17T06:06:38.757 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T06:06:38.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.760+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb3ac073200 msgr2=0x7fb3ac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.760+0000 7fb3ceee2640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb3ac073200 0x7fb3ac075710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40af000 tx=0x7fb3b401b100 comp rx=0 tx=0).stop 2024-09-17T06:06:38.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.760+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1949229797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3c80cc640 msgr2=0x7fb3c8165840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.760+0000 7fb3ceee2640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3c80cc640 0x7fb3c8165840 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00b410 tx=0x7fb3bc00b8d0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.760+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1949229797 shutdown_connections 2024-09-17T06:06:38.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.760+0000 7fb3ceee2640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3c81f7a90 0x7fb3c813f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.760+0000 7fb3ceee2640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb3ac073200 0x7fb3ac075710 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.760+0000 7fb3ceee2640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3c814e140 0x7fb3c8165fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.760+0000 7fb3ceee2640 1 --2- 172.21.15.122:0/1949229797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3c80cc640 0x7fb3c8165840 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.760+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1949229797 >> 172.21.15.122:0/1949229797 conn(0x7fb3c80746d0 msgr2=0x7fb3c814c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:38.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.760+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1949229797 shutdown_connections 2024-09-17T06:06:38.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.760+0000 7fb3ceee2640 1 -- 172.21.15.122:0/1949229797 wait complete. 2024-09-17T06:06:38.780 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T06:06:38.780 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T06:06:38.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.928+0000 7f4135253640 1 -- 172.21.15.122:0/3883247231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41300c2dd0 msgr2=0x7f4130071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.930 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.928+0000 7f4135253640 1 --2- 172.21.15.122:0/3883247231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41300c2dd0 0x7f4130071690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4124009900 tx=0x7f412401c7c0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.928+0000 7f4135253640 1 -- 172.21.15.122:0/3883247231 shutdown_connections 2024-09-17T06:06:38.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.928+0000 7f4135253640 1 --2- 172.21.15.122:0/3883247231 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41300c2dd0 0x7f4130071690 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.928+0000 7f4135253640 1 --2- 172.21.15.122:0/3883247231 >> v2:172.21.15.173:3300/0 conn(0x7f413006f540 0x7f4130152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.928+0000 7f4135253640 1 -- 172.21.15.122:0/3883247231 >> 172.21.15.122:0/3883247231 conn(0x7f41300cdcf0 msgr2=0x7f41300ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:38.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.928+0000 7f4135253640 1 -- 172.21.15.122:0/3883247231 shutdown_connections 2024-09-17T06:06:38.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.928+0000 7f4135253640 1 -- 172.21.15.122:0/3883247231 wait complete. 2024-09-17T06:06:38.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f4135253640 1 Processor -- start 2024-09-17T06:06:38.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f4135253640 1 -- start start 2024-09-17T06:06:38.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f4135253640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f413006f540 0x7f413014ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f4135253640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4130071bd0 0x7f41301f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f4135253640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41300c2dd0 0x7f413014a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f4135253640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f41300c4870 con 0x7f413006f540 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f4135253640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41300c94e0 con 0x7f4130071bd0 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f4135253640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4130165500 con 0x7f41300c2dd0 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f412ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f413006f540 0x7f413014ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f412ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f413006f540 0x7f413014ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56586/0 (socket says 172.21.15.122:56586) 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f412ed9d640 1 -- 172.21.15.122:0/1825412694 learned_addr learned my addr 172.21.15.122:0/1825412694 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f412e59c640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4130071bd0 0x7f41301f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f412f59e640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41300c2dd0 0x7f413014a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f412ed9d640 1 -- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41300c2dd0 msgr2=0x7f413014a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f412ed9d640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41300c2dd0 0x7f413014a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f412ed9d640 1 -- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4130071bd0 msgr2=0x7f41301f66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f412ed9d640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4130071bd0 0x7f41301f66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f412ed9d640 1 -- 172.21.15.122:0/1825412694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413014cf80 con 0x7f413006f540 2024-09-17T06:06:38.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f412ed9d640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f413006f540 0x7f413014ca40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f412000e7a0 tx=0x7f412000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:38.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f41177fe640 1 -- 172.21.15.122:0/1825412694 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412000ccc0 con 0x7f413006f540 2024-09-17T06:06:38.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f41177fe640 1 -- 172.21.15.122:0/1825412694 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4120010430 con 0x7f413006f540 2024-09-17T06:06:38.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f4135253640 1 -- 172.21.15.122:0/1825412694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41301f6c20 con 0x7f413006f540 2024-09-17T06:06:38.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f41177fe640 1 -- 172.21.15.122:0/1825412694 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120010860 con 0x7f413006f540 2024-09-17T06:06:38.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f4135253640 1 -- 172.21.15.122:0/1825412694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41300cccf0 con 0x7f413006f540 2024-09-17T06:06:38.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.932+0000 7f4135253640 1 -- 172.21.15.122:0/1825412694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41301f62e0 con 0x7f413006f540 2024-09-17T06:06:38.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.936+0000 7f41177fe640 1 -- 172.21.15.122:0/1825412694 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4120010a00 con 0x7f413006f540 2024-09-17T06:06:38.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.936+0000 7f41177fe640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f411c073230 0x7f411c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.936+0000 7f41177fe640 1 -- 172.21.15.122:0/1825412694 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f4120095af0 con 0x7f413006f540 2024-09-17T06:06:38.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.936+0000 7f41177fe640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] conn(0x7f411c07cd10 0x7f411c07f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:38.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.936+0000 7f41177fe640 1 -- 172.21.15.122:0/1825412694 --> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f411c07f8d0 con 0x7f411c07cd10 2024-09-17T06:06:38.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.936+0000 7f41177fe640 1 -- 172.21.15.122:0/1825412694 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f4120095f80 con 0x7f413006f540 2024-09-17T06:06:38.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.936+0000 7f412e59c640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f411c073230 0x7f411c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.936+0000 7f412f59e640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] conn(0x7f411c07cd10 0x7f411c07f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:38.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.936+0000 7f412e59c640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f411c073230 0x7f411c075740 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f41240ae000 tx=0x7f41240aa040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:38.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.936+0000 7f412f59e640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] conn(0x7f411c07cd10 0x7f411c07f200 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:38.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.936+0000 7f41177fe640 1 -- 172.21.15.122:0/1825412694 <== osd.4 v2:172.21.15.173:6810/1065110369 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f411c07f8d0 con 0x7f411c07cd10 2024-09-17T06:06:38.952 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f4135253640 1 -- 172.21.15.122:0/1825412694 --> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4130152440 con 0x7f411c07cd10 2024-09-17T06:06:38.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f41177fe640 1 -- 172.21.15.122:0/1825412694 <== osd.4 v2:172.21.15.173:6810/1065110369 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f4130152440 con 0x7f411c07cd10 2024-09-17T06:06:38.953 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:06:38.953 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T06:06:38.954 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:06:38.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f4135253640 1 -- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] conn(0x7f411c07cd10 msgr2=0x7f411c07f200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f4135253640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:6810/1065110369,v1:172.21.15.173:6811/1065110369] conn(0x7f411c07cd10 0x7f411c07f200 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:38.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f4135253640 1 -- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f411c073230 msgr2=0x7f411c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f4135253640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f411c073230 0x7f411c075740 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f41240ae000 tx=0x7f41240aa040 comp rx=0 tx=0).stop 2024-09-17T06:06:38.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f4135253640 1 -- 172.21.15.122:0/1825412694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f413006f540 msgr2=0x7f413014ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:38.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f4135253640 1 --2- 172.21.15.122:0/1825412694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f413006f540 0x7f413014ca40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f412000e7a0 tx=0x7f412000ec60 comp rx=0 tx=0).stop 2024-09-17T06:06:38.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f412f59e640 1 -- 172.21.15.122:0/1825412694 reap_dead start 2024-09-17T06:06:38.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f4135253640 1 -- 172.21.15.122:0/1825412694 shutdown_connections 2024-09-17T06:06:38.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f4135253640 1 -- 172.21.15.122:0/1825412694 >> 172.21.15.122:0/1825412694 conn(0x7f41300cdcf0 msgr2=0x7f41301497d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:38.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f4135253640 1 -- 172.21.15.122:0/1825412694 shutdown_connections 2024-09-17T06:06:38.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:38.952+0000 7f4135253640 1 -- 172.21.15.122:0/1825412694 wait complete. 2024-09-17T06:06:38.972 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T06:06:39.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.116+0000 7f2324d2c640 1 -- 172.21.15.122:0/3068958029 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23200c3f30 msgr2=0x7f2320157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.116+0000 7f2324d2c640 1 --2- 172.21.15.122:0/3068958029 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23200c3f30 0x7f2320157de0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2310009840 tx=0x7f231001f010 comp rx=0 tx=0).stop 2024-09-17T06:06:39.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.116+0000 7f2324d2c640 1 -- 172.21.15.122:0/3068958029 shutdown_connections 2024-09-17T06:06:39.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.116+0000 7f2324d2c640 1 --2- 172.21.15.122:0/3068958029 >> v2:172.21.15.173:3300/0 conn(0x7f23200718a0 0x7f2320158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.116+0000 7f2324d2c640 1 --2- 172.21.15.122:0/3068958029 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23200c3f30 0x7f2320157de0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.116+0000 7f2324d2c640 1 -- 172.21.15.122:0/3068958029 >> 172.21.15.122:0/3068958029 conn(0x7f232006d8f0 msgr2=0x7f232006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:39.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.116+0000 7f2324d2c640 1 -- 172.21.15.122:0/3068958029 shutdown_connections 2024-09-17T06:06:39.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.116+0000 7f2324d2c640 1 -- 172.21.15.122:0/3068958029 wait complete. 2024-09-17T06:06:39.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.116+0000 7f2324d2c640 1 Processor -- start 2024-09-17T06:06:39.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.116+0000 7f2324d2c640 1 -- start start 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f2324d2c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23200718a0 0x7f2320141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f2324d2c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23200c3f30 0x7f23200cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f2324d2c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f232014e310 0x7f23200cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f2324d2c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f23200cdcc0 con 0x7f23200718a0 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f2324d2c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23200cd9e0 con 0x7f232014e310 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f2324d2c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f23200c3aa0 con 0x7f23200c3f30 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f231e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23200718a0 0x7f2320141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f231e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23200718a0 0x7f2320141790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56600/0 (socket says 172.21.15.122:56600) 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f231e59c640 1 -- 172.21.15.122:0/1561445287 learned_addr learned my addr 172.21.15.122:0/1561445287 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f2315d9b640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23200c3f30 0x7f23200cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f231ed9d640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f232014e310 0x7f23200cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f231e59c640 1 -- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23200c3f30 msgr2=0x7f23200cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f231e59c640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23200c3f30 0x7f23200cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f231e59c640 1 -- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f232014e310 msgr2=0x7f23200cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f231e59c640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f232014e310 0x7f23200cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f231e59c640 1 -- 172.21.15.122:0/1561445287 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232014cbe0 con 0x7f23200718a0 2024-09-17T06:06:39.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f231e59c640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23200718a0 0x7f2320141790 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f231001d6c0 tx=0x7f2310005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:39.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f23177fe640 1 -- 172.21.15.122:0/1561445287 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23100be070 con 0x7f23200718a0 2024-09-17T06:06:39.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f23177fe640 1 -- 172.21.15.122:0/1561445287 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23100052f0 con 0x7f23200718a0 2024-09-17T06:06:39.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f23177fe640 1 -- 172.21.15.122:0/1561445287 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23100b5040 con 0x7f23200718a0 2024-09-17T06:06:39.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f2324d2c640 1 -- 172.21.15.122:0/1561445287 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23200c4500 con 0x7f23200718a0 2024-09-17T06:06:39.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f2324d2c640 1 -- 172.21.15.122:0/1561445287 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23200ca4b0 con 0x7f23200718a0 2024-09-17T06:06:39.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.120+0000 7f2324d2c640 1 -- 172.21.15.122:0/1561445287 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2320151d70 con 0x7f23200718a0 2024-09-17T06:06:39.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.124+0000 7f23177fe640 1 -- 172.21.15.122:0/1561445287 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f23100046d0 con 0x7f23200718a0 2024-09-17T06:06:39.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.124+0000 7f23177fe640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2300073230 0x7f2300075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.124+0000 7f23177fe640 1 -- 172.21.15.122:0/1561445287 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f2310131500 con 0x7f23200718a0 2024-09-17T06:06:39.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.124+0000 7f2315d9b640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2300073230 0x7f2300075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.124+0000 7f2315d9b640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2300073230 0x7f2300075740 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2320151950 tx=0x7f23080091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:39.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.128+0000 7f23177fe640 1 -- 172.21.15.122:0/1561445287 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f23200c4500 con 0x7f23200718a0 2024-09-17T06:06:39.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.284+0000 7f2324d2c640 1 -- 172.21.15.122:0/1561445287 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f23200c7530 con 0x7f2300073230 2024-09-17T06:06:39.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f23177fe640 1 -- 172.21.15.122:0/1561445287 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f23200c7530 con 0x7f2300073230 2024-09-17T06:06:39.289 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T06:06:39.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f2324d2c640 1 -- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2300073230 msgr2=0x7f2300075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f2324d2c640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2300073230 0x7f2300075740 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2320151950 tx=0x7f23080091e0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f2324d2c640 1 -- 172.21.15.122:0/1561445287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23200718a0 msgr2=0x7f2320141790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f2324d2c640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23200718a0 0x7f2320141790 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f231001d6c0 tx=0x7f2310005db0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f2324d2c640 1 -- 172.21.15.122:0/1561445287 shutdown_connections 2024-09-17T06:06:39.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f2324d2c640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2300073230 0x7f2300075740 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f2324d2c640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f232014e310 0x7f23200cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f2324d2c640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23200c3f30 0x7f23200cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f2324d2c640 1 --2- 172.21.15.122:0/1561445287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23200718a0 0x7f2320141790 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f2324d2c640 1 -- 172.21.15.122:0/1561445287 >> 172.21.15.122:0/1561445287 conn(0x7f232006d8f0 msgr2=0x7f232006ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:39.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f2324d2c640 1 -- 172.21.15.122:0/1561445287 shutdown_connections 2024-09-17T06:06:39.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.288+0000 7f2324d2c640 1 -- 172.21.15.122:0/1561445287 wait complete. 2024-09-17T06:06:39.311 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T06:06:39.311 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T06:06:39.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.468+0000 7f3720588640 1 -- 172.21.15.122:0/3797779081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3718072270 msgr2=0x7f3718072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.468+0000 7f3720588640 1 --2- 172.21.15.122:0/3797779081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3718072270 0x7f3718072680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3718073d30 tx=0x7f370801c8c0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.468+0000 7f3720588640 1 -- 172.21.15.122:0/3797779081 shutdown_connections 2024-09-17T06:06:39.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.468+0000 7f3720588640 1 --2- 172.21.15.122:0/3797779081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3718072270 0x7f3718072680 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.468+0000 7f3720588640 1 --2- 172.21.15.122:0/3797779081 >> v2:172.21.15.173:3300/0 conn(0x7f37180c67a0 0x7f371814e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.468+0000 7f3720588640 1 -- 172.21.15.122:0/3797779081 >> 172.21.15.122:0/3797779081 conn(0x7f37180746d0 msgr2=0x7f3718074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:39.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.468+0000 7f3720588640 1 -- 172.21.15.122:0/3797779081 shutdown_connections 2024-09-17T06:06:39.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.468+0000 7f3720588640 1 -- 172.21.15.122:0/3797779081 wait complete. 2024-09-17T06:06:39.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f3720588640 1 Processor -- start 2024-09-17T06:06:39.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f3720588640 1 -- start start 2024-09-17T06:06:39.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f3720588640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3718072270 0x7f3718148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f3720588640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37180c67a0 0x7f371813e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f3720588640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f371815b7b0 0x7f37180c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f3720588640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f37181526c0 con 0x7f37180c67a0 2024-09-17T06:06:39.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f3720588640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3718152540 con 0x7f3718072270 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f3720588640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f37180c9f70 con 0x7f371815b7b0 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f371db23640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37180c67a0 0x7f371813e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f371db23640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37180c67a0 0x7f371813e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56620/0 (socket says 172.21.15.122:56620) 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f371db23640 1 -- 172.21.15.122:0/3393743483 learned_addr learned my addr 172.21.15.122:0/3393743483 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f371eb25640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f371815b7b0 0x7f37180c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f371e324640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3718072270 0x7f3718148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f371db23640 1 -- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f371815b7b0 msgr2=0x7f37180c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f371db23640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f371815b7b0 0x7f37180c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f371db23640 1 -- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3718072270 msgr2=0x7f3718148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f371db23640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3718072270 0x7f3718148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f371db23640 1 -- 172.21.15.122:0/3393743483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3718156650 con 0x7f37180c67a0 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f371e324640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3718072270 0x7f3718148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:39.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f371db23640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37180c67a0 0x7f371813e250 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f370801af70 tx=0x7f37080a55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:39.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f370effd640 1 -- 172.21.15.122:0/3393743483 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37080b2040 con 0x7f37180c67a0 2024-09-17T06:06:39.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f370effd640 1 -- 172.21.15.122:0/3393743483 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37080043b0 con 0x7f37180c67a0 2024-09-17T06:06:39.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f370effd640 1 -- 172.21.15.122:0/3393743483 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708003860 con 0x7f37180c67a0 2024-09-17T06:06:39.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f3720588640 1 -- 172.21.15.122:0/3393743483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371813e790 con 0x7f37180c67a0 2024-09-17T06:06:39.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.472+0000 7f3720588640 1 -- 172.21.15.122:0/3393743483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37181f7aa0 con 0x7f37180c67a0 2024-09-17T06:06:39.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.476+0000 7f3720588640 1 -- 172.21.15.122:0/3393743483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3718072680 con 0x7f37180c67a0 2024-09-17T06:06:39.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.476+0000 7f370effd640 1 -- 172.21.15.122:0/3393743483 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f37080bf060 con 0x7f37180c67a0 2024-09-17T06:06:39.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.476+0000 7f370effd640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f36fc073200 0x7f36fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.476+0000 7f370effd640 1 -- 172.21.15.122:0/3393743483 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f370812e410 con 0x7f37180c67a0 2024-09-17T06:06:39.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.476+0000 7f370effd640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f36fc07cce0 0x7f36fc07f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.476+0000 7f371e324640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f36fc073200 0x7f36fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.476+0000 7f370effd640 1 -- 172.21.15.122:0/3393743483 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37080a7ea0 con 0x7f36fc07cce0 2024-09-17T06:06:39.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.476+0000 7f370effd640 1 -- 172.21.15.122:0/3393743483 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f370812e8a0 con 0x7f37180c67a0 2024-09-17T06:06:39.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.476+0000 7f371eb25640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f36fc07cce0 0x7f36fc07f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.476+0000 7f371e324640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f36fc073200 0x7f36fc075710 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f371400a870 tx=0x7f3714008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:39.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.476+0000 7f371eb25640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f36fc07cce0 0x7f36fc07f1d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:39.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.480+0000 7f370effd640 1 -- 172.21.15.122:0/3393743483 <== osd.5 v2:172.21.15.173:6802/2576144160 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f37080a7ea0 con 0x7f36fc07cce0 2024-09-17T06:06:39.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f3720588640 1 -- 172.21.15.122:0/3393743483 --> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f371814ed00 con 0x7f36fc07cce0 2024-09-17T06:06:39.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f370effd640 1 -- 172.21.15.122:0/3393743483 <== osd.5 v2:172.21.15.173:6802/2576144160 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f371814ed00 con 0x7f36fc07cce0 2024-09-17T06:06:39.494 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:06:39.494 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T06:06:39.494 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:06:39.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f3720588640 1 -- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f36fc07cce0 msgr2=0x7f36fc07f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f3720588640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:6802/2576144160,v1:172.21.15.173:6803/2576144160] conn(0x7f36fc07cce0 0x7f36fc07f1d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f3720588640 1 -- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f36fc073200 msgr2=0x7f36fc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f3720588640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f36fc073200 0x7f36fc075710 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f371400a870 tx=0x7f3714008040 comp rx=0 tx=0).stop 2024-09-17T06:06:39.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f3720588640 1 -- 172.21.15.122:0/3393743483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37180c67a0 msgr2=0x7f371813e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f3720588640 1 --2- 172.21.15.122:0/3393743483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37180c67a0 0x7f371813e250 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f370801af70 tx=0x7f37080a55c0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f371eb25640 1 -- 172.21.15.122:0/3393743483 reap_dead start 2024-09-17T06:06:39.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f3720588640 1 -- 172.21.15.122:0/3393743483 shutdown_connections 2024-09-17T06:06:39.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f3720588640 1 -- 172.21.15.122:0/3393743483 >> 172.21.15.122:0/3393743483 conn(0x7f37180746d0 msgr2=0x7f371813f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:39.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f3720588640 1 -- 172.21.15.122:0/3393743483 shutdown_connections 2024-09-17T06:06:39.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.492+0000 7f3720588640 1 -- 172.21.15.122:0/3393743483 wait complete. 2024-09-17T06:06:39.514 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T06:06:39.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.664+0000 7f93373fb640 1 -- 172.21.15.122:0/3700441036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f933015b6b0 msgr2=0x7f93300c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.664+0000 7f93373fb640 1 --2- 172.21.15.122:0/3700441036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f933015b6b0 0x7f93300c9ba0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f93300c3020 tx=0x7f932c01cd80 comp rx=0 tx=0).stop 2024-09-17T06:06:39.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.664+0000 7f93373fb640 1 -- 172.21.15.122:0/3700441036 shutdown_connections 2024-09-17T06:06:39.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.664+0000 7f93373fb640 1 --2- 172.21.15.122:0/3700441036 >> v2:172.21.15.173:3300/0 conn(0x7f93301523b0 0x7f9330162a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.664+0000 7f93373fb640 1 --2- 172.21.15.122:0/3700441036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f933015b6b0 0x7f93300c9ba0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.664+0000 7f93373fb640 1 -- 172.21.15.122:0/3700441036 >> 172.21.15.122:0/3700441036 conn(0x7f9330072fe0 msgr2=0x7f93300733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:39.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.664+0000 7f93373fb640 1 -- 172.21.15.122:0/3700441036 shutdown_connections 2024-09-17T06:06:39.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.664+0000 7f93373fb640 1 -- 172.21.15.122:0/3700441036 wait complete. 2024-09-17T06:06:39.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.664+0000 7f93373fb640 1 Processor -- start 2024-09-17T06:06:39.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.664+0000 7f93373fb640 1 -- start start 2024-09-17T06:06:39.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f93373fb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93300b2c00 0x7f93301481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f93373fb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93301523b0 0x7f93300ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f93373fb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f933015b6b0 0x7f9330141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f93373fb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f93300c8f00 con 0x7f933015b6b0 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f93373fb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f93300c8d80 con 0x7f93300b2c00 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f93373fb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f93300caa00 con 0x7f93301523b0 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9335998640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f933015b6b0 0x7f9330141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9335998640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f933015b6b0 0x7f9330141690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56630/0 (socket says 172.21.15.122:56630) 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9335998640 1 -- 172.21.15.122:0/2155400529 learned_addr learned my addr 172.21.15.122:0/2155400529 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9334996640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93301523b0 0x7f93300ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9335197640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93300b2c00 0x7f93301481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9335998640 1 -- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93301523b0 msgr2=0x7f93300ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9335998640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93301523b0 0x7f93300ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9335998640 1 -- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93300b2c00 msgr2=0x7f93301481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9335998640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93300b2c00 0x7f93301481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9335998640 1 -- 172.21.15.122:0/2155400529 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9330148710 con 0x7f933015b6b0 2024-09-17T06:06:39.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9335998640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f933015b6b0 0x7f9330141690 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f932000c740 tx=0x7f932000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:39.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9325ffb640 1 -- 172.21.15.122:0/2155400529 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9320004220 con 0x7f933015b6b0 2024-09-17T06:06:39.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9325ffb640 1 -- 172.21.15.122:0/2155400529 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f932000ce50 con 0x7f933015b6b0 2024-09-17T06:06:39.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9325ffb640 1 -- 172.21.15.122:0/2155400529 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9320007bb0 con 0x7f933015b6b0 2024-09-17T06:06:39.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f93373fb640 1 -- 172.21.15.122:0/2155400529 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9330147170 con 0x7f933015b6b0 2024-09-17T06:06:39.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f93373fb640 1 -- 172.21.15.122:0/2155400529 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9330147410 con 0x7f933015b6b0 2024-09-17T06:06:39.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f93373fb640 1 -- 172.21.15.122:0/2155400529 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93300c9230 con 0x7f933015b6b0 2024-09-17T06:06:39.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9325ffb640 1 -- 172.21.15.122:0/2155400529 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9320003600 con 0x7f933015b6b0 2024-09-17T06:06:39.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9325ffb640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9314073200 0x7f9314075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:39.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9325ffb640 1 -- 172.21.15.122:0/2155400529 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f9320094a50 con 0x7f933015b6b0 2024-09-17T06:06:39.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.668+0000 7f9335197640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9314073200 0x7f9314075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:39.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.672+0000 7f9335197640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9314073200 0x7f9314075710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9328001650 tx=0x7f9328009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:39.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.676+0000 7f9325ffb640 1 -- 172.21.15.122:0/2155400529 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9320014030 con 0x7f933015b6b0 2024-09-17T06:06:39.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.832+0000 7f93373fb640 1 -- 172.21.15.122:0/2155400529 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f93301464e0 con 0x7f9314073200 2024-09-17T06:06:39.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.832+0000 7f9325ffb640 1 -- 172.21.15.122:0/2155400529 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f93301464e0 con 0x7f9314073200 2024-09-17T06:06:39.834 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T06:06:39.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.836+0000 7f93373fb640 1 -- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9314073200 msgr2=0x7f9314075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.836+0000 7f93373fb640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9314073200 0x7f9314075710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9328001650 tx=0x7f9328009040 comp rx=0 tx=0).stop 2024-09-17T06:06:39.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.836+0000 7f93373fb640 1 -- 172.21.15.122:0/2155400529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f933015b6b0 msgr2=0x7f9330141690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:39.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.836+0000 7f93373fb640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f933015b6b0 0x7f9330141690 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f932000c740 tx=0x7f932000cc00 comp rx=0 tx=0).stop 2024-09-17T06:06:39.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.836+0000 7f93373fb640 1 -- 172.21.15.122:0/2155400529 shutdown_connections 2024-09-17T06:06:39.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.836+0000 7f93373fb640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f933015b6b0 0x7f9330141690 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.836+0000 7f93373fb640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93301523b0 0x7f93300ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.836+0000 7f93373fb640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9314073200 0x7f9314075710 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.836+0000 7f93373fb640 1 --2- 172.21.15.122:0/2155400529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93300b2c00 0x7f93301481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:39.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.836+0000 7f93373fb640 1 -- 172.21.15.122:0/2155400529 >> 172.21.15.122:0/2155400529 conn(0x7f9330072fe0 msgr2=0x7f933014b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:39.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.836+0000 7f93373fb640 1 -- 172.21.15.122:0/2155400529 shutdown_connections 2024-09-17T06:06:39.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:39.836+0000 7f93373fb640 1 -- 172.21.15.122:0/2155400529 wait complete. 2024-09-17T06:06:39.857 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T06:06:39.857 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T06:06:40.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.008+0000 7f0683414640 1 -- 172.21.15.122:0/158388036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0668003a10 msgr2=0x7f0668003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.008+0000 7f0683414640 1 --2- 172.21.15.122:0/158388036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0668003a10 0x7f0668003e80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f067800c2e0 tx=0x7f067801cfc0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.008+0000 7f06819b1640 1 -- 172.21.15.122:0/158388036 reap_dead start 2024-09-17T06:06:40.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f0683414640 1 -- 172.21.15.122:0/158388036 shutdown_connections 2024-09-17T06:06:40.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f0683414640 1 -- 172.21.15.122:0/158388036 >> 172.21.15.122:0/158388036 conn(0x7f067c08d450 msgr2=0x7f067c06ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:40.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f0683414640 1 -- 172.21.15.122:0/158388036 shutdown_connections 2024-09-17T06:06:40.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f0683414640 1 -- 172.21.15.122:0/158388036 wait complete. 2024-09-17T06:06:40.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f0683414640 1 Processor -- start 2024-09-17T06:06:40.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f0683414640 1 -- start start 2024-09-17T06:06:40.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f0683414640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0668003a10 0x7f067c159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f0683414640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f067c150a30 0x7f067c15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f0683414640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f067c14d510 0x7f067c14af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f0683414640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f067c0cca70 con 0x7f067c14d510 2024-09-17T06:06:40.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f0683414640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f067c0cc8f0 con 0x7f067c150a30 2024-09-17T06:06:40.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f0683414640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f067c166500 con 0x7f0668003a10 2024-09-17T06:06:40.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f06819b1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f067c14d510 0x7f067c14af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f06819b1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f067c14d510 0x7f067c14af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56656/0 (socket says 172.21.15.122:56656) 2024-09-17T06:06:40.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f06819b1640 1 -- 172.21.15.122:0/993013365 learned_addr learned my addr 172.21.15.122:0/993013365 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f06811b0640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0668003a10 0x7f067c159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f06809af640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f067c150a30 0x7f067c15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f06819b1640 1 -- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0668003a10 msgr2=0x7f067c159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f06819b1640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0668003a10 0x7f067c159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f06819b1640 1 -- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f067c150a30 msgr2=0x7f067c15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f06819b1640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f067c150a30 0x7f067c15abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f06819b1640 1 -- 172.21.15.122:0/993013365 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067c1501f0 con 0x7f067c14d510 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.012+0000 7f06819b1640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f067c14d510 0x7f067c14af20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f067c0b6e50 tx=0x7f067400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f0671ffb640 1 -- 172.21.15.122:0/993013365 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674004b30 con 0x7f067c14d510 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f0671ffb640 1 -- 172.21.15.122:0/993013365 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0674004dc0 con 0x7f067c14d510 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f0683414640 1 -- 172.21.15.122:0/993013365 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067c151050 con 0x7f067c14d510 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f0671ffb640 1 -- 172.21.15.122:0/993013365 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067400cd60 con 0x7f067c14d510 2024-09-17T06:06:40.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f0683414640 1 -- 172.21.15.122:0/993013365 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f067c153c20 con 0x7f067c14d510 2024-09-17T06:06:40.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f0683414640 1 -- 172.21.15.122:0/993013365 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f067c15ba30 con 0x7f067c14d510 2024-09-17T06:06:40.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f0671ffb640 1 -- 172.21.15.122:0/993013365 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f067401b030 con 0x7f067c14d510 2024-09-17T06:06:40.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f0671ffb640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0660073200 0x7f0660075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f0671ffb640 1 -- 172.21.15.122:0/993013365 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f0674094040 con 0x7f067c14d510 2024-09-17T06:06:40.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f0671ffb640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f066007cce0 0x7f066007f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f0671ffb640 1 -- 172.21.15.122:0/993013365 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f066007f8a0 con 0x7f066007cce0 2024-09-17T06:06:40.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f0671ffb640 1 -- 172.21.15.122:0/993013365 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f067409b050 con 0x7f067c14d510 2024-09-17T06:06:40.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f06811b0640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0660073200 0x7f0660075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f06809af640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f066007cce0 0x7f066007f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f06809af640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f066007cce0 0x7f066007f1d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:40.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.016+0000 7f06811b0640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0660073200 0x7f0660075710 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f067800c2e0 tx=0x7f0668005840 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:40.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.020+0000 7f0671ffb640 1 -- 172.21.15.122:0/993013365 <== osd.6 v2:172.21.15.173:6818/1877869793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f066007f8a0 con 0x7f066007cce0 2024-09-17T06:06:40.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f0683414640 1 -- 172.21.15.122:0/993013365 --> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f067c0b5cc0 con 0x7f066007cce0 2024-09-17T06:06:40.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f0671ffb640 1 -- 172.21.15.122:0/993013365 <== osd.6 v2:172.21.15.173:6818/1877869793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f067c0b5cc0 con 0x7f066007cce0 2024-09-17T06:06:40.034 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:06:40.034 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T06:06:40.034 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:06:40.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f0683414640 1 -- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f066007cce0 msgr2=0x7f066007f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f0683414640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:6818/1877869793,v1:172.21.15.173:6819/1877869793] conn(0x7f066007cce0 0x7f066007f1d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f0683414640 1 -- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0660073200 msgr2=0x7f0660075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f0683414640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f0660073200 0x7f0660075710 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f067800c2e0 tx=0x7f0668005840 comp rx=0 tx=0).stop 2024-09-17T06:06:40.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f0683414640 1 -- 172.21.15.122:0/993013365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f067c14d510 msgr2=0x7f067c14af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f0683414640 1 --2- 172.21.15.122:0/993013365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f067c14d510 0x7f067c14af20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f067c0b6e50 tx=0x7f067400eec0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f06819b1640 1 -- 172.21.15.122:0/993013365 reap_dead start 2024-09-17T06:06:40.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f0683414640 1 -- 172.21.15.122:0/993013365 shutdown_connections 2024-09-17T06:06:40.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f0683414640 1 -- 172.21.15.122:0/993013365 >> 172.21.15.122:0/993013365 conn(0x7f067c08d450 msgr2=0x7f067c0b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:40.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f0683414640 1 -- 172.21.15.122:0/993013365 shutdown_connections 2024-09-17T06:06:40.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.032+0000 7f0683414640 1 -- 172.21.15.122:0/993013365 wait complete. 2024-09-17T06:06:40.054 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T06:06:40.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.200+0000 7f49d6cb6640 1 -- 172.21.15.122:0/3622865646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d00c6840 msgr2=0x7f49d00c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.200+0000 7f49d6cb6640 1 --2- 172.21.15.122:0/3622865646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d00c6840 0x7f49d00c2870 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f49d0071320 tx=0x7f49c801c8c0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 -- 172.21.15.122:0/3622865646 shutdown_connections 2024-09-17T06:06:40.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 --2- 172.21.15.122:0/3622865646 >> v2:172.21.15.173:3300/0 conn(0x7f49d0072520 0x7f49d015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 --2- 172.21.15.122:0/3622865646 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49d00c9070 0x7f49d0071fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.204 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 --2- 172.21.15.122:0/3622865646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d00c6840 0x7f49d00c2870 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 -- 172.21.15.122:0/3622865646 >> 172.21.15.122:0/3622865646 conn(0x7f49d00744c0 msgr2=0x7f49d00748d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:40.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 -- 172.21.15.122:0/3622865646 shutdown_connections 2024-09-17T06:06:40.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 -- 172.21.15.122:0/3622865646 wait complete. 2024-09-17T06:06:40.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 Processor -- start 2024-09-17T06:06:40.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 -- start start 2024-09-17T06:06:40.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49d0072520 0x7f49d01f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d00c6840 0x7f49d01509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49d00c9070 0x7f49d0148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f49d015c0c0 con 0x7f49d00c6840 2024-09-17T06:06:40.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f49d00c9ab0 con 0x7f49d0072520 2024-09-17T06:06:40.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d6cb6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f49d01525e0 con 0x7f49d00c9070 2024-09-17T06:06:40.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d54b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d00c6840 0x7f49d01509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d54b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d00c6840 0x7f49d01509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56676/0 (socket says 172.21.15.122:56676) 2024-09-17T06:06:40.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d54b3640 1 -- 172.21.15.122:0/1343169496 learned_addr learned my addr 172.21.15.122:0/1343169496 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:40.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d5cb4640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49d0072520 0x7f49d01f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d64b5640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49d00c9070 0x7f49d0148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d54b3640 1 -- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49d00c9070 msgr2=0x7f49d0148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d54b3640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49d00c9070 0x7f49d0148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d54b3640 1 -- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49d0072520 msgr2=0x7f49d01f7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d54b3640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49d0072520 0x7f49d01f7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d54b3640 1 -- 172.21.15.122:0/1343169496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d0150ee0 con 0x7f49d00c6840 2024-09-17T06:06:40.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49d54b3640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d00c6840 0x7f49d01509a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f49c000c9a0 tx=0x7f49c000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:40.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.204+0000 7f49c67fc640 1 -- 172.21.15.122:0/1343169496 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c0007b50 con 0x7f49d00c6840 2024-09-17T06:06:40.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.208+0000 7f49c67fc640 1 -- 172.21.15.122:0/1343169496 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49c0007e00 con 0x7f49d00c6840 2024-09-17T06:06:40.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.208+0000 7f49d6cb6640 1 -- 172.21.15.122:0/1343169496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d0148990 con 0x7f49d00c6840 2024-09-17T06:06:40.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.208+0000 7f49c67fc640 1 -- 172.21.15.122:0/1343169496 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c0005280 con 0x7f49d00c6840 2024-09-17T06:06:40.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.208+0000 7f49d6cb6640 1 -- 172.21.15.122:0/1343169496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d014f220 con 0x7f49d00c6840 2024-09-17T06:06:40.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.208+0000 7f49d6cb6640 1 -- 172.21.15.122:0/1343169496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d00c8cf0 con 0x7f49d00c6840 2024-09-17T06:06:40.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.208+0000 7f49c67fc640 1 -- 172.21.15.122:0/1343169496 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f49c0005420 con 0x7f49d00c6840 2024-09-17T06:06:40.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.208+0000 7f49c67fc640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f49b4073200 0x7f49b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.208+0000 7f49c67fc640 1 -- 172.21.15.122:0/1343169496 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f49c0094ab0 con 0x7f49d00c6840 2024-09-17T06:06:40.210 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.208+0000 7f49d5cb4640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f49b4073200 0x7f49b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.208+0000 7f49d5cb4640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f49b4073200 0x7f49b4075710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f49c80af000 tx=0x7f49c801b100 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:40.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.212+0000 7f49c67fc640 1 -- 172.21.15.122:0/1343169496 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f49c0014030 con 0x7f49d00c6840 2024-09-17T06:06:40.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.380+0000 7f49d6cb6640 1 -- 172.21.15.122:0/1343169496 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f49d014f060 con 0x7f49b4073200 2024-09-17T06:06:40.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49c67fc640 1 -- 172.21.15.122:0/1343169496 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f49c8004140 con 0x7f49b4073200 2024-09-17T06:06:40.384 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T06:06:40.387 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49d6cb6640 1 -- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f49b4073200 msgr2=0x7f49b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49d6cb6640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f49b4073200 0x7f49b4075710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f49c80af000 tx=0x7f49c801b100 comp rx=0 tx=0).stop 2024-09-17T06:06:40.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49d6cb6640 1 -- 172.21.15.122:0/1343169496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d00c6840 msgr2=0x7f49d01509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49d6cb6640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d00c6840 0x7f49d01509a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f49c000c9a0 tx=0x7f49c000ce60 comp rx=0 tx=0).stop 2024-09-17T06:06:40.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49d6cb6640 1 -- 172.21.15.122:0/1343169496 shutdown_connections 2024-09-17T06:06:40.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49d6cb6640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49d00c9070 0x7f49d0148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49d6cb6640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d00c6840 0x7f49d01509a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49d6cb6640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f49b4073200 0x7f49b4075710 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49d6cb6640 1 --2- 172.21.15.122:0/1343169496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49d0072520 0x7f49d01f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49d6cb6640 1 -- 172.21.15.122:0/1343169496 >> 172.21.15.122:0/1343169496 conn(0x7f49d00744c0 msgr2=0x7f49d00c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:40.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49d6cb6640 1 -- 172.21.15.122:0/1343169496 shutdown_connections 2024-09-17T06:06:40.388 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.384+0000 7f49d6cb6640 1 -- 172.21.15.122:0/1343169496 wait complete. 2024-09-17T06:06:40.408 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T06:06:40.408 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T06:06:40.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 -- 172.21.15.122:0/976330654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07000c6780 msgr2=0x7f0700159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 --2- 172.21.15.122:0/976330654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07000c6780 0x7f0700159b30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0700156ca0 tx=0x7f06f001eff0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 -- 172.21.15.122:0/976330654 shutdown_connections 2024-09-17T06:06:40.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 --2- 172.21.15.122:0/976330654 >> v2:172.21.15.173:3300/0 conn(0x7f0700153310 0x7f070015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 --2- 172.21.15.122:0/976330654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07000c6780 0x7f0700159b30 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 -- 172.21.15.122:0/976330654 >> 172.21.15.122:0/976330654 conn(0x7f07000746d0 msgr2=0x7f0700074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:40.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 -- 172.21.15.122:0/976330654 shutdown_connections 2024-09-17T06:06:40.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 -- 172.21.15.122:0/976330654 wait complete. 2024-09-17T06:06:40.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 Processor -- start 2024-09-17T06:06:40.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 -- start start 2024-09-17T06:06:40.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07000c6780 0x7f07001f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0700152f00 0x7f07000c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0700153310 0x7f070014d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f070015d470 con 0x7f0700152f00 2024-09-17T06:06:40.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f070015d190 con 0x7f0700153310 2024-09-17T06:06:40.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f07000b8cf0 con 0x7f07000c6780 2024-09-17T06:06:40.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06f7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0700152f00 0x7f07000c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06f7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0700152f00 0x7f07000c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56680/0 (socket says 172.21.15.122:56680) 2024-09-17T06:06:40.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06f7fff640 1 -- 172.21.15.122:0/573081718 learned_addr learned my addr 172.21.15.122:0/573081718 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:40.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06ff7fe640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07000c6780 0x7f07001f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06f7fff640 1 -- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07000c6780 msgr2=0x7f07001f3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06f7fff640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07000c6780 0x7f07001f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06fffff640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0700153310 0x7f070014d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06f7fff640 1 -- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0700153310 msgr2=0x7f070014d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06f7fff640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0700153310 0x7f070014d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06f7fff640 1 -- 172.21.15.122:0/573081718 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07001f35c0 con 0x7f0700152f00 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06f7fff640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0700152f00 0x7f07000c9830 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f06e800c3f0 tx=0x7f06e800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06fcff9640 1 -- 172.21.15.122:0/573081718 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8011790 con 0x7f0700152f00 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06fcff9640 1 -- 172.21.15.122:0/573081718 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06e8017070 con 0x7f0700152f00 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 -- 172.21.15.122:0/573081718 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07001f02b0 con 0x7f0700152f00 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f06fcff9640 1 -- 172.21.15.122:0/573081718 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8011ce0 con 0x7f0700152f00 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.556+0000 7f0706032640 1 -- 172.21.15.122:0/573081718 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07000c7120 con 0x7f0700152f00 2024-09-17T06:06:40.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.560+0000 7f0706032640 1 -- 172.21.15.122:0/573081718 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f07000729d0 con 0x7f0700152f00 2024-09-17T06:06:40.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.560+0000 7f06fcff9640 1 -- 172.21.15.122:0/573081718 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f06e801c460 con 0x7f0700152f00 2024-09-17T06:06:40.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.560+0000 7f06fcff9640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f06e0073230 0x7f06e0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.560+0000 7f06fcff9640 1 -- 172.21.15.122:0/573081718 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f06e8094e30 con 0x7f0700152f00 2024-09-17T06:06:40.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.560+0000 7f06fcff9640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f06e007cc90 0x7f06e007f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.560+0000 7f06fcff9640 1 -- 172.21.15.122:0/573081718 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06e8015e50 con 0x7f06e007cc90 2024-09-17T06:06:40.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.560+0000 7f06fcff9640 1 -- 172.21.15.122:0/573081718 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f06e80952c0 con 0x7f0700152f00 2024-09-17T06:06:40.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.560+0000 7f06ff7fe640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f06e0073230 0x7f06e0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.560+0000 7f06fffff640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f06e007cc90 0x7f06e007f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.560+0000 7f06ff7fe640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f06e0073230 0x7f06e0075740 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f06f00b2000 tx=0x7f06f001d830 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:40.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.560+0000 7f06fffff640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f06e007cc90 0x7f06e007f180 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:40.564 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.564+0000 7f06fcff9640 1 -- 172.21.15.122:0/573081718 <== osd.7 v2:172.21.15.173:6826/1719466778 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f06e8015e50 con 0x7f06e007cc90 2024-09-17T06:06:40.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f0706032640 1 -- 172.21.15.122:0/573081718 --> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f07000c3650 con 0x7f06e007cc90 2024-09-17T06:06:40.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f06fcff9640 1 -- 172.21.15.122:0/573081718 <== osd.7 v2:172.21.15.173:6826/1719466778 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f07000c3650 con 0x7f06e007cc90 2024-09-17T06:06:40.578 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-17T06:06:40.578 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T06:06:40.578 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-17T06:06:40.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f0706032640 1 -- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f06e007cc90 msgr2=0x7f06e007f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f0706032640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:6826/1719466778,v1:172.21.15.173:6827/1719466778] conn(0x7f06e007cc90 0x7f06e007f180 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f0706032640 1 -- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f06e0073230 msgr2=0x7f06e0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f0706032640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f06e0073230 0x7f06e0075740 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f06f00b2000 tx=0x7f06f001d830 comp rx=0 tx=0).stop 2024-09-17T06:06:40.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f0706032640 1 -- 172.21.15.122:0/573081718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0700152f00 msgr2=0x7f07000c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f0706032640 1 --2- 172.21.15.122:0/573081718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0700152f00 0x7f07000c9830 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f06e800c3f0 tx=0x7f06e800c8b0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f06fffff640 1 -- 172.21.15.122:0/573081718 reap_dead start 2024-09-17T06:06:40.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f0706032640 1 -- 172.21.15.122:0/573081718 shutdown_connections 2024-09-17T06:06:40.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f0706032640 1 -- 172.21.15.122:0/573081718 >> 172.21.15.122:0/573081718 conn(0x7f07000746d0 msgr2=0x7f07001e46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:40.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f0706032640 1 -- 172.21.15.122:0/573081718 shutdown_connections 2024-09-17T06:06:40.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.576+0000 7f0706032640 1 -- 172.21.15.122:0/573081718 wait complete. 2024-09-17T06:06:40.597 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T06:06:40.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 -- 172.21.15.122:0/3896590498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a80c7660 msgr2=0x7f27a80c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 --2- 172.21.15.122:0/3896590498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a80c7660 0x7f27a80c5c90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f279c009840 tx=0x7f279c01f010 comp rx=0 tx=0).stop 2024-09-17T06:06:40.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 -- 172.21.15.122:0/3896590498 shutdown_connections 2024-09-17T06:06:40.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 --2- 172.21.15.122:0/3896590498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a80c7660 0x7f27a80c5c90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 -- 172.21.15.122:0/3896590498 >> 172.21.15.122:0/3896590498 conn(0x7f27a80cb310 msgr2=0x7f27a80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:40.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 -- 172.21.15.122:0/3896590498 shutdown_connections 2024-09-17T06:06:40.736 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 -- 172.21.15.122:0/3896590498 wait complete. 2024-09-17T06:06:40.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 Processor -- start 2024-09-17T06:06:40.737 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 -- start start 2024-09-17T06:06:40.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a80c61d0 0x7f27a81f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a80c7660 0x7f27a80c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27a8153430 0x7f27a815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8159dc0 con 0x7f27a80c61d0 2024-09-17T06:06:40.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8159ae0 con 0x7f27a80c7660 2024-09-17T06:06:40.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27ae65e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f27a80c9280 con 0x7f27a8153430 2024-09-17T06:06:40.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27a7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a80c61d0 0x7f27a81f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27a7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a80c61d0 0x7f27a81f3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56696/0 (socket says 172.21.15.122:56696) 2024-09-17T06:06:40.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27a7fff640 1 -- 172.21.15.122:0/3036880582 learned_addr learned my addr 172.21.15.122:0/3036880582 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:40.740 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27a7fff640 1 -- 172.21.15.122:0/3036880582 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27a8153430 msgr2=0x7f27a815bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27a7fff640 1 --2- 172.21.15.122:0/3036880582 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27a8153430 0x7f27a815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27a7fff640 1 -- 172.21.15.122:0/3036880582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a80c7660 msgr2=0x7f27a80c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27a7fff640 1 --2- 172.21.15.122:0/3036880582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a80c7660 0x7f27a80c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27a7fff640 1 -- 172.21.15.122:0/3036880582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a81f3cc0 con 0x7f27a80c61d0 2024-09-17T06:06:40.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.736+0000 7f27a7fff640 1 --2- 172.21.15.122:0/3036880582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a80c61d0 0x7f27a81f3780 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f279800c3c0 tx=0x7f279800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:40.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.740+0000 7f27a4ff9640 1 -- 172.21.15.122:0/3036880582 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798011790 con 0x7f27a80c61d0 2024-09-17T06:06:40.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.740+0000 7f27a4ff9640 1 -- 172.21.15.122:0/3036880582 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2798017070 con 0x7f27a80c61d0 2024-09-17T06:06:40.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.740+0000 7f27ae65e640 1 -- 172.21.15.122:0/3036880582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a80c4380 con 0x7f27a80c61d0 2024-09-17T06:06:40.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.740+0000 7f27a4ff9640 1 -- 172.21.15.122:0/3036880582 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798011d40 con 0x7f27a80c61d0 2024-09-17T06:06:40.741 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.740+0000 7f27ae65e640 1 -- 172.21.15.122:0/3036880582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a80ce1d0 con 0x7f27a80c61d0 2024-09-17T06:06:40.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.740+0000 7f27ae65e640 1 -- 172.21.15.122:0/3036880582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a80c5c90 con 0x7f27a80c61d0 2024-09-17T06:06:40.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.740+0000 7f27a4ff9640 1 -- 172.21.15.122:0/3036880582 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f279801c460 con 0x7f27a80c61d0 2024-09-17T06:06:40.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.740+0000 7f27a4ff9640 1 --2- 172.21.15.122:0/3036880582 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2794073230 0x7f2794075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:40.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.740+0000 7f27a4ff9640 1 -- 172.21.15.122:0/3036880582 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7f2798094460 con 0x7f27a80c61d0 2024-09-17T06:06:40.742 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.740+0000 7f27a77fe640 1 --2- 172.21.15.122:0/3036880582 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2794073230 0x7f2794075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:40.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.740+0000 7f27a77fe640 1 --2- 172.21.15.122:0/3036880582 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2794073230 0x7f2794075740 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f279c0b2000 tx=0x7f279c01bdb0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:40.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.744+0000 7f27a4ff9640 1 -- 172.21.15.122:0/3036880582 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f279805f060 con 0x7f27a80c61d0 2024-09-17T06:06:40.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.916+0000 7f27ae65e640 1 -- 172.21.15.122:0/3036880582 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f27a8156ee0 con 0x7f2794073230 2024-09-17T06:06:40.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27a4ff9640 1 -- 172.21.15.122:0/3036880582 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f27a8156ee0 con 0x7f2794073230 2024-09-17T06:06:40.920 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T06:06:40.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27ae65e640 1 -- 172.21.15.122:0/3036880582 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2794073230 msgr2=0x7f2794075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27ae65e640 1 --2- 172.21.15.122:0/3036880582 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2794073230 0x7f2794075740 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f279c0b2000 tx=0x7f279c01bdb0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27ae65e640 1 -- 172.21.15.122:0/3036880582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a80c61d0 msgr2=0x7f27a81f3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:40.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27ae65e640 1 --2- 172.21.15.122:0/3036880582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a80c61d0 0x7f27a81f3780 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f279800c3c0 tx=0x7f279800c880 comp rx=0 tx=0).stop 2024-09-17T06:06:40.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27ae65e640 1 -- 172.21.15.122:0/3036880582 shutdown_connections 2024-09-17T06:06:40.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27ae65e640 1 --2- 172.21.15.122:0/3036880582 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27a8153430 0x7f27a815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27ae65e640 1 --2- 172.21.15.122:0/3036880582 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f2794073230 0x7f2794075740 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27ae65e640 1 --2- 172.21.15.122:0/3036880582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a80c7660 0x7f27a80c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27ae65e640 1 --2- 172.21.15.122:0/3036880582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27a80c61d0 0x7f27a81f3780 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:40.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27ae65e640 1 -- 172.21.15.122:0/3036880582 >> 172.21.15.122:0/3036880582 conn(0x7f27a80cb310 msgr2=0x7f27a80c19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:40.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27ae65e640 1 -- 172.21.15.122:0/3036880582 shutdown_connections 2024-09-17T06:06:40.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:40.920+0000 7f27ae65e640 1 -- 172.21.15.122:0/3036880582 wait complete. 2024-09-17T06:06:40.942 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:06:41.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.092+0000 7fc85f827640 1 -- 172.21.15.122:0/2606457960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc844004810 msgr2=0x7fc844004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:41.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.092+0000 7fc85f827640 1 --2- 172.21.15.122:0/2606457960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc844004810 0x7fc844004c20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc848009b30 tx=0x7fc84801d300 comp rx=0 tx=0).stop 2024-09-17T06:06:41.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.092+0000 7fc85ddc4640 1 -- 172.21.15.122:0/2606457960 reap_dead start 2024-09-17T06:06:41.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.092+0000 7fc85f827640 1 -- 172.21.15.122:0/2606457960 shutdown_connections 2024-09-17T06:06:41.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.092+0000 7fc85f827640 1 -- 172.21.15.122:0/2606457960 >> 172.21.15.122:0/2606457960 conn(0x7fc8580746d0 msgr2=0x7fc858074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:41.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.092+0000 7fc85f827640 1 -- 172.21.15.122:0/2606457960 shutdown_connections 2024-09-17T06:06:41.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.092+0000 7fc85f827640 1 -- 172.21.15.122:0/2606457960 wait complete. 2024-09-17T06:06:41.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85f827640 1 Processor -- start 2024-09-17T06:06:41.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85f827640 1 -- start start 2024-09-17T06:06:41.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85f827640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc844004810 0x7fc8581f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:41.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85f827640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc858148ad0 0x7fc8581580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:41.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85f827640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8581585e0 0x7fc8580c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:41.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85f827640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc85815d470 con 0x7fc858148ad0 2024-09-17T06:06:41.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85f827640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc85815d190 con 0x7fc844004810 2024-09-17T06:06:41.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85f827640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc8581534a0 con 0x7fc8581585e0 2024-09-17T06:06:41.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85cdc2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc858148ad0 0x7fc8581580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:41.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85cdc2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc858148ad0 0x7fc8581580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56706/0 (socket says 172.21.15.122:56706) 2024-09-17T06:06:41.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85cdc2640 1 -- 172.21.15.122:0/1211017305 learned_addr learned my addr 172.21.15.122:0/1211017305 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:06:41.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85d5c3640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc844004810 0x7fc8581f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:41.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85ddc4640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8581585e0 0x7fc8580c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:41.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85cdc2640 1 -- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8581585e0 msgr2=0x7fc8580c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:41.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85cdc2640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8581585e0 0x7fc8580c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:41.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85cdc2640 1 -- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc844004810 msgr2=0x7fc8581f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:41.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85cdc2640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc844004810 0x7fc8581f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:41.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85cdc2640 1 -- 172.21.15.122:0/1211017305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8581f2ee0 con 0x7fc858148ad0 2024-09-17T06:06:41.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85ddc4640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8581585e0 0x7fc8580c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:06:41.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85cdc2640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc858148ad0 0x7fc8581580a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc848009a80 tx=0x7fc848004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:41.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc84dffb640 1 -- 172.21.15.122:0/1211017305 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480bc020 con 0x7fc858148ad0 2024-09-17T06:06:41.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc84dffb640 1 -- 172.21.15.122:0/1211017305 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8480052b0 con 0x7fc858148ad0 2024-09-17T06:06:41.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85f827640 1 -- 172.21.15.122:0/1211017305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8581ef1a0 con 0x7fc858148ad0 2024-09-17T06:06:41.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc84dffb640 1 -- 172.21.15.122:0/1211017305 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480b3040 con 0x7fc858148ad0 2024-09-17T06:06:41.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85f827640 1 -- 172.21.15.122:0/1211017305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8581f2480 con 0x7fc858148ad0 2024-09-17T06:06:41.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.096+0000 7fc85f827640 1 -- 172.21.15.122:0/1211017305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc858072bb0 con 0x7fc858148ad0 2024-09-17T06:06:41.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.100+0000 7fc84dffb640 1 -- 172.21.15.122:0/1211017305 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc8480bf020 con 0x7fc858148ad0 2024-09-17T06:06:41.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.100+0000 7fc84dffb640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc83c073200 0x7fc83c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:06:41.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.100+0000 7fc84dffb640 1 -- 172.21.15.122:0/1211017305 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6767+0+0 (secure 0 0 0) 0x7fc84812f5f0 con 0x7fc858148ad0 2024-09-17T06:06:41.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.100+0000 7fc85d5c3640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc83c073200 0x7fc83c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:06:41.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.100+0000 7fc85d5c3640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc83c073200 0x7fc83c075710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc854001870 tx=0x7fc854001660 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:06:41.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.104+0000 7fc84dffb640 1 -- 172.21.15.122:0/1211017305 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc8480c6030 con 0x7fc858148ad0 2024-09-17T06:06:41.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.272+0000 7fc85f827640 1 -- 172.21.15.122:0/1211017305 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc8580cac30 con 0x7fc83c073200 2024-09-17T06:06:41.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.288+0000 7fc84dffb640 1 -- 172.21.15.122:0/1211017305 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332690 (secure 0 0 0) 0x7fc8580cac30 con 0x7fc83c073200 2024-09-17T06:06:41.293 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:06:41.295 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:06:41.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.292+0000 7fc85f827640 1 -- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc83c073200 msgr2=0x7fc83c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:41.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.292+0000 7fc85f827640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc83c073200 0x7fc83c075710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc854001870 tx=0x7fc854001660 comp rx=0 tx=0).stop 2024-09-17T06:06:41.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.292+0000 7fc85f827640 1 -- 172.21.15.122:0/1211017305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc858148ad0 msgr2=0x7fc8581580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:06:41.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.292+0000 7fc85f827640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc858148ad0 0x7fc8581580a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc848009a80 tx=0x7fc848004e30 comp rx=0 tx=0).stop 2024-09-17T06:06:41.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.292+0000 7fc85f827640 1 -- 172.21.15.122:0/1211017305 shutdown_connections 2024-09-17T06:06:41.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.292+0000 7fc85f827640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8581585e0 0x7fc8580c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:41.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.292+0000 7fc85f827640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc858148ad0 0x7fc8581580a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:41.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.292+0000 7fc85f827640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc83c073200 0x7fc83c075710 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:41.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.292+0000 7fc85f827640 1 --2- 172.21.15.122:0/1211017305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc844004810 0x7fc8581f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:06:41.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.292+0000 7fc85f827640 1 -- 172.21.15.122:0/1211017305 >> 172.21.15.122:0/1211017305 conn(0x7fc8580746d0 msgr2=0x7fc85814e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:06:41.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.292+0000 7fc85f827640 1 -- 172.21.15.122:0/1211017305 shutdown_connections 2024-09-17T06:06:41.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:06:41.292+0000 7fc85f827640 1 -- 172.21.15.122:0/1211017305 wait complete. 2024-09-17T06:06:41.316 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-17T06:06:39.575976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":656,"ondisk_log_size":656,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242544,"kb_used_data":8688,"kb_used_omap":17,"kb_used_meta":233710,"kb_avail":754732176,"statfs":{"total":773094113280,"available":772845748224,"internally_reserved":0,"allocated":8896512,"data_stored":5206280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":239319789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":76,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005838"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500455+0000","last_change":"2024-09-17T06:04:07.837295+0000","last_active":"2024-09-17T06:06:22.500455+0000","last_peered":"2024-09-17T06:06:22.500455+0000","last_clean":"2024-09-17T06:06:22.500455+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:06:22.500455+0000","last_undegraded":"2024-09-17T06:06:22.500455+0000","last_fullsized":"2024-09-17T06:06:22.500455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:19.791745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.522869+0000","last_change":"2024-09-17T06:06:14.882867+0000","last_active":"2024-09-17T06:06:27.522869+0000","last_peered":"2024-09-17T06:06:27.522869+0000","last_clean":"2024-09-17T06:06:27.522869+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:06:27.522869+0000","last_undegraded":"2024-09-17T06:06:27.522869+0000","last_fullsized":"2024-09-17T06:06:27.522869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:30.856555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498014+0000","last_change":"2024-09-17T06:06:15.369420+0000","last_active":"2024-09-17T06:06:22.498014+0000","last_peered":"2024-09-17T06:06:22.498014+0000","last_clean":"2024-09-17T06:06:22.498014+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:06:22.498014+0000","last_undegraded":"2024-09-17T06:06:22.498014+0000","last_fullsized":"2024-09-17T06:06:22.498014+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:26.332180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500348+0000","last_change":"2024-09-17T06:06:14.876941+0000","last_active":"2024-09-17T06:06:22.500348+0000","last_peered":"2024-09-17T06:06:22.500348+0000","last_clean":"2024-09-17T06:06:22.500348+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:06:22.500348+0000","last_undegraded":"2024-09-17T06:06:22.500348+0000","last_fullsized":"2024-09-17T06:06:22.500348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:16.802718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.559750+0000","last_change":"2024-09-17T06:04:08.840157+0000","last_active":"2024-09-17T06:06:27.559750+0000","last_peered":"2024-09-17T06:06:27.559750+0000","last_clean":"2024-09-17T06:06:27.559750+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:06:27.559750+0000","last_undegraded":"2024-09-17T06:06:27.559750+0000","last_fullsized":"2024-09-17T06:06:27.559750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:31.708895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966721+0000","last_change":"2024-09-17T06:06:02.760496+0000","last_active":"2024-09-17T06:06:21.966721+0000","last_peered":"2024-09-17T06:06:21.966721+0000","last_clean":"2024-09-17T06:06:21.966721+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:06:21.966721+0000","last_undegraded":"2024-09-17T06:06:21.966721+0000","last_fullsized":"2024-09-17T06:06:21.966721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.085087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"60'3","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501624+0000","last_change":"2024-09-17T06:04:07.853905+0000","last_active":"2024-09-17T06:06:22.501624+0000","last_peered":"2024-09-17T06:06:22.501624+0000","last_clean":"2024-09-17T06:06:22.501624+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:06:22.501624+0000","last_undegraded":"2024-09-17T06:06:22.501624+0000","last_fullsized":"2024-09-17T06:06:22.501624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:37.866818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568851+0000","last_change":"2024-09-17T06:06:02.772542+0000","last_active":"2024-09-17T06:06:27.568851+0000","last_peered":"2024-09-17T06:06:27.568851+0000","last_clean":"2024-09-17T06:06:27.568851+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:27.568851+0000","last_undegraded":"2024-09-17T06:06:27.568851+0000","last_fullsized":"2024-09-17T06:06:27.568851+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:31.442644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968566+0000","last_change":"2024-09-17T06:06:02.762154+0000","last_active":"2024-09-17T06:06:21.968566+0000","last_peered":"2024-09-17T06:06:21.968566+0000","last_clean":"2024-09-17T06:06:21.968566+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:06:21.968566+0000","last_undegraded":"2024-09-17T06:06:21.968566+0000","last_fullsized":"2024-09-17T06:06:21.968566+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:56.087057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500668+0000","last_change":"2024-09-17T06:04:07.859792+0000","last_active":"2024-09-17T06:06:22.500668+0000","last_peered":"2024-09-17T06:06:22.500668+0000","last_clean":"2024-09-17T06:06:22.500668+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:06:22.500668+0000","last_undegraded":"2024-09-17T06:06:22.500668+0000","last_fullsized":"2024-09-17T06:06:22.500668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:01.882018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.549485+0000","last_change":"2024-09-17T06:06:02.747441+0000","last_active":"2024-09-17T06:06:27.549485+0000","last_peered":"2024-09-17T06:06:27.549485+0000","last_clean":"2024-09-17T06:06:27.549485+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:06:27.549485+0000","last_undegraded":"2024-09-17T06:06:27.549485+0000","last_fullsized":"2024-09-17T06:06:27.549485+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:56.535771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968309+0000","last_change":"2024-09-17T06:06:02.760042+0000","last_active":"2024-09-17T06:06:21.968309+0000","last_peered":"2024-09-17T06:06:21.968309+0000","last_clean":"2024-09-17T06:06:21.968309+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:06:21.968309+0000","last_undegraded":"2024-09-17T06:06:21.968309+0000","last_fullsized":"2024-09-17T06:06:21.968309+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:53.866107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.555668+0000","last_change":"2024-09-17T06:06:02.772614+0000","last_active":"2024-09-17T06:06:27.555668+0000","last_peered":"2024-09-17T06:06:27.555668+0000","last_clean":"2024-09-17T06:06:27.555668+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:06:27.555668+0000","last_undegraded":"2024-09-17T06:06:27.555668+0000","last_fullsized":"2024-09-17T06:06:27.555668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:56.086542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"60'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501042+0000","last_change":"2024-09-17T06:06:02.763938+0000","last_active":"2024-09-17T06:06:22.501042+0000","last_peered":"2024-09-17T06:06:22.501042+0000","last_clean":"2024-09-17T06:06:22.501042+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:06:22.501042+0000","last_undegraded":"2024-09-17T06:06:22.501042+0000","last_fullsized":"2024-09-17T06:06:22.501042+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:09.262608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969558+0000","last_change":"2024-09-17T06:06:02.764648+0000","last_active":"2024-09-17T06:06:21.969558+0000","last_peered":"2024-09-17T06:06:21.969558+0000","last_clean":"2024-09-17T06:06:21.969558+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:06:21.969558+0000","last_undegraded":"2024-09-17T06:06:21.969558+0000","last_fullsized":"2024-09-17T06:06:21.969558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:56.341325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.536106+0000","last_change":"2024-09-17T06:06:14.877208+0000","last_active":"2024-09-17T06:06:27.536106+0000","last_peered":"2024-09-17T06:06:27.536106+0000","last_clean":"2024-09-17T06:06:27.536106+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:06:27.536106+0000","last_undegraded":"2024-09-17T06:06:27.536106+0000","last_fullsized":"2024-09-17T06:06:27.536106+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:16.547077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967926+0000","last_change":"2024-09-17T06:04:07.835983+0000","last_active":"2024-09-17T06:06:21.967926+0000","last_peered":"2024-09-17T06:06:21.967926+0000","last_clean":"2024-09-17T06:06:21.967926+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:06:21.967926+0000","last_undegraded":"2024-09-17T06:06:21.967926+0000","last_fullsized":"2024-09-17T06:06:21.967926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969187+0000","last_change":"2024-09-17T06:06:02.777996+0000","last_active":"2024-09-17T06:06:21.969187+0000","last_peered":"2024-09-17T06:06:21.969187+0000","last_clean":"2024-09-17T06:06:21.969187+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:06:21.969187+0000","last_undegraded":"2024-09-17T06:06:21.969187+0000","last_fullsized":"2024-09-17T06:06:21.969187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:04.148545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.502605+0000","last_change":"2024-09-17T06:06:14.859614+0000","last_active":"2024-09-17T06:06:27.502605+0000","last_peered":"2024-09-17T06:06:27.502605+0000","last_clean":"2024-09-17T06:06:27.502605+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:06:27.502605+0000","last_undegraded":"2024-09-17T06:06:27.502605+0000","last_fullsized":"2024-09-17T06:06:27.502605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.132428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.966735+0000","last_change":"2024-09-17T06:04:07.848053+0000","last_active":"2024-09-17T06:06:21.966735+0000","last_peered":"2024-09-17T06:06:21.966735+0000","last_clean":"2024-09-17T06:06:21.966735+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:06:21.966735+0000","last_undegraded":"2024-09-17T06:06:21.966735+0000","last_fullsized":"2024-09-17T06:06:21.966735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:05.405840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967353+0000","last_change":"2024-09-17T06:06:02.773038+0000","last_active":"2024-09-17T06:06:21.967353+0000","last_peered":"2024-09-17T06:06:21.967353+0000","last_clean":"2024-09-17T06:06:21.967353+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:06:21.967353+0000","last_undegraded":"2024-09-17T06:06:21.967353+0000","last_fullsized":"2024-09-17T06:06:21.967353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:24.833172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.539183+0000","last_change":"2024-09-17T06:06:02.742391+0000","last_active":"2024-09-17T06:06:27.539183+0000","last_peered":"2024-09-17T06:06:27.539183+0000","last_clean":"2024-09-17T06:06:27.539183+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:06:27.539183+0000","last_undegraded":"2024-09-17T06:06:27.539183+0000","last_fullsized":"2024-09-17T06:06:27.539183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:18.282190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499601+0000","last_change":"2024-09-17T06:04:07.844975+0000","last_active":"2024-09-17T06:06:22.499601+0000","last_peered":"2024-09-17T06:06:22.499601+0000","last_clean":"2024-09-17T06:06:22.499601+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:06:22.499601+0000","last_undegraded":"2024-09-17T06:06:22.499601+0000","last_fullsized":"2024-09-17T06:06:22.499601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:20.750248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.973250+0000","last_change":"2024-09-17T06:06:02.760965+0000","last_active":"2024-09-17T06:06:21.973250+0000","last_peered":"2024-09-17T06:06:21.973250+0000","last_clean":"2024-09-17T06:06:21.973250+0000","last_became_active":"2024-09-17T06:06:02.755335+0000","last_became_peered":"2024-09-17T06:06:02.755335+0000","last_unstale":"2024-09-17T06:06:21.973250+0000","last_undegraded":"2024-09-17T06:06:21.973250+0000","last_fullsized":"2024-09-17T06:06:21.973250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:49.568290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.530774+0000","last_change":"2024-09-17T06:04:08.844102+0000","last_active":"2024-09-17T06:06:27.530774+0000","last_peered":"2024-09-17T06:06:27.530774+0000","last_clean":"2024-09-17T06:06:27.530774+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:06:27.530774+0000","last_undegraded":"2024-09-17T06:06:27.530774+0000","last_fullsized":"2024-09-17T06:06:27.530774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"61'3","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503161+0000","last_change":"2024-09-17T06:04:07.848832+0000","last_active":"2024-09-17T06:06:22.503161+0000","last_peered":"2024-09-17T06:06:22.503161+0000","last_clean":"2024-09-17T06:06:22.503161+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:06:22.503161+0000","last_undegraded":"2024-09-17T06:06:22.503161+0000","last_fullsized":"2024-09-17T06:06:22.503161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:30.840060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967557+0000","last_change":"2024-09-17T06:06:02.770140+0000","last_active":"2024-09-17T06:06:21.967557+0000","last_peered":"2024-09-17T06:06:21.967557+0000","last_clean":"2024-09-17T06:06:21.967557+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:06:21.967557+0000","last_undegraded":"2024-09-17T06:06:21.967557+0000","last_fullsized":"2024-09-17T06:06:21.967557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:35.888277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.556341+0000","last_change":"2024-09-17T06:06:14.875548+0000","last_active":"2024-09-17T06:06:27.556341+0000","last_peered":"2024-09-17T06:06:27.556341+0000","last_clean":"2024-09-17T06:06:27.556341+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:06:27.556341+0000","last_undegraded":"2024-09-17T06:06:27.556341+0000","last_fullsized":"2024-09-17T06:06:27.556341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:24.521256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967487+0000","last_change":"2024-09-17T06:04:07.846343+0000","last_active":"2024-09-17T06:06:21.967487+0000","last_peered":"2024-09-17T06:06:21.967487+0000","last_clean":"2024-09-17T06:06:21.967487+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:06:21.967487+0000","last_undegraded":"2024-09-17T06:06:21.967487+0000","last_fullsized":"2024-09-17T06:06:21.967487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:23.495357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498066+0000","last_change":"2024-09-17T06:06:14.876736+0000","last_active":"2024-09-17T06:06:22.498066+0000","last_peered":"2024-09-17T06:06:22.498066+0000","last_clean":"2024-09-17T06:06:22.498066+0000","last_became_active":"2024-09-17T06:06:14.875773+0000","last_became_peered":"2024-09-17T06:06:14.875773+0000","last_unstale":"2024-09-17T06:06:22.498066+0000","last_undegraded":"2024-09-17T06:06:22.498066+0000","last_fullsized":"2024-09-17T06:06:22.498066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:52.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.504990+0000","last_change":"2024-09-17T06:04:08.831292+0000","last_active":"2024-09-17T06:06:27.504990+0000","last_peered":"2024-09-17T06:06:27.504990+0000","last_clean":"2024-09-17T06:06:27.504990+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:06:27.504990+0000","last_undegraded":"2024-09-17T06:06:27.504990+0000","last_fullsized":"2024-09-17T06:06:27.504990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:59.405949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501976+0000","last_change":"2024-09-17T06:04:07.855383+0000","last_active":"2024-09-17T06:06:22.501976+0000","last_peered":"2024-09-17T06:06:22.501976+0000","last_clean":"2024-09-17T06:06:22.501976+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:06:22.501976+0000","last_undegraded":"2024-09-17T06:06:22.501976+0000","last_fullsized":"2024-09-17T06:06:22.501976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:46.578513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499225+0000","last_change":"2024-09-17T06:04:13.034486+0000","last_active":"2024-09-17T06:06:22.499225+0000","last_peered":"2024-09-17T06:06:22.499225+0000","last_clean":"2024-09-17T06:06:22.499225+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:06:22.499225+0000","last_undegraded":"2024-09-17T06:06:22.499225+0000","last_fullsized":"2024-09-17T06:06:22.499225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.246058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.549748+0000","last_change":"2024-09-17T06:04:08.856016+0000","last_active":"2024-09-17T06:06:27.549748+0000","last_peered":"2024-09-17T06:06:27.549748+0000","last_clean":"2024-09-17T06:06:27.549748+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:06:27.549748+0000","last_undegraded":"2024-09-17T06:06:27.549748+0000","last_fullsized":"2024-09-17T06:06:27.549748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:04.137529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968198+0000","last_change":"2024-09-17T06:04:07.831896+0000","last_active":"2024-09-17T06:06:21.968198+0000","last_peered":"2024-09-17T06:06:21.968198+0000","last_clean":"2024-09-17T06:06:21.968198+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:06:21.968198+0000","last_undegraded":"2024-09-17T06:06:21.968198+0000","last_fullsized":"2024-09-17T06:06:21.968198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:17.209493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967191+0000","last_change":"2024-09-17T06:06:02.750734+0000","last_active":"2024-09-17T06:06:21.967191+0000","last_peered":"2024-09-17T06:06:21.967191+0000","last_clean":"2024-09-17T06:06:21.967191+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:06:21.967191+0000","last_undegraded":"2024-09-17T06:06:21.967191+0000","last_fullsized":"2024-09-17T06:06:21.967191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:55.436212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.547264+0000","last_change":"2024-09-17T06:06:02.780406+0000","last_active":"2024-09-17T06:06:27.547264+0000","last_peered":"2024-09-17T06:06:27.547264+0000","last_clean":"2024-09-17T06:06:27.547264+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:06:27.547264+0000","last_undegraded":"2024-09-17T06:06:27.547264+0000","last_fullsized":"2024-09-17T06:06:27.547264+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:34.785782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971985+0000","last_change":"2024-09-17T06:04:07.857351+0000","last_active":"2024-09-17T06:06:21.971985+0000","last_peered":"2024-09-17T06:06:21.971985+0000","last_clean":"2024-09-17T06:06:21.971985+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:06:21.971985+0000","last_undegraded":"2024-09-17T06:06:21.971985+0000","last_fullsized":"2024-09-17T06:06:21.971985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:52.231832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967920+0000","last_change":"2024-09-17T06:04:12.948694+0000","last_active":"2024-09-17T06:06:21.967920+0000","last_peered":"2024-09-17T06:06:21.967920+0000","last_clean":"2024-09-17T06:06:21.967920+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:06:21.967920+0000","last_undegraded":"2024-09-17T06:06:21.967920+0000","last_fullsized":"2024-09-17T06:06:21.967920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:08.227561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.494802+0000","last_change":"2024-09-17T06:04:08.831417+0000","last_active":"2024-09-17T06:06:27.494802+0000","last_peered":"2024-09-17T06:06:27.494802+0000","last_clean":"2024-09-17T06:06:27.494802+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:06:27.494802+0000","last_undegraded":"2024-09-17T06:06:27.494802+0000","last_fullsized":"2024-09-17T06:06:27.494802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"62'4","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498551+0000","last_change":"2024-09-17T06:04:07.835926+0000","last_active":"2024-09-17T06:06:22.498551+0000","last_peered":"2024-09-17T06:06:22.498551+0000","last_clean":"2024-09-17T06:06:22.498551+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:06:22.498551+0000","last_undegraded":"2024-09-17T06:06:22.498551+0000","last_fullsized":"2024-09-17T06:06:22.498551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:14.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967511+0000","last_change":"2024-09-17T06:04:12.946990+0000","last_active":"2024-09-17T06:06:21.967511+0000","last_peered":"2024-09-17T06:06:21.967511+0000","last_clean":"2024-09-17T06:06:21.967511+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:06:21.967511+0000","last_undegraded":"2024-09-17T06:06:21.967511+0000","last_fullsized":"2024-09-17T06:06:21.967511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:57.367062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.545291+0000","last_change":"2024-09-17T06:06:02.775030+0000","last_active":"2024-09-17T06:06:27.545291+0000","last_peered":"2024-09-17T06:06:27.545291+0000","last_clean":"2024-09-17T06:06:27.545291+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:06:27.545291+0000","last_undegraded":"2024-09-17T06:06:27.545291+0000","last_fullsized":"2024-09-17T06:06:27.545291+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:56.086542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499602+0000","last_change":"2024-09-17T06:04:07.842724+0000","last_active":"2024-09-17T06:06:22.499602+0000","last_peered":"2024-09-17T06:06:22.499602+0000","last_clean":"2024-09-17T06:06:22.499602+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:06:22.499602+0000","last_undegraded":"2024-09-17T06:06:22.499602+0000","last_fullsized":"2024-09-17T06:06:22.499602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:15.889070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500801+0000","last_change":"2024-09-17T06:04:13.034711+0000","last_active":"2024-09-17T06:06:22.500801+0000","last_peered":"2024-09-17T06:06:22.500801+0000","last_clean":"2024-09-17T06:06:22.500801+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:06:22.500801+0000","last_undegraded":"2024-09-17T06:06:22.500801+0000","last_fullsized":"2024-09-17T06:06:22.500801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:57.745883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.500084+0000","last_change":"2024-09-17T06:06:14.863098+0000","last_active":"2024-09-17T06:06:27.500084+0000","last_peered":"2024-09-17T06:06:27.500084+0000","last_clean":"2024-09-17T06:06:27.500084+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:06:27.500084+0000","last_undegraded":"2024-09-17T06:06:27.500084+0000","last_fullsized":"2024-09-17T06:06:27.500084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:43.199274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.969649+0000","last_change":"2024-09-17T06:04:07.853592+0000","last_active":"2024-09-17T06:06:21.969649+0000","last_peered":"2024-09-17T06:06:21.969649+0000","last_clean":"2024-09-17T06:06:21.969649+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:06:21.969649+0000","last_undegraded":"2024-09-17T06:06:21.969649+0000","last_fullsized":"2024-09-17T06:06:21.969649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:22.469318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":229,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503185+0000","last_change":"2024-09-17T06:03:59.193530+0000","last_active":"2024-09-17T06:06:22.503185+0000","last_peered":"2024-09-17T06:06:22.503185+0000","last_clean":"2024-09-17T06:06:22.503185+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:06:22.503185+0000","last_undegraded":"2024-09-17T06:06:22.503185+0000","last_fullsized":"2024-09-17T06:06:22.503185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:03:57.596752+0000","last_clean_scrub_stamp":"2024-09-17T06:03:57.596752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:55.337263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502700+0000","last_change":"2024-09-17T06:06:02.751844+0000","last_active":"2024-09-17T06:06:22.502700+0000","last_peered":"2024-09-17T06:06:22.502700+0000","last_clean":"2024-09-17T06:06:22.502700+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:06:22.502700+0000","last_undegraded":"2024-09-17T06:06:22.502700+0000","last_fullsized":"2024-09-17T06:06:22.502700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:29.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":122,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.565234+0000","last_change":"2024-09-17T06:04:49.135526+0000","last_active":"2024-09-17T06:06:27.565234+0000","last_peered":"2024-09-17T06:06:27.565234+0000","last_clean":"2024-09-17T06:06:27.565234+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:06:27.565234+0000","last_undegraded":"2024-09-17T06:06:27.565234+0000","last_fullsized":"2024-09-17T06:06:27.565234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:45.338884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499366+0000","last_change":"2024-09-17T06:04:07.857591+0000","last_active":"2024-09-17T06:06:22.499366+0000","last_peered":"2024-09-17T06:06:22.499366+0000","last_clean":"2024-09-17T06:06:22.499366+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:06:22.499366+0000","last_undegraded":"2024-09-17T06:06:22.499366+0000","last_fullsized":"2024-09-17T06:06:22.499366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:39:18.485642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501381+0000","last_change":"2024-09-17T06:04:13.036581+0000","last_active":"2024-09-17T06:06:22.501381+0000","last_peered":"2024-09-17T06:06:22.501381+0000","last_clean":"2024-09-17T06:06:22.501381+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:06:22.501381+0000","last_undegraded":"2024-09-17T06:06:22.501381+0000","last_fullsized":"2024-09-17T06:06:22.501381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:07.345995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.548759+0000","last_change":"2024-09-17T06:04:08.837937+0000","last_active":"2024-09-17T06:06:27.548759+0000","last_peered":"2024-09-17T06:06:27.548759+0000","last_clean":"2024-09-17T06:06:27.548759+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:06:27.548759+0000","last_undegraded":"2024-09-17T06:06:27.548759+0000","last_fullsized":"2024-09-17T06:06:27.548759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:27.374668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968279+0000","last_change":"2024-09-17T06:06:02.750773+0000","last_active":"2024-09-17T06:06:21.968279+0000","last_peered":"2024-09-17T06:06:21.968279+0000","last_clean":"2024-09-17T06:06:21.968279+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:06:21.968279+0000","last_undegraded":"2024-09-17T06:06:21.968279+0000","last_fullsized":"2024-09-17T06:06:21.968279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:40.847404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499934+0000","last_change":"2024-09-17T06:06:02.772644+0000","last_active":"2024-09-17T06:06:22.499934+0000","last_peered":"2024-09-17T06:06:22.499934+0000","last_clean":"2024-09-17T06:06:22.499934+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:06:22.499934+0000","last_undegraded":"2024-09-17T06:06:22.499934+0000","last_fullsized":"2024-09-17T06:06:22.499934+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:29.035665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568314+0000","last_change":"2024-09-17T06:06:02.743237+0000","last_active":"2024-09-17T06:06:27.568314+0000","last_peered":"2024-09-17T06:06:27.568314+0000","last_clean":"2024-09-17T06:06:27.568314+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:06:27.568314+0000","last_undegraded":"2024-09-17T06:06:27.568314+0000","last_fullsized":"2024-09-17T06:06:27.568314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:21.599408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499049+0000","last_change":"2024-09-17T06:04:07.837030+0000","last_active":"2024-09-17T06:06:22.499049+0000","last_peered":"2024-09-17T06:06:22.499049+0000","last_clean":"2024-09-17T06:06:22.499049+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:06:22.499049+0000","last_undegraded":"2024-09-17T06:06:22.499049+0000","last_fullsized":"2024-09-17T06:06:22.499049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:11.362892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970549+0000","last_change":"2024-09-17T06:06:02.749776+0000","last_active":"2024-09-17T06:06:21.970549+0000","last_peered":"2024-09-17T06:06:21.970549+0000","last_clean":"2024-09-17T06:06:21.970549+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:06:21.970549+0000","last_undegraded":"2024-09-17T06:06:21.970549+0000","last_fullsized":"2024-09-17T06:06:21.970549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:14.070869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568383+0000","last_change":"2024-09-17T06:06:02.743241+0000","last_active":"2024-09-17T06:06:27.568383+0000","last_peered":"2024-09-17T06:06:27.568383+0000","last_clean":"2024-09-17T06:06:27.568383+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:06:27.568383+0000","last_undegraded":"2024-09-17T06:06:27.568383+0000","last_fullsized":"2024-09-17T06:06:27.568383+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:24.945633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.972191+0000","last_change":"2024-09-17T06:06:02.747970+0000","last_active":"2024-09-17T06:06:21.972191+0000","last_peered":"2024-09-17T06:06:21.972191+0000","last_clean":"2024-09-17T06:06:21.972191+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:06:21.972191+0000","last_undegraded":"2024-09-17T06:06:21.972191+0000","last_fullsized":"2024-09-17T06:06:21.972191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:01.251626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967658+0000","last_change":"2024-09-17T06:06:02.765641+0000","last_active":"2024-09-17T06:06:21.967658+0000","last_peered":"2024-09-17T06:06:21.967658+0000","last_clean":"2024-09-17T06:06:21.967658+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:06:21.967658+0000","last_undegraded":"2024-09-17T06:06:21.967658+0000","last_fullsized":"2024-09-17T06:06:21.967658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:45.801441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568079+0000","last_change":"2024-09-17T06:06:02.771427+0000","last_active":"2024-09-17T06:06:27.568079+0000","last_peered":"2024-09-17T06:06:27.568079+0000","last_clean":"2024-09-17T06:06:27.568079+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:06:27.568079+0000","last_undegraded":"2024-09-17T06:06:27.568079+0000","last_fullsized":"2024-09-17T06:06:27.568079+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.132428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"62'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498400+0000","last_change":"2024-09-17T06:04:07.833457+0000","last_active":"2024-09-17T06:06:22.498400+0000","last_peered":"2024-09-17T06:06:22.498400+0000","last_clean":"2024-09-17T06:06:22.498400+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:06:22.498400+0000","last_undegraded":"2024-09-17T06:06:22.498400+0000","last_fullsized":"2024-09-17T06:06:22.498400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:39.598827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500027+0000","last_change":"2024-09-17T06:04:12.947108+0000","last_active":"2024-09-17T06:06:22.500027+0000","last_peered":"2024-09-17T06:06:22.500027+0000","last_clean":"2024-09-17T06:06:22.500027+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:06:22.500027+0000","last_undegraded":"2024-09-17T06:06:22.500027+0000","last_fullsized":"2024-09-17T06:06:22.500027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.518926+0000","last_change":"2024-09-17T06:04:08.840722+0000","last_active":"2024-09-17T06:06:27.518926+0000","last_peered":"2024-09-17T06:06:27.518926+0000","last_clean":"2024-09-17T06:06:27.518926+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:06:27.518926+0000","last_undegraded":"2024-09-17T06:06:27.518926+0000","last_fullsized":"2024-09-17T06:06:27.518926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.501692+0000","last_change":"2024-09-17T06:06:02.772623+0000","last_active":"2024-09-17T06:06:22.501692+0000","last_peered":"2024-09-17T06:06:22.501692+0000","last_clean":"2024-09-17T06:06:22.501692+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:22.501692+0000","last_undegraded":"2024-09-17T06:06:22.501692+0000","last_fullsized":"2024-09-17T06:06:22.501692+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:53.767911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500320+0000","last_change":"2024-09-17T06:06:14.883260+0000","last_active":"2024-09-17T06:06:22.500320+0000","last_peered":"2024-09-17T06:06:22.500320+0000","last_clean":"2024-09-17T06:06:22.500320+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:06:22.500320+0000","last_undegraded":"2024-09-17T06:06:22.500320+0000","last_fullsized":"2024-09-17T06:06:22.500320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:01.451360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.568687+0000","last_change":"2024-09-17T06:06:02.767610+0000","last_active":"2024-09-17T06:06:27.568687+0000","last_peered":"2024-09-17T06:06:27.568687+0000","last_clean":"2024-09-17T06:06:27.568687+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:06:27.568687+0000","last_undegraded":"2024-09-17T06:06:27.568687+0000","last_fullsized":"2024-09-17T06:06:27.568687+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:54.779217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971946+0000","last_change":"2024-09-17T06:04:07.857330+0000","last_active":"2024-09-17T06:06:21.971946+0000","last_peered":"2024-09-17T06:06:21.971946+0000","last_clean":"2024-09-17T06:06:21.971946+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:06:21.971946+0000","last_undegraded":"2024-09-17T06:06:21.971946+0000","last_fullsized":"2024-09-17T06:06:21.971946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:06.217349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500361+0000","last_change":"2024-09-17T06:06:15.372083+0000","last_active":"2024-09-17T06:06:22.500361+0000","last_peered":"2024-09-17T06:06:22.500361+0000","last_clean":"2024-09-17T06:06:22.500361+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:06:22.500361+0000","last_undegraded":"2024-09-17T06:06:22.500361+0000","last_fullsized":"2024-09-17T06:06:22.500361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:53.468260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.554841+0000","last_change":"2024-09-17T06:04:08.843624+0000","last_active":"2024-09-17T06:06:27.554841+0000","last_peered":"2024-09-17T06:06:27.554841+0000","last_clean":"2024-09-17T06:06:27.554841+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:06:27.554841+0000","last_undegraded":"2024-09-17T06:06:27.554841+0000","last_fullsized":"2024-09-17T06:06:27.554841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:37.383440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500005+0000","last_change":"2024-09-17T06:06:02.772342+0000","last_active":"2024-09-17T06:06:22.500005+0000","last_peered":"2024-09-17T06:06:22.500005+0000","last_clean":"2024-09-17T06:06:22.500005+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:06:22.500005+0000","last_undegraded":"2024-09-17T06:06:22.500005+0000","last_fullsized":"2024-09-17T06:06:22.500005+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:36.591645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970221+0000","last_change":"2024-09-17T06:04:13.036456+0000","last_active":"2024-09-17T06:06:21.970221+0000","last_peered":"2024-09-17T06:06:21.970221+0000","last_clean":"2024-09-17T06:06:21.970221+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:06:21.970221+0000","last_undegraded":"2024-09-17T06:06:21.970221+0000","last_fullsized":"2024-09-17T06:06:21.970221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:28.077841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.564616+0000","last_change":"2024-09-17T06:04:08.853259+0000","last_active":"2024-09-17T06:06:27.564616+0000","last_peered":"2024-09-17T06:06:27.564616+0000","last_clean":"2024-09-17T06:06:27.564616+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:06:27.564616+0000","last_undegraded":"2024-09-17T06:06:27.564616+0000","last_fullsized":"2024-09-17T06:06:27.564616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:39.779319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.522395+0000","last_change":"2024-09-17T06:04:07.846181+0000","last_active":"2024-09-17T06:06:27.522395+0000","last_peered":"2024-09-17T06:06:27.522395+0000","last_clean":"2024-09-17T06:06:27.522395+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:06:27.522395+0000","last_undegraded":"2024-09-17T06:06:27.522395+0000","last_fullsized":"2024-09-17T06:06:27.522395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:28.580921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.967772+0000","last_change":"2024-09-17T06:04:12.954132+0000","last_active":"2024-09-17T06:06:21.967772+0000","last_peered":"2024-09-17T06:06:21.967772+0000","last_clean":"2024-09-17T06:06:21.967772+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:06:21.967772+0000","last_undegraded":"2024-09-17T06:06:21.967772+0000","last_fullsized":"2024-09-17T06:06:21.967772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:49.495764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.566590+0000","last_change":"2024-09-17T06:06:02.778195+0000","last_active":"2024-09-17T06:06:27.566590+0000","last_peered":"2024-09-17T06:06:27.566590+0000","last_clean":"2024-09-17T06:06:27.566590+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:06:27.566590+0000","last_undegraded":"2024-09-17T06:06:27.566590+0000","last_fullsized":"2024-09-17T06:06:27.566590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:41.521760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"62'7","reported_seq":116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970857+0000","last_change":"2024-09-17T06:05:20.635633+0000","last_active":"2024-09-17T06:06:21.970857+0000","last_peered":"2024-09-17T06:06:21.970857+0000","last_clean":"2024-09-17T06:06:21.970857+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:06:21.970857+0000","last_undegraded":"2024-09-17T06:06:21.970857+0000","last_fullsized":"2024-09-17T06:06:21.970857+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:42.262918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":59,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.968250+0000","last_change":"2024-09-17T06:06:02.762076+0000","last_active":"2024-09-17T06:06:21.968250+0000","last_peered":"2024-09-17T06:06:21.968250+0000","last_clean":"2024-09-17T06:06:21.968250+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:06:21.968250+0000","last_undegraded":"2024-09-17T06:06:21.968250+0000","last_fullsized":"2024-09-17T06:06:21.968250+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:12.436619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.559749+0000","last_change":"2024-09-17T06:04:08.840697+0000","last_active":"2024-09-17T06:06:27.559749+0000","last_peered":"2024-09-17T06:06:27.559749+0000","last_clean":"2024-09-17T06:06:27.559749+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:06:27.559749+0000","last_undegraded":"2024-09-17T06:06:27.559749+0000","last_fullsized":"2024-09-17T06:06:27.559749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.970909+0000","last_change":"2024-09-17T06:04:07.852622+0000","last_active":"2024-09-17T06:06:21.970909+0000","last_peered":"2024-09-17T06:06:21.970909+0000","last_clean":"2024-09-17T06:06:21.970909+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:06:21.970909+0000","last_undegraded":"2024-09-17T06:06:21.970909+0000","last_fullsized":"2024-09-17T06:06:21.970909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:25.610065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498270+0000","last_change":"2024-09-17T06:06:14.879517+0000","last_active":"2024-09-17T06:06:22.498270+0000","last_peered":"2024-09-17T06:06:22.498270+0000","last_clean":"2024-09-17T06:06:22.498270+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:06:22.498270+0000","last_undegraded":"2024-09-17T06:06:22.498270+0000","last_fullsized":"2024-09-17T06:06:22.498270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:59.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574612+0000","last_change":"2024-09-17T06:04:08.846993+0000","last_active":"2024-09-17T06:06:27.574612+0000","last_peered":"2024-09-17T06:06:27.574612+0000","last_clean":"2024-09-17T06:06:27.574612+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:06:27.574612+0000","last_undegraded":"2024-09-17T06:06:27.574612+0000","last_fullsized":"2024-09-17T06:06:27.574612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:35.117742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.503060+0000","last_change":"2024-09-17T06:04:07.859435+0000","last_active":"2024-09-17T06:06:22.503060+0000","last_peered":"2024-09-17T06:06:22.503060+0000","last_clean":"2024-09-17T06:06:22.503060+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:06:22.503060+0000","last_undegraded":"2024-09-17T06:06:22.503060+0000","last_fullsized":"2024-09-17T06:06:22.503060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.145833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498442+0000","last_change":"2024-09-17T06:06:14.881955+0000","last_active":"2024-09-17T06:06:22.498442+0000","last_peered":"2024-09-17T06:06:22.498442+0000","last_clean":"2024-09-17T06:06:22.498442+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:06:22.498442+0000","last_undegraded":"2024-09-17T06:06:22.498442+0000","last_fullsized":"2024-09-17T06:06:22.498442+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:31.787475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499845+0000","last_change":"2024-09-17T06:04:13.040310+0000","last_active":"2024-09-17T06:06:22.499845+0000","last_peered":"2024-09-17T06:06:22.499845+0000","last_clean":"2024-09-17T06:06:22.499845+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:06:22.499845+0000","last_undegraded":"2024-09-17T06:06:22.499845+0000","last_fullsized":"2024-09-17T06:06:22.499845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:40.955572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.542729+0000","last_change":"2024-09-17T06:04:08.833250+0000","last_active":"2024-09-17T06:06:27.542729+0000","last_peered":"2024-09-17T06:06:27.542729+0000","last_clean":"2024-09-17T06:06:27.542729+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:06:27.542729+0000","last_undegraded":"2024-09-17T06:06:27.542729+0000","last_fullsized":"2024-09-17T06:06:27.542729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:05.522456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:21.971365+0000","last_change":"2024-09-17T06:06:02.751465+0000","last_active":"2024-09-17T06:06:21.971365+0000","last_peered":"2024-09-17T06:06:21.971365+0000","last_clean":"2024-09-17T06:06:21.971365+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:06:21.971365+0000","last_undegraded":"2024-09-17T06:06:21.971365+0000","last_fullsized":"2024-09-17T06:06:21.971365+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:15.399241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502473+0000","last_change":"2024-09-17T06:04:12.961507+0000","last_active":"2024-09-17T06:06:22.502473+0000","last_peered":"2024-09-17T06:06:22.502473+0000","last_clean":"2024-09-17T06:06:22.502473+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:06:22.502473+0000","last_undegraded":"2024-09-17T06:06:22.502473+0000","last_fullsized":"2024-09-17T06:06:22.502473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:03.501856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.537194+0000","last_change":"2024-09-17T06:06:14.876329+0000","last_active":"2024-09-17T06:06:27.537194+0000","last_peered":"2024-09-17T06:06:27.537194+0000","last_clean":"2024-09-17T06:06:27.537194+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:06:27.537194+0000","last_undegraded":"2024-09-17T06:06:27.537194+0000","last_fullsized":"2024-09-17T06:06:27.537194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:44.076246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.498602+0000","last_change":"2024-09-17T06:06:14.883367+0000","last_active":"2024-09-17T06:06:22.498602+0000","last_peered":"2024-09-17T06:06:22.498602+0000","last_clean":"2024-09-17T06:06:22.498602+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:06:22.498602+0000","last_undegraded":"2024-09-17T06:06:22.498602+0000","last_fullsized":"2024-09-17T06:06:22.498602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:34.486361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.502031+0000","last_change":"2024-09-17T06:06:02.753865+0000","last_active":"2024-09-17T06:06:22.502031+0000","last_peered":"2024-09-17T06:06:22.502031+0000","last_clean":"2024-09-17T06:06:22.502031+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:06:22.502031+0000","last_undegraded":"2024-09-17T06:06:22.502031+0000","last_fullsized":"2024-09-17T06:06:22.502031+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:02.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.547358+0000","last_change":"2024-09-17T06:06:02.774846+0000","last_active":"2024-09-17T06:06:27.547358+0000","last_peered":"2024-09-17T06:06:27.547358+0000","last_clean":"2024-09-17T06:06:27.547358+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:06:27.547358+0000","last_undegraded":"2024-09-17T06:06:27.547358+0000","last_fullsized":"2024-09-17T06:06:27.547358+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:03.871862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499002+0000","last_change":"2024-09-17T06:04:12.949632+0000","last_active":"2024-09-17T06:06:22.499002+0000","last_peered":"2024-09-17T06:06:22.499002+0000","last_clean":"2024-09-17T06:06:22.499002+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:06:22.499002+0000","last_undegraded":"2024-09-17T06:06:22.499002+0000","last_fullsized":"2024-09-17T06:06:22.499002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.095718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.499972+0000","last_change":"2024-09-17T06:06:14.874567+0000","last_active":"2024-09-17T06:06:22.499972+0000","last_peered":"2024-09-17T06:06:22.499972+0000","last_clean":"2024-09-17T06:06:22.499972+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:06:22.499972+0000","last_undegraded":"2024-09-17T06:06:22.499972+0000","last_fullsized":"2024-09-17T06:06:22.499972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:06.782599+0000","last_clean_scrub_stamp":"2024-09-17T06:04:06.782599+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:16.000785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.555058+0000","last_change":"2024-09-17T06:06:02.747397+0000","last_active":"2024-09-17T06:06:27.555058+0000","last_peered":"2024-09-17T06:06:27.555058+0000","last_clean":"2024-09-17T06:06:27.555058+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:06:27.555058+0000","last_undegraded":"2024-09-17T06:06:27.555058+0000","last_fullsized":"2024-09-17T06:06:27.555058+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:35.982291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":116,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:22.500463+0000","last_change":"2024-09-17T06:06:15.371993+0000","last_active":"2024-09-17T06:06:22.500463+0000","last_peered":"2024-09-17T06:06:22.500463+0000","last_clean":"2024-09-17T06:06:22.500463+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:06:22.500463+0000","last_undegraded":"2024-09-17T06:06:22.500463+0000","last_fullsized":"2024-09-17T06:06:22.500463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:36.359097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.551299+0000","last_change":"2024-09-17T06:04:08.840599+0000","last_active":"2024-09-17T06:06:27.551299+0000","last_peered":"2024-09-17T06:06:27.551299+0000","last_clean":"2024-09-17T06:06:27.551299+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:06:27.551299+0000","last_undegraded":"2024-09-17T06:06:27.551299+0000","last_fullsized":"2024-09-17T06:06:27.551299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:21.538107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.563391+0000","last_change":"2024-09-17T06:04:08.842771+0000","last_active":"2024-09-17T06:06:27.563391+0000","last_peered":"2024-09-17T06:06:27.563391+0000","last_clean":"2024-09-17T06:06:27.563391+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:06:27.563391+0000","last_undegraded":"2024-09-17T06:06:27.563391+0000","last_fullsized":"2024-09-17T06:06:27.563391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.553626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.552660+0000","last_change":"2024-09-17T06:04:08.851707+0000","last_active":"2024-09-17T06:06:27.552660+0000","last_peered":"2024-09-17T06:06:27.552660+0000","last_clean":"2024-09-17T06:06:27.552660+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:06:27.552660+0000","last_undegraded":"2024-09-17T06:06:27.552660+0000","last_fullsized":"2024-09-17T06:06:27.552660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:32.163518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.527615+0000","last_change":"2024-09-17T06:04:08.854402+0000","last_active":"2024-09-17T06:06:27.527615+0000","last_peered":"2024-09-17T06:06:27.527615+0000","last_clean":"2024-09-17T06:06:27.527615+0000","last_became_active":"2024-09-17T06:04:08.854082+0000","last_became_peered":"2024-09-17T06:04:08.854082+0000","last_unstale":"2024-09-17T06:06:27.527615+0000","last_undegraded":"2024-09-17T06:06:27.527615+0000","last_fullsized":"2024-09-17T06:06:27.527615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:08.378053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":103,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.548572+0000","last_change":"2024-09-17T06:06:14.862875+0000","last_active":"2024-09-17T06:06:27.548572+0000","last_peered":"2024-09-17T06:06:27.548572+0000","last_clean":"2024-09-17T06:06:27.548572+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:06:27.548572+0000","last_undegraded":"2024-09-17T06:06:27.548572+0000","last_fullsized":"2024-09-17T06:06:27.548572+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:58.805589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.531497+0000","last_change":"2024-09-17T06:04:08.836840+0000","last_active":"2024-09-17T06:06:27.531497+0000","last_peered":"2024-09-17T06:06:27.531497+0000","last_clean":"2024-09-17T06:06:27.531497+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:06:27.531497+0000","last_undegraded":"2024-09-17T06:06:27.531497+0000","last_fullsized":"2024-09-17T06:06:27.531497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:16.913529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.573178+0000","last_change":"2024-09-17T06:04:08.850928+0000","last_active":"2024-09-17T06:06:27.573178+0000","last_peered":"2024-09-17T06:06:27.573178+0000","last_clean":"2024-09-17T06:06:27.573178+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:06:27.573178+0000","last_undegraded":"2024-09-17T06:06:27.573178+0000","last_fullsized":"2024-09-17T06:06:27.573178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:49.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.519555+0000","last_change":"2024-09-17T06:06:14.869993+0000","last_active":"2024-09-17T06:06:27.519555+0000","last_peered":"2024-09-17T06:06:27.519555+0000","last_clean":"2024-09-17T06:06:27.519555+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:06:27.519555+0000","last_undegraded":"2024-09-17T06:06:27.519555+0000","last_fullsized":"2024-09-17T06:06:27.519555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:10.143503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.552477+0000","last_change":"2024-09-17T06:05:13.535655+0000","last_active":"2024-09-17T06:06:27.552477+0000","last_peered":"2024-09-17T06:06:27.552477+0000","last_clean":"2024-09-17T06:06:27.552477+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:06:27.552477+0000","last_undegraded":"2024-09-17T06:06:27.552477+0000","last_fullsized":"2024-09-17T06:06:27.552477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:26.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.547204+0000","last_change":"2024-09-17T06:06:14.862354+0000","last_active":"2024-09-17T06:06:27.547204+0000","last_peered":"2024-09-17T06:06:27.547204+0000","last_clean":"2024-09-17T06:06:27.547204+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:06:27.547204+0000","last_undegraded":"2024-09-17T06:06:27.547204+0000","last_fullsized":"2024-09-17T06:06:27.547204+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:57.348056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574065+0000","last_change":"2024-09-17T06:04:08.846294+0000","last_active":"2024-09-17T06:06:27.574065+0000","last_peered":"2024-09-17T06:06:27.574065+0000","last_clean":"2024-09-17T06:06:27.574065+0000","last_became_active":"2024-09-17T06:04:08.845883+0000","last_became_peered":"2024-09-17T06:04:08.845883+0000","last_unstale":"2024-09-17T06:06:27.574065+0000","last_undegraded":"2024-09-17T06:06:27.574065+0000","last_fullsized":"2024-09-17T06:06:27.574065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.551870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.536183+0000","last_change":"2024-09-17T06:04:08.842395+0000","last_active":"2024-09-17T06:06:27.536183+0000","last_peered":"2024-09-17T06:06:27.536183+0000","last_clean":"2024-09-17T06:06:27.536183+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:06:27.536183+0000","last_undegraded":"2024-09-17T06:06:27.536183+0000","last_fullsized":"2024-09-17T06:06:27.536183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.557127+0000","last_change":"2024-09-17T06:06:02.781690+0000","last_active":"2024-09-17T06:06:27.557127+0000","last_peered":"2024-09-17T06:06:27.557127+0000","last_clean":"2024-09-17T06:06:27.557127+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:06:27.557127+0000","last_undegraded":"2024-09-17T06:06:27.557127+0000","last_fullsized":"2024-09-17T06:06:27.557127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:50.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.544249+0000","last_change":"2024-09-17T06:04:08.838804+0000","last_active":"2024-09-17T06:06:27.544249+0000","last_peered":"2024-09-17T06:06:27.544249+0000","last_clean":"2024-09-17T06:06:27.544249+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:06:27.544249+0000","last_undegraded":"2024-09-17T06:06:27.544249+0000","last_fullsized":"2024-09-17T06:06:27.544249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:21.870289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.551918+0000","last_change":"2024-09-17T06:04:08.845114+0000","last_active":"2024-09-17T06:06:27.551918+0000","last_peered":"2024-09-17T06:06:27.551918+0000","last_clean":"2024-09-17T06:06:27.551918+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:06:27.551918+0000","last_undegraded":"2024-09-17T06:06:27.551918+0000","last_fullsized":"2024-09-17T06:06:27.551918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.727982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574667+0000","last_change":"2024-09-17T06:04:08.852271+0000","last_active":"2024-09-17T06:06:27.574667+0000","last_peered":"2024-09-17T06:06:27.574667+0000","last_clean":"2024-09-17T06:06:27.574667+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:06:27.574667+0000","last_undegraded":"2024-09-17T06:06:27.574667+0000","last_fullsized":"2024-09-17T06:06:27.574667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:41:45.405732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.553238+0000","last_change":"2024-09-17T06:04:08.840410+0000","last_active":"2024-09-17T06:06:27.553238+0000","last_peered":"2024-09-17T06:06:27.553238+0000","last_clean":"2024-09-17T06:06:27.553238+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:06:27.553238+0000","last_undegraded":"2024-09-17T06:06:27.553238+0000","last_fullsized":"2024-09-17T06:06:27.553238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:01.522681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.532776+0000","last_change":"2024-09-17T06:06:02.777396+0000","last_active":"2024-09-17T06:06:27.532776+0000","last_peered":"2024-09-17T06:06:27.532776+0000","last_clean":"2024-09-17T06:06:27.532776+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:06:27.532776+0000","last_undegraded":"2024-09-17T06:06:27.532776+0000","last_fullsized":"2024-09-17T06:06:27.532776+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:28.787647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.543210+0000","last_change":"2024-09-17T06:04:08.843141+0000","last_active":"2024-09-17T06:06:27.543210+0000","last_peered":"2024-09-17T06:06:27.543210+0000","last_clean":"2024-09-17T06:06:27.543210+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:06:27.543210+0000","last_undegraded":"2024-09-17T06:06:27.543210+0000","last_fullsized":"2024-09-17T06:06:27.543210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:21.341662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.551631+0000","last_change":"2024-09-17T06:06:14.882860+0000","last_active":"2024-09-17T06:06:27.551631+0000","last_peered":"2024-09-17T06:06:27.551631+0000","last_clean":"2024-09-17T06:06:27.551631+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:06:27.551631+0000","last_undegraded":"2024-09-17T06:06:27.551631+0000","last_fullsized":"2024-09-17T06:06:27.551631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:07.158141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.558120+0000","last_change":"2024-09-17T06:06:02.776605+0000","last_active":"2024-09-17T06:06:27.558120+0000","last_peered":"2024-09-17T06:06:27.558120+0000","last_clean":"2024-09-17T06:06:27.558120+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:06:27.558120+0000","last_undegraded":"2024-09-17T06:06:27.558120+0000","last_fullsized":"2024-09-17T06:06:27.558120+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:55.566930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.562118+0000","last_change":"2024-09-17T06:04:08.840082+0000","last_active":"2024-09-17T06:06:27.562118+0000","last_peered":"2024-09-17T06:06:27.562118+0000","last_clean":"2024-09-17T06:06:27.562118+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:06:27.562118+0000","last_undegraded":"2024-09-17T06:06:27.562118+0000","last_fullsized":"2024-09-17T06:06:27.562118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.803879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.564166+0000","last_change":"2024-09-17T06:04:08.844523+0000","last_active":"2024-09-17T06:06:27.564166+0000","last_peered":"2024-09-17T06:06:27.564166+0000","last_clean":"2024-09-17T06:06:27.564166+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:06:27.564166+0000","last_undegraded":"2024-09-17T06:06:27.564166+0000","last_fullsized":"2024-09-17T06:06:27.564166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:15.647871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.574397+0000","last_change":"2024-09-17T06:04:08.852521+0000","last_active":"2024-09-17T06:06:27.574397+0000","last_peered":"2024-09-17T06:06:27.574397+0000","last_clean":"2024-09-17T06:06:27.574397+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:06:27.574397+0000","last_undegraded":"2024-09-17T06:06:27.574397+0000","last_fullsized":"2024-09-17T06:06:27.574397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:49.418873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.553454+0000","last_change":"2024-09-17T06:06:14.863779+0000","last_active":"2024-09-17T06:06:27.553454+0000","last_peered":"2024-09-17T06:06:27.553454+0000","last_clean":"2024-09-17T06:06:27.553454+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:06:27.553454+0000","last_undegraded":"2024-09-17T06:06:27.553454+0000","last_fullsized":"2024-09-17T06:06:27.553454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:41.626998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.527586+0000","last_change":"2024-09-17T06:04:08.839575+0000","last_active":"2024-09-17T06:06:27.527586+0000","last_peered":"2024-09-17T06:06:27.527586+0000","last_clean":"2024-09-17T06:06:27.527586+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:06:27.527586+0000","last_undegraded":"2024-09-17T06:06:27.527586+0000","last_fullsized":"2024-09-17T06:06:27.527586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:42.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.553590+0000","last_change":"2024-09-17T06:04:08.840887+0000","last_active":"2024-09-17T06:06:27.553590+0000","last_peered":"2024-09-17T06:06:27.553590+0000","last_clean":"2024-09-17T06:06:27.553590+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:06:27.553590+0000","last_undegraded":"2024-09-17T06:06:27.553590+0000","last_fullsized":"2024-09-17T06:06:27.553590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:01.100928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.554203+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:06:27.554203+0000","last_peered":"2024-09-17T06:06:27.554203+0000","last_clean":"2024-09-17T06:06:27.554203+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:06:27.554203+0000","last_undegraded":"2024-09-17T06:06:27.554203+0000","last_fullsized":"2024-09-17T06:06:27.554203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:55.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.554038+0000","last_change":"2024-09-17T06:04:08.856180+0000","last_active":"2024-09-17T06:06:27.554038+0000","last_peered":"2024-09-17T06:06:27.554038+0000","last_clean":"2024-09-17T06:06:27.554038+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:06:27.554038+0000","last_undegraded":"2024-09-17T06:06:27.554038+0000","last_fullsized":"2024-09-17T06:06:27.554038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:17.180740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.541975+0000","last_change":"2024-09-17T06:04:08.839606+0000","last_active":"2024-09-17T06:06:27.541975+0000","last_peered":"2024-09-17T06:06:27.541975+0000","last_clean":"2024-09-17T06:06:27.541975+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:06:27.541975+0000","last_undegraded":"2024-09-17T06:06:27.541975+0000","last_fullsized":"2024-09-17T06:06:27.541975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:23.400691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.492171+0000","last_change":"2024-09-17T06:04:08.839678+0000","last_active":"2024-09-17T06:06:27.492171+0000","last_peered":"2024-09-17T06:06:27.492171+0000","last_clean":"2024-09-17T06:06:27.492171+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:06:27.492171+0000","last_undegraded":"2024-09-17T06:06:27.492171+0000","last_fullsized":"2024-09-17T06:06:27.492171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:59.462842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T06:06:27.569630+0000","last_change":"2024-09-17T06:04:08.854141+0000","last_active":"2024-09-17T06:06:27.569630+0000","last_peered":"2024-09-17T06:06:27.569630+0000","last_clean":"2024-09-17T06:06:27.569630+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:06:27.569630+0000","last_undegraded":"2024-09-17T06:06:27.569630+0000","last_fullsized":"2024-09-17T06:06:27.569630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:59.411825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":995328,"data_stored":530556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":494218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1556480,"data_stored":1084902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1544192,"data_stored":1084756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":530144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906953,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28984,"kb_used_data":936,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342856,"statfs":{"total":96636764160,"available":96607084544,"internally_reserved":0,"allocated":958464,"data_stored":493932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509478,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":493876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":950272,"data_stored":493896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:06:41.326 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.326 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.326 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.326 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.326 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.326 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.326 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.327 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.327 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.327 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.327 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.327 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.327 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.327 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.327 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.328 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.328 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.328 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.328 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.328 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.328 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.328 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.328 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.329 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.329 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.329 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.329 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.329 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.329 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.329 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.329 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.330 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.330 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.330 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.330 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.330 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.330 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.330 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.330 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.331 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.331 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.331 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.331 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.331 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.331 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.331 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.331 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.332 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T06:03:57.596752+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=3, tm_sec=57, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.332 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.332 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.332 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.332 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.332 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.332 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.332 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.333 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.333 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.333 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.333 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.333 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.333 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.333 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.333 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.334 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.334 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.334 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.334 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.334 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.334 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.334 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.334 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.335 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.335 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.335 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.335 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.335 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.335 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.335 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.335 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.336 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.336 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.336 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.336 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.336 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.336 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.336 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.336 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.337 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.337 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.337 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.337 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.337 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.337 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.337 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.337 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-17T06:04:06.782599+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.338 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.338 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.338 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.338 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.338 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.338 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.338 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.338 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.339 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.339 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.339 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.339 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.339 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.339 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.339 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.339 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.340 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.340 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.340 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.340 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.340 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.340 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.340 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.340 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.341 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.341 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.341 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.341 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.341 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.341 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.341 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.341 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.342 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.342 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:06:41.342 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T06:07:01.343 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:07:01.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.512+0000 7f023a45a640 1 -- 172.21.15.122:0/1526672798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02340c8740 msgr2=0x7f0234152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:01.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.512+0000 7f023a45a640 1 --2- 172.21.15.122:0/1526672798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02340c8740 0x7f0234152360 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f02340c7720 tx=0x7f022401f0b0 comp rx=0 tx=0).stop 2024-09-17T06:07:01.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.512+0000 7f023a45a640 1 -- 172.21.15.122:0/1526672798 shutdown_connections 2024-09-17T06:07:01.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.512+0000 7f023a45a640 1 --2- 172.21.15.122:0/1526672798 >> v2:172.21.15.173:3300/0 conn(0x7f02340c2870 0x7f02340cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:01.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.512+0000 7f023a45a640 1 --2- 172.21.15.122:0/1526672798 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02340cd7d0 0x7f023415b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:01.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.512+0000 7f023a45a640 1 --2- 172.21.15.122:0/1526672798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02340c8740 0x7f0234152360 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:01.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.512+0000 7f023a45a640 1 -- 172.21.15.122:0/1526672798 >> 172.21.15.122:0/1526672798 conn(0x7f023406d8f0 msgr2=0x7f023406dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:07:01.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.512+0000 7f023a45a640 1 -- 172.21.15.122:0/1526672798 shutdown_connections 2024-09-17T06:07:01.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.512+0000 7f023a45a640 1 -- 172.21.15.122:0/1526672798 wait complete. 2024-09-17T06:07:01.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.512+0000 7f023a45a640 1 Processor -- start 2024-09-17T06:07:01.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.512+0000 7f023a45a640 1 -- start start 2024-09-17T06:07:01.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f023a45a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02340c2870 0x7f02341f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:07:01.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f023a45a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02340c8740 0x7f023413da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:07:01.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f023a45a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02340cd7d0 0x7f023413df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:07:01.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f023a45a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f02340c3290 con 0x7f02340c2870 2024-09-17T06:07:01.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f023a45a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f02340c94f0 con 0x7f02340cd7d0 2024-09-17T06:07:01.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f023a45a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f02340c2c80 con 0x7f02340c8740 2024-09-17T06:07:01.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0233fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02340c2870 0x7f02341f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:07:01.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0233fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02340c2870 0x7f02341f00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37018/0 (socket says 172.21.15.122:37018) 2024-09-17T06:07:01.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0233fff640 1 -- 172.21.15.122:0/4203124134 learned_addr learned my addr 172.21.15.122:0/4203124134 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:07:01.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f02337fe640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02340c8740 0x7f023413da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:07:01.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f02389f7640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02340cd7d0 0x7f023413df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:07:01.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0233fff640 1 -- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02340c8740 msgr2=0x7f023413da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:01.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0233fff640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02340c8740 0x7f023413da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:01.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0233fff640 1 -- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02340cd7d0 msgr2=0x7f023413df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:01.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0233fff640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02340cd7d0 0x7f023413df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:01.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0233fff640 1 -- 172.21.15.122:0/4203124134 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02341f0620 con 0x7f02340c2870 2024-09-17T06:07:01.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f02389f7640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02340cd7d0 0x7f023413df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:07:01.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0233fff640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02340c2870 0x7f02341f00e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f02240b3040 tx=0x7f0224005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:07:01.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0230ff9640 1 -- 172.21.15.122:0/4203124134 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02240b5040 con 0x7f02340c2870 2024-09-17T06:07:01.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0230ff9640 1 -- 172.21.15.122:0/4203124134 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0224005320 con 0x7f02340c2870 2024-09-17T06:07:01.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f023a45a640 1 -- 172.21.15.122:0/4203124134 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02341f3d00 con 0x7f02340c2870 2024-09-17T06:07:01.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0230ff9640 1 -- 172.21.15.122:0/4203124134 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02240046d0 con 0x7f02340c2870 2024-09-17T06:07:01.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f023a45a640 1 -- 172.21.15.122:0/4203124134 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02340cb340 con 0x7f02340c2870 2024-09-17T06:07:01.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f023a45a640 1 -- 172.21.15.122:0/4203124134 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f023406f0f0 con 0x7f02340c2870 2024-09-17T06:07:01.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0230ff9640 1 -- 172.21.15.122:0/4203124134 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0224004890 con 0x7f02340c2870 2024-09-17T06:07:01.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.516+0000 7f0230ff9640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f021c073200 0x7f021c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:07:01.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.520+0000 7f0230ff9640 1 -- 172.21.15.122:0/4203124134 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6825+0+0 (secure 0 0 0) 0x7f0224131af0 con 0x7f02340c2870 2024-09-17T06:07:01.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.520+0000 7f02337fe640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f021c073200 0x7f021c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:07:01.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.520+0000 7f02337fe640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f021c073200 0x7f021c075710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f02341470e0 tx=0x7f022000c3c0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:07:01.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.524+0000 7f0230ff9640 1 -- 172.21.15.122:0/4203124134 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f02240c1060 con 0x7f02340c2870 2024-09-17T06:07:01.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.688+0000 7f023a45a640 1 -- 172.21.15.122:0/4203124134 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f023406d3b0 con 0x7f021c073200 2024-09-17T06:07:01.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.704+0000 7f0230ff9640 1 -- 172.21.15.122:0/4203124134 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332834 (secure 0 0 0) 0x7f023406d3b0 con 0x7f021c073200 2024-09-17T06:07:01.707 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:07:01.710 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:07:01.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.708+0000 7f023a45a640 1 -- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f021c073200 msgr2=0x7f021c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:01.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.708+0000 7f023a45a640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f021c073200 0x7f021c075710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f02341470e0 tx=0x7f022000c3c0 comp rx=0 tx=0).stop 2024-09-17T06:07:01.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.708+0000 7f023a45a640 1 -- 172.21.15.122:0/4203124134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02340c2870 msgr2=0x7f02341f00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:01.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.708+0000 7f023a45a640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02340c2870 0x7f02341f00e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f02240b3040 tx=0x7f0224005d80 comp rx=0 tx=0).stop 2024-09-17T06:07:01.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.708+0000 7f023a45a640 1 -- 172.21.15.122:0/4203124134 shutdown_connections 2024-09-17T06:07:01.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.708+0000 7f023a45a640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f021c073200 0x7f021c075710 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:01.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.708+0000 7f023a45a640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02340cd7d0 0x7f023413df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:01.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.708+0000 7f023a45a640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f02340c8740 0x7f023413da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:01.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.708+0000 7f023a45a640 1 --2- 172.21.15.122:0/4203124134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02340c2870 0x7f02341f00e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:01.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.708+0000 7f023a45a640 1 -- 172.21.15.122:0/4203124134 >> 172.21.15.122:0/4203124134 conn(0x7f023406d8f0 msgr2=0x7f023414bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:07:01.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.708+0000 7f023a45a640 1 -- 172.21.15.122:0/4203124134 shutdown_connections 2024-09-17T06:07:01.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:01.708+0000 7f023a45a640 1 -- 172.21.15.122:0/4203124134 wait complete. 2024-09-17T06:07:01.731 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-09-17T06:07:01.586105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246896,"kb_used_data":8880,"kb_used_omap":17,"kb_used_meta":237870,"kb_avail":754727824,"statfs":{"total":773094113280,"available":772841291776,"internally_reserved":0,"allocated":9093120,"data_stored":5319704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":243579629},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.842435"},"pg_stats":[{"pgid":"2.1f","version":"81'6","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.746227+0000","last_change":"2024-09-17T06:06:38.646633+0000","last_active":"2024-09-17T06:06:49.746227+0000","last_peered":"2024-09-17T06:06:49.746227+0000","last_clean":"2024-09-17T06:06:49.746227+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:06:49.746227+0000","last_undegraded":"2024-09-17T06:06:49.746227+0000","last_fullsized":"2024-09-17T06:06:49.746227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.646522+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:55.373873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751997+0000","last_change":"2024-09-17T06:06:47.678984+0000","last_active":"2024-09-17T06:06:49.751997+0000","last_peered":"2024-09-17T06:06:49.751997+0000","last_clean":"2024-09-17T06:06:49.751997+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:06:49.751997+0000","last_undegraded":"2024-09-17T06:06:49.751997+0000","last_fullsized":"2024-09-17T06:06:49.751997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.678793+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:31.584591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:55.606541+0000","last_change":"2024-09-17T06:06:55.606541+0000","last_active":"2024-09-17T06:06:55.606541+0000","last_peered":"2024-09-17T06:06:55.606541+0000","last_clean":"2024-09-17T06:06:55.606541+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:06:55.606541+0000","last_undegraded":"2024-09-17T06:06:55.606541+0000","last_fullsized":"2024-09-17T06:06:55.606541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.606346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:05.514205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":75,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.752147+0000","last_change":"2024-09-17T06:06:41.626922+0000","last_active":"2024-09-17T06:06:49.752147+0000","last_peered":"2024-09-17T06:06:49.752147+0000","last_clean":"2024-09-17T06:06:49.752147+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:06:49.752147+0000","last_undegraded":"2024-09-17T06:06:49.752147+0000","last_fullsized":"2024-09-17T06:06:49.752147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.626723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:41.581056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.745096+0000","last_change":"2024-09-17T06:06:42.561017+0000","last_active":"2024-09-17T06:06:49.745096+0000","last_peered":"2024-09-17T06:06:49.745096+0000","last_clean":"2024-09-17T06:06:49.745096+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:06:49.745096+0000","last_undegraded":"2024-09-17T06:06:49.745096+0000","last_fullsized":"2024-09-17T06:06:49.745096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.560815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:06.386417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.581741+0000","last_change":"2024-09-17T06:06:50.581741+0000","last_active":"2024-09-17T06:06:50.581741+0000","last_peered":"2024-09-17T06:06:50.581741+0000","last_clean":"2024-09-17T06:06:50.581741+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:06:50.581741+0000","last_undegraded":"2024-09-17T06:06:50.581741+0000","last_fullsized":"2024-09-17T06:06:50.581741+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.581526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:27.538796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.758705+0000","last_change":"2024-09-17T06:06:44.503792+0000","last_active":"2024-09-17T06:06:49.758705+0000","last_peered":"2024-09-17T06:06:49.758705+0000","last_clean":"2024-09-17T06:06:49.758705+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:06:49.758705+0000","last_undegraded":"2024-09-17T06:06:49.758705+0000","last_fullsized":"2024-09-17T06:06:49.758705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.503569+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.329171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751579+0000","last_change":"2024-09-17T06:06:49.490282+0000","last_active":"2024-09-17T06:06:49.751579+0000","last_peered":"2024-09-17T06:06:49.751579+0000","last_clean":"2024-09-17T06:06:49.751579+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:49.751579+0000","last_undegraded":"2024-09-17T06:06:49.751579+0000","last_fullsized":"2024-09-17T06:06:49.751579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.490084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:52.911935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.542004+0000","last_change":"2024-09-17T06:06:51.542004+0000","last_active":"2024-09-17T06:06:51.542004+0000","last_peered":"2024-09-17T06:06:51.542004+0000","last_clean":"2024-09-17T06:06:51.542004+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:06:51.542004+0000","last_undegraded":"2024-09-17T06:06:51.542004+0000","last_fullsized":"2024-09-17T06:06:51.542004+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.541795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.542454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.758374+0000","last_change":"2024-09-17T06:06:45.535472+0000","last_active":"2024-09-17T06:06:49.758374+0000","last_peered":"2024-09-17T06:06:49.758374+0000","last_clean":"2024-09-17T06:06:49.758374+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:06:49.758374+0000","last_undegraded":"2024-09-17T06:06:49.758374+0000","last_fullsized":"2024-09-17T06:06:49.758374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.535262+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:56.606861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754011+0000","last_change":"2024-09-17T06:06:45.459635+0000","last_active":"2024-09-17T06:06:49.754011+0000","last_peered":"2024-09-17T06:06:49.754011+0000","last_clean":"2024-09-17T06:06:49.754011+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:06:49.754011+0000","last_undegraded":"2024-09-17T06:06:49.754011+0000","last_fullsized":"2024-09-17T06:06:49.754011+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.459406+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:41.152666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.519889+0000","last_change":"2024-09-17T06:06:52.519889+0000","last_active":"2024-09-17T06:06:52.519889+0000","last_peered":"2024-09-17T06:06:52.519889+0000","last_clean":"2024-09-17T06:06:52.519889+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:06:52.519889+0000","last_undegraded":"2024-09-17T06:06:52.519889+0000","last_fullsized":"2024-09-17T06:06:52.519889+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.519692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:06.562811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.857797+0000","last_change":"2024-09-17T06:06:46.282925+0000","last_active":"2024-09-17T06:06:49.857797+0000","last_peered":"2024-09-17T06:06:49.857797+0000","last_clean":"2024-09-17T06:06:49.857797+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:06:49.857797+0000","last_undegraded":"2024-09-17T06:06:49.857797+0000","last_fullsized":"2024-09-17T06:06:49.857797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.282607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:45.646843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":159,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.758127+0000","last_change":"2024-09-17T06:06:47.578055+0000","last_active":"2024-09-17T06:06:49.758127+0000","last_peered":"2024-09-17T06:06:49.758127+0000","last_clean":"2024-09-17T06:06:49.758127+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:06:49.758127+0000","last_undegraded":"2024-09-17T06:06:49.758127+0000","last_fullsized":"2024-09-17T06:06:49.758127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.577825+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:54.466675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":86,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749786+0000","last_change":"2024-09-17T06:06:48.564278+0000","last_active":"2024-09-17T06:06:49.749786+0000","last_peered":"2024-09-17T06:06:49.749786+0000","last_clean":"2024-09-17T06:06:49.749786+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:06:49.749786+0000","last_undegraded":"2024-09-17T06:06:49.749786+0000","last_fullsized":"2024-09-17T06:06:49.749786+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.564076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:09.526182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750307+0000","last_change":"2024-09-17T06:06:45.719909+0000","last_active":"2024-09-17T06:06:49.750307+0000","last_peered":"2024-09-17T06:06:49.750307+0000","last_clean":"2024-09-17T06:06:49.750307+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:06:49.750307+0000","last_undegraded":"2024-09-17T06:06:49.750307+0000","last_fullsized":"2024-09-17T06:06:49.750307+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.719724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:58.812630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860343+0000","last_change":"2024-09-17T06:06:39.054952+0000","last_active":"2024-09-17T06:06:49.860343+0000","last_peered":"2024-09-17T06:06:49.860343+0000","last_clean":"2024-09-17T06:06:49.860343+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:06:49.860343+0000","last_undegraded":"2024-09-17T06:06:49.860343+0000","last_fullsized":"2024-09-17T06:06:49.860343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.054879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:22.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751397+0000","last_change":"2024-09-17T06:06:47.595782+0000","last_active":"2024-09-17T06:06:49.751397+0000","last_peered":"2024-09-17T06:06:49.751397+0000","last_clean":"2024-09-17T06:06:49.751397+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:06:49.751397+0000","last_undegraded":"2024-09-17T06:06:49.751397+0000","last_fullsized":"2024-09-17T06:06:49.751397+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.595562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.305297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749806+0000","last_change":"2024-09-17T06:06:44.685583+0000","last_active":"2024-09-17T06:06:49.749806+0000","last_peered":"2024-09-17T06:06:49.749806+0000","last_clean":"2024-09-17T06:06:49.749806+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:06:49.749806+0000","last_undegraded":"2024-09-17T06:06:49.749806+0000","last_fullsized":"2024-09-17T06:06:49.749806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.685386+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:42.733827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859499+0000","last_change":"2024-09-17T06:06:41.096528+0000","last_active":"2024-09-17T06:06:49.859499+0000","last_peered":"2024-09-17T06:06:49.859499+0000","last_clean":"2024-09-17T06:06:49.859499+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:06:49.859499+0000","last_undegraded":"2024-09-17T06:06:49.859499+0000","last_fullsized":"2024-09-17T06:06:49.859499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.096443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.182798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.955862+0000","last_change":"2024-09-17T06:06:51.955862+0000","last_active":"2024-09-17T06:06:51.955862+0000","last_peered":"2024-09-17T06:06:51.955862+0000","last_clean":"2024-09-17T06:06:51.955862+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:06:51.955862+0000","last_undegraded":"2024-09-17T06:06:51.955862+0000","last_fullsized":"2024-09-17T06:06:51.955862+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.955662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.579450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":68,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.747588+0000","last_change":"2024-09-17T06:06:41.561023+0000","last_active":"2024-09-17T06:06:49.747588+0000","last_peered":"2024-09-17T06:06:49.747588+0000","last_clean":"2024-09-17T06:06:49.747588+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:06:49.747588+0000","last_undegraded":"2024-09-17T06:06:49.747588+0000","last_fullsized":"2024-09-17T06:06:49.747588+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.560833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:35.979151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.569920+0000","last_change":"2024-09-17T06:06:51.569920+0000","last_active":"2024-09-17T06:06:51.569920+0000","last_peered":"2024-09-17T06:06:51.569920+0000","last_clean":"2024-09-17T06:06:51.569920+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:06:51.569920+0000","last_undegraded":"2024-09-17T06:06:51.569920+0000","last_fullsized":"2024-09-17T06:06:51.569920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.569724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:16.044884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.534994+0000","last_change":"2024-09-17T06:06:54.534994+0000","last_active":"2024-09-17T06:06:54.534994+0000","last_peered":"2024-09-17T06:06:54.534994+0000","last_clean":"2024-09-17T06:06:54.534994+0000","last_became_active":"2024-09-17T06:06:49.862233+0000","last_became_peered":"2024-09-17T06:06:49.862233+0000","last_unstale":"2024-09-17T06:06:54.534994+0000","last_undegraded":"2024-09-17T06:06:54.534994+0000","last_fullsized":"2024-09-17T06:06:54.534994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.534811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:53.555338+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.534811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:09.975013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,1],"acting":[4,2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.745160+0000","last_change":"2024-09-17T06:06:39.595362+0000","last_active":"2024-09-17T06:06:49.745160+0000","last_peered":"2024-09-17T06:06:49.745160+0000","last_clean":"2024-09-17T06:06:49.745160+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:06:49.745160+0000","last_undegraded":"2024-09-17T06:06:49.745160+0000","last_fullsized":"2024-09-17T06:06:49.745160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.595150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:36.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860025+0000","last_change":"2024-09-17T06:06:41.345210+0000","last_active":"2024-09-17T06:06:49.860025+0000","last_peered":"2024-09-17T06:06:49.860025+0000","last_clean":"2024-09-17T06:06:49.860025+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:06:49.860025+0000","last_undegraded":"2024-09-17T06:06:49.860025+0000","last_fullsized":"2024-09-17T06:06:49.860025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.345015+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:38.207077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748131+0000","last_change":"2024-09-17T06:06:44.540629+0000","last_active":"2024-09-17T06:06:49.748131+0000","last_peered":"2024-09-17T06:06:49.748131+0000","last_clean":"2024-09-17T06:06:49.748131+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:06:49.748131+0000","last_undegraded":"2024-09-17T06:06:49.748131+0000","last_fullsized":"2024-09-17T06:06:49.748131+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.540426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:03.473101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751833+0000","last_change":"2024-09-17T06:06:43.669448+0000","last_active":"2024-09-17T06:06:49.751833+0000","last_peered":"2024-09-17T06:06:49.751833+0000","last_clean":"2024-09-17T06:06:49.751833+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:06:49.751833+0000","last_undegraded":"2024-09-17T06:06:49.751833+0000","last_fullsized":"2024-09-17T06:06:49.751833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.669209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:54.877316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.861170+0000","last_change":"2024-09-17T06:06:38.067895+0000","last_active":"2024-09-17T06:06:49.861170+0000","last_peered":"2024-09-17T06:06:49.861170+0000","last_clean":"2024-09-17T06:06:49.861170+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:06:49.861170+0000","last_undegraded":"2024-09-17T06:06:49.861170+0000","last_fullsized":"2024-09-17T06:06:49.861170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.067715+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:26.508119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:56.651636+0000","last_change":"2024-09-17T06:06:56.651636+0000","last_active":"2024-09-17T06:06:56.651636+0000","last_peered":"2024-09-17T06:06:56.651636+0000","last_clean":"2024-09-17T06:06:56.651636+0000","last_became_active":"2024-09-17T06:06:14.875773+0000","last_became_peered":"2024-09-17T06:06:14.875773+0000","last_unstale":"2024-09-17T06:06:56.651636+0000","last_undegraded":"2024-09-17T06:06:56.651636+0000","last_fullsized":"2024-09-17T06:06:56.651636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.651441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:44.887864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860941+0000","last_change":"2024-09-17T06:06:45.060936+0000","last_active":"2024-09-17T06:06:49.860941+0000","last_peered":"2024-09-17T06:06:49.860941+0000","last_clean":"2024-09-17T06:06:49.860941+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:06:49.860941+0000","last_undegraded":"2024-09-17T06:06:49.860941+0000","last_fullsized":"2024-09-17T06:06:49.860941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.060719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:03.842916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.759038+0000","last_change":"2024-09-17T06:06:43.537259+0000","last_active":"2024-09-17T06:06:49.759038+0000","last_peered":"2024-09-17T06:06:49.759038+0000","last_clean":"2024-09-17T06:06:49.759038+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:06:49.759038+0000","last_undegraded":"2024-09-17T06:06:49.759038+0000","last_fullsized":"2024-09-17T06:06:49.759038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.537064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:53.557183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.588334+0000","last_change":"2024-09-17T06:06:50.588334+0000","last_active":"2024-09-17T06:06:50.588334+0000","last_peered":"2024-09-17T06:06:50.588334+0000","last_clean":"2024-09-17T06:06:50.588334+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:06:50.588334+0000","last_undegraded":"2024-09-17T06:06:50.588334+0000","last_fullsized":"2024-09-17T06:06:50.588334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.588146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:34.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.752542+0000","last_change":"2024-09-17T06:06:45.560755+0000","last_active":"2024-09-17T06:06:49.752542+0000","last_peered":"2024-09-17T06:06:49.752542+0000","last_clean":"2024-09-17T06:06:49.752542+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:06:49.752542+0000","last_undegraded":"2024-09-17T06:06:49.752542+0000","last_fullsized":"2024-09-17T06:06:49.752542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.560562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.352415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.861038+0000","last_change":"2024-09-17T06:06:40.077709+0000","last_active":"2024-09-17T06:06:49.861038+0000","last_peered":"2024-09-17T06:06:49.861038+0000","last_clean":"2024-09-17T06:06:49.861038+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:06:49.861038+0000","last_undegraded":"2024-09-17T06:06:49.861038+0000","last_fullsized":"2024-09-17T06:06:49.861038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.077616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:13.235085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.943563+0000","last_change":"2024-09-17T06:06:50.943563+0000","last_active":"2024-09-17T06:06:50.943563+0000","last_peered":"2024-09-17T06:06:50.943563+0000","last_clean":"2024-09-17T06:06:50.943563+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:06:50.943563+0000","last_undegraded":"2024-09-17T06:06:50.943563+0000","last_fullsized":"2024-09-17T06:06:50.943563+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.943366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.661632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750143+0000","last_change":"2024-09-17T06:06:39.544246+0000","last_active":"2024-09-17T06:06:49.750143+0000","last_peered":"2024-09-17T06:06:49.750143+0000","last_clean":"2024-09-17T06:06:49.750143+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:06:49.750143+0000","last_undegraded":"2024-09-17T06:06:49.750143+0000","last_fullsized":"2024-09-17T06:06:49.750143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.544002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:04.906600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748659+0000","last_change":"2024-09-17T06:06:41.601594+0000","last_active":"2024-09-17T06:06:49.748659+0000","last_peered":"2024-09-17T06:06:49.748659+0000","last_clean":"2024-09-17T06:06:49.748659+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:06:49.748659+0000","last_undegraded":"2024-09-17T06:06:49.748659+0000","last_fullsized":"2024-09-17T06:06:49.748659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.601393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.687748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.922504+0000","last_change":"2024-09-17T06:06:49.922504+0000","last_active":"2024-09-17T06:06:49.922504+0000","last_peered":"2024-09-17T06:06:49.922504+0000","last_clean":"2024-09-17T06:06:49.922504+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:06:49.922504+0000","last_undegraded":"2024-09-17T06:06:49.922504+0000","last_fullsized":"2024-09-17T06:06:49.922504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.922302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:53.344154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859489+0000","last_change":"2024-09-17T06:06:42.067931+0000","last_active":"2024-09-17T06:06:49.859489+0000","last_peered":"2024-09-17T06:06:49.859489+0000","last_clean":"2024-09-17T06:06:49.859489+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:06:49.859489+0000","last_undegraded":"2024-09-17T06:06:49.859489+0000","last_fullsized":"2024-09-17T06:06:49.859489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.067737+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.818001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754080+0000","last_change":"2024-09-17T06:06:38.338953+0000","last_active":"2024-09-17T06:06:49.754080+0000","last_peered":"2024-09-17T06:06:49.754080+0000","last_clean":"2024-09-17T06:06:49.754080+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:06:49.754080+0000","last_undegraded":"2024-09-17T06:06:49.754080+0000","last_fullsized":"2024-09-17T06:06:49.754080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.338737+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:58.670904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.861218+0000","last_change":"2024-09-17T06:06:47.938470+0000","last_active":"2024-09-17T06:06:49.861218+0000","last_peered":"2024-09-17T06:06:49.861218+0000","last_clean":"2024-09-17T06:06:49.861218+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:06:49.861218+0000","last_undegraded":"2024-09-17T06:06:49.861218+0000","last_fullsized":"2024-09-17T06:06:49.861218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.938263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.607027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.743075+0000","last_change":"2024-09-17T06:06:41.585374+0000","last_active":"2024-09-17T06:06:49.743075+0000","last_peered":"2024-09-17T06:06:49.743075+0000","last_clean":"2024-09-17T06:06:49.743075+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:06:49.743075+0000","last_undegraded":"2024-09-17T06:06:49.743075+0000","last_fullsized":"2024-09-17T06:06:49.743075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.585183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:11.929990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.756619+0000","last_change":"2024-09-17T06:06:42.536575+0000","last_active":"2024-09-17T06:06:49.756619+0000","last_peered":"2024-09-17T06:06:49.756619+0000","last_clean":"2024-09-17T06:06:49.756619+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:06:49.756619+0000","last_undegraded":"2024-09-17T06:06:49.756619+0000","last_fullsized":"2024-09-17T06:06:49.756619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.536371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:23.547872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744757+0000","last_change":"2024-09-17T06:06:47.627398+0000","last_active":"2024-09-17T06:06:49.744757+0000","last_peered":"2024-09-17T06:06:49.744757+0000","last_clean":"2024-09-17T06:06:49.744757+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:06:49.744757+0000","last_undegraded":"2024-09-17T06:06:49.744757+0000","last_fullsized":"2024-09-17T06:06:49.744757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.627188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:28.206295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750147+0000","last_change":"2024-09-17T06:06:42.642781+0000","last_active":"2024-09-17T06:06:49.750147+0000","last_peered":"2024-09-17T06:06:49.750147+0000","last_clean":"2024-09-17T06:06:49.750147+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:06:49.750147+0000","last_undegraded":"2024-09-17T06:06:49.750147+0000","last_fullsized":"2024-09-17T06:06:49.750147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.642468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:03.874053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749362+0000","last_change":"2024-09-17T06:06:40.563124+0000","last_active":"2024-09-17T06:06:49.749362+0000","last_peered":"2024-09-17T06:06:49.749362+0000","last_clean":"2024-09-17T06:06:49.749362+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:06:49.749362+0000","last_undegraded":"2024-09-17T06:06:49.749362+0000","last_fullsized":"2024-09-17T06:06:49.749362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.562781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:51.528772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"81'74","reported_seq":243,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.756962+0000","last_change":"2024-09-17T06:06:41.529207+0000","last_active":"2024-09-17T06:06:49.756962+0000","last_peered":"2024-09-17T06:06:49.756962+0000","last_clean":"2024-09-17T06:06:49.756962+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:06:49.756962+0000","last_undegraded":"2024-09-17T06:06:49.756962+0000","last_fullsized":"2024-09-17T06:06:49.756962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'74","last_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_deep_scrub":"81'74","last_deep_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.529006+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:17.811347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.168189+0000","last_change":"2024-09-17T06:06:50.168189+0000","last_active":"2024-09-17T06:06:50.168189+0000","last_peered":"2024-09-17T06:06:50.168189+0000","last_clean":"2024-09-17T06:06:50.168189+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:06:50.168189+0000","last_undegraded":"2024-09-17T06:06:50.168189+0000","last_fullsized":"2024-09-17T06:06:50.168189+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.167993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:53.277144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754170+0000","last_change":"2024-09-17T06:06:46.470862+0000","last_active":"2024-09-17T06:06:49.754170+0000","last_peered":"2024-09-17T06:06:49.754170+0000","last_clean":"2024-09-17T06:06:49.754170+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:06:49.754170+0000","last_undegraded":"2024-09-17T06:06:49.754170+0000","last_fullsized":"2024-09-17T06:06:49.754170+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.470640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:54.803752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754535+0000","last_change":"2024-09-17T06:06:39.308543+0000","last_active":"2024-09-17T06:06:49.754535+0000","last_peered":"2024-09-17T06:06:49.754535+0000","last_clean":"2024-09-17T06:06:49.754535+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:06:49.754535+0000","last_undegraded":"2024-09-17T06:06:49.754535+0000","last_fullsized":"2024-09-17T06:06:49.754535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.308468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:26.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":135,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:55.194732+0000","last_change":"2024-09-17T06:06:55.194732+0000","last_active":"2024-09-17T06:06:55.194732+0000","last_peered":"2024-09-17T06:06:55.194732+0000","last_clean":"2024-09-17T06:06:55.194732+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:06:55.194732+0000","last_undegraded":"2024-09-17T06:06:55.194732+0000","last_fullsized":"2024-09-17T06:06:55.194732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.194477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:46.395618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751826+0000","last_change":"2024-09-17T06:06:47.481798+0000","last_active":"2024-09-17T06:06:49.751826+0000","last_peered":"2024-09-17T06:06:49.751826+0000","last_clean":"2024-09-17T06:06:49.751826+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:06:49.751826+0000","last_undegraded":"2024-09-17T06:06:49.751826+0000","last_fullsized":"2024-09-17T06:06:49.751826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.481588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.150352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860641+0000","last_change":"2024-09-17T06:06:43.064298+0000","last_active":"2024-09-17T06:06:49.860641+0000","last_peered":"2024-09-17T06:06:49.860641+0000","last_clean":"2024-09-17T06:06:49.860641+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:06:49.860641+0000","last_undegraded":"2024-09-17T06:06:49.860641+0000","last_fullsized":"2024-09-17T06:06:49.860641+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.064096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:30.993498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.593990+0000","last_change":"2024-09-17T06:06:52.593990+0000","last_active":"2024-09-17T06:06:52.593990+0000","last_peered":"2024-09-17T06:06:52.593990+0000","last_clean":"2024-09-17T06:06:52.593990+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:06:52.593990+0000","last_undegraded":"2024-09-17T06:06:52.593990+0000","last_fullsized":"2024-09-17T06:06:52.593990+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.593787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:04.850781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.758420+0000","last_change":"2024-09-17T06:06:46.576306+0000","last_active":"2024-09-17T06:06:49.758420+0000","last_peered":"2024-09-17T06:06:49.758420+0000","last_clean":"2024-09-17T06:06:49.758420+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:06:49.758420+0000","last_undegraded":"2024-09-17T06:06:49.758420+0000","last_fullsized":"2024-09-17T06:06:49.758420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:36.552616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'3","reported_seq":147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754961+0000","last_change":"2024-09-17T06:06:40.289371+0000","last_active":"2024-09-17T06:06:49.754961+0000","last_peered":"2024-09-17T06:06:49.754961+0000","last_clean":"2024-09-17T06:06:49.754961+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:06:49.754961+0000","last_undegraded":"2024-09-17T06:06:49.754961+0000","last_fullsized":"2024-09-17T06:06:49.754961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.289195+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.187275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:57.580034+0000","last_change":"2024-09-17T06:06:57.580034+0000","last_active":"2024-09-17T06:06:57.580034+0000","last_peered":"2024-09-17T06:06:57.580034+0000","last_clean":"2024-09-17T06:06:57.580034+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:06:57.580034+0000","last_undegraded":"2024-09-17T06:06:57.580034+0000","last_fullsized":"2024-09-17T06:06:57.580034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.579707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:15.990501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:53.554156+0000","last_change":"2024-09-17T06:06:53.554156+0000","last_active":"2024-09-17T06:06:53.554156+0000","last_peered":"2024-09-17T06:06:53.554156+0000","last_clean":"2024-09-17T06:06:53.554156+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:06:53.554156+0000","last_undegraded":"2024-09-17T06:06:53.554156+0000","last_fullsized":"2024-09-17T06:06:53.554156+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.553919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:37.374837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749434+0000","last_change":"2024-09-17T06:06:40.545470+0000","last_active":"2024-09-17T06:06:49.749434+0000","last_peered":"2024-09-17T06:06:49.749434+0000","last_clean":"2024-09-17T06:06:49.749434+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:06:49.749434+0000","last_undegraded":"2024-09-17T06:06:49.749434+0000","last_fullsized":"2024-09-17T06:06:49.749434+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.545271+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:41.942375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748456+0000","last_change":"2024-09-17T06:06:46.553900+0000","last_active":"2024-09-17T06:06:49.748456+0000","last_peered":"2024-09-17T06:06:49.748456+0000","last_clean":"2024-09-17T06:06:49.748456+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:06:49.748456+0000","last_undegraded":"2024-09-17T06:06:49.748456+0000","last_fullsized":"2024-09-17T06:06:49.748456+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.553594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:37.347089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.757000+0000","last_change":"2024-09-17T06:06:49.557072+0000","last_active":"2024-09-17T06:06:49.757000+0000","last_peered":"2024-09-17T06:06:49.757000+0000","last_clean":"2024-09-17T06:06:49.757000+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:06:49.757000+0000","last_undegraded":"2024-09-17T06:06:49.757000+0000","last_fullsized":"2024-09-17T06:06:49.757000+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.556746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:02.173527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'13","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.753380+0000","last_change":"2024-09-17T06:06:41.327726+0000","last_active":"2024-09-17T06:06:49.753380+0000","last_peered":"2024-09-17T06:06:49.753380+0000","last_clean":"2024-09-17T06:06:49.753380+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:06:49.753380+0000","last_undegraded":"2024-09-17T06:06:49.753380+0000","last_fullsized":"2024-09-17T06:06:49.753380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'13","last_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_deep_scrub":"81'13","last_deep_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.327620+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:41.975086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744584+0000","last_change":"2024-09-17T06:06:48.590089+0000","last_active":"2024-09-17T06:06:49.744584+0000","last_peered":"2024-09-17T06:06:49.744584+0000","last_clean":"2024-09-17T06:06:49.744584+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:06:49.744584+0000","last_undegraded":"2024-09-17T06:06:49.744584+0000","last_fullsized":"2024-09-17T06:06:49.744584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.589881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:13.065040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.857805+0000","last_change":"2024-09-17T06:06:47.234619+0000","last_active":"2024-09-17T06:06:49.857805+0000","last_peered":"2024-09-17T06:06:49.857805+0000","last_clean":"2024-09-17T06:06:49.857805+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:06:49.857805+0000","last_undegraded":"2024-09-17T06:06:49.857805+0000","last_fullsized":"2024-09-17T06:06:49.857805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.234392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:10.297041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.858044+0000","last_change":"2024-09-17T06:06:42.362985+0000","last_active":"2024-09-17T06:06:49.858044+0000","last_peered":"2024-09-17T06:06:49.858044+0000","last_clean":"2024-09-17T06:06:49.858044+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:49.858044+0000","last_undegraded":"2024-09-17T06:06:49.858044+0000","last_fullsized":"2024-09-17T06:06:49.858044+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.362795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:21.306942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.645399+0000","last_change":"2024-09-17T06:06:54.645399+0000","last_active":"2024-09-17T06:06:54.645399+0000","last_peered":"2024-09-17T06:06:54.645399+0000","last_clean":"2024-09-17T06:06:54.645399+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:06:54.645399+0000","last_undegraded":"2024-09-17T06:06:54.645399+0000","last_fullsized":"2024-09-17T06:06:54.645399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.645200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:04.728298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":167,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.757580+0000","last_change":"2024-09-17T06:06:48.595269+0000","last_active":"2024-09-17T06:06:49.757580+0000","last_peered":"2024-09-17T06:06:49.757580+0000","last_clean":"2024-09-17T06:06:49.757580+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:06:49.757580+0000","last_undegraded":"2024-09-17T06:06:49.757580+0000","last_fullsized":"2024-09-17T06:06:49.757580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.595073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:51.297831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748599+0000","last_change":"2024-09-17T06:06:42.583243+0000","last_active":"2024-09-17T06:06:49.748599+0000","last_peered":"2024-09-17T06:06:49.748599+0000","last_clean":"2024-09-17T06:06:49.748599+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:06:49.748599+0000","last_undegraded":"2024-09-17T06:06:49.748599+0000","last_fullsized":"2024-09-17T06:06:49.748599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.583048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:54.333313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750564+0000","last_change":"2024-09-17T06:06:15.372083+0000","last_active":"2024-09-17T06:06:49.750564+0000","last_peered":"2024-09-17T06:06:49.750564+0000","last_clean":"2024-09-17T06:06:49.750564+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:06:49.750564+0000","last_undegraded":"2024-09-17T06:06:49.750564+0000","last_fullsized":"2024-09-17T06:06:49.750564+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":153,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744169+0000","last_change":"2024-09-17T06:06:45.591584+0000","last_active":"2024-09-17T06:06:49.744169+0000","last_peered":"2024-09-17T06:06:49.744169+0000","last_clean":"2024-09-17T06:06:49.744169+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:06:49.744169+0000","last_undegraded":"2024-09-17T06:06:49.744169+0000","last_fullsized":"2024-09-17T06:06:49.744169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.591276+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:08.653925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":159,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744538+0000","last_change":"2024-09-17T06:06:37.667757+0000","last_active":"2024-09-17T06:06:49.744538+0000","last_peered":"2024-09-17T06:06:49.744538+0000","last_clean":"2024-09-17T06:06:49.744538+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:06:49.744538+0000","last_undegraded":"2024-09-17T06:06:49.744538+0000","last_fullsized":"2024-09-17T06:06:49.744538+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_clean_scrub_stamp":"2024-09-17T06:06:37.667675+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:46.885860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:56.615164+0000","last_change":"2024-09-17T06:06:56.615164+0000","last_active":"2024-09-17T06:06:56.615164+0000","last_peered":"2024-09-17T06:06:56.615164+0000","last_clean":"2024-09-17T06:06:56.615164+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:06:56.615164+0000","last_undegraded":"2024-09-17T06:06:56.615164+0000","last_fullsized":"2024-09-17T06:06:56.615164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.614970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:07.482666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.577732+0000","last_change":"2024-09-17T06:06:52.577732+0000","last_active":"2024-09-17T06:06:52.577732+0000","last_peered":"2024-09-17T06:06:52.577732+0000","last_clean":"2024-09-17T06:06:52.577732+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:06:52.577732+0000","last_undegraded":"2024-09-17T06:06:52.577732+0000","last_fullsized":"2024-09-17T06:06:52.577732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.577533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:34.161856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":169,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.858709+0000","last_change":"2024-09-17T06:06:43.358428+0000","last_active":"2024-09-17T06:06:49.858709+0000","last_peered":"2024-09-17T06:06:49.858709+0000","last_clean":"2024-09-17T06:06:49.858709+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:06:49.858709+0000","last_undegraded":"2024-09-17T06:06:49.858709+0000","last_fullsized":"2024-09-17T06:06:49.858709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'27","last_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_deep_scrub":"81'27","last_deep_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.358219+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:13.703025+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":140,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.944474+0000","last_change":"2024-09-17T06:06:52.944474+0000","last_active":"2024-09-17T06:06:52.944474+0000","last_peered":"2024-09-17T06:06:52.944474+0000","last_clean":"2024-09-17T06:06:52.944474+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:06:52.944474+0000","last_undegraded":"2024-09-17T06:06:52.944474+0000","last_fullsized":"2024-09-17T06:06:52.944474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.944213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.533972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":77,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750311+0000","last_change":"2024-09-17T06:06:43.557285+0000","last_active":"2024-09-17T06:06:49.750311+0000","last_peered":"2024-09-17T06:06:49.750311+0000","last_clean":"2024-09-17T06:06:49.750311+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:06:49.750311+0000","last_undegraded":"2024-09-17T06:06:49.750311+0000","last_fullsized":"2024-09-17T06:06:49.750311+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.557090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:01.412234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"81'9","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.752887+0000","last_change":"2024-09-17T06:06:43.599342+0000","last_active":"2024-09-17T06:06:49.752887+0000","last_peered":"2024-09-17T06:06:49.752887+0000","last_clean":"2024-09-17T06:06:49.752887+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:06:49.752887+0000","last_undegraded":"2024-09-17T06:06:49.752887+0000","last_fullsized":"2024-09-17T06:06:49.752887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.599114+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:49.432076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749353+0000","last_change":"2024-09-17T06:06:49.561761+0000","last_active":"2024-09-17T06:06:49.749353+0000","last_peered":"2024-09-17T06:06:49.749353+0000","last_clean":"2024-09-17T06:06:49.749353+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:06:49.749353+0000","last_undegraded":"2024-09-17T06:06:49.749353+0000","last_fullsized":"2024-09-17T06:06:49.749353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.561572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:15.208406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":153,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.746162+0000","last_change":"2024-09-17T06:06:40.581076+0000","last_active":"2024-09-17T06:06:49.746162+0000","last_peered":"2024-09-17T06:06:49.746162+0000","last_clean":"2024-09-17T06:06:49.746162+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:06:49.746162+0000","last_undegraded":"2024-09-17T06:06:49.746162+0000","last_fullsized":"2024-09-17T06:06:49.746162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.580978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:19.525125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.753149+0000","last_change":"2024-09-17T06:06:44.589361+0000","last_active":"2024-09-17T06:06:49.753149+0000","last_peered":"2024-09-17T06:06:49.753149+0000","last_clean":"2024-09-17T06:06:49.753149+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:06:49.753149+0000","last_undegraded":"2024-09-17T06:06:49.753149+0000","last_fullsized":"2024-09-17T06:06:49.753149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.589149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.705503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":105,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749605+0000","last_change":"2024-09-17T06:06:14.879517+0000","last_active":"2024-09-17T06:06:49.749605+0000","last_peered":"2024-09-17T06:06:49.749605+0000","last_clean":"2024-09-17T06:06:49.749605+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:06:49.749605+0000","last_undegraded":"2024-09-17T06:06:49.749605+0000","last_fullsized":"2024-09-17T06:06:49.749605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":153,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.752815+0000","last_change":"2024-09-17T06:06:48.493667+0000","last_active":"2024-09-17T06:06:49.752815+0000","last_peered":"2024-09-17T06:06:49.752815+0000","last_clean":"2024-09-17T06:06:49.752815+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:06:49.752815+0000","last_undegraded":"2024-09-17T06:06:49.752815+0000","last_fullsized":"2024-09-17T06:06:49.752815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.493470+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.837170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859785+0000","last_change":"2024-09-17T06:06:44.333474+0000","last_active":"2024-09-17T06:06:49.859785+0000","last_peered":"2024-09-17T06:06:49.859785+0000","last_clean":"2024-09-17T06:06:49.859785+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:06:49.859785+0000","last_undegraded":"2024-09-17T06:06:49.859785+0000","last_fullsized":"2024-09-17T06:06:49.859785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.333150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.158751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.699338+0000","last_change":"2024-09-17T06:06:52.699338+0000","last_active":"2024-09-17T06:06:52.699338+0000","last_peered":"2024-09-17T06:06:52.699338+0000","last_clean":"2024-09-17T06:06:52.699338+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:06:52.699338+0000","last_undegraded":"2024-09-17T06:06:52.699338+0000","last_fullsized":"2024-09-17T06:06:52.699338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.699134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:51.626769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.743506+0000","last_change":"2024-09-17T06:06:49.633934+0000","last_active":"2024-09-17T06:06:49.743506+0000","last_peered":"2024-09-17T06:06:49.743506+0000","last_clean":"2024-09-17T06:06:49.743506+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:06:49.743506+0000","last_undegraded":"2024-09-17T06:06:49.743506+0000","last_fullsized":"2024-09-17T06:06:49.743506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.633660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.217982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859138+0000","last_change":"2024-09-17T06:06:46.974853+0000","last_active":"2024-09-17T06:06:49.859138+0000","last_peered":"2024-09-17T06:06:49.859138+0000","last_clean":"2024-09-17T06:06:49.859138+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:06:49.859138+0000","last_undegraded":"2024-09-17T06:06:49.859138+0000","last_fullsized":"2024-09-17T06:06:49.859138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.974637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:26.337532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748920+0000","last_change":"2024-09-17T06:06:46.527438+0000","last_active":"2024-09-17T06:06:49.748920+0000","last_peered":"2024-09-17T06:06:49.748920+0000","last_clean":"2024-09-17T06:06:49.748920+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:06:49.748920+0000","last_undegraded":"2024-09-17T06:06:49.748920+0000","last_fullsized":"2024-09-17T06:06:49.748920+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.527230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:25.890125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":135,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.199209+0000","last_change":"2024-09-17T06:06:54.199209+0000","last_active":"2024-09-17T06:06:54.199209+0000","last_peered":"2024-09-17T06:06:54.199209+0000","last_clean":"2024-09-17T06:06:54.199209+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:06:54.199209+0000","last_undegraded":"2024-09-17T06:06:54.199209+0000","last_fullsized":"2024-09-17T06:06:54.199209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.198989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:51.609301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749502+0000","last_change":"2024-09-17T06:06:46.699017+0000","last_active":"2024-09-17T06:06:49.749502+0000","last_peered":"2024-09-17T06:06:49.749502+0000","last_clean":"2024-09-17T06:06:49.749502+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:06:49.749502+0000","last_undegraded":"2024-09-17T06:06:49.749502+0000","last_fullsized":"2024-09-17T06:06:49.749502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.698821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:33.586359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":74,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751839+0000","last_change":"2024-09-17T06:06:40.624617+0000","last_active":"2024-09-17T06:06:49.751839+0000","last_peered":"2024-09-17T06:06:49.751839+0000","last_clean":"2024-09-17T06:06:49.751839+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:06:49.751839+0000","last_undegraded":"2024-09-17T06:06:49.751839+0000","last_fullsized":"2024-09-17T06:06:49.751839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.624540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:48.054970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.858437+0000","last_change":"2024-09-17T06:06:45.311790+0000","last_active":"2024-09-17T06:06:49.858437+0000","last_peered":"2024-09-17T06:06:49.858437+0000","last_clean":"2024-09-17T06:06:49.858437+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:06:49.858437+0000","last_undegraded":"2024-09-17T06:06:49.858437+0000","last_fullsized":"2024-09-17T06:06:49.858437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.311572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:05.215110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744226+0000","last_change":"2024-09-17T06:06:43.594929+0000","last_active":"2024-09-17T06:06:49.744226+0000","last_peered":"2024-09-17T06:06:49.744226+0000","last_clean":"2024-09-17T06:06:49.744226+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:06:49.744226+0000","last_undegraded":"2024-09-17T06:06:49.744226+0000","last_fullsized":"2024-09-17T06:06:49.744226+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.594608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:54.666206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":136,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.753903+0000","last_change":"2024-09-17T06:06:44.420446+0000","last_active":"2024-09-17T06:06:49.753903+0000","last_peered":"2024-09-17T06:06:49.753903+0000","last_clean":"2024-09-17T06:06:49.753903+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:06:49.753903+0000","last_undegraded":"2024-09-17T06:06:49.753903+0000","last_fullsized":"2024-09-17T06:06:49.753903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.420226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:35.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":76,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750435+0000","last_change":"2024-09-17T06:06:39.644661+0000","last_active":"2024-09-17T06:06:49.750435+0000","last_peered":"2024-09-17T06:06:49.750435+0000","last_clean":"2024-09-17T06:06:49.750435+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:06:49.750435+0000","last_undegraded":"2024-09-17T06:06:49.750435+0000","last_fullsized":"2024-09-17T06:06:49.750435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.644581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:43.034866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.747384+0000","last_change":"2024-09-17T06:06:42.552587+0000","last_active":"2024-09-17T06:06:49.747384+0000","last_peered":"2024-09-17T06:06:49.747384+0000","last_clean":"2024-09-17T06:06:49.747384+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:06:49.747384+0000","last_undegraded":"2024-09-17T06:06:49.747384+0000","last_fullsized":"2024-09-17T06:06:49.747384+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.552253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:16.204277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":121,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750127+0000","last_change":"2024-09-17T06:06:15.371993+0000","last_active":"2024-09-17T06:06:49.750127+0000","last_peered":"2024-09-17T06:06:49.750127+0000","last_clean":"2024-09-17T06:06:49.750127+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:06:49.750127+0000","last_undegraded":"2024-09-17T06:06:49.750127+0000","last_fullsized":"2024-09-17T06:06:49.750127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:11.883937+0000","last_clean_scrub_stamp":"2024-09-17T06:04:11.883937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.857577+0000","last_change":"2024-09-17T06:06:49.212293+0000","last_active":"2024-09-17T06:06:49.857577+0000","last_peered":"2024-09-17T06:06:49.857577+0000","last_clean":"2024-09-17T06:06:49.857577+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:06:49.857577+0000","last_undegraded":"2024-09-17T06:06:49.857577+0000","last_fullsized":"2024-09-17T06:06:49.857577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.211966+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:29.791073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.753750+0000","last_change":"2024-09-17T06:06:43.370824+0000","last_active":"2024-09-17T06:06:49.753750+0000","last_peered":"2024-09-17T06:06:49.753750+0000","last_clean":"2024-09-17T06:06:49.753750+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:06:49.753750+0000","last_undegraded":"2024-09-17T06:06:49.753750+0000","last_fullsized":"2024-09-17T06:06:49.753750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.370630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:28.698931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.490824+0000","last_change":"2024-09-17T06:06:50.490824+0000","last_active":"2024-09-17T06:06:50.490824+0000","last_peered":"2024-09-17T06:06:50.490824+0000","last_clean":"2024-09-17T06:06:50.490824+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:06:50.490824+0000","last_undegraded":"2024-09-17T06:06:50.490824+0000","last_fullsized":"2024-09-17T06:06:50.490824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.490494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.208761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.564398+0000","last_change":"2024-09-17T06:06:54.564398+0000","last_active":"2024-09-17T06:06:54.564398+0000","last_peered":"2024-09-17T06:06:54.564398+0000","last_clean":"2024-09-17T06:06:54.564398+0000","last_became_active":"2024-09-17T06:06:49.863977+0000","last_became_peered":"2024-09-17T06:06:49.863977+0000","last_unstale":"2024-09-17T06:06:54.564398+0000","last_undegraded":"2024-09-17T06:06:54.564398+0000","last_fullsized":"2024-09-17T06:06:54.564398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:54.564097+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:53.583377+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.564097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:45.765238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":115,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751434+0000","last_change":"2024-09-17T06:06:48.701826+0000","last_active":"2024-09-17T06:06:49.751434+0000","last_peered":"2024-09-17T06:06:49.751434+0000","last_clean":"2024-09-17T06:06:49.751434+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:06:49.751434+0000","last_undegraded":"2024-09-17T06:06:49.751434+0000","last_fullsized":"2024-09-17T06:06:49.751434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.701596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:43:38.318752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860476+0000","last_change":"2024-09-17T06:06:44.071550+0000","last_active":"2024-09-17T06:06:49.860476+0000","last_peered":"2024-09-17T06:06:49.860476+0000","last_clean":"2024-09-17T06:06:49.860476+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:06:49.860476+0000","last_undegraded":"2024-09-17T06:06:49.860476+0000","last_fullsized":"2024-09-17T06:06:49.860476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.071343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:50.902738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859970+0000","last_change":"2024-09-17T06:06:48.219488+0000","last_active":"2024-09-17T06:06:49.859970+0000","last_peered":"2024-09-17T06:06:49.859970+0000","last_clean":"2024-09-17T06:06:49.859970+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:06:49.859970+0000","last_undegraded":"2024-09-17T06:06:49.859970+0000","last_fullsized":"2024-09-17T06:06:49.859970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.219293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:00.836074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":113,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.710122+0000","last_change":"2024-09-17T06:06:50.710122+0000","last_active":"2024-09-17T06:06:50.710122+0000","last_peered":"2024-09-17T06:06:50.710122+0000","last_clean":"2024-09-17T06:06:50.710122+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:06:50.710122+0000","last_undegraded":"2024-09-17T06:06:50.710122+0000","last_fullsized":"2024-09-17T06:06:50.710122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.709804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:24.696128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":112,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.502240+0000","last_change":"2024-09-17T06:06:51.502240+0000","last_active":"2024-09-17T06:06:51.502240+0000","last_peered":"2024-09-17T06:06:51.502240+0000","last_clean":"2024-09-17T06:06:51.502240+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:06:51.502240+0000","last_undegraded":"2024-09-17T06:06:51.502240+0000","last_fullsized":"2024-09-17T06:06:51.502240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.502041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.125829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":119,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751190+0000","last_change":"2024-09-17T06:06:49.687515+0000","last_active":"2024-09-17T06:06:49.751190+0000","last_peered":"2024-09-17T06:06:49.751190+0000","last_clean":"2024-09-17T06:06:49.751190+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:06:49.751190+0000","last_undegraded":"2024-09-17T06:06:49.751190+0000","last_fullsized":"2024-09-17T06:06:49.751190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.687322+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:09.182168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.762506+0000","last_change":"2024-09-17T06:06:49.761230+0000","last_active":"2024-09-17T06:06:49.762506+0000","last_peered":"2024-09-17T06:06:49.762506+0000","last_clean":"2024-09-17T06:06:49.762506+0000","last_became_active":"2024-09-17T06:06:49.760405+0000","last_became_peered":"2024-09-17T06:06:49.760405+0000","last_unstale":"2024-09-17T06:06:49.762506+0000","last_undegraded":"2024-09-17T06:06:49.762506+0000","last_fullsized":"2024-09-17T06:06:49.762506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:18.198271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.561891+0000","last_change":"2024-09-17T06:06:51.561891+0000","last_active":"2024-09-17T06:06:51.561891+0000","last_peered":"2024-09-17T06:06:51.561891+0000","last_clean":"2024-09-17T06:06:51.561891+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:06:51.561891+0000","last_undegraded":"2024-09-17T06:06:51.561891+0000","last_fullsized":"2024-09-17T06:06:51.561891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.561576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:27.536230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.171689+0000","last_change":"2024-09-17T06:06:51.171689+0000","last_active":"2024-09-17T06:06:51.171689+0000","last_peered":"2024-09-17T06:06:51.171689+0000","last_clean":"2024-09-17T06:06:51.171689+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:06:51.171689+0000","last_undegraded":"2024-09-17T06:06:51.171689+0000","last_fullsized":"2024-09-17T06:06:51.171689+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.171493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:39.452849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:55.610932+0000","last_change":"2024-09-17T06:06:55.610932+0000","last_active":"2024-09-17T06:06:55.610932+0000","last_peered":"2024-09-17T06:06:55.610932+0000","last_clean":"2024-09-17T06:06:55.610932+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:06:55.610932+0000","last_undegraded":"2024-09-17T06:06:55.610932+0000","last_fullsized":"2024-09-17T06:06:55.610932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.610700+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:07.867694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754627+0000","last_change":"2024-09-17T06:06:42.353051+0000","last_active":"2024-09-17T06:06:49.754627+0000","last_peered":"2024-09-17T06:06:49.754627+0000","last_clean":"2024-09-17T06:06:49.754627+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:06:49.754627+0000","last_undegraded":"2024-09-17T06:06:49.754627+0000","last_fullsized":"2024-09-17T06:06:49.754627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.352711+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:14.862093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.529037+0000","last_change":"2024-09-17T06:06:52.529037+0000","last_active":"2024-09-17T06:06:52.529037+0000","last_peered":"2024-09-17T06:06:52.529037+0000","last_clean":"2024-09-17T06:06:52.529037+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:06:52.529037+0000","last_undegraded":"2024-09-17T06:06:52.529037+0000","last_fullsized":"2024-09-17T06:06:52.529037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.528843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.118602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:53.547108+0000","last_change":"2024-09-17T06:06:53.547108+0000","last_active":"2024-09-17T06:06:53.547108+0000","last_peered":"2024-09-17T06:06:53.547108+0000","last_clean":"2024-09-17T06:06:53.547108+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:06:53.547108+0000","last_undegraded":"2024-09-17T06:06:53.547108+0000","last_fullsized":"2024-09-17T06:06:53.547108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.546853+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:05.208153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859294+0000","last_change":"2024-09-17T06:06:48.919436+0000","last_active":"2024-09-17T06:06:49.859294+0000","last_peered":"2024-09-17T06:06:49.859294+0000","last_clean":"2024-09-17T06:06:49.859294+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:06:49.859294+0000","last_undegraded":"2024-09-17T06:06:49.859294+0000","last_fullsized":"2024-09-17T06:06:49.859294+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.919235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:27.262935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.743865+0000","last_change":"2024-09-17T06:06:44.636882+0000","last_active":"2024-09-17T06:06:49.743865+0000","last_peered":"2024-09-17T06:06:49.743865+0000","last_clean":"2024-09-17T06:06:49.743865+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:06:49.743865+0000","last_undegraded":"2024-09-17T06:06:49.743865+0000","last_fullsized":"2024-09-17T06:06:49.743865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.636626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:44.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":83,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.717905+0000","last_change":"2024-09-17T06:06:51.717905+0000","last_active":"2024-09-17T06:06:51.717905+0000","last_peered":"2024-09-17T06:06:51.717905+0000","last_clean":"2024-09-17T06:06:51.717905+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:06:51.717905+0000","last_undegraded":"2024-09-17T06:06:51.717905+0000","last_fullsized":"2024-09-17T06:06:51.717905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.717694+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:59.444208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750868+0000","last_change":"2024-09-17T06:06:45.539679+0000","last_active":"2024-09-17T06:06:49.750868+0000","last_peered":"2024-09-17T06:06:49.750868+0000","last_clean":"2024-09-17T06:06:49.750868+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:06:49.750868+0000","last_undegraded":"2024-09-17T06:06:49.750868+0000","last_fullsized":"2024-09-17T06:06:49.750868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.539468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:55.832105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.213250+0000","last_change":"2024-09-17T06:06:52.213250+0000","last_active":"2024-09-17T06:06:52.213250+0000","last_peered":"2024-09-17T06:06:52.213250+0000","last_clean":"2024-09-17T06:06:52.213250+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:06:52.213250+0000","last_undegraded":"2024-09-17T06:06:52.213250+0000","last_fullsized":"2024-09-17T06:06:52.213250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.213042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:36.033960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":156,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:53.226240+0000","last_change":"2024-09-17T06:06:53.226240+0000","last_active":"2024-09-17T06:06:53.226240+0000","last_peered":"2024-09-17T06:06:53.226240+0000","last_clean":"2024-09-17T06:06:53.226240+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:06:53.226240+0000","last_undegraded":"2024-09-17T06:06:53.226240+0000","last_fullsized":"2024-09-17T06:06:53.226240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'16","last_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_deep_scrub":"81'16","last_deep_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.226044+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:15.604828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.593476+0000","last_change":"2024-09-17T06:06:50.593476+0000","last_active":"2024-09-17T06:06:50.593476+0000","last_peered":"2024-09-17T06:06:50.593476+0000","last_clean":"2024-09-17T06:06:50.593476+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:06:50.593476+0000","last_undegraded":"2024-09-17T06:06:50.593476+0000","last_fullsized":"2024-09-17T06:06:50.593476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.593281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.041524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":82,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:53.662277+0000","last_change":"2024-09-17T06:06:53.662277+0000","last_active":"2024-09-17T06:06:53.662277+0000","last_peered":"2024-09-17T06:06:53.662277+0000","last_clean":"2024-09-17T06:06:53.662277+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:06:53.662277+0000","last_undegraded":"2024-09-17T06:06:53.662277+0000","last_fullsized":"2024-09-17T06:06:53.662277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.662083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:09.458813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.601401+0000","last_change":"2024-09-17T06:06:54.601401+0000","last_active":"2024-09-17T06:06:54.601401+0000","last_peered":"2024-09-17T06:06:54.601401+0000","last_clean":"2024-09-17T06:06:54.601401+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:06:54.601401+0000","last_undegraded":"2024-09-17T06:06:54.601401+0000","last_fullsized":"2024-09-17T06:06:54.601401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.601206+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:30.575859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.592256+0000","last_change":"2024-09-17T06:06:54.592256+0000","last_active":"2024-09-17T06:06:54.592256+0000","last_peered":"2024-09-17T06:06:54.592256+0000","last_clean":"2024-09-17T06:06:54.592256+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:06:54.592256+0000","last_undegraded":"2024-09-17T06:06:54.592256+0000","last_fullsized":"2024-09-17T06:06:54.592256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.591916+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:43.180179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":139,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.757238+0000","last_change":"2024-09-17T06:04:08.852490+0000","last_active":"2024-09-17T06:06:49.757238+0000","last_peered":"2024-09-17T06:06:49.757238+0000","last_clean":"2024-09-17T06:06:49.757238+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:06:49.757238+0000","last_undegraded":"2024-09-17T06:06:49.757238+0000","last_fullsized":"2024-09-17T06:06:49.757238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:55.569378+0000","last_change":"2024-09-17T06:06:55.569378+0000","last_active":"2024-09-17T06:06:55.569378+0000","last_peered":"2024-09-17T06:06:55.569378+0000","last_clean":"2024-09-17T06:06:55.569378+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:06:55.569378+0000","last_undegraded":"2024-09-17T06:06:55.569378+0000","last_fullsized":"2024-09-17T06:06:55.569378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.569171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:50.988830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744160+0000","last_change":"2024-09-17T06:06:46.576687+0000","last_active":"2024-09-17T06:06:49.744160+0000","last_peered":"2024-09-17T06:06:49.744160+0000","last_clean":"2024-09-17T06:06:49.744160+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:06:49.744160+0000","last_undegraded":"2024-09-17T06:06:49.744160+0000","last_fullsized":"2024-09-17T06:06:49.744160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:36.143901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860930+0000","last_change":"2024-09-17T06:06:46.022759+0000","last_active":"2024-09-17T06:06:49.860930+0000","last_peered":"2024-09-17T06:06:49.860930+0000","last_clean":"2024-09-17T06:06:49.860930+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:06:49.860930+0000","last_undegraded":"2024-09-17T06:06:49.860930+0000","last_fullsized":"2024-09-17T06:06:49.860930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.022447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.814300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:56.620251+0000","last_change":"2024-09-17T06:06:56.620251+0000","last_active":"2024-09-17T06:06:56.620251+0000","last_peered":"2024-09-17T06:06:56.620251+0000","last_clean":"2024-09-17T06:06:56.620251+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:06:56.620251+0000","last_undegraded":"2024-09-17T06:06:56.620251+0000","last_fullsized":"2024-09-17T06:06:56.620251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.619933+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:00.010218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1019904,"data_stored":544734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":508396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1581056,"data_stored":1099080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1568768,"data_stored":1098934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":544322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906958,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29008,"kb_used_data":960,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342832,"statfs":{"total":96636764160,"available":96607059968,"internally_reserved":0,"allocated":983040,"data_stored":508110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":508054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":508074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:07:01.739 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:07:01.739 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:07:01.739 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-17T06:04:11.883937+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=11, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:07:01.739 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:07:01.740 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:07:01.740 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T06:07:05.806 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:07:05.809 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:07:21.741 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:07:21.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.903+0000 7f695a8fc640 1 -- 172.21.15.122:0/1007661008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f695415aa30 msgr2=0x7f695415ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:21.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.903+0000 7f695a8fc640 1 --2- 172.21.15.122:0/1007661008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f695415aa30 0x7f695415ae40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f69540731b0 tx=0x7f694c01f0b0 comp rx=0 tx=0).stop 2024-09-17T06:07:21.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.903+0000 7f695a8fc640 1 -- 172.21.15.122:0/1007661008 shutdown_connections 2024-09-17T06:07:21.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.903+0000 7f695a8fc640 1 --2- 172.21.15.122:0/1007661008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f695415aa30 0x7f695415ae40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:21.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.903+0000 7f695a8fc640 1 --2- 172.21.15.122:0/1007661008 >> v2:172.21.15.173:3300/0 conn(0x7f69540c6780 0x7f6954153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:21.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.903+0000 7f695a8fc640 1 -- 172.21.15.122:0/1007661008 >> 172.21.15.122:0/1007661008 conn(0x7f69540746d0 msgr2=0x7f6954074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:07:21.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.903+0000 7f695a8fc640 1 -- 172.21.15.122:0/1007661008 shutdown_connections 2024-09-17T06:07:21.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.903+0000 7f695a8fc640 1 -- 172.21.15.122:0/1007661008 wait complete. 2024-09-17T06:07:21.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f695a8fc640 1 Processor -- start 2024-09-17T06:07:21.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f695a8fc640 1 -- start start 2024-09-17T06:07:21.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f695a8fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69540c6780 0x7f6954155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:07:21.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f695a8fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6954159b00 0x7f69541f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f695a8fc640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f695415aa30 0x7f6954145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f695a8fc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f695415d470 con 0x7f6954159b00 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f695a8fc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f695415d190 con 0x7f69540c6780 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f695a8fc640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f695415b380 con 0x7f695415aa30 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f69537fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6954159b00 0x7f69541f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f69537fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6954159b00 0x7f69541f2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:32820/0 (socket says 172.21.15.122:32820) 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f69537fe640 1 -- 172.21.15.122:0/2193397762 learned_addr learned my addr 172.21.15.122:0/2193397762 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f6958e99640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f695415aa30 0x7f6954145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f6953fff640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69540c6780 0x7f6954155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f69537fe640 1 -- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f695415aa30 msgr2=0x7f6954145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f69537fe640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f695415aa30 0x7f6954145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f69537fe640 1 -- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69540c6780 msgr2=0x7f6954155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:21.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f69537fe640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69540c6780 0x7f6954155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:21.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f69537fe640 1 -- 172.21.15.122:0/2193397762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69541e5330 con 0x7f6954159b00 2024-09-17T06:07:21.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f6953fff640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69540c6780 0x7f6954155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:07:21.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f69537fe640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6954159b00 0x7f69541f2770 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f694800b410 tx=0x7f694800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:07:21.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f6950ff9640 1 -- 172.21.15.122:0/2193397762 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948015020 con 0x7f6954159b00 2024-09-17T06:07:21.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f6950ff9640 1 -- 172.21.15.122:0/2193397762 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6948011940 con 0x7f6954159b00 2024-09-17T06:07:21.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f6950ff9640 1 -- 172.21.15.122:0/2193397762 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948011d90 con 0x7f6954159b00 2024-09-17T06:07:21.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f695a8fc640 1 -- 172.21.15.122:0/2193397762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6954157880 con 0x7f6954159b00 2024-09-17T06:07:21.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.907+0000 7f695a8fc640 1 -- 172.21.15.122:0/2193397762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6954153d60 con 0x7f6954159b00 2024-09-17T06:07:21.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.911+0000 7f695a8fc640 1 -- 172.21.15.122:0/2193397762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69541e5000 con 0x7f6954159b00 2024-09-17T06:07:21.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.911+0000 7f6950ff9640 1 -- 172.21.15.122:0/2193397762 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6948018020 con 0x7f6954159b00 2024-09-17T06:07:21.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.911+0000 7f6950ff9640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6940073230 0x7f6940075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:07:21.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.911+0000 7f6950ff9640 1 -- 172.21.15.122:0/2193397762 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6825+0+0 (secure 0 0 0) 0x7f6948094030 con 0x7f6954159b00 2024-09-17T06:07:21.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.911+0000 7f6953fff640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6940073230 0x7f6940075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:07:21.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.911+0000 7f6953fff640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6940073230 0x7f6940075740 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6944005c50 tx=0x7f69440082b0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:07:21.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:21.915+0000 7f6950ff9640 1 -- 172.21.15.122:0/2193397762 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f694801f070 con 0x7f6954159b00 2024-09-17T06:07:22.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.079+0000 7f695a8fc640 1 -- 172.21.15.122:0/2193397762 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69540b8cf0 con 0x7f6940073230 2024-09-17T06:07:22.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.099+0000 7f6950ff9640 1 -- 172.21.15.122:0/2193397762 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332984 (secure 0 0 0) 0x7f69540b8cf0 con 0x7f6940073230 2024-09-17T06:07:22.103 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:07:22.105 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:07:22.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.099+0000 7f695a8fc640 1 -- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6940073230 msgr2=0x7f6940075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:22.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.099+0000 7f695a8fc640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6940073230 0x7f6940075740 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6944005c50 tx=0x7f69440082b0 comp rx=0 tx=0).stop 2024-09-17T06:07:22.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.099+0000 7f695a8fc640 1 -- 172.21.15.122:0/2193397762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6954159b00 msgr2=0x7f69541f2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:22.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.099+0000 7f695a8fc640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6954159b00 0x7f69541f2770 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f694800b410 tx=0x7f694800b8d0 comp rx=0 tx=0).stop 2024-09-17T06:07:22.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.099+0000 7f695a8fc640 1 -- 172.21.15.122:0/2193397762 shutdown_connections 2024-09-17T06:07:22.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.099+0000 7f695a8fc640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f695415aa30 0x7f6954145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:22.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.099+0000 7f695a8fc640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6954159b00 0x7f69541f2770 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:22.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.099+0000 7f695a8fc640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6940073230 0x7f6940075740 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:22.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.099+0000 7f695a8fc640 1 --2- 172.21.15.122:0/2193397762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69540c6780 0x7f6954155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:22.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.099+0000 7f695a8fc640 1 -- 172.21.15.122:0/2193397762 >> 172.21.15.122:0/2193397762 conn(0x7f69540746d0 msgr2=0x7f6954149370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:07:22.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.103+0000 7f695a8fc640 1 -- 172.21.15.122:0/2193397762 shutdown_connections 2024-09-17T06:07:22.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:22.103+0000 7f695a8fc640 1 -- 172.21.15.122:0/2193397762 wait complete. 2024-09-17T06:07:22.125 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-17T06:07:21.595996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246896,"kb_used_data":8880,"kb_used_omap":17,"kb_used_meta":237870,"kb_avail":754727824,"statfs":{"total":773094113280,"available":772841291776,"internally_reserved":0,"allocated":9093120,"data_stored":5319704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":243579629},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005477"},"pg_stats":[{"pgid":"2.1f","version":"81'6","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.746227+0000","last_change":"2024-09-17T06:06:38.646633+0000","last_active":"2024-09-17T06:06:49.746227+0000","last_peered":"2024-09-17T06:06:49.746227+0000","last_clean":"2024-09-17T06:06:49.746227+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:06:49.746227+0000","last_undegraded":"2024-09-17T06:06:49.746227+0000","last_fullsized":"2024-09-17T06:06:49.746227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.646522+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:55.373873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751997+0000","last_change":"2024-09-17T06:06:47.678984+0000","last_active":"2024-09-17T06:06:49.751997+0000","last_peered":"2024-09-17T06:06:49.751997+0000","last_clean":"2024-09-17T06:06:49.751997+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:06:49.751997+0000","last_undegraded":"2024-09-17T06:06:49.751997+0000","last_fullsized":"2024-09-17T06:06:49.751997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.678793+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:31.584591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:55.606541+0000","last_change":"2024-09-17T06:06:55.606541+0000","last_active":"2024-09-17T06:06:55.606541+0000","last_peered":"2024-09-17T06:06:55.606541+0000","last_clean":"2024-09-17T06:06:55.606541+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:06:55.606541+0000","last_undegraded":"2024-09-17T06:06:55.606541+0000","last_fullsized":"2024-09-17T06:06:55.606541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.606346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:05.514205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":75,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.752147+0000","last_change":"2024-09-17T06:06:41.626922+0000","last_active":"2024-09-17T06:06:49.752147+0000","last_peered":"2024-09-17T06:06:49.752147+0000","last_clean":"2024-09-17T06:06:49.752147+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:06:49.752147+0000","last_undegraded":"2024-09-17T06:06:49.752147+0000","last_fullsized":"2024-09-17T06:06:49.752147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.626723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:41.581056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.745096+0000","last_change":"2024-09-17T06:06:42.561017+0000","last_active":"2024-09-17T06:06:49.745096+0000","last_peered":"2024-09-17T06:06:49.745096+0000","last_clean":"2024-09-17T06:06:49.745096+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:06:49.745096+0000","last_undegraded":"2024-09-17T06:06:49.745096+0000","last_fullsized":"2024-09-17T06:06:49.745096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.560815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:06.386417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.581741+0000","last_change":"2024-09-17T06:06:50.581741+0000","last_active":"2024-09-17T06:06:50.581741+0000","last_peered":"2024-09-17T06:06:50.581741+0000","last_clean":"2024-09-17T06:06:50.581741+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:06:50.581741+0000","last_undegraded":"2024-09-17T06:06:50.581741+0000","last_fullsized":"2024-09-17T06:06:50.581741+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.581526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:27.538796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.758705+0000","last_change":"2024-09-17T06:06:44.503792+0000","last_active":"2024-09-17T06:06:49.758705+0000","last_peered":"2024-09-17T06:06:49.758705+0000","last_clean":"2024-09-17T06:06:49.758705+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:06:49.758705+0000","last_undegraded":"2024-09-17T06:06:49.758705+0000","last_fullsized":"2024-09-17T06:06:49.758705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.503569+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.329171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751579+0000","last_change":"2024-09-17T06:06:49.490282+0000","last_active":"2024-09-17T06:06:49.751579+0000","last_peered":"2024-09-17T06:06:49.751579+0000","last_clean":"2024-09-17T06:06:49.751579+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:49.751579+0000","last_undegraded":"2024-09-17T06:06:49.751579+0000","last_fullsized":"2024-09-17T06:06:49.751579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.490084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:52.911935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.542004+0000","last_change":"2024-09-17T06:06:51.542004+0000","last_active":"2024-09-17T06:06:51.542004+0000","last_peered":"2024-09-17T06:06:51.542004+0000","last_clean":"2024-09-17T06:06:51.542004+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:06:51.542004+0000","last_undegraded":"2024-09-17T06:06:51.542004+0000","last_fullsized":"2024-09-17T06:06:51.542004+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.541795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.542454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.758374+0000","last_change":"2024-09-17T06:06:45.535472+0000","last_active":"2024-09-17T06:06:49.758374+0000","last_peered":"2024-09-17T06:06:49.758374+0000","last_clean":"2024-09-17T06:06:49.758374+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:06:49.758374+0000","last_undegraded":"2024-09-17T06:06:49.758374+0000","last_fullsized":"2024-09-17T06:06:49.758374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.535262+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:56.606861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754011+0000","last_change":"2024-09-17T06:06:45.459635+0000","last_active":"2024-09-17T06:06:49.754011+0000","last_peered":"2024-09-17T06:06:49.754011+0000","last_clean":"2024-09-17T06:06:49.754011+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:06:49.754011+0000","last_undegraded":"2024-09-17T06:06:49.754011+0000","last_fullsized":"2024-09-17T06:06:49.754011+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.459406+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:41.152666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.519889+0000","last_change":"2024-09-17T06:06:52.519889+0000","last_active":"2024-09-17T06:06:52.519889+0000","last_peered":"2024-09-17T06:06:52.519889+0000","last_clean":"2024-09-17T06:06:52.519889+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:06:52.519889+0000","last_undegraded":"2024-09-17T06:06:52.519889+0000","last_fullsized":"2024-09-17T06:06:52.519889+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.519692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:06.562811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.857797+0000","last_change":"2024-09-17T06:06:46.282925+0000","last_active":"2024-09-17T06:06:49.857797+0000","last_peered":"2024-09-17T06:06:49.857797+0000","last_clean":"2024-09-17T06:06:49.857797+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:06:49.857797+0000","last_undegraded":"2024-09-17T06:06:49.857797+0000","last_fullsized":"2024-09-17T06:06:49.857797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.282607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:45.646843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":159,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.758127+0000","last_change":"2024-09-17T06:06:47.578055+0000","last_active":"2024-09-17T06:06:49.758127+0000","last_peered":"2024-09-17T06:06:49.758127+0000","last_clean":"2024-09-17T06:06:49.758127+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:06:49.758127+0000","last_undegraded":"2024-09-17T06:06:49.758127+0000","last_fullsized":"2024-09-17T06:06:49.758127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.577825+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:54.466675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":86,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749786+0000","last_change":"2024-09-17T06:06:48.564278+0000","last_active":"2024-09-17T06:06:49.749786+0000","last_peered":"2024-09-17T06:06:49.749786+0000","last_clean":"2024-09-17T06:06:49.749786+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:06:49.749786+0000","last_undegraded":"2024-09-17T06:06:49.749786+0000","last_fullsized":"2024-09-17T06:06:49.749786+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.564076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:09.526182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750307+0000","last_change":"2024-09-17T06:06:45.719909+0000","last_active":"2024-09-17T06:06:49.750307+0000","last_peered":"2024-09-17T06:06:49.750307+0000","last_clean":"2024-09-17T06:06:49.750307+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:06:49.750307+0000","last_undegraded":"2024-09-17T06:06:49.750307+0000","last_fullsized":"2024-09-17T06:06:49.750307+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.719724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:58.812630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860343+0000","last_change":"2024-09-17T06:06:39.054952+0000","last_active":"2024-09-17T06:06:49.860343+0000","last_peered":"2024-09-17T06:06:49.860343+0000","last_clean":"2024-09-17T06:06:49.860343+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:06:49.860343+0000","last_undegraded":"2024-09-17T06:06:49.860343+0000","last_fullsized":"2024-09-17T06:06:49.860343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.054879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:22.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751397+0000","last_change":"2024-09-17T06:06:47.595782+0000","last_active":"2024-09-17T06:06:49.751397+0000","last_peered":"2024-09-17T06:06:49.751397+0000","last_clean":"2024-09-17T06:06:49.751397+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:06:49.751397+0000","last_undegraded":"2024-09-17T06:06:49.751397+0000","last_fullsized":"2024-09-17T06:06:49.751397+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.595562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.305297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749806+0000","last_change":"2024-09-17T06:06:44.685583+0000","last_active":"2024-09-17T06:06:49.749806+0000","last_peered":"2024-09-17T06:06:49.749806+0000","last_clean":"2024-09-17T06:06:49.749806+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:06:49.749806+0000","last_undegraded":"2024-09-17T06:06:49.749806+0000","last_fullsized":"2024-09-17T06:06:49.749806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.685386+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:42.733827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859499+0000","last_change":"2024-09-17T06:06:41.096528+0000","last_active":"2024-09-17T06:06:49.859499+0000","last_peered":"2024-09-17T06:06:49.859499+0000","last_clean":"2024-09-17T06:06:49.859499+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:06:49.859499+0000","last_undegraded":"2024-09-17T06:06:49.859499+0000","last_fullsized":"2024-09-17T06:06:49.859499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.096443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.182798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.955862+0000","last_change":"2024-09-17T06:06:51.955862+0000","last_active":"2024-09-17T06:06:51.955862+0000","last_peered":"2024-09-17T06:06:51.955862+0000","last_clean":"2024-09-17T06:06:51.955862+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:06:51.955862+0000","last_undegraded":"2024-09-17T06:06:51.955862+0000","last_fullsized":"2024-09-17T06:06:51.955862+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.955662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.579450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":68,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.747588+0000","last_change":"2024-09-17T06:06:41.561023+0000","last_active":"2024-09-17T06:06:49.747588+0000","last_peered":"2024-09-17T06:06:49.747588+0000","last_clean":"2024-09-17T06:06:49.747588+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:06:49.747588+0000","last_undegraded":"2024-09-17T06:06:49.747588+0000","last_fullsized":"2024-09-17T06:06:49.747588+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.560833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:35.979151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.569920+0000","last_change":"2024-09-17T06:06:51.569920+0000","last_active":"2024-09-17T06:06:51.569920+0000","last_peered":"2024-09-17T06:06:51.569920+0000","last_clean":"2024-09-17T06:06:51.569920+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:06:51.569920+0000","last_undegraded":"2024-09-17T06:06:51.569920+0000","last_fullsized":"2024-09-17T06:06:51.569920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.569724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:16.044884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.534994+0000","last_change":"2024-09-17T06:06:54.534994+0000","last_active":"2024-09-17T06:06:54.534994+0000","last_peered":"2024-09-17T06:06:54.534994+0000","last_clean":"2024-09-17T06:06:54.534994+0000","last_became_active":"2024-09-17T06:06:49.862233+0000","last_became_peered":"2024-09-17T06:06:49.862233+0000","last_unstale":"2024-09-17T06:06:54.534994+0000","last_undegraded":"2024-09-17T06:06:54.534994+0000","last_fullsized":"2024-09-17T06:06:54.534994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.534811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:53.555338+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.534811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:09.975013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,1],"acting":[4,2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.745160+0000","last_change":"2024-09-17T06:06:39.595362+0000","last_active":"2024-09-17T06:06:49.745160+0000","last_peered":"2024-09-17T06:06:49.745160+0000","last_clean":"2024-09-17T06:06:49.745160+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:06:49.745160+0000","last_undegraded":"2024-09-17T06:06:49.745160+0000","last_fullsized":"2024-09-17T06:06:49.745160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.595150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:36.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860025+0000","last_change":"2024-09-17T06:06:41.345210+0000","last_active":"2024-09-17T06:06:49.860025+0000","last_peered":"2024-09-17T06:06:49.860025+0000","last_clean":"2024-09-17T06:06:49.860025+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:06:49.860025+0000","last_undegraded":"2024-09-17T06:06:49.860025+0000","last_fullsized":"2024-09-17T06:06:49.860025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.345015+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:38.207077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748131+0000","last_change":"2024-09-17T06:06:44.540629+0000","last_active":"2024-09-17T06:06:49.748131+0000","last_peered":"2024-09-17T06:06:49.748131+0000","last_clean":"2024-09-17T06:06:49.748131+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:06:49.748131+0000","last_undegraded":"2024-09-17T06:06:49.748131+0000","last_fullsized":"2024-09-17T06:06:49.748131+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.540426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:03.473101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751833+0000","last_change":"2024-09-17T06:06:43.669448+0000","last_active":"2024-09-17T06:06:49.751833+0000","last_peered":"2024-09-17T06:06:49.751833+0000","last_clean":"2024-09-17T06:06:49.751833+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:06:49.751833+0000","last_undegraded":"2024-09-17T06:06:49.751833+0000","last_fullsized":"2024-09-17T06:06:49.751833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.669209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:54.877316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.861170+0000","last_change":"2024-09-17T06:06:38.067895+0000","last_active":"2024-09-17T06:06:49.861170+0000","last_peered":"2024-09-17T06:06:49.861170+0000","last_clean":"2024-09-17T06:06:49.861170+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:06:49.861170+0000","last_undegraded":"2024-09-17T06:06:49.861170+0000","last_fullsized":"2024-09-17T06:06:49.861170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.067715+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:26.508119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:56.651636+0000","last_change":"2024-09-17T06:06:56.651636+0000","last_active":"2024-09-17T06:06:56.651636+0000","last_peered":"2024-09-17T06:06:56.651636+0000","last_clean":"2024-09-17T06:06:56.651636+0000","last_became_active":"2024-09-17T06:06:14.875773+0000","last_became_peered":"2024-09-17T06:06:14.875773+0000","last_unstale":"2024-09-17T06:06:56.651636+0000","last_undegraded":"2024-09-17T06:06:56.651636+0000","last_fullsized":"2024-09-17T06:06:56.651636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.651441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:44.887864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860941+0000","last_change":"2024-09-17T06:06:45.060936+0000","last_active":"2024-09-17T06:06:49.860941+0000","last_peered":"2024-09-17T06:06:49.860941+0000","last_clean":"2024-09-17T06:06:49.860941+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:06:49.860941+0000","last_undegraded":"2024-09-17T06:06:49.860941+0000","last_fullsized":"2024-09-17T06:06:49.860941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.060719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:03.842916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.759038+0000","last_change":"2024-09-17T06:06:43.537259+0000","last_active":"2024-09-17T06:06:49.759038+0000","last_peered":"2024-09-17T06:06:49.759038+0000","last_clean":"2024-09-17T06:06:49.759038+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:06:49.759038+0000","last_undegraded":"2024-09-17T06:06:49.759038+0000","last_fullsized":"2024-09-17T06:06:49.759038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.537064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:53.557183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.588334+0000","last_change":"2024-09-17T06:06:50.588334+0000","last_active":"2024-09-17T06:06:50.588334+0000","last_peered":"2024-09-17T06:06:50.588334+0000","last_clean":"2024-09-17T06:06:50.588334+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:06:50.588334+0000","last_undegraded":"2024-09-17T06:06:50.588334+0000","last_fullsized":"2024-09-17T06:06:50.588334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.588146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:34.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.752542+0000","last_change":"2024-09-17T06:06:45.560755+0000","last_active":"2024-09-17T06:06:49.752542+0000","last_peered":"2024-09-17T06:06:49.752542+0000","last_clean":"2024-09-17T06:06:49.752542+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:06:49.752542+0000","last_undegraded":"2024-09-17T06:06:49.752542+0000","last_fullsized":"2024-09-17T06:06:49.752542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.560562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.352415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.861038+0000","last_change":"2024-09-17T06:06:40.077709+0000","last_active":"2024-09-17T06:06:49.861038+0000","last_peered":"2024-09-17T06:06:49.861038+0000","last_clean":"2024-09-17T06:06:49.861038+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:06:49.861038+0000","last_undegraded":"2024-09-17T06:06:49.861038+0000","last_fullsized":"2024-09-17T06:06:49.861038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.077616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:13.235085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.943563+0000","last_change":"2024-09-17T06:06:50.943563+0000","last_active":"2024-09-17T06:06:50.943563+0000","last_peered":"2024-09-17T06:06:50.943563+0000","last_clean":"2024-09-17T06:06:50.943563+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:06:50.943563+0000","last_undegraded":"2024-09-17T06:06:50.943563+0000","last_fullsized":"2024-09-17T06:06:50.943563+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.943366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.661632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750143+0000","last_change":"2024-09-17T06:06:39.544246+0000","last_active":"2024-09-17T06:06:49.750143+0000","last_peered":"2024-09-17T06:06:49.750143+0000","last_clean":"2024-09-17T06:06:49.750143+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:06:49.750143+0000","last_undegraded":"2024-09-17T06:06:49.750143+0000","last_fullsized":"2024-09-17T06:06:49.750143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.544002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:04.906600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748659+0000","last_change":"2024-09-17T06:06:41.601594+0000","last_active":"2024-09-17T06:06:49.748659+0000","last_peered":"2024-09-17T06:06:49.748659+0000","last_clean":"2024-09-17T06:06:49.748659+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:06:49.748659+0000","last_undegraded":"2024-09-17T06:06:49.748659+0000","last_fullsized":"2024-09-17T06:06:49.748659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.601393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.687748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.922504+0000","last_change":"2024-09-17T06:06:49.922504+0000","last_active":"2024-09-17T06:06:49.922504+0000","last_peered":"2024-09-17T06:06:49.922504+0000","last_clean":"2024-09-17T06:06:49.922504+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:06:49.922504+0000","last_undegraded":"2024-09-17T06:06:49.922504+0000","last_fullsized":"2024-09-17T06:06:49.922504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.922302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:53.344154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859489+0000","last_change":"2024-09-17T06:06:42.067931+0000","last_active":"2024-09-17T06:06:49.859489+0000","last_peered":"2024-09-17T06:06:49.859489+0000","last_clean":"2024-09-17T06:06:49.859489+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:06:49.859489+0000","last_undegraded":"2024-09-17T06:06:49.859489+0000","last_fullsized":"2024-09-17T06:06:49.859489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.067737+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.818001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754080+0000","last_change":"2024-09-17T06:06:38.338953+0000","last_active":"2024-09-17T06:06:49.754080+0000","last_peered":"2024-09-17T06:06:49.754080+0000","last_clean":"2024-09-17T06:06:49.754080+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:06:49.754080+0000","last_undegraded":"2024-09-17T06:06:49.754080+0000","last_fullsized":"2024-09-17T06:06:49.754080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.338737+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:58.670904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.861218+0000","last_change":"2024-09-17T06:06:47.938470+0000","last_active":"2024-09-17T06:06:49.861218+0000","last_peered":"2024-09-17T06:06:49.861218+0000","last_clean":"2024-09-17T06:06:49.861218+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:06:49.861218+0000","last_undegraded":"2024-09-17T06:06:49.861218+0000","last_fullsized":"2024-09-17T06:06:49.861218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.938263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.607027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.743075+0000","last_change":"2024-09-17T06:06:41.585374+0000","last_active":"2024-09-17T06:06:49.743075+0000","last_peered":"2024-09-17T06:06:49.743075+0000","last_clean":"2024-09-17T06:06:49.743075+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:06:49.743075+0000","last_undegraded":"2024-09-17T06:06:49.743075+0000","last_fullsized":"2024-09-17T06:06:49.743075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.585183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:11.929990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.756619+0000","last_change":"2024-09-17T06:06:42.536575+0000","last_active":"2024-09-17T06:06:49.756619+0000","last_peered":"2024-09-17T06:06:49.756619+0000","last_clean":"2024-09-17T06:06:49.756619+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:06:49.756619+0000","last_undegraded":"2024-09-17T06:06:49.756619+0000","last_fullsized":"2024-09-17T06:06:49.756619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.536371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:23.547872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744757+0000","last_change":"2024-09-17T06:06:47.627398+0000","last_active":"2024-09-17T06:06:49.744757+0000","last_peered":"2024-09-17T06:06:49.744757+0000","last_clean":"2024-09-17T06:06:49.744757+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:06:49.744757+0000","last_undegraded":"2024-09-17T06:06:49.744757+0000","last_fullsized":"2024-09-17T06:06:49.744757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.627188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:28.206295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750147+0000","last_change":"2024-09-17T06:06:42.642781+0000","last_active":"2024-09-17T06:06:49.750147+0000","last_peered":"2024-09-17T06:06:49.750147+0000","last_clean":"2024-09-17T06:06:49.750147+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:06:49.750147+0000","last_undegraded":"2024-09-17T06:06:49.750147+0000","last_fullsized":"2024-09-17T06:06:49.750147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.642468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:03.874053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749362+0000","last_change":"2024-09-17T06:06:40.563124+0000","last_active":"2024-09-17T06:06:49.749362+0000","last_peered":"2024-09-17T06:06:49.749362+0000","last_clean":"2024-09-17T06:06:49.749362+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:06:49.749362+0000","last_undegraded":"2024-09-17T06:06:49.749362+0000","last_fullsized":"2024-09-17T06:06:49.749362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.562781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:51.528772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"81'74","reported_seq":243,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.756962+0000","last_change":"2024-09-17T06:06:41.529207+0000","last_active":"2024-09-17T06:06:49.756962+0000","last_peered":"2024-09-17T06:06:49.756962+0000","last_clean":"2024-09-17T06:06:49.756962+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:06:49.756962+0000","last_undegraded":"2024-09-17T06:06:49.756962+0000","last_fullsized":"2024-09-17T06:06:49.756962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'74","last_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_deep_scrub":"81'74","last_deep_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.529006+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:17.811347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.168189+0000","last_change":"2024-09-17T06:06:50.168189+0000","last_active":"2024-09-17T06:06:50.168189+0000","last_peered":"2024-09-17T06:06:50.168189+0000","last_clean":"2024-09-17T06:06:50.168189+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:06:50.168189+0000","last_undegraded":"2024-09-17T06:06:50.168189+0000","last_fullsized":"2024-09-17T06:06:50.168189+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.167993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:53.277144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":135,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754353+0000","last_change":"2024-09-17T06:06:46.470862+0000","last_active":"2024-09-17T06:06:49.754353+0000","last_peered":"2024-09-17T06:06:49.754353+0000","last_clean":"2024-09-17T06:06:49.754353+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:06:49.754353+0000","last_undegraded":"2024-09-17T06:06:49.754353+0000","last_fullsized":"2024-09-17T06:06:49.754353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.470640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:54.803752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754535+0000","last_change":"2024-09-17T06:06:39.308543+0000","last_active":"2024-09-17T06:06:49.754535+0000","last_peered":"2024-09-17T06:06:49.754535+0000","last_clean":"2024-09-17T06:06:49.754535+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:06:49.754535+0000","last_undegraded":"2024-09-17T06:06:49.754535+0000","last_fullsized":"2024-09-17T06:06:49.754535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.308468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:26.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":135,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:55.194732+0000","last_change":"2024-09-17T06:06:55.194732+0000","last_active":"2024-09-17T06:06:55.194732+0000","last_peered":"2024-09-17T06:06:55.194732+0000","last_clean":"2024-09-17T06:06:55.194732+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:06:55.194732+0000","last_undegraded":"2024-09-17T06:06:55.194732+0000","last_fullsized":"2024-09-17T06:06:55.194732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.194477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:46.395618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751826+0000","last_change":"2024-09-17T06:06:47.481798+0000","last_active":"2024-09-17T06:06:49.751826+0000","last_peered":"2024-09-17T06:06:49.751826+0000","last_clean":"2024-09-17T06:06:49.751826+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:06:49.751826+0000","last_undegraded":"2024-09-17T06:06:49.751826+0000","last_fullsized":"2024-09-17T06:06:49.751826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.481588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.150352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860641+0000","last_change":"2024-09-17T06:06:43.064298+0000","last_active":"2024-09-17T06:06:49.860641+0000","last_peered":"2024-09-17T06:06:49.860641+0000","last_clean":"2024-09-17T06:06:49.860641+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:06:49.860641+0000","last_undegraded":"2024-09-17T06:06:49.860641+0000","last_fullsized":"2024-09-17T06:06:49.860641+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.064096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:30.993498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.593990+0000","last_change":"2024-09-17T06:06:52.593990+0000","last_active":"2024-09-17T06:06:52.593990+0000","last_peered":"2024-09-17T06:06:52.593990+0000","last_clean":"2024-09-17T06:06:52.593990+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:06:52.593990+0000","last_undegraded":"2024-09-17T06:06:52.593990+0000","last_fullsized":"2024-09-17T06:06:52.593990+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.593787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:04.850781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.758420+0000","last_change":"2024-09-17T06:06:46.576306+0000","last_active":"2024-09-17T06:06:49.758420+0000","last_peered":"2024-09-17T06:06:49.758420+0000","last_clean":"2024-09-17T06:06:49.758420+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:06:49.758420+0000","last_undegraded":"2024-09-17T06:06:49.758420+0000","last_fullsized":"2024-09-17T06:06:49.758420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:36.552616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'3","reported_seq":147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754961+0000","last_change":"2024-09-17T06:06:40.289371+0000","last_active":"2024-09-17T06:06:49.754961+0000","last_peered":"2024-09-17T06:06:49.754961+0000","last_clean":"2024-09-17T06:06:49.754961+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:06:49.754961+0000","last_undegraded":"2024-09-17T06:06:49.754961+0000","last_fullsized":"2024-09-17T06:06:49.754961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.289195+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.187275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:57.580034+0000","last_change":"2024-09-17T06:06:57.580034+0000","last_active":"2024-09-17T06:06:57.580034+0000","last_peered":"2024-09-17T06:06:57.580034+0000","last_clean":"2024-09-17T06:06:57.580034+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:06:57.580034+0000","last_undegraded":"2024-09-17T06:06:57.580034+0000","last_fullsized":"2024-09-17T06:06:57.580034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.579707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:15.990501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:53.554156+0000","last_change":"2024-09-17T06:06:53.554156+0000","last_active":"2024-09-17T06:06:53.554156+0000","last_peered":"2024-09-17T06:06:53.554156+0000","last_clean":"2024-09-17T06:06:53.554156+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:06:53.554156+0000","last_undegraded":"2024-09-17T06:06:53.554156+0000","last_fullsized":"2024-09-17T06:06:53.554156+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.553919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:37.374837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749434+0000","last_change":"2024-09-17T06:06:40.545470+0000","last_active":"2024-09-17T06:06:49.749434+0000","last_peered":"2024-09-17T06:06:49.749434+0000","last_clean":"2024-09-17T06:06:49.749434+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:06:49.749434+0000","last_undegraded":"2024-09-17T06:06:49.749434+0000","last_fullsized":"2024-09-17T06:06:49.749434+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.545271+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:41.942375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748456+0000","last_change":"2024-09-17T06:06:46.553900+0000","last_active":"2024-09-17T06:06:49.748456+0000","last_peered":"2024-09-17T06:06:49.748456+0000","last_clean":"2024-09-17T06:06:49.748456+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:06:49.748456+0000","last_undegraded":"2024-09-17T06:06:49.748456+0000","last_fullsized":"2024-09-17T06:06:49.748456+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.553594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:37.347089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.757000+0000","last_change":"2024-09-17T06:06:49.557072+0000","last_active":"2024-09-17T06:06:49.757000+0000","last_peered":"2024-09-17T06:06:49.757000+0000","last_clean":"2024-09-17T06:06:49.757000+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:06:49.757000+0000","last_undegraded":"2024-09-17T06:06:49.757000+0000","last_fullsized":"2024-09-17T06:06:49.757000+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.556746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:02.173527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'13","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.753380+0000","last_change":"2024-09-17T06:06:41.327726+0000","last_active":"2024-09-17T06:06:49.753380+0000","last_peered":"2024-09-17T06:06:49.753380+0000","last_clean":"2024-09-17T06:06:49.753380+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:06:49.753380+0000","last_undegraded":"2024-09-17T06:06:49.753380+0000","last_fullsized":"2024-09-17T06:06:49.753380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'13","last_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_deep_scrub":"81'13","last_deep_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.327620+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:41.975086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744584+0000","last_change":"2024-09-17T06:06:48.590089+0000","last_active":"2024-09-17T06:06:49.744584+0000","last_peered":"2024-09-17T06:06:49.744584+0000","last_clean":"2024-09-17T06:06:49.744584+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:06:49.744584+0000","last_undegraded":"2024-09-17T06:06:49.744584+0000","last_fullsized":"2024-09-17T06:06:49.744584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.589881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:13.065040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.857805+0000","last_change":"2024-09-17T06:06:47.234619+0000","last_active":"2024-09-17T06:06:49.857805+0000","last_peered":"2024-09-17T06:06:49.857805+0000","last_clean":"2024-09-17T06:06:49.857805+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:06:49.857805+0000","last_undegraded":"2024-09-17T06:06:49.857805+0000","last_fullsized":"2024-09-17T06:06:49.857805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.234392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:10.297041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.858044+0000","last_change":"2024-09-17T06:06:42.362985+0000","last_active":"2024-09-17T06:06:49.858044+0000","last_peered":"2024-09-17T06:06:49.858044+0000","last_clean":"2024-09-17T06:06:49.858044+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:49.858044+0000","last_undegraded":"2024-09-17T06:06:49.858044+0000","last_fullsized":"2024-09-17T06:06:49.858044+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.362795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:21.306942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.645399+0000","last_change":"2024-09-17T06:06:54.645399+0000","last_active":"2024-09-17T06:06:54.645399+0000","last_peered":"2024-09-17T06:06:54.645399+0000","last_clean":"2024-09-17T06:06:54.645399+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:06:54.645399+0000","last_undegraded":"2024-09-17T06:06:54.645399+0000","last_fullsized":"2024-09-17T06:06:54.645399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.645200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:04.728298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":167,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.757580+0000","last_change":"2024-09-17T06:06:48.595269+0000","last_active":"2024-09-17T06:06:49.757580+0000","last_peered":"2024-09-17T06:06:49.757580+0000","last_clean":"2024-09-17T06:06:49.757580+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:06:49.757580+0000","last_undegraded":"2024-09-17T06:06:49.757580+0000","last_fullsized":"2024-09-17T06:06:49.757580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.595073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:51.297831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748599+0000","last_change":"2024-09-17T06:06:42.583243+0000","last_active":"2024-09-17T06:06:49.748599+0000","last_peered":"2024-09-17T06:06:49.748599+0000","last_clean":"2024-09-17T06:06:49.748599+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:06:49.748599+0000","last_undegraded":"2024-09-17T06:06:49.748599+0000","last_fullsized":"2024-09-17T06:06:49.748599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.583048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:54.333313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:57.607574+0000","last_change":"2024-09-17T06:06:57.607574+0000","last_active":"2024-09-17T06:06:57.607574+0000","last_peered":"2024-09-17T06:06:57.607574+0000","last_clean":"2024-09-17T06:06:57.607574+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:06:57.607574+0000","last_undegraded":"2024-09-17T06:06:57.607574+0000","last_fullsized":"2024-09-17T06:06:57.607574+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.607379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:56.898447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":153,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744169+0000","last_change":"2024-09-17T06:06:45.591584+0000","last_active":"2024-09-17T06:06:49.744169+0000","last_peered":"2024-09-17T06:06:49.744169+0000","last_clean":"2024-09-17T06:06:49.744169+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:06:49.744169+0000","last_undegraded":"2024-09-17T06:06:49.744169+0000","last_fullsized":"2024-09-17T06:06:49.744169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.591276+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:08.653925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":159,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744538+0000","last_change":"2024-09-17T06:06:37.667757+0000","last_active":"2024-09-17T06:06:49.744538+0000","last_peered":"2024-09-17T06:06:49.744538+0000","last_clean":"2024-09-17T06:06:49.744538+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:06:49.744538+0000","last_undegraded":"2024-09-17T06:06:49.744538+0000","last_fullsized":"2024-09-17T06:06:49.744538+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_clean_scrub_stamp":"2024-09-17T06:06:37.667675+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:46.885860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:56.615164+0000","last_change":"2024-09-17T06:06:56.615164+0000","last_active":"2024-09-17T06:06:56.615164+0000","last_peered":"2024-09-17T06:06:56.615164+0000","last_clean":"2024-09-17T06:06:56.615164+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:06:56.615164+0000","last_undegraded":"2024-09-17T06:06:56.615164+0000","last_fullsized":"2024-09-17T06:06:56.615164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.614970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:07.482666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.577732+0000","last_change":"2024-09-17T06:06:52.577732+0000","last_active":"2024-09-17T06:06:52.577732+0000","last_peered":"2024-09-17T06:06:52.577732+0000","last_clean":"2024-09-17T06:06:52.577732+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:06:52.577732+0000","last_undegraded":"2024-09-17T06:06:52.577732+0000","last_fullsized":"2024-09-17T06:06:52.577732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.577533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:34.161856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":169,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.858709+0000","last_change":"2024-09-17T06:06:43.358428+0000","last_active":"2024-09-17T06:06:49.858709+0000","last_peered":"2024-09-17T06:06:49.858709+0000","last_clean":"2024-09-17T06:06:49.858709+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:06:49.858709+0000","last_undegraded":"2024-09-17T06:06:49.858709+0000","last_fullsized":"2024-09-17T06:06:49.858709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'27","last_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_deep_scrub":"81'27","last_deep_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.358219+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:13.703025+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":140,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.944474+0000","last_change":"2024-09-17T06:06:52.944474+0000","last_active":"2024-09-17T06:06:52.944474+0000","last_peered":"2024-09-17T06:06:52.944474+0000","last_clean":"2024-09-17T06:06:52.944474+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:06:52.944474+0000","last_undegraded":"2024-09-17T06:06:52.944474+0000","last_fullsized":"2024-09-17T06:06:52.944474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.944213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.533972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":77,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750311+0000","last_change":"2024-09-17T06:06:43.557285+0000","last_active":"2024-09-17T06:06:49.750311+0000","last_peered":"2024-09-17T06:06:49.750311+0000","last_clean":"2024-09-17T06:06:49.750311+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:06:49.750311+0000","last_undegraded":"2024-09-17T06:06:49.750311+0000","last_fullsized":"2024-09-17T06:06:49.750311+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.557090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:01.412234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"81'9","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.752887+0000","last_change":"2024-09-17T06:06:43.599342+0000","last_active":"2024-09-17T06:06:49.752887+0000","last_peered":"2024-09-17T06:06:49.752887+0000","last_clean":"2024-09-17T06:06:49.752887+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:06:49.752887+0000","last_undegraded":"2024-09-17T06:06:49.752887+0000","last_fullsized":"2024-09-17T06:06:49.752887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.599114+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:49.432076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749353+0000","last_change":"2024-09-17T06:06:49.561761+0000","last_active":"2024-09-17T06:06:49.749353+0000","last_peered":"2024-09-17T06:06:49.749353+0000","last_clean":"2024-09-17T06:06:49.749353+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:06:49.749353+0000","last_undegraded":"2024-09-17T06:06:49.749353+0000","last_fullsized":"2024-09-17T06:06:49.749353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.561572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:15.208406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":153,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.746162+0000","last_change":"2024-09-17T06:06:40.581076+0000","last_active":"2024-09-17T06:06:49.746162+0000","last_peered":"2024-09-17T06:06:49.746162+0000","last_clean":"2024-09-17T06:06:49.746162+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:06:49.746162+0000","last_undegraded":"2024-09-17T06:06:49.746162+0000","last_fullsized":"2024-09-17T06:06:49.746162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.580978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:19.525125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.753149+0000","last_change":"2024-09-17T06:06:44.589361+0000","last_active":"2024-09-17T06:06:49.753149+0000","last_peered":"2024-09-17T06:06:49.753149+0000","last_clean":"2024-09-17T06:06:49.753149+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:06:49.753149+0000","last_undegraded":"2024-09-17T06:06:49.753149+0000","last_fullsized":"2024-09-17T06:06:49.753149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.589149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.705503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":113,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:58.599122+0000","last_change":"2024-09-17T06:06:58.599122+0000","last_active":"2024-09-17T06:06:58.599122+0000","last_peered":"2024-09-17T06:06:58.599122+0000","last_clean":"2024-09-17T06:06:58.599122+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:06:58.599122+0000","last_undegraded":"2024-09-17T06:06:58.599122+0000","last_fullsized":"2024-09-17T06:06:58.599122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_clean_scrub_stamp":"2024-09-17T06:06:58.598909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.505821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":153,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.752815+0000","last_change":"2024-09-17T06:06:48.493667+0000","last_active":"2024-09-17T06:06:49.752815+0000","last_peered":"2024-09-17T06:06:49.752815+0000","last_clean":"2024-09-17T06:06:49.752815+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:06:49.752815+0000","last_undegraded":"2024-09-17T06:06:49.752815+0000","last_fullsized":"2024-09-17T06:06:49.752815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.493470+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.837170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859785+0000","last_change":"2024-09-17T06:06:44.333474+0000","last_active":"2024-09-17T06:06:49.859785+0000","last_peered":"2024-09-17T06:06:49.859785+0000","last_clean":"2024-09-17T06:06:49.859785+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:06:49.859785+0000","last_undegraded":"2024-09-17T06:06:49.859785+0000","last_fullsized":"2024-09-17T06:06:49.859785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.333150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.158751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.699338+0000","last_change":"2024-09-17T06:06:52.699338+0000","last_active":"2024-09-17T06:06:52.699338+0000","last_peered":"2024-09-17T06:06:52.699338+0000","last_clean":"2024-09-17T06:06:52.699338+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:06:52.699338+0000","last_undegraded":"2024-09-17T06:06:52.699338+0000","last_fullsized":"2024-09-17T06:06:52.699338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.699134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:51.626769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.743506+0000","last_change":"2024-09-17T06:06:49.633934+0000","last_active":"2024-09-17T06:06:49.743506+0000","last_peered":"2024-09-17T06:06:49.743506+0000","last_clean":"2024-09-17T06:06:49.743506+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:06:49.743506+0000","last_undegraded":"2024-09-17T06:06:49.743506+0000","last_fullsized":"2024-09-17T06:06:49.743506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.633660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.217982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859138+0000","last_change":"2024-09-17T06:06:46.974853+0000","last_active":"2024-09-17T06:06:49.859138+0000","last_peered":"2024-09-17T06:06:49.859138+0000","last_clean":"2024-09-17T06:06:49.859138+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:06:49.859138+0000","last_undegraded":"2024-09-17T06:06:49.859138+0000","last_fullsized":"2024-09-17T06:06:49.859138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.974637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:26.337532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748920+0000","last_change":"2024-09-17T06:06:46.527438+0000","last_active":"2024-09-17T06:06:49.748920+0000","last_peered":"2024-09-17T06:06:49.748920+0000","last_clean":"2024-09-17T06:06:49.748920+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:06:49.748920+0000","last_undegraded":"2024-09-17T06:06:49.748920+0000","last_fullsized":"2024-09-17T06:06:49.748920+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.527230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:25.890125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":135,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.199209+0000","last_change":"2024-09-17T06:06:54.199209+0000","last_active":"2024-09-17T06:06:54.199209+0000","last_peered":"2024-09-17T06:06:54.199209+0000","last_clean":"2024-09-17T06:06:54.199209+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:06:54.199209+0000","last_undegraded":"2024-09-17T06:06:54.199209+0000","last_fullsized":"2024-09-17T06:06:54.199209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.198989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:51.609301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749502+0000","last_change":"2024-09-17T06:06:46.699017+0000","last_active":"2024-09-17T06:06:49.749502+0000","last_peered":"2024-09-17T06:06:49.749502+0000","last_clean":"2024-09-17T06:06:49.749502+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:06:49.749502+0000","last_undegraded":"2024-09-17T06:06:49.749502+0000","last_fullsized":"2024-09-17T06:06:49.749502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.698821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:33.586359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":74,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751839+0000","last_change":"2024-09-17T06:06:40.624617+0000","last_active":"2024-09-17T06:06:49.751839+0000","last_peered":"2024-09-17T06:06:49.751839+0000","last_clean":"2024-09-17T06:06:49.751839+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:06:49.751839+0000","last_undegraded":"2024-09-17T06:06:49.751839+0000","last_fullsized":"2024-09-17T06:06:49.751839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.624540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:48.054970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.858437+0000","last_change":"2024-09-17T06:06:45.311790+0000","last_active":"2024-09-17T06:06:49.858437+0000","last_peered":"2024-09-17T06:06:49.858437+0000","last_clean":"2024-09-17T06:06:49.858437+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:06:49.858437+0000","last_undegraded":"2024-09-17T06:06:49.858437+0000","last_fullsized":"2024-09-17T06:06:49.858437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.311572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:05.215110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744226+0000","last_change":"2024-09-17T06:06:43.594929+0000","last_active":"2024-09-17T06:06:49.744226+0000","last_peered":"2024-09-17T06:06:49.744226+0000","last_clean":"2024-09-17T06:06:49.744226+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:06:49.744226+0000","last_undegraded":"2024-09-17T06:06:49.744226+0000","last_fullsized":"2024-09-17T06:06:49.744226+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.594608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:54.666206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":136,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.753903+0000","last_change":"2024-09-17T06:06:44.420446+0000","last_active":"2024-09-17T06:06:49.753903+0000","last_peered":"2024-09-17T06:06:49.753903+0000","last_clean":"2024-09-17T06:06:49.753903+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:06:49.753903+0000","last_undegraded":"2024-09-17T06:06:49.753903+0000","last_fullsized":"2024-09-17T06:06:49.753903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.420226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:35.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":76,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750435+0000","last_change":"2024-09-17T06:06:39.644661+0000","last_active":"2024-09-17T06:06:49.750435+0000","last_peered":"2024-09-17T06:06:49.750435+0000","last_clean":"2024-09-17T06:06:49.750435+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:06:49.750435+0000","last_undegraded":"2024-09-17T06:06:49.750435+0000","last_fullsized":"2024-09-17T06:06:49.750435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.644581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:43.034866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.747384+0000","last_change":"2024-09-17T06:06:42.552587+0000","last_active":"2024-09-17T06:06:49.747384+0000","last_peered":"2024-09-17T06:06:49.747384+0000","last_clean":"2024-09-17T06:06:49.747384+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:06:49.747384+0000","last_undegraded":"2024-09-17T06:06:49.747384+0000","last_fullsized":"2024-09-17T06:06:49.747384+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.552253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:16.204277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":129,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:59.590058+0000","last_change":"2024-09-17T06:06:59.590058+0000","last_active":"2024-09-17T06:06:59.590058+0000","last_peered":"2024-09-17T06:06:59.590058+0000","last_clean":"2024-09-17T06:06:59.590058+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:06:59.590058+0000","last_undegraded":"2024-09-17T06:06:59.590058+0000","last_fullsized":"2024-09-17T06:06:59.590058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_clean_scrub_stamp":"2024-09-17T06:06:59.589844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:13.777383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.857577+0000","last_change":"2024-09-17T06:06:49.212293+0000","last_active":"2024-09-17T06:06:49.857577+0000","last_peered":"2024-09-17T06:06:49.857577+0000","last_clean":"2024-09-17T06:06:49.857577+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:06:49.857577+0000","last_undegraded":"2024-09-17T06:06:49.857577+0000","last_fullsized":"2024-09-17T06:06:49.857577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.211966+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:29.791073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.753750+0000","last_change":"2024-09-17T06:06:43.370824+0000","last_active":"2024-09-17T06:06:49.753750+0000","last_peered":"2024-09-17T06:06:49.753750+0000","last_clean":"2024-09-17T06:06:49.753750+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:06:49.753750+0000","last_undegraded":"2024-09-17T06:06:49.753750+0000","last_fullsized":"2024-09-17T06:06:49.753750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.370630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:28.698931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.490824+0000","last_change":"2024-09-17T06:06:50.490824+0000","last_active":"2024-09-17T06:06:50.490824+0000","last_peered":"2024-09-17T06:06:50.490824+0000","last_clean":"2024-09-17T06:06:50.490824+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:06:50.490824+0000","last_undegraded":"2024-09-17T06:06:50.490824+0000","last_fullsized":"2024-09-17T06:06:50.490824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.490494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.208761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.564398+0000","last_change":"2024-09-17T06:06:54.564398+0000","last_active":"2024-09-17T06:06:54.564398+0000","last_peered":"2024-09-17T06:06:54.564398+0000","last_clean":"2024-09-17T06:06:54.564398+0000","last_became_active":"2024-09-17T06:06:49.863977+0000","last_became_peered":"2024-09-17T06:06:49.863977+0000","last_unstale":"2024-09-17T06:06:54.564398+0000","last_undegraded":"2024-09-17T06:06:54.564398+0000","last_fullsized":"2024-09-17T06:06:54.564398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:54.564097+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:53.583377+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.564097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:45.765238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":115,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751434+0000","last_change":"2024-09-17T06:06:48.701826+0000","last_active":"2024-09-17T06:06:49.751434+0000","last_peered":"2024-09-17T06:06:49.751434+0000","last_clean":"2024-09-17T06:06:49.751434+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:06:49.751434+0000","last_undegraded":"2024-09-17T06:06:49.751434+0000","last_fullsized":"2024-09-17T06:06:49.751434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.701596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:43:38.318752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860476+0000","last_change":"2024-09-17T06:06:44.071550+0000","last_active":"2024-09-17T06:06:49.860476+0000","last_peered":"2024-09-17T06:06:49.860476+0000","last_clean":"2024-09-17T06:06:49.860476+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:06:49.860476+0000","last_undegraded":"2024-09-17T06:06:49.860476+0000","last_fullsized":"2024-09-17T06:06:49.860476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.071343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:50.902738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859970+0000","last_change":"2024-09-17T06:06:48.219488+0000","last_active":"2024-09-17T06:06:49.859970+0000","last_peered":"2024-09-17T06:06:49.859970+0000","last_clean":"2024-09-17T06:06:49.859970+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:06:49.859970+0000","last_undegraded":"2024-09-17T06:06:49.859970+0000","last_fullsized":"2024-09-17T06:06:49.859970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.219293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:00.836074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":113,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.710122+0000","last_change":"2024-09-17T06:06:50.710122+0000","last_active":"2024-09-17T06:06:50.710122+0000","last_peered":"2024-09-17T06:06:50.710122+0000","last_clean":"2024-09-17T06:06:50.710122+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:06:50.710122+0000","last_undegraded":"2024-09-17T06:06:50.710122+0000","last_fullsized":"2024-09-17T06:06:50.710122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.709804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:24.696128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":112,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.502240+0000","last_change":"2024-09-17T06:06:51.502240+0000","last_active":"2024-09-17T06:06:51.502240+0000","last_peered":"2024-09-17T06:06:51.502240+0000","last_clean":"2024-09-17T06:06:51.502240+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:06:51.502240+0000","last_undegraded":"2024-09-17T06:06:51.502240+0000","last_fullsized":"2024-09-17T06:06:51.502240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.502041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.125829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":119,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751190+0000","last_change":"2024-09-17T06:06:49.687515+0000","last_active":"2024-09-17T06:06:49.751190+0000","last_peered":"2024-09-17T06:06:49.751190+0000","last_clean":"2024-09-17T06:06:49.751190+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:06:49.751190+0000","last_undegraded":"2024-09-17T06:06:49.751190+0000","last_fullsized":"2024-09-17T06:06:49.751190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.687322+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:09.182168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.762506+0000","last_change":"2024-09-17T06:06:49.761230+0000","last_active":"2024-09-17T06:06:49.762506+0000","last_peered":"2024-09-17T06:06:49.762506+0000","last_clean":"2024-09-17T06:06:49.762506+0000","last_became_active":"2024-09-17T06:06:49.760405+0000","last_became_peered":"2024-09-17T06:06:49.760405+0000","last_unstale":"2024-09-17T06:06:49.762506+0000","last_undegraded":"2024-09-17T06:06:49.762506+0000","last_fullsized":"2024-09-17T06:06:49.762506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:18.198271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.561891+0000","last_change":"2024-09-17T06:06:51.561891+0000","last_active":"2024-09-17T06:06:51.561891+0000","last_peered":"2024-09-17T06:06:51.561891+0000","last_clean":"2024-09-17T06:06:51.561891+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:06:51.561891+0000","last_undegraded":"2024-09-17T06:06:51.561891+0000","last_fullsized":"2024-09-17T06:06:51.561891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.561576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:27.536230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.171689+0000","last_change":"2024-09-17T06:06:51.171689+0000","last_active":"2024-09-17T06:06:51.171689+0000","last_peered":"2024-09-17T06:06:51.171689+0000","last_clean":"2024-09-17T06:06:51.171689+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:06:51.171689+0000","last_undegraded":"2024-09-17T06:06:51.171689+0000","last_fullsized":"2024-09-17T06:06:51.171689+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.171493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:39.452849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:55.610932+0000","last_change":"2024-09-17T06:06:55.610932+0000","last_active":"2024-09-17T06:06:55.610932+0000","last_peered":"2024-09-17T06:06:55.610932+0000","last_clean":"2024-09-17T06:06:55.610932+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:06:55.610932+0000","last_undegraded":"2024-09-17T06:06:55.610932+0000","last_fullsized":"2024-09-17T06:06:55.610932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.610700+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:07.867694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754627+0000","last_change":"2024-09-17T06:06:42.353051+0000","last_active":"2024-09-17T06:06:49.754627+0000","last_peered":"2024-09-17T06:06:49.754627+0000","last_clean":"2024-09-17T06:06:49.754627+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:06:49.754627+0000","last_undegraded":"2024-09-17T06:06:49.754627+0000","last_fullsized":"2024-09-17T06:06:49.754627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.352711+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:14.862093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.529037+0000","last_change":"2024-09-17T06:06:52.529037+0000","last_active":"2024-09-17T06:06:52.529037+0000","last_peered":"2024-09-17T06:06:52.529037+0000","last_clean":"2024-09-17T06:06:52.529037+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:06:52.529037+0000","last_undegraded":"2024-09-17T06:06:52.529037+0000","last_fullsized":"2024-09-17T06:06:52.529037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.528843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.118602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:53.547108+0000","last_change":"2024-09-17T06:06:53.547108+0000","last_active":"2024-09-17T06:06:53.547108+0000","last_peered":"2024-09-17T06:06:53.547108+0000","last_clean":"2024-09-17T06:06:53.547108+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:06:53.547108+0000","last_undegraded":"2024-09-17T06:06:53.547108+0000","last_fullsized":"2024-09-17T06:06:53.547108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.546853+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:05.208153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859294+0000","last_change":"2024-09-17T06:06:48.919436+0000","last_active":"2024-09-17T06:06:49.859294+0000","last_peered":"2024-09-17T06:06:49.859294+0000","last_clean":"2024-09-17T06:06:49.859294+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:06:49.859294+0000","last_undegraded":"2024-09-17T06:06:49.859294+0000","last_fullsized":"2024-09-17T06:06:49.859294+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.919235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:27.262935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.743865+0000","last_change":"2024-09-17T06:06:44.636882+0000","last_active":"2024-09-17T06:06:49.743865+0000","last_peered":"2024-09-17T06:06:49.743865+0000","last_clean":"2024-09-17T06:06:49.743865+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:06:49.743865+0000","last_undegraded":"2024-09-17T06:06:49.743865+0000","last_fullsized":"2024-09-17T06:06:49.743865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.636626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:44.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":83,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.717905+0000","last_change":"2024-09-17T06:06:51.717905+0000","last_active":"2024-09-17T06:06:51.717905+0000","last_peered":"2024-09-17T06:06:51.717905+0000","last_clean":"2024-09-17T06:06:51.717905+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:06:51.717905+0000","last_undegraded":"2024-09-17T06:06:51.717905+0000","last_fullsized":"2024-09-17T06:06:51.717905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.717694+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:59.444208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750868+0000","last_change":"2024-09-17T06:06:45.539679+0000","last_active":"2024-09-17T06:06:49.750868+0000","last_peered":"2024-09-17T06:06:49.750868+0000","last_clean":"2024-09-17T06:06:49.750868+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:06:49.750868+0000","last_undegraded":"2024-09-17T06:06:49.750868+0000","last_fullsized":"2024-09-17T06:06:49.750868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.539468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:55.832105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.213250+0000","last_change":"2024-09-17T06:06:52.213250+0000","last_active":"2024-09-17T06:06:52.213250+0000","last_peered":"2024-09-17T06:06:52.213250+0000","last_clean":"2024-09-17T06:06:52.213250+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:06:52.213250+0000","last_undegraded":"2024-09-17T06:06:52.213250+0000","last_fullsized":"2024-09-17T06:06:52.213250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.213042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:36.033960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":156,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:53.226240+0000","last_change":"2024-09-17T06:06:53.226240+0000","last_active":"2024-09-17T06:06:53.226240+0000","last_peered":"2024-09-17T06:06:53.226240+0000","last_clean":"2024-09-17T06:06:53.226240+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:06:53.226240+0000","last_undegraded":"2024-09-17T06:06:53.226240+0000","last_fullsized":"2024-09-17T06:06:53.226240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'16","last_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_deep_scrub":"81'16","last_deep_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.226044+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:15.604828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.593476+0000","last_change":"2024-09-17T06:06:50.593476+0000","last_active":"2024-09-17T06:06:50.593476+0000","last_peered":"2024-09-17T06:06:50.593476+0000","last_clean":"2024-09-17T06:06:50.593476+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:06:50.593476+0000","last_undegraded":"2024-09-17T06:06:50.593476+0000","last_fullsized":"2024-09-17T06:06:50.593476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.593281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.041524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":82,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:53.662277+0000","last_change":"2024-09-17T06:06:53.662277+0000","last_active":"2024-09-17T06:06:53.662277+0000","last_peered":"2024-09-17T06:06:53.662277+0000","last_clean":"2024-09-17T06:06:53.662277+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:06:53.662277+0000","last_undegraded":"2024-09-17T06:06:53.662277+0000","last_fullsized":"2024-09-17T06:06:53.662277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.662083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:09.458813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.601401+0000","last_change":"2024-09-17T06:06:54.601401+0000","last_active":"2024-09-17T06:06:54.601401+0000","last_peered":"2024-09-17T06:06:54.601401+0000","last_clean":"2024-09-17T06:06:54.601401+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:06:54.601401+0000","last_undegraded":"2024-09-17T06:06:54.601401+0000","last_fullsized":"2024-09-17T06:06:54.601401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.601206+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:30.575859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.592256+0000","last_change":"2024-09-17T06:06:54.592256+0000","last_active":"2024-09-17T06:06:54.592256+0000","last_peered":"2024-09-17T06:06:54.592256+0000","last_clean":"2024-09-17T06:06:54.592256+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:06:54.592256+0000","last_undegraded":"2024-09-17T06:06:54.592256+0000","last_fullsized":"2024-09-17T06:06:54.592256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.591916+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:43.180179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:57.597911+0000","last_change":"2024-09-17T06:06:57.597911+0000","last_active":"2024-09-17T06:06:57.597911+0000","last_peered":"2024-09-17T06:06:57.597911+0000","last_clean":"2024-09-17T06:06:57.597911+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:06:57.597911+0000","last_undegraded":"2024-09-17T06:06:57.597911+0000","last_fullsized":"2024-09-17T06:06:57.597911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.597715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:05.028145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:55.569378+0000","last_change":"2024-09-17T06:06:55.569378+0000","last_active":"2024-09-17T06:06:55.569378+0000","last_peered":"2024-09-17T06:06:55.569378+0000","last_clean":"2024-09-17T06:06:55.569378+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:06:55.569378+0000","last_undegraded":"2024-09-17T06:06:55.569378+0000","last_fullsized":"2024-09-17T06:06:55.569378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.569171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:50.988830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744160+0000","last_change":"2024-09-17T06:06:46.576687+0000","last_active":"2024-09-17T06:06:49.744160+0000","last_peered":"2024-09-17T06:06:49.744160+0000","last_clean":"2024-09-17T06:06:49.744160+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:06:49.744160+0000","last_undegraded":"2024-09-17T06:06:49.744160+0000","last_fullsized":"2024-09-17T06:06:49.744160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:36.143901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860930+0000","last_change":"2024-09-17T06:06:46.022759+0000","last_active":"2024-09-17T06:06:49.860930+0000","last_peered":"2024-09-17T06:06:49.860930+0000","last_clean":"2024-09-17T06:06:49.860930+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:06:49.860930+0000","last_undegraded":"2024-09-17T06:06:49.860930+0000","last_fullsized":"2024-09-17T06:06:49.860930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.022447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.814300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:56.620251+0000","last_change":"2024-09-17T06:06:56.620251+0000","last_active":"2024-09-17T06:06:56.620251+0000","last_peered":"2024-09-17T06:06:56.620251+0000","last_clean":"2024-09-17T06:06:56.620251+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:06:56.620251+0000","last_undegraded":"2024-09-17T06:06:56.620251+0000","last_fullsized":"2024-09-17T06:06:56.620251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.619933+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:00.010218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1019904,"data_stored":544734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":508396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1581056,"data_stored":1099080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1568768,"data_stored":1098934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509484,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":544322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906962,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29008,"kb_used_data":960,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342832,"statfs":{"total":96636764160,"available":96607059968,"internally_reserved":0,"allocated":983040,"data_stored":508110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509486,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":508054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":508074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:07:22.133 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:07:22.133 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T06:07:35.969 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:07:35.972 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:07:42.135 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:07:42.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.298+0000 7fc82c238640 1 -- 172.21.15.122:0/3103547036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc810005360 msgr2=0x7fc81000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:42.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.298+0000 7fc82c238640 1 --2- 172.21.15.122:0/3103547036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc810005360 0x7fc81000b9d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc8240b3580 tx=0x7fc81c01fa00 comp rx=0 tx=0).stop 2024-09-17T06:07:42.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.298+0000 7fc82c238640 1 -- 172.21.15.122:0/3103547036 shutdown_connections 2024-09-17T06:07:42.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.298+0000 7fc82c238640 1 --2- 172.21.15.122:0/3103547036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc810005360 0x7fc81000b9d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:42.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.298+0000 7fc82c238640 1 -- 172.21.15.122:0/3103547036 >> 172.21.15.122:0/3103547036 conn(0x7fc82408d450 msgr2=0x7fc82406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:07:42.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.298+0000 7fc82c238640 1 -- 172.21.15.122:0/3103547036 shutdown_connections 2024-09-17T06:07:42.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.298+0000 7fc82c238640 1 -- 172.21.15.122:0/3103547036 wait complete. 2024-09-17T06:07:42.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.298+0000 7fc82c238640 1 Processor -- start 2024-09-17T06:07:42.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.298+0000 7fc82c238640 1 -- start start 2024-09-17T06:07:42.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc82c238640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc810005360 0x7fc82414fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:07:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc82c238640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc824151bb0 0x7fc82415d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:07:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc82c238640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc82414b360 0x7fc82414b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:07:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc82c238640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc824155970 con 0x7fc810005360 2024-09-17T06:07:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc82c238640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8240cb680 con 0x7fc824151bb0 2024-09-17T06:07:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc82c238640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc8240cc1e0 con 0x7fc82414b360 2024-09-17T06:07:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc829fd4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc810005360 0x7fc82414fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:07:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc829fd4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc810005360 0x7fc82414fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48350/0 (socket says 172.21.15.122:48350) 2024-09-17T06:07:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc829fd4640 1 -- 172.21.15.122:0/3281713998 learned_addr learned my addr 172.21.15.122:0/3281713998 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:07:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc82a7d5640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc82414b360 0x7fc82414b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:07:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc829fd4640 1 -- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc82414b360 msgr2=0x7fc82414b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc829fd4640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc82414b360 0x7fc82414b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:42.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc829fd4640 1 -- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc824151bb0 msgr2=0x7fc82415d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:42.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc829fd4640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc824151bb0 0x7fc82415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:42.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc829fd4640 1 -- 172.21.15.122:0/3281713998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8241519a0 con 0x7fc810005360 2024-09-17T06:07:42.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc829fd4640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc810005360 0x7fc82414fa90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc820004e30 tx=0x7fc820001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:07:42.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc81a7fc640 1 -- 172.21.15.122:0/3281713998 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820015020 con 0x7fc810005360 2024-09-17T06:07:42.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc81a7fc640 1 -- 172.21.15.122:0/3281713998 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc820011960 con 0x7fc810005360 2024-09-17T06:07:42.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc82c238640 1 -- 172.21.15.122:0/3281713998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8241f3050 con 0x7fc810005360 2024-09-17T06:07:42.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc81a7fc640 1 -- 172.21.15.122:0/3281713998 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820011d90 con 0x7fc810005360 2024-09-17T06:07:42.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc82c238640 1 -- 172.21.15.122:0/3281713998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8241f2570 con 0x7fc810005360 2024-09-17T06:07:42.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc82c238640 1 -- 172.21.15.122:0/3281713998 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8240cc610 con 0x7fc810005360 2024-09-17T06:07:42.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.302+0000 7fc81a7fc640 1 -- 172.21.15.122:0/3281713998 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc820018020 con 0x7fc810005360 2024-09-17T06:07:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.306+0000 7fc81a7fc640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc808073230 0x7fc808075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:07:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.306+0000 7fc81a7fc640 1 -- 172.21.15.122:0/3281713998 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6825+0+0 (secure 0 0 0) 0x7fc820095110 con 0x7fc810005360 2024-09-17T06:07:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.306+0000 7fc8297d3640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc808073230 0x7fc808075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:07:42.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.306+0000 7fc8297d3640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc808073230 0x7fc808075740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc824159b90 tx=0x7fc814009500 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:07:42.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.310+0000 7fc81a7fc640 1 -- 172.21.15.122:0/3281713998 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc82001f020 con 0x7fc810005360 2024-09-17T06:07:42.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.478+0000 7fc82c238640 1 -- 172.21.15.122:0/3281713998 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc8240d1740 con 0x7fc808073230 2024-09-17T06:07:42.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.494+0000 7fc81a7fc640 1 -- 172.21.15.122:0/3281713998 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332984 (secure 0 0 0) 0x7fc8240d1740 con 0x7fc808073230 2024-09-17T06:07:42.503 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:07:42.505 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:07:42.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.502+0000 7fc82c238640 1 -- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc808073230 msgr2=0x7fc808075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:42.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.502+0000 7fc82c238640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc808073230 0x7fc808075740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc824159b90 tx=0x7fc814009500 comp rx=0 tx=0).stop 2024-09-17T06:07:42.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.502+0000 7fc82c238640 1 -- 172.21.15.122:0/3281713998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc810005360 msgr2=0x7fc82414fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:07:42.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.502+0000 7fc82c238640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc810005360 0x7fc82414fa90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc820004e30 tx=0x7fc820001640 comp rx=0 tx=0).stop 2024-09-17T06:07:42.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.502+0000 7fc82c238640 1 -- 172.21.15.122:0/3281713998 shutdown_connections 2024-09-17T06:07:42.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.502+0000 7fc82c238640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc82414b360 0x7fc82414b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:42.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.502+0000 7fc82c238640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fc808073230 0x7fc808075740 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:42.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.502+0000 7fc82c238640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc824151bb0 0x7fc82415d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:42.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.502+0000 7fc82c238640 1 --2- 172.21.15.122:0/3281713998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc810005360 0x7fc82414fa90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:07:42.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.502+0000 7fc82c238640 1 -- 172.21.15.122:0/3281713998 >> 172.21.15.122:0/3281713998 conn(0x7fc82408d450 msgr2=0x7fc82415a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:07:42.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.502+0000 7fc82c238640 1 -- 172.21.15.122:0/3281713998 shutdown_connections 2024-09-17T06:07:42.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:07:42.502+0000 7fc82c238640 1 -- 172.21.15.122:0/3281713998 wait complete. 2024-09-17T06:07:42.527 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-17T06:07:41.605693+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246896,"kb_used_data":8880,"kb_used_omap":17,"kb_used_meta":237870,"kb_avail":754727824,"statfs":{"total":773094113280,"available":772841291776,"internally_reserved":0,"allocated":9093120,"data_stored":5319704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":243579629},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005667"},"pg_stats":[{"pgid":"2.1f","version":"81'6","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.746227+0000","last_change":"2024-09-17T06:06:38.646633+0000","last_active":"2024-09-17T06:06:49.746227+0000","last_peered":"2024-09-17T06:06:49.746227+0000","last_clean":"2024-09-17T06:06:49.746227+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:06:49.746227+0000","last_undegraded":"2024-09-17T06:06:49.746227+0000","last_fullsized":"2024-09-17T06:06:49.746227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.646522+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:55.373873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751997+0000","last_change":"2024-09-17T06:06:47.678984+0000","last_active":"2024-09-17T06:06:49.751997+0000","last_peered":"2024-09-17T06:06:49.751997+0000","last_clean":"2024-09-17T06:06:49.751997+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:06:49.751997+0000","last_undegraded":"2024-09-17T06:06:49.751997+0000","last_fullsized":"2024-09-17T06:06:49.751997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.678793+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:31.584591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:55.606541+0000","last_change":"2024-09-17T06:06:55.606541+0000","last_active":"2024-09-17T06:06:55.606541+0000","last_peered":"2024-09-17T06:06:55.606541+0000","last_clean":"2024-09-17T06:06:55.606541+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:06:55.606541+0000","last_undegraded":"2024-09-17T06:06:55.606541+0000","last_fullsized":"2024-09-17T06:06:55.606541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.606346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:05.514205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":75,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.752147+0000","last_change":"2024-09-17T06:06:41.626922+0000","last_active":"2024-09-17T06:06:49.752147+0000","last_peered":"2024-09-17T06:06:49.752147+0000","last_clean":"2024-09-17T06:06:49.752147+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:06:49.752147+0000","last_undegraded":"2024-09-17T06:06:49.752147+0000","last_fullsized":"2024-09-17T06:06:49.752147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.626723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:41.581056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.745096+0000","last_change":"2024-09-17T06:06:42.561017+0000","last_active":"2024-09-17T06:06:49.745096+0000","last_peered":"2024-09-17T06:06:49.745096+0000","last_clean":"2024-09-17T06:06:49.745096+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:06:49.745096+0000","last_undegraded":"2024-09-17T06:06:49.745096+0000","last_fullsized":"2024-09-17T06:06:49.745096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.560815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:06.386417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.581741+0000","last_change":"2024-09-17T06:06:50.581741+0000","last_active":"2024-09-17T06:06:50.581741+0000","last_peered":"2024-09-17T06:06:50.581741+0000","last_clean":"2024-09-17T06:06:50.581741+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:06:50.581741+0000","last_undegraded":"2024-09-17T06:06:50.581741+0000","last_fullsized":"2024-09-17T06:06:50.581741+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.581526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:27.538796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.758705+0000","last_change":"2024-09-17T06:06:44.503792+0000","last_active":"2024-09-17T06:06:49.758705+0000","last_peered":"2024-09-17T06:06:49.758705+0000","last_clean":"2024-09-17T06:06:49.758705+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:06:49.758705+0000","last_undegraded":"2024-09-17T06:06:49.758705+0000","last_fullsized":"2024-09-17T06:06:49.758705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.503569+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.329171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751579+0000","last_change":"2024-09-17T06:06:49.490282+0000","last_active":"2024-09-17T06:06:49.751579+0000","last_peered":"2024-09-17T06:06:49.751579+0000","last_clean":"2024-09-17T06:06:49.751579+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:49.751579+0000","last_undegraded":"2024-09-17T06:06:49.751579+0000","last_fullsized":"2024-09-17T06:06:49.751579+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.490084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:52.911935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.542004+0000","last_change":"2024-09-17T06:06:51.542004+0000","last_active":"2024-09-17T06:06:51.542004+0000","last_peered":"2024-09-17T06:06:51.542004+0000","last_clean":"2024-09-17T06:06:51.542004+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:06:51.542004+0000","last_undegraded":"2024-09-17T06:06:51.542004+0000","last_fullsized":"2024-09-17T06:06:51.542004+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.541795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.542454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.758374+0000","last_change":"2024-09-17T06:06:45.535472+0000","last_active":"2024-09-17T06:06:49.758374+0000","last_peered":"2024-09-17T06:06:49.758374+0000","last_clean":"2024-09-17T06:06:49.758374+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:06:49.758374+0000","last_undegraded":"2024-09-17T06:06:49.758374+0000","last_fullsized":"2024-09-17T06:06:49.758374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.535262+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:56.606861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754189+0000","last_change":"2024-09-17T06:06:45.459635+0000","last_active":"2024-09-17T06:06:49.754189+0000","last_peered":"2024-09-17T06:06:49.754189+0000","last_clean":"2024-09-17T06:06:49.754189+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:06:49.754189+0000","last_undegraded":"2024-09-17T06:06:49.754189+0000","last_fullsized":"2024-09-17T06:06:49.754189+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.459406+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:41.152666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.519889+0000","last_change":"2024-09-17T06:06:52.519889+0000","last_active":"2024-09-17T06:06:52.519889+0000","last_peered":"2024-09-17T06:06:52.519889+0000","last_clean":"2024-09-17T06:06:52.519889+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:06:52.519889+0000","last_undegraded":"2024-09-17T06:06:52.519889+0000","last_fullsized":"2024-09-17T06:06:52.519889+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.519692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:06.562811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.857797+0000","last_change":"2024-09-17T06:06:46.282925+0000","last_active":"2024-09-17T06:06:49.857797+0000","last_peered":"2024-09-17T06:06:49.857797+0000","last_clean":"2024-09-17T06:06:49.857797+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:06:49.857797+0000","last_undegraded":"2024-09-17T06:06:49.857797+0000","last_fullsized":"2024-09-17T06:06:49.857797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.282607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:45.646843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":159,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.758127+0000","last_change":"2024-09-17T06:06:47.578055+0000","last_active":"2024-09-17T06:06:49.758127+0000","last_peered":"2024-09-17T06:06:49.758127+0000","last_clean":"2024-09-17T06:06:49.758127+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:06:49.758127+0000","last_undegraded":"2024-09-17T06:06:49.758127+0000","last_fullsized":"2024-09-17T06:06:49.758127+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.577825+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:54.466675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":86,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749786+0000","last_change":"2024-09-17T06:06:48.564278+0000","last_active":"2024-09-17T06:06:49.749786+0000","last_peered":"2024-09-17T06:06:49.749786+0000","last_clean":"2024-09-17T06:06:49.749786+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:06:49.749786+0000","last_undegraded":"2024-09-17T06:06:49.749786+0000","last_fullsized":"2024-09-17T06:06:49.749786+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.564076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:09.526182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750307+0000","last_change":"2024-09-17T06:06:45.719909+0000","last_active":"2024-09-17T06:06:49.750307+0000","last_peered":"2024-09-17T06:06:49.750307+0000","last_clean":"2024-09-17T06:06:49.750307+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:06:49.750307+0000","last_undegraded":"2024-09-17T06:06:49.750307+0000","last_fullsized":"2024-09-17T06:06:49.750307+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.719724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:58.812630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860343+0000","last_change":"2024-09-17T06:06:39.054952+0000","last_active":"2024-09-17T06:06:49.860343+0000","last_peered":"2024-09-17T06:06:49.860343+0000","last_clean":"2024-09-17T06:06:49.860343+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:06:49.860343+0000","last_undegraded":"2024-09-17T06:06:49.860343+0000","last_fullsized":"2024-09-17T06:06:49.860343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.054879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:22.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751397+0000","last_change":"2024-09-17T06:06:47.595782+0000","last_active":"2024-09-17T06:06:49.751397+0000","last_peered":"2024-09-17T06:06:49.751397+0000","last_clean":"2024-09-17T06:06:49.751397+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:06:49.751397+0000","last_undegraded":"2024-09-17T06:06:49.751397+0000","last_fullsized":"2024-09-17T06:06:49.751397+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.595562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.305297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749806+0000","last_change":"2024-09-17T06:06:44.685583+0000","last_active":"2024-09-17T06:06:49.749806+0000","last_peered":"2024-09-17T06:06:49.749806+0000","last_clean":"2024-09-17T06:06:49.749806+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:06:49.749806+0000","last_undegraded":"2024-09-17T06:06:49.749806+0000","last_fullsized":"2024-09-17T06:06:49.749806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.685386+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:42.733827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859499+0000","last_change":"2024-09-17T06:06:41.096528+0000","last_active":"2024-09-17T06:06:49.859499+0000","last_peered":"2024-09-17T06:06:49.859499+0000","last_clean":"2024-09-17T06:06:49.859499+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:06:49.859499+0000","last_undegraded":"2024-09-17T06:06:49.859499+0000","last_fullsized":"2024-09-17T06:06:49.859499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.096443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.182798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.955862+0000","last_change":"2024-09-17T06:06:51.955862+0000","last_active":"2024-09-17T06:06:51.955862+0000","last_peered":"2024-09-17T06:06:51.955862+0000","last_clean":"2024-09-17T06:06:51.955862+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:06:51.955862+0000","last_undegraded":"2024-09-17T06:06:51.955862+0000","last_fullsized":"2024-09-17T06:06:51.955862+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.955662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.579450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":68,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.747588+0000","last_change":"2024-09-17T06:06:41.561023+0000","last_active":"2024-09-17T06:06:49.747588+0000","last_peered":"2024-09-17T06:06:49.747588+0000","last_clean":"2024-09-17T06:06:49.747588+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:06:49.747588+0000","last_undegraded":"2024-09-17T06:06:49.747588+0000","last_fullsized":"2024-09-17T06:06:49.747588+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.560833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:35.979151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.569920+0000","last_change":"2024-09-17T06:06:51.569920+0000","last_active":"2024-09-17T06:06:51.569920+0000","last_peered":"2024-09-17T06:06:51.569920+0000","last_clean":"2024-09-17T06:06:51.569920+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:06:51.569920+0000","last_undegraded":"2024-09-17T06:06:51.569920+0000","last_fullsized":"2024-09-17T06:06:51.569920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.569724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:16.044884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.534994+0000","last_change":"2024-09-17T06:06:54.534994+0000","last_active":"2024-09-17T06:06:54.534994+0000","last_peered":"2024-09-17T06:06:54.534994+0000","last_clean":"2024-09-17T06:06:54.534994+0000","last_became_active":"2024-09-17T06:06:49.862233+0000","last_became_peered":"2024-09-17T06:06:49.862233+0000","last_unstale":"2024-09-17T06:06:54.534994+0000","last_undegraded":"2024-09-17T06:06:54.534994+0000","last_fullsized":"2024-09-17T06:06:54.534994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.534811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:53.555338+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.534811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:09.975013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,1],"acting":[4,2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.745160+0000","last_change":"2024-09-17T06:06:39.595362+0000","last_active":"2024-09-17T06:06:49.745160+0000","last_peered":"2024-09-17T06:06:49.745160+0000","last_clean":"2024-09-17T06:06:49.745160+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:06:49.745160+0000","last_undegraded":"2024-09-17T06:06:49.745160+0000","last_fullsized":"2024-09-17T06:06:49.745160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.595150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:36.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860025+0000","last_change":"2024-09-17T06:06:41.345210+0000","last_active":"2024-09-17T06:06:49.860025+0000","last_peered":"2024-09-17T06:06:49.860025+0000","last_clean":"2024-09-17T06:06:49.860025+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:06:49.860025+0000","last_undegraded":"2024-09-17T06:06:49.860025+0000","last_fullsized":"2024-09-17T06:06:49.860025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.345015+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:38.207077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748131+0000","last_change":"2024-09-17T06:06:44.540629+0000","last_active":"2024-09-17T06:06:49.748131+0000","last_peered":"2024-09-17T06:06:49.748131+0000","last_clean":"2024-09-17T06:06:49.748131+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:06:49.748131+0000","last_undegraded":"2024-09-17T06:06:49.748131+0000","last_fullsized":"2024-09-17T06:06:49.748131+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.540426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:03.473101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751833+0000","last_change":"2024-09-17T06:06:43.669448+0000","last_active":"2024-09-17T06:06:49.751833+0000","last_peered":"2024-09-17T06:06:49.751833+0000","last_clean":"2024-09-17T06:06:49.751833+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:06:49.751833+0000","last_undegraded":"2024-09-17T06:06:49.751833+0000","last_fullsized":"2024-09-17T06:06:49.751833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.669209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:54.877316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.861170+0000","last_change":"2024-09-17T06:06:38.067895+0000","last_active":"2024-09-17T06:06:49.861170+0000","last_peered":"2024-09-17T06:06:49.861170+0000","last_clean":"2024-09-17T06:06:49.861170+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:06:49.861170+0000","last_undegraded":"2024-09-17T06:06:49.861170+0000","last_fullsized":"2024-09-17T06:06:49.861170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.067715+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:26.508119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:56.651636+0000","last_change":"2024-09-17T06:06:56.651636+0000","last_active":"2024-09-17T06:06:56.651636+0000","last_peered":"2024-09-17T06:06:56.651636+0000","last_clean":"2024-09-17T06:06:56.651636+0000","last_became_active":"2024-09-17T06:06:14.875773+0000","last_became_peered":"2024-09-17T06:06:14.875773+0000","last_unstale":"2024-09-17T06:06:56.651636+0000","last_undegraded":"2024-09-17T06:06:56.651636+0000","last_fullsized":"2024-09-17T06:06:56.651636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.651441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:44.887864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860941+0000","last_change":"2024-09-17T06:06:45.060936+0000","last_active":"2024-09-17T06:06:49.860941+0000","last_peered":"2024-09-17T06:06:49.860941+0000","last_clean":"2024-09-17T06:06:49.860941+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:06:49.860941+0000","last_undegraded":"2024-09-17T06:06:49.860941+0000","last_fullsized":"2024-09-17T06:06:49.860941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.060719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:03.842916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.759038+0000","last_change":"2024-09-17T06:06:43.537259+0000","last_active":"2024-09-17T06:06:49.759038+0000","last_peered":"2024-09-17T06:06:49.759038+0000","last_clean":"2024-09-17T06:06:49.759038+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:06:49.759038+0000","last_undegraded":"2024-09-17T06:06:49.759038+0000","last_fullsized":"2024-09-17T06:06:49.759038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.537064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:53.557183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.588334+0000","last_change":"2024-09-17T06:06:50.588334+0000","last_active":"2024-09-17T06:06:50.588334+0000","last_peered":"2024-09-17T06:06:50.588334+0000","last_clean":"2024-09-17T06:06:50.588334+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:06:50.588334+0000","last_undegraded":"2024-09-17T06:06:50.588334+0000","last_fullsized":"2024-09-17T06:06:50.588334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.588146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:34.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.752542+0000","last_change":"2024-09-17T06:06:45.560755+0000","last_active":"2024-09-17T06:06:49.752542+0000","last_peered":"2024-09-17T06:06:49.752542+0000","last_clean":"2024-09-17T06:06:49.752542+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:06:49.752542+0000","last_undegraded":"2024-09-17T06:06:49.752542+0000","last_fullsized":"2024-09-17T06:06:49.752542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.560562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.352415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.861038+0000","last_change":"2024-09-17T06:06:40.077709+0000","last_active":"2024-09-17T06:06:49.861038+0000","last_peered":"2024-09-17T06:06:49.861038+0000","last_clean":"2024-09-17T06:06:49.861038+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:06:49.861038+0000","last_undegraded":"2024-09-17T06:06:49.861038+0000","last_fullsized":"2024-09-17T06:06:49.861038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.077616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:13.235085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.943563+0000","last_change":"2024-09-17T06:06:50.943563+0000","last_active":"2024-09-17T06:06:50.943563+0000","last_peered":"2024-09-17T06:06:50.943563+0000","last_clean":"2024-09-17T06:06:50.943563+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:06:50.943563+0000","last_undegraded":"2024-09-17T06:06:50.943563+0000","last_fullsized":"2024-09-17T06:06:50.943563+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.943366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.661632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750143+0000","last_change":"2024-09-17T06:06:39.544246+0000","last_active":"2024-09-17T06:06:49.750143+0000","last_peered":"2024-09-17T06:06:49.750143+0000","last_clean":"2024-09-17T06:06:49.750143+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:06:49.750143+0000","last_undegraded":"2024-09-17T06:06:49.750143+0000","last_fullsized":"2024-09-17T06:06:49.750143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.544002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:04.906600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748659+0000","last_change":"2024-09-17T06:06:41.601594+0000","last_active":"2024-09-17T06:06:49.748659+0000","last_peered":"2024-09-17T06:06:49.748659+0000","last_clean":"2024-09-17T06:06:49.748659+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:06:49.748659+0000","last_undegraded":"2024-09-17T06:06:49.748659+0000","last_fullsized":"2024-09-17T06:06:49.748659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.601393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.687748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.922504+0000","last_change":"2024-09-17T06:06:49.922504+0000","last_active":"2024-09-17T06:06:49.922504+0000","last_peered":"2024-09-17T06:06:49.922504+0000","last_clean":"2024-09-17T06:06:49.922504+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:06:49.922504+0000","last_undegraded":"2024-09-17T06:06:49.922504+0000","last_fullsized":"2024-09-17T06:06:49.922504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.922302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:53.344154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859489+0000","last_change":"2024-09-17T06:06:42.067931+0000","last_active":"2024-09-17T06:06:49.859489+0000","last_peered":"2024-09-17T06:06:49.859489+0000","last_clean":"2024-09-17T06:06:49.859489+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:06:49.859489+0000","last_undegraded":"2024-09-17T06:06:49.859489+0000","last_fullsized":"2024-09-17T06:06:49.859489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.067737+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.818001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754080+0000","last_change":"2024-09-17T06:06:38.338953+0000","last_active":"2024-09-17T06:06:49.754080+0000","last_peered":"2024-09-17T06:06:49.754080+0000","last_clean":"2024-09-17T06:06:49.754080+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:06:49.754080+0000","last_undegraded":"2024-09-17T06:06:49.754080+0000","last_fullsized":"2024-09-17T06:06:49.754080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.338737+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:58.670904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.861218+0000","last_change":"2024-09-17T06:06:47.938470+0000","last_active":"2024-09-17T06:06:49.861218+0000","last_peered":"2024-09-17T06:06:49.861218+0000","last_clean":"2024-09-17T06:06:49.861218+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:06:49.861218+0000","last_undegraded":"2024-09-17T06:06:49.861218+0000","last_fullsized":"2024-09-17T06:06:49.861218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.938263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.607027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.743075+0000","last_change":"2024-09-17T06:06:41.585374+0000","last_active":"2024-09-17T06:06:49.743075+0000","last_peered":"2024-09-17T06:06:49.743075+0000","last_clean":"2024-09-17T06:06:49.743075+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:06:49.743075+0000","last_undegraded":"2024-09-17T06:06:49.743075+0000","last_fullsized":"2024-09-17T06:06:49.743075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.585183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:11.929990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.756619+0000","last_change":"2024-09-17T06:06:42.536575+0000","last_active":"2024-09-17T06:06:49.756619+0000","last_peered":"2024-09-17T06:06:49.756619+0000","last_clean":"2024-09-17T06:06:49.756619+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:06:49.756619+0000","last_undegraded":"2024-09-17T06:06:49.756619+0000","last_fullsized":"2024-09-17T06:06:49.756619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.536371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:23.547872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744757+0000","last_change":"2024-09-17T06:06:47.627398+0000","last_active":"2024-09-17T06:06:49.744757+0000","last_peered":"2024-09-17T06:06:49.744757+0000","last_clean":"2024-09-17T06:06:49.744757+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:06:49.744757+0000","last_undegraded":"2024-09-17T06:06:49.744757+0000","last_fullsized":"2024-09-17T06:06:49.744757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.627188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:28.206295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750147+0000","last_change":"2024-09-17T06:06:42.642781+0000","last_active":"2024-09-17T06:06:49.750147+0000","last_peered":"2024-09-17T06:06:49.750147+0000","last_clean":"2024-09-17T06:06:49.750147+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:06:49.750147+0000","last_undegraded":"2024-09-17T06:06:49.750147+0000","last_fullsized":"2024-09-17T06:06:49.750147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.642468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:03.874053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749362+0000","last_change":"2024-09-17T06:06:40.563124+0000","last_active":"2024-09-17T06:06:49.749362+0000","last_peered":"2024-09-17T06:06:49.749362+0000","last_clean":"2024-09-17T06:06:49.749362+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:06:49.749362+0000","last_undegraded":"2024-09-17T06:06:49.749362+0000","last_fullsized":"2024-09-17T06:06:49.749362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.562781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:51.528772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"81'74","reported_seq":243,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.756962+0000","last_change":"2024-09-17T06:06:41.529207+0000","last_active":"2024-09-17T06:06:49.756962+0000","last_peered":"2024-09-17T06:06:49.756962+0000","last_clean":"2024-09-17T06:06:49.756962+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:06:49.756962+0000","last_undegraded":"2024-09-17T06:06:49.756962+0000","last_fullsized":"2024-09-17T06:06:49.756962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'74","last_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_deep_scrub":"81'74","last_deep_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.529006+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:17.811347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.168189+0000","last_change":"2024-09-17T06:06:50.168189+0000","last_active":"2024-09-17T06:06:50.168189+0000","last_peered":"2024-09-17T06:06:50.168189+0000","last_clean":"2024-09-17T06:06:50.168189+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:06:50.168189+0000","last_undegraded":"2024-09-17T06:06:50.168189+0000","last_fullsized":"2024-09-17T06:06:50.168189+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.167993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:53.277144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":135,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754353+0000","last_change":"2024-09-17T06:06:46.470862+0000","last_active":"2024-09-17T06:06:49.754353+0000","last_peered":"2024-09-17T06:06:49.754353+0000","last_clean":"2024-09-17T06:06:49.754353+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:06:49.754353+0000","last_undegraded":"2024-09-17T06:06:49.754353+0000","last_fullsized":"2024-09-17T06:06:49.754353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.470640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:54.803752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754535+0000","last_change":"2024-09-17T06:06:39.308543+0000","last_active":"2024-09-17T06:06:49.754535+0000","last_peered":"2024-09-17T06:06:49.754535+0000","last_clean":"2024-09-17T06:06:49.754535+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:06:49.754535+0000","last_undegraded":"2024-09-17T06:06:49.754535+0000","last_fullsized":"2024-09-17T06:06:49.754535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.308468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:26.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":135,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:55.194732+0000","last_change":"2024-09-17T06:06:55.194732+0000","last_active":"2024-09-17T06:06:55.194732+0000","last_peered":"2024-09-17T06:06:55.194732+0000","last_clean":"2024-09-17T06:06:55.194732+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:06:55.194732+0000","last_undegraded":"2024-09-17T06:06:55.194732+0000","last_fullsized":"2024-09-17T06:06:55.194732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.194477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:46.395618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751826+0000","last_change":"2024-09-17T06:06:47.481798+0000","last_active":"2024-09-17T06:06:49.751826+0000","last_peered":"2024-09-17T06:06:49.751826+0000","last_clean":"2024-09-17T06:06:49.751826+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:06:49.751826+0000","last_undegraded":"2024-09-17T06:06:49.751826+0000","last_fullsized":"2024-09-17T06:06:49.751826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.481588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.150352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860641+0000","last_change":"2024-09-17T06:06:43.064298+0000","last_active":"2024-09-17T06:06:49.860641+0000","last_peered":"2024-09-17T06:06:49.860641+0000","last_clean":"2024-09-17T06:06:49.860641+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:06:49.860641+0000","last_undegraded":"2024-09-17T06:06:49.860641+0000","last_fullsized":"2024-09-17T06:06:49.860641+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.064096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:30.993498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.593990+0000","last_change":"2024-09-17T06:06:52.593990+0000","last_active":"2024-09-17T06:06:52.593990+0000","last_peered":"2024-09-17T06:06:52.593990+0000","last_clean":"2024-09-17T06:06:52.593990+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:06:52.593990+0000","last_undegraded":"2024-09-17T06:06:52.593990+0000","last_fullsized":"2024-09-17T06:06:52.593990+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.593787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:04.850781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.758420+0000","last_change":"2024-09-17T06:06:46.576306+0000","last_active":"2024-09-17T06:06:49.758420+0000","last_peered":"2024-09-17T06:06:49.758420+0000","last_clean":"2024-09-17T06:06:49.758420+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:06:49.758420+0000","last_undegraded":"2024-09-17T06:06:49.758420+0000","last_fullsized":"2024-09-17T06:06:49.758420+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:36.552616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'3","reported_seq":147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754961+0000","last_change":"2024-09-17T06:06:40.289371+0000","last_active":"2024-09-17T06:06:49.754961+0000","last_peered":"2024-09-17T06:06:49.754961+0000","last_clean":"2024-09-17T06:06:49.754961+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:06:49.754961+0000","last_undegraded":"2024-09-17T06:06:49.754961+0000","last_fullsized":"2024-09-17T06:06:49.754961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.289195+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.187275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:57.580034+0000","last_change":"2024-09-17T06:06:57.580034+0000","last_active":"2024-09-17T06:06:57.580034+0000","last_peered":"2024-09-17T06:06:57.580034+0000","last_clean":"2024-09-17T06:06:57.580034+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:06:57.580034+0000","last_undegraded":"2024-09-17T06:06:57.580034+0000","last_fullsized":"2024-09-17T06:06:57.580034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.579707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:15.990501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:53.554156+0000","last_change":"2024-09-17T06:06:53.554156+0000","last_active":"2024-09-17T06:06:53.554156+0000","last_peered":"2024-09-17T06:06:53.554156+0000","last_clean":"2024-09-17T06:06:53.554156+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:06:53.554156+0000","last_undegraded":"2024-09-17T06:06:53.554156+0000","last_fullsized":"2024-09-17T06:06:53.554156+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.553919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:37.374837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749434+0000","last_change":"2024-09-17T06:06:40.545470+0000","last_active":"2024-09-17T06:06:49.749434+0000","last_peered":"2024-09-17T06:06:49.749434+0000","last_clean":"2024-09-17T06:06:49.749434+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:06:49.749434+0000","last_undegraded":"2024-09-17T06:06:49.749434+0000","last_fullsized":"2024-09-17T06:06:49.749434+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.545271+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:41.942375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748456+0000","last_change":"2024-09-17T06:06:46.553900+0000","last_active":"2024-09-17T06:06:49.748456+0000","last_peered":"2024-09-17T06:06:49.748456+0000","last_clean":"2024-09-17T06:06:49.748456+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:06:49.748456+0000","last_undegraded":"2024-09-17T06:06:49.748456+0000","last_fullsized":"2024-09-17T06:06:49.748456+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.553594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:37.347089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.757000+0000","last_change":"2024-09-17T06:06:49.557072+0000","last_active":"2024-09-17T06:06:49.757000+0000","last_peered":"2024-09-17T06:06:49.757000+0000","last_clean":"2024-09-17T06:06:49.757000+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:06:49.757000+0000","last_undegraded":"2024-09-17T06:06:49.757000+0000","last_fullsized":"2024-09-17T06:06:49.757000+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.556746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:02.173527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'13","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.753380+0000","last_change":"2024-09-17T06:06:41.327726+0000","last_active":"2024-09-17T06:06:49.753380+0000","last_peered":"2024-09-17T06:06:49.753380+0000","last_clean":"2024-09-17T06:06:49.753380+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:06:49.753380+0000","last_undegraded":"2024-09-17T06:06:49.753380+0000","last_fullsized":"2024-09-17T06:06:49.753380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'13","last_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_deep_scrub":"81'13","last_deep_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.327620+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:41.975086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744584+0000","last_change":"2024-09-17T06:06:48.590089+0000","last_active":"2024-09-17T06:06:49.744584+0000","last_peered":"2024-09-17T06:06:49.744584+0000","last_clean":"2024-09-17T06:06:49.744584+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:06:49.744584+0000","last_undegraded":"2024-09-17T06:06:49.744584+0000","last_fullsized":"2024-09-17T06:06:49.744584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.589881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:13.065040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.857805+0000","last_change":"2024-09-17T06:06:47.234619+0000","last_active":"2024-09-17T06:06:49.857805+0000","last_peered":"2024-09-17T06:06:49.857805+0000","last_clean":"2024-09-17T06:06:49.857805+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:06:49.857805+0000","last_undegraded":"2024-09-17T06:06:49.857805+0000","last_fullsized":"2024-09-17T06:06:49.857805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.234392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:10.297041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.858044+0000","last_change":"2024-09-17T06:06:42.362985+0000","last_active":"2024-09-17T06:06:49.858044+0000","last_peered":"2024-09-17T06:06:49.858044+0000","last_clean":"2024-09-17T06:06:49.858044+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:06:49.858044+0000","last_undegraded":"2024-09-17T06:06:49.858044+0000","last_fullsized":"2024-09-17T06:06:49.858044+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.362795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:21.306942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.645399+0000","last_change":"2024-09-17T06:06:54.645399+0000","last_active":"2024-09-17T06:06:54.645399+0000","last_peered":"2024-09-17T06:06:54.645399+0000","last_clean":"2024-09-17T06:06:54.645399+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:06:54.645399+0000","last_undegraded":"2024-09-17T06:06:54.645399+0000","last_fullsized":"2024-09-17T06:06:54.645399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.645200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:04.728298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":167,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.757580+0000","last_change":"2024-09-17T06:06:48.595269+0000","last_active":"2024-09-17T06:06:49.757580+0000","last_peered":"2024-09-17T06:06:49.757580+0000","last_clean":"2024-09-17T06:06:49.757580+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:06:49.757580+0000","last_undegraded":"2024-09-17T06:06:49.757580+0000","last_fullsized":"2024-09-17T06:06:49.757580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.595073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:51.297831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748599+0000","last_change":"2024-09-17T06:06:42.583243+0000","last_active":"2024-09-17T06:06:49.748599+0000","last_peered":"2024-09-17T06:06:49.748599+0000","last_clean":"2024-09-17T06:06:49.748599+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:06:49.748599+0000","last_undegraded":"2024-09-17T06:06:49.748599+0000","last_fullsized":"2024-09-17T06:06:49.748599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.583048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:54.333313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:57.607574+0000","last_change":"2024-09-17T06:06:57.607574+0000","last_active":"2024-09-17T06:06:57.607574+0000","last_peered":"2024-09-17T06:06:57.607574+0000","last_clean":"2024-09-17T06:06:57.607574+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:06:57.607574+0000","last_undegraded":"2024-09-17T06:06:57.607574+0000","last_fullsized":"2024-09-17T06:06:57.607574+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.607379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:56.898447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":153,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744169+0000","last_change":"2024-09-17T06:06:45.591584+0000","last_active":"2024-09-17T06:06:49.744169+0000","last_peered":"2024-09-17T06:06:49.744169+0000","last_clean":"2024-09-17T06:06:49.744169+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:06:49.744169+0000","last_undegraded":"2024-09-17T06:06:49.744169+0000","last_fullsized":"2024-09-17T06:06:49.744169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.591276+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:08.653925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":159,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744538+0000","last_change":"2024-09-17T06:06:37.667757+0000","last_active":"2024-09-17T06:06:49.744538+0000","last_peered":"2024-09-17T06:06:49.744538+0000","last_clean":"2024-09-17T06:06:49.744538+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:06:49.744538+0000","last_undegraded":"2024-09-17T06:06:49.744538+0000","last_fullsized":"2024-09-17T06:06:49.744538+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_clean_scrub_stamp":"2024-09-17T06:06:37.667675+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:46.885860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:56.615164+0000","last_change":"2024-09-17T06:06:56.615164+0000","last_active":"2024-09-17T06:06:56.615164+0000","last_peered":"2024-09-17T06:06:56.615164+0000","last_clean":"2024-09-17T06:06:56.615164+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:06:56.615164+0000","last_undegraded":"2024-09-17T06:06:56.615164+0000","last_fullsized":"2024-09-17T06:06:56.615164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.614970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:07.482666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.577732+0000","last_change":"2024-09-17T06:06:52.577732+0000","last_active":"2024-09-17T06:06:52.577732+0000","last_peered":"2024-09-17T06:06:52.577732+0000","last_clean":"2024-09-17T06:06:52.577732+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:06:52.577732+0000","last_undegraded":"2024-09-17T06:06:52.577732+0000","last_fullsized":"2024-09-17T06:06:52.577732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.577533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:34.161856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":169,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.858709+0000","last_change":"2024-09-17T06:06:43.358428+0000","last_active":"2024-09-17T06:06:49.858709+0000","last_peered":"2024-09-17T06:06:49.858709+0000","last_clean":"2024-09-17T06:06:49.858709+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:06:49.858709+0000","last_undegraded":"2024-09-17T06:06:49.858709+0000","last_fullsized":"2024-09-17T06:06:49.858709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'27","last_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_deep_scrub":"81'27","last_deep_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.358219+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:13.703025+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":140,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.944474+0000","last_change":"2024-09-17T06:06:52.944474+0000","last_active":"2024-09-17T06:06:52.944474+0000","last_peered":"2024-09-17T06:06:52.944474+0000","last_clean":"2024-09-17T06:06:52.944474+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:06:52.944474+0000","last_undegraded":"2024-09-17T06:06:52.944474+0000","last_fullsized":"2024-09-17T06:06:52.944474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.944213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.533972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":77,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750311+0000","last_change":"2024-09-17T06:06:43.557285+0000","last_active":"2024-09-17T06:06:49.750311+0000","last_peered":"2024-09-17T06:06:49.750311+0000","last_clean":"2024-09-17T06:06:49.750311+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:06:49.750311+0000","last_undegraded":"2024-09-17T06:06:49.750311+0000","last_fullsized":"2024-09-17T06:06:49.750311+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.557090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:01.412234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"81'9","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.752887+0000","last_change":"2024-09-17T06:06:43.599342+0000","last_active":"2024-09-17T06:06:49.752887+0000","last_peered":"2024-09-17T06:06:49.752887+0000","last_clean":"2024-09-17T06:06:49.752887+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:06:49.752887+0000","last_undegraded":"2024-09-17T06:06:49.752887+0000","last_fullsized":"2024-09-17T06:06:49.752887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.599114+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:49.432076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749353+0000","last_change":"2024-09-17T06:06:49.561761+0000","last_active":"2024-09-17T06:06:49.749353+0000","last_peered":"2024-09-17T06:06:49.749353+0000","last_clean":"2024-09-17T06:06:49.749353+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:06:49.749353+0000","last_undegraded":"2024-09-17T06:06:49.749353+0000","last_fullsized":"2024-09-17T06:06:49.749353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.561572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:15.208406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":153,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.746162+0000","last_change":"2024-09-17T06:06:40.581076+0000","last_active":"2024-09-17T06:06:49.746162+0000","last_peered":"2024-09-17T06:06:49.746162+0000","last_clean":"2024-09-17T06:06:49.746162+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:06:49.746162+0000","last_undegraded":"2024-09-17T06:06:49.746162+0000","last_fullsized":"2024-09-17T06:06:49.746162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.580978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:19.525125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.753149+0000","last_change":"2024-09-17T06:06:44.589361+0000","last_active":"2024-09-17T06:06:49.753149+0000","last_peered":"2024-09-17T06:06:49.753149+0000","last_clean":"2024-09-17T06:06:49.753149+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:06:49.753149+0000","last_undegraded":"2024-09-17T06:06:49.753149+0000","last_fullsized":"2024-09-17T06:06:49.753149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.589149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.705503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":113,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:58.599122+0000","last_change":"2024-09-17T06:06:58.599122+0000","last_active":"2024-09-17T06:06:58.599122+0000","last_peered":"2024-09-17T06:06:58.599122+0000","last_clean":"2024-09-17T06:06:58.599122+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:06:58.599122+0000","last_undegraded":"2024-09-17T06:06:58.599122+0000","last_fullsized":"2024-09-17T06:06:58.599122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_clean_scrub_stamp":"2024-09-17T06:06:58.598909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.505821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":153,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.752815+0000","last_change":"2024-09-17T06:06:48.493667+0000","last_active":"2024-09-17T06:06:49.752815+0000","last_peered":"2024-09-17T06:06:49.752815+0000","last_clean":"2024-09-17T06:06:49.752815+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:06:49.752815+0000","last_undegraded":"2024-09-17T06:06:49.752815+0000","last_fullsized":"2024-09-17T06:06:49.752815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.493470+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.837170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859785+0000","last_change":"2024-09-17T06:06:44.333474+0000","last_active":"2024-09-17T06:06:49.859785+0000","last_peered":"2024-09-17T06:06:49.859785+0000","last_clean":"2024-09-17T06:06:49.859785+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:06:49.859785+0000","last_undegraded":"2024-09-17T06:06:49.859785+0000","last_fullsized":"2024-09-17T06:06:49.859785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.333150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.158751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.699338+0000","last_change":"2024-09-17T06:06:52.699338+0000","last_active":"2024-09-17T06:06:52.699338+0000","last_peered":"2024-09-17T06:06:52.699338+0000","last_clean":"2024-09-17T06:06:52.699338+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:06:52.699338+0000","last_undegraded":"2024-09-17T06:06:52.699338+0000","last_fullsized":"2024-09-17T06:06:52.699338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.699134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:51.626769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.743506+0000","last_change":"2024-09-17T06:06:49.633934+0000","last_active":"2024-09-17T06:06:49.743506+0000","last_peered":"2024-09-17T06:06:49.743506+0000","last_clean":"2024-09-17T06:06:49.743506+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:06:49.743506+0000","last_undegraded":"2024-09-17T06:06:49.743506+0000","last_fullsized":"2024-09-17T06:06:49.743506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.633660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.217982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859138+0000","last_change":"2024-09-17T06:06:46.974853+0000","last_active":"2024-09-17T06:06:49.859138+0000","last_peered":"2024-09-17T06:06:49.859138+0000","last_clean":"2024-09-17T06:06:49.859138+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:06:49.859138+0000","last_undegraded":"2024-09-17T06:06:49.859138+0000","last_fullsized":"2024-09-17T06:06:49.859138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.974637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:26.337532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.748920+0000","last_change":"2024-09-17T06:06:46.527438+0000","last_active":"2024-09-17T06:06:49.748920+0000","last_peered":"2024-09-17T06:06:49.748920+0000","last_clean":"2024-09-17T06:06:49.748920+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:06:49.748920+0000","last_undegraded":"2024-09-17T06:06:49.748920+0000","last_fullsized":"2024-09-17T06:06:49.748920+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.527230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:25.890125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":135,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.199209+0000","last_change":"2024-09-17T06:06:54.199209+0000","last_active":"2024-09-17T06:06:54.199209+0000","last_peered":"2024-09-17T06:06:54.199209+0000","last_clean":"2024-09-17T06:06:54.199209+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:06:54.199209+0000","last_undegraded":"2024-09-17T06:06:54.199209+0000","last_fullsized":"2024-09-17T06:06:54.199209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.198989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:51.609301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.749502+0000","last_change":"2024-09-17T06:06:46.699017+0000","last_active":"2024-09-17T06:06:49.749502+0000","last_peered":"2024-09-17T06:06:49.749502+0000","last_clean":"2024-09-17T06:06:49.749502+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:06:49.749502+0000","last_undegraded":"2024-09-17T06:06:49.749502+0000","last_fullsized":"2024-09-17T06:06:49.749502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.698821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:33.586359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":74,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751839+0000","last_change":"2024-09-17T06:06:40.624617+0000","last_active":"2024-09-17T06:06:49.751839+0000","last_peered":"2024-09-17T06:06:49.751839+0000","last_clean":"2024-09-17T06:06:49.751839+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:06:49.751839+0000","last_undegraded":"2024-09-17T06:06:49.751839+0000","last_fullsized":"2024-09-17T06:06:49.751839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.624540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:48.054970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.858437+0000","last_change":"2024-09-17T06:06:45.311790+0000","last_active":"2024-09-17T06:06:49.858437+0000","last_peered":"2024-09-17T06:06:49.858437+0000","last_clean":"2024-09-17T06:06:49.858437+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:06:49.858437+0000","last_undegraded":"2024-09-17T06:06:49.858437+0000","last_fullsized":"2024-09-17T06:06:49.858437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.311572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:05.215110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744226+0000","last_change":"2024-09-17T06:06:43.594929+0000","last_active":"2024-09-17T06:06:49.744226+0000","last_peered":"2024-09-17T06:06:49.744226+0000","last_clean":"2024-09-17T06:06:49.744226+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:06:49.744226+0000","last_undegraded":"2024-09-17T06:06:49.744226+0000","last_fullsized":"2024-09-17T06:06:49.744226+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.594608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:54.666206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":136,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.753903+0000","last_change":"2024-09-17T06:06:44.420446+0000","last_active":"2024-09-17T06:06:49.753903+0000","last_peered":"2024-09-17T06:06:49.753903+0000","last_clean":"2024-09-17T06:06:49.753903+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:06:49.753903+0000","last_undegraded":"2024-09-17T06:06:49.753903+0000","last_fullsized":"2024-09-17T06:06:49.753903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.420226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:35.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":76,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750435+0000","last_change":"2024-09-17T06:06:39.644661+0000","last_active":"2024-09-17T06:06:49.750435+0000","last_peered":"2024-09-17T06:06:49.750435+0000","last_clean":"2024-09-17T06:06:49.750435+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:06:49.750435+0000","last_undegraded":"2024-09-17T06:06:49.750435+0000","last_fullsized":"2024-09-17T06:06:49.750435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.644581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:43.034866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.747384+0000","last_change":"2024-09-17T06:06:42.552587+0000","last_active":"2024-09-17T06:06:49.747384+0000","last_peered":"2024-09-17T06:06:49.747384+0000","last_clean":"2024-09-17T06:06:49.747384+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:06:49.747384+0000","last_undegraded":"2024-09-17T06:06:49.747384+0000","last_fullsized":"2024-09-17T06:06:49.747384+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.552253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:16.204277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":129,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:59.590058+0000","last_change":"2024-09-17T06:06:59.590058+0000","last_active":"2024-09-17T06:06:59.590058+0000","last_peered":"2024-09-17T06:06:59.590058+0000","last_clean":"2024-09-17T06:06:59.590058+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:06:59.590058+0000","last_undegraded":"2024-09-17T06:06:59.590058+0000","last_fullsized":"2024-09-17T06:06:59.590058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_clean_scrub_stamp":"2024-09-17T06:06:59.589844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:13.777383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.857577+0000","last_change":"2024-09-17T06:06:49.212293+0000","last_active":"2024-09-17T06:06:49.857577+0000","last_peered":"2024-09-17T06:06:49.857577+0000","last_clean":"2024-09-17T06:06:49.857577+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:06:49.857577+0000","last_undegraded":"2024-09-17T06:06:49.857577+0000","last_fullsized":"2024-09-17T06:06:49.857577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.211966+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:29.791073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.753750+0000","last_change":"2024-09-17T06:06:43.370824+0000","last_active":"2024-09-17T06:06:49.753750+0000","last_peered":"2024-09-17T06:06:49.753750+0000","last_clean":"2024-09-17T06:06:49.753750+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:06:49.753750+0000","last_undegraded":"2024-09-17T06:06:49.753750+0000","last_fullsized":"2024-09-17T06:06:49.753750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.370630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:28.698931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.490824+0000","last_change":"2024-09-17T06:06:50.490824+0000","last_active":"2024-09-17T06:06:50.490824+0000","last_peered":"2024-09-17T06:06:50.490824+0000","last_clean":"2024-09-17T06:06:50.490824+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:06:50.490824+0000","last_undegraded":"2024-09-17T06:06:50.490824+0000","last_fullsized":"2024-09-17T06:06:50.490824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.490494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.208761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.564398+0000","last_change":"2024-09-17T06:06:54.564398+0000","last_active":"2024-09-17T06:06:54.564398+0000","last_peered":"2024-09-17T06:06:54.564398+0000","last_clean":"2024-09-17T06:06:54.564398+0000","last_became_active":"2024-09-17T06:06:49.863977+0000","last_became_peered":"2024-09-17T06:06:49.863977+0000","last_unstale":"2024-09-17T06:06:54.564398+0000","last_undegraded":"2024-09-17T06:06:54.564398+0000","last_fullsized":"2024-09-17T06:06:54.564398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:54.564097+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:53.583377+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.564097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:45.765238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":115,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751434+0000","last_change":"2024-09-17T06:06:48.701826+0000","last_active":"2024-09-17T06:06:49.751434+0000","last_peered":"2024-09-17T06:06:49.751434+0000","last_clean":"2024-09-17T06:06:49.751434+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:06:49.751434+0000","last_undegraded":"2024-09-17T06:06:49.751434+0000","last_fullsized":"2024-09-17T06:06:49.751434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.701596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:43:38.318752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860476+0000","last_change":"2024-09-17T06:06:44.071550+0000","last_active":"2024-09-17T06:06:49.860476+0000","last_peered":"2024-09-17T06:06:49.860476+0000","last_clean":"2024-09-17T06:06:49.860476+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:06:49.860476+0000","last_undegraded":"2024-09-17T06:06:49.860476+0000","last_fullsized":"2024-09-17T06:06:49.860476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.071343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:50.902738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859970+0000","last_change":"2024-09-17T06:06:48.219488+0000","last_active":"2024-09-17T06:06:49.859970+0000","last_peered":"2024-09-17T06:06:49.859970+0000","last_clean":"2024-09-17T06:06:49.859970+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:06:49.859970+0000","last_undegraded":"2024-09-17T06:06:49.859970+0000","last_fullsized":"2024-09-17T06:06:49.859970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.219293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:00.836074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":113,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.710122+0000","last_change":"2024-09-17T06:06:50.710122+0000","last_active":"2024-09-17T06:06:50.710122+0000","last_peered":"2024-09-17T06:06:50.710122+0000","last_clean":"2024-09-17T06:06:50.710122+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:06:50.710122+0000","last_undegraded":"2024-09-17T06:06:50.710122+0000","last_fullsized":"2024-09-17T06:06:50.710122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.709804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:24.696128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":113,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.502412+0000","last_change":"2024-09-17T06:06:51.502240+0000","last_active":"2024-09-17T06:06:51.502412+0000","last_peered":"2024-09-17T06:06:51.502412+0000","last_clean":"2024-09-17T06:06:51.502412+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:06:51.502412+0000","last_undegraded":"2024-09-17T06:06:51.502412+0000","last_fullsized":"2024-09-17T06:06:51.502412+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.502041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.125829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":119,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.751190+0000","last_change":"2024-09-17T06:06:49.687515+0000","last_active":"2024-09-17T06:06:49.751190+0000","last_peered":"2024-09-17T06:06:49.751190+0000","last_clean":"2024-09-17T06:06:49.751190+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:06:49.751190+0000","last_undegraded":"2024-09-17T06:06:49.751190+0000","last_fullsized":"2024-09-17T06:06:49.751190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.687322+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:09.182168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.762506+0000","last_change":"2024-09-17T06:06:49.761230+0000","last_active":"2024-09-17T06:06:49.762506+0000","last_peered":"2024-09-17T06:06:49.762506+0000","last_clean":"2024-09-17T06:06:49.762506+0000","last_became_active":"2024-09-17T06:06:49.760405+0000","last_became_peered":"2024-09-17T06:06:49.760405+0000","last_unstale":"2024-09-17T06:06:49.762506+0000","last_undegraded":"2024-09-17T06:06:49.762506+0000","last_fullsized":"2024-09-17T06:06:49.762506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:18.198271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":155,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.561891+0000","last_change":"2024-09-17T06:06:51.561891+0000","last_active":"2024-09-17T06:06:51.561891+0000","last_peered":"2024-09-17T06:06:51.561891+0000","last_clean":"2024-09-17T06:06:51.561891+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:06:51.561891+0000","last_undegraded":"2024-09-17T06:06:51.561891+0000","last_fullsized":"2024-09-17T06:06:51.561891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.561576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:27.536230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.171689+0000","last_change":"2024-09-17T06:06:51.171689+0000","last_active":"2024-09-17T06:06:51.171689+0000","last_peered":"2024-09-17T06:06:51.171689+0000","last_clean":"2024-09-17T06:06:51.171689+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:06:51.171689+0000","last_undegraded":"2024-09-17T06:06:51.171689+0000","last_fullsized":"2024-09-17T06:06:51.171689+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.171493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:39.452849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:55.610932+0000","last_change":"2024-09-17T06:06:55.610932+0000","last_active":"2024-09-17T06:06:55.610932+0000","last_peered":"2024-09-17T06:06:55.610932+0000","last_clean":"2024-09-17T06:06:55.610932+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:06:55.610932+0000","last_undegraded":"2024-09-17T06:06:55.610932+0000","last_fullsized":"2024-09-17T06:06:55.610932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.610700+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:07.867694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.754627+0000","last_change":"2024-09-17T06:06:42.353051+0000","last_active":"2024-09-17T06:06:49.754627+0000","last_peered":"2024-09-17T06:06:49.754627+0000","last_clean":"2024-09-17T06:06:49.754627+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:06:49.754627+0000","last_undegraded":"2024-09-17T06:06:49.754627+0000","last_fullsized":"2024-09-17T06:06:49.754627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.352711+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:14.862093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.529037+0000","last_change":"2024-09-17T06:06:52.529037+0000","last_active":"2024-09-17T06:06:52.529037+0000","last_peered":"2024-09-17T06:06:52.529037+0000","last_clean":"2024-09-17T06:06:52.529037+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:06:52.529037+0000","last_undegraded":"2024-09-17T06:06:52.529037+0000","last_fullsized":"2024-09-17T06:06:52.529037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.528843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.118602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:53.547108+0000","last_change":"2024-09-17T06:06:53.547108+0000","last_active":"2024-09-17T06:06:53.547108+0000","last_peered":"2024-09-17T06:06:53.547108+0000","last_clean":"2024-09-17T06:06:53.547108+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:06:53.547108+0000","last_undegraded":"2024-09-17T06:06:53.547108+0000","last_fullsized":"2024-09-17T06:06:53.547108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.546853+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:05.208153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.859294+0000","last_change":"2024-09-17T06:06:48.919436+0000","last_active":"2024-09-17T06:06:49.859294+0000","last_peered":"2024-09-17T06:06:49.859294+0000","last_clean":"2024-09-17T06:06:49.859294+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:06:49.859294+0000","last_undegraded":"2024-09-17T06:06:49.859294+0000","last_fullsized":"2024-09-17T06:06:49.859294+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.919235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:27.262935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.743865+0000","last_change":"2024-09-17T06:06:44.636882+0000","last_active":"2024-09-17T06:06:49.743865+0000","last_peered":"2024-09-17T06:06:49.743865+0000","last_clean":"2024-09-17T06:06:49.743865+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:06:49.743865+0000","last_undegraded":"2024-09-17T06:06:49.743865+0000","last_fullsized":"2024-09-17T06:06:49.743865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.636626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:44.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":83,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:51.717905+0000","last_change":"2024-09-17T06:06:51.717905+0000","last_active":"2024-09-17T06:06:51.717905+0000","last_peered":"2024-09-17T06:06:51.717905+0000","last_clean":"2024-09-17T06:06:51.717905+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:06:51.717905+0000","last_undegraded":"2024-09-17T06:06:51.717905+0000","last_fullsized":"2024-09-17T06:06:51.717905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.717694+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:59.444208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.750868+0000","last_change":"2024-09-17T06:06:45.539679+0000","last_active":"2024-09-17T06:06:49.750868+0000","last_peered":"2024-09-17T06:06:49.750868+0000","last_clean":"2024-09-17T06:06:49.750868+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:06:49.750868+0000","last_undegraded":"2024-09-17T06:06:49.750868+0000","last_fullsized":"2024-09-17T06:06:49.750868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.539468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:55.832105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:52.213250+0000","last_change":"2024-09-17T06:06:52.213250+0000","last_active":"2024-09-17T06:06:52.213250+0000","last_peered":"2024-09-17T06:06:52.213250+0000","last_clean":"2024-09-17T06:06:52.213250+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:06:52.213250+0000","last_undegraded":"2024-09-17T06:06:52.213250+0000","last_fullsized":"2024-09-17T06:06:52.213250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.213042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:36.033960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":156,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:53.226240+0000","last_change":"2024-09-17T06:06:53.226240+0000","last_active":"2024-09-17T06:06:53.226240+0000","last_peered":"2024-09-17T06:06:53.226240+0000","last_clean":"2024-09-17T06:06:53.226240+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:06:53.226240+0000","last_undegraded":"2024-09-17T06:06:53.226240+0000","last_fullsized":"2024-09-17T06:06:53.226240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'16","last_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_deep_scrub":"81'16","last_deep_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.226044+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:15.604828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:50.593476+0000","last_change":"2024-09-17T06:06:50.593476+0000","last_active":"2024-09-17T06:06:50.593476+0000","last_peered":"2024-09-17T06:06:50.593476+0000","last_clean":"2024-09-17T06:06:50.593476+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:06:50.593476+0000","last_undegraded":"2024-09-17T06:06:50.593476+0000","last_fullsized":"2024-09-17T06:06:50.593476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.593281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.041524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":82,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:53.662277+0000","last_change":"2024-09-17T06:06:53.662277+0000","last_active":"2024-09-17T06:06:53.662277+0000","last_peered":"2024-09-17T06:06:53.662277+0000","last_clean":"2024-09-17T06:06:53.662277+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:06:53.662277+0000","last_undegraded":"2024-09-17T06:06:53.662277+0000","last_fullsized":"2024-09-17T06:06:53.662277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.662083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:09.458813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.601401+0000","last_change":"2024-09-17T06:06:54.601401+0000","last_active":"2024-09-17T06:06:54.601401+0000","last_peered":"2024-09-17T06:06:54.601401+0000","last_clean":"2024-09-17T06:06:54.601401+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:06:54.601401+0000","last_undegraded":"2024-09-17T06:06:54.601401+0000","last_fullsized":"2024-09-17T06:06:54.601401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.601206+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:30.575859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:54.592256+0000","last_change":"2024-09-17T06:06:54.592256+0000","last_active":"2024-09-17T06:06:54.592256+0000","last_peered":"2024-09-17T06:06:54.592256+0000","last_clean":"2024-09-17T06:06:54.592256+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:06:54.592256+0000","last_undegraded":"2024-09-17T06:06:54.592256+0000","last_fullsized":"2024-09-17T06:06:54.592256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.591916+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:43.180179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:57.597911+0000","last_change":"2024-09-17T06:06:57.597911+0000","last_active":"2024-09-17T06:06:57.597911+0000","last_peered":"2024-09-17T06:06:57.597911+0000","last_clean":"2024-09-17T06:06:57.597911+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:06:57.597911+0000","last_undegraded":"2024-09-17T06:06:57.597911+0000","last_fullsized":"2024-09-17T06:06:57.597911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.597715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:05.028145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:55.569378+0000","last_change":"2024-09-17T06:06:55.569378+0000","last_active":"2024-09-17T06:06:55.569378+0000","last_peered":"2024-09-17T06:06:55.569378+0000","last_clean":"2024-09-17T06:06:55.569378+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:06:55.569378+0000","last_undegraded":"2024-09-17T06:06:55.569378+0000","last_fullsized":"2024-09-17T06:06:55.569378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.569171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:50.988830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.744160+0000","last_change":"2024-09-17T06:06:46.576687+0000","last_active":"2024-09-17T06:06:49.744160+0000","last_peered":"2024-09-17T06:06:49.744160+0000","last_clean":"2024-09-17T06:06:49.744160+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:06:49.744160+0000","last_undegraded":"2024-09-17T06:06:49.744160+0000","last_fullsized":"2024-09-17T06:06:49.744160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:36.143901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:49.860930+0000","last_change":"2024-09-17T06:06:46.022759+0000","last_active":"2024-09-17T06:06:49.860930+0000","last_peered":"2024-09-17T06:06:49.860930+0000","last_clean":"2024-09-17T06:06:49.860930+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:06:49.860930+0000","last_undegraded":"2024-09-17T06:06:49.860930+0000","last_fullsized":"2024-09-17T06:06:49.860930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.022447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.814300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T06:06:56.620251+0000","last_change":"2024-09-17T06:06:56.620251+0000","last_active":"2024-09-17T06:06:56.620251+0000","last_peered":"2024-09-17T06:06:56.620251+0000","last_clean":"2024-09-17T06:06:56.620251+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:06:56.620251+0000","last_undegraded":"2024-09-17T06:06:56.620251+0000","last_fullsized":"2024-09-17T06:06:56.620251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.619933+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:00.010218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1019904,"data_stored":544734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":508396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509490,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1581056,"data_stored":1099080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1568768,"data_stored":1098934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":544322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906966,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29008,"kb_used_data":960,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342832,"statfs":{"total":96636764160,"available":96607059968,"internally_reserved":0,"allocated":983040,"data_stored":508110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":508054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":508074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:07:42.534 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:07:42.535 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T06:08:02.536 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:08:02.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.698+0000 7fd9c163d640 1 -- 172.21.15.122:0/1284738378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9a4004810 msgr2=0x7fd9a4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:02.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.698+0000 7fd9c163d640 1 --2- 172.21.15.122:0/1284738378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9a4004810 0x7fd9a4004c20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc074230 tx=0x7fd9b001c6b0 comp rx=0 tx=0).stop 2024-09-17T06:08:02.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.698+0000 7fd9bb7fe640 1 -- 172.21.15.122:0/1284738378 reap_dead start 2024-09-17T06:08:02.703 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.698+0000 7fd9c163d640 1 -- 172.21.15.122:0/1284738378 shutdown_connections 2024-09-17T06:08:02.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.698+0000 7fd9c163d640 1 -- 172.21.15.122:0/1284738378 >> 172.21.15.122:0/1284738378 conn(0x7fd9bc0746d0 msgr2=0x7fd9bc074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:08:02.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.698+0000 7fd9c163d640 1 -- 172.21.15.122:0/1284738378 shutdown_connections 2024-09-17T06:08:02.704 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.698+0000 7fd9c163d640 1 -- 172.21.15.122:0/1284738378 wait complete. 2024-09-17T06:08:02.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9c163d640 1 Processor -- start 2024-09-17T06:08:02.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9c163d640 1 -- start start 2024-09-17T06:08:02.708 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9c163d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a4004810 0x7fd9bc1f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:08:02.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9c163d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0cbb90 0x7fd9bc148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:08:02.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9c163d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9bc145e80 0x7fd9bc146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:08:02.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9c163d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd9bc0b8d70 con 0x7fd9bc0cbb90 2024-09-17T06:08:02.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9c163d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd9bc15d5f0 con 0x7fd9a4004810 2024-09-17T06:08:02.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9c163d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd9bc0b8ef0 con 0x7fd9bc145e80 2024-09-17T06:08:02.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9ba7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0cbb90 0x7fd9bc148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:08:02.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9ba7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0cbb90 0x7fd9bc148130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:60936/0 (socket says 172.21.15.122:60936) 2024-09-17T06:08:02.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9ba7fc640 1 -- 172.21.15.122:0/1098185465 learned_addr learned my addr 172.21.15.122:0/1098185465 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:08:02.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9baffd640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a4004810 0x7fd9bc1f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:08:02.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9bb7fe640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9bc145e80 0x7fd9bc146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:08:02.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9ba7fc640 1 -- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9bc145e80 msgr2=0x7fd9bc146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:02.709 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9ba7fc640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9bc145e80 0x7fd9bc146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:02.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9ba7fc640 1 -- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a4004810 msgr2=0x7fd9bc1f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:02.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.702+0000 7fd9ba7fc640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a4004810 0x7fd9bc1f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:02.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9ba7fc640 1 -- 172.21.15.122:0/1098185465 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9bc1f3410 con 0x7fd9bc0cbb90 2024-09-17T06:08:02.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9baffd640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a4004810 0x7fd9bc1f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:08:02.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9ba7fc640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0cbb90 0x7fd9bc148130 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd9b001adb0 tx=0x7fd9b0006930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:08:02.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9a37fe640 1 -- 172.21.15.122:0/1098185465 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00038d0 con 0x7fd9bc0cbb90 2024-09-17T06:08:02.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9a37fe640 1 -- 172.21.15.122:0/1098185465 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9b0003b60 con 0x7fd9bc0cbb90 2024-09-17T06:08:02.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9c163d640 1 -- 172.21.15.122:0/1098185465 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9bc1f29f0 con 0x7fd9bc0cbb90 2024-09-17T06:08:02.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9a37fe640 1 -- 172.21.15.122:0/1098185465 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00a5510 con 0x7fd9bc0cbb90 2024-09-17T06:08:02.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9c163d640 1 -- 172.21.15.122:0/1098185465 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9bc1e3f80 con 0x7fd9bc0cbb90 2024-09-17T06:08:02.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9c163d640 1 -- 172.21.15.122:0/1098185465 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9bc072c10 con 0x7fd9bc0cbb90 2024-09-17T06:08:02.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9a37fe640 1 -- 172.21.15.122:0/1098185465 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd9b00a56b0 con 0x7fd9bc0cbb90 2024-09-17T06:08:02.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9a37fe640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd9a8073230 0x7fd9a8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:08:02.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9a37fe640 1 -- 172.21.15.122:0/1098185465 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6854+0+0 (secure 0 0 0) 0x7fd9b012e780 con 0x7fd9bc0cbb90 2024-09-17T06:08:02.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.706+0000 7fd9baffd640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd9a8073230 0x7fd9a8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:08:02.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.710+0000 7fd9baffd640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd9a8073230 0x7fd9a8075740 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00dbf0 tx=0x7fd9ac00d5d0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:08:02.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.710+0000 7fd9a37fe640 1 -- 172.21.15.122:0/1098185465 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd9b0016410 con 0x7fd9bc0cbb90 2024-09-17T06:08:02.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.882+0000 7fd9c163d640 1 -- 172.21.15.122:0/1098185465 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd9bc0c3630 con 0x7fd9a8073230 2024-09-17T06:08:02.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.898+0000 7fd9a37fe640 1 -- 172.21.15.122:0/1098185465 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332987 (secure 0 0 0) 0x7fd9bc0c3630 con 0x7fd9a8073230 2024-09-17T06:08:02.906 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:08:02.908 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:08:02.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.902+0000 7fd9c163d640 1 -- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd9a8073230 msgr2=0x7fd9a8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:02.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.902+0000 7fd9c163d640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd9a8073230 0x7fd9a8075740 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00dbf0 tx=0x7fd9ac00d5d0 comp rx=0 tx=0).stop 2024-09-17T06:08:02.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.902+0000 7fd9c163d640 1 -- 172.21.15.122:0/1098185465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0cbb90 msgr2=0x7fd9bc148130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:02.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.902+0000 7fd9c163d640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0cbb90 0x7fd9bc148130 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd9b001adb0 tx=0x7fd9b0006930 comp rx=0 tx=0).stop 2024-09-17T06:08:02.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.902+0000 7fd9c163d640 1 -- 172.21.15.122:0/1098185465 shutdown_connections 2024-09-17T06:08:02.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.902+0000 7fd9c163d640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9bc145e80 0x7fd9bc146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:02.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.902+0000 7fd9c163d640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0cbb90 0x7fd9bc148130 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:02.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.902+0000 7fd9c163d640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd9a8073230 0x7fd9a8075740 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:02.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.902+0000 7fd9c163d640 1 --2- 172.21.15.122:0/1098185465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a4004810 0x7fd9bc1f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:02.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.902+0000 7fd9c163d640 1 -- 172.21.15.122:0/1098185465 >> 172.21.15.122:0/1098185465 conn(0x7fd9bc0746d0 msgr2=0x7fd9bc069060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:08:02.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.902+0000 7fd9c163d640 1 -- 172.21.15.122:0/1098185465 shutdown_connections 2024-09-17T06:08:02.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:02.902+0000 7fd9c163d640 1 -- 172.21.15.122:0/1098185465 wait complete. 2024-09-17T06:08:02.929 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-09-17T06:08:01.615119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247140,"kb_used_data":9072,"kb_used_omap":17,"kb_used_meta":237870,"kb_avail":754727580,"statfs":{"total":773094113280,"available":772841041920,"internally_reserved":0,"allocated":9289728,"data_stored":5432864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":243579629},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.923546"},"pg_stats":[{"pgid":"2.1f","version":"81'6","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223877+0000","last_change":"2024-09-17T06:06:38.646633+0000","last_active":"2024-09-17T06:07:51.223877+0000","last_peered":"2024-09-17T06:07:51.223877+0000","last_clean":"2024-09-17T06:07:51.223877+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:07:51.223877+0000","last_undegraded":"2024-09-17T06:07:51.223877+0000","last_fullsized":"2024-09-17T06:07:51.223877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.646522+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:55.373873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699759+0000","last_change":"2024-09-17T06:06:47.678984+0000","last_active":"2024-09-17T06:07:50.699759+0000","last_peered":"2024-09-17T06:07:50.699759+0000","last_clean":"2024-09-17T06:07:50.699759+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:07:50.699759+0000","last_undegraded":"2024-09-17T06:07:50.699759+0000","last_fullsized":"2024-09-17T06:07:50.699759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.678793+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:31.584591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697854+0000","last_change":"2024-09-17T06:06:55.606541+0000","last_active":"2024-09-17T06:07:50.697854+0000","last_peered":"2024-09-17T06:07:50.697854+0000","last_clean":"2024-09-17T06:07:50.697854+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:07:50.697854+0000","last_undegraded":"2024-09-17T06:07:50.697854+0000","last_fullsized":"2024-09-17T06:07:50.697854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.606346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:05.514205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700147+0000","last_change":"2024-09-17T06:06:41.626922+0000","last_active":"2024-09-17T06:07:50.700147+0000","last_peered":"2024-09-17T06:07:50.700147+0000","last_clean":"2024-09-17T06:07:50.700147+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:07:50.700147+0000","last_undegraded":"2024-09-17T06:07:50.700147+0000","last_fullsized":"2024-09-17T06:07:50.700147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.626723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:41.581056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222997+0000","last_change":"2024-09-17T06:06:42.561017+0000","last_active":"2024-09-17T06:07:51.222997+0000","last_peered":"2024-09-17T06:07:51.222997+0000","last_clean":"2024-09-17T06:07:51.222997+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:07:51.222997+0000","last_undegraded":"2024-09-17T06:07:51.222997+0000","last_fullsized":"2024-09-17T06:07:51.222997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.560815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:06.386417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.694947+0000","last_change":"2024-09-17T06:06:50.581741+0000","last_active":"2024-09-17T06:07:50.694947+0000","last_peered":"2024-09-17T06:07:50.694947+0000","last_clean":"2024-09-17T06:07:50.694947+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:07:50.694947+0000","last_undegraded":"2024-09-17T06:07:50.694947+0000","last_fullsized":"2024-09-17T06:07:50.694947+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.581526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:27.538796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841990+0000","last_change":"2024-09-17T06:06:44.503792+0000","last_active":"2024-09-17T06:07:50.841990+0000","last_peered":"2024-09-17T06:07:50.841990+0000","last_clean":"2024-09-17T06:07:50.841990+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:07:50.841990+0000","last_undegraded":"2024-09-17T06:07:50.841990+0000","last_fullsized":"2024-09-17T06:07:50.841990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.503569+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.329171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219618+0000","last_change":"2024-09-17T06:06:49.490282+0000","last_active":"2024-09-17T06:07:51.219618+0000","last_peered":"2024-09-17T06:07:51.219618+0000","last_clean":"2024-09-17T06:07:51.219618+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:07:51.219618+0000","last_undegraded":"2024-09-17T06:07:51.219618+0000","last_fullsized":"2024-09-17T06:07:51.219618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.490084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:52.911935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700188+0000","last_change":"2024-09-17T06:06:51.542004+0000","last_active":"2024-09-17T06:07:50.700188+0000","last_peered":"2024-09-17T06:07:50.700188+0000","last_clean":"2024-09-17T06:07:50.700188+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:07:50.700188+0000","last_undegraded":"2024-09-17T06:07:50.700188+0000","last_fullsized":"2024-09-17T06:07:50.700188+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.541795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.542454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841533+0000","last_change":"2024-09-17T06:06:45.535472+0000","last_active":"2024-09-17T06:07:50.841533+0000","last_peered":"2024-09-17T06:07:50.841533+0000","last_clean":"2024-09-17T06:07:50.841533+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:07:50.841533+0000","last_undegraded":"2024-09-17T06:07:50.841533+0000","last_fullsized":"2024-09-17T06:07:50.841533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.535262+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:56.606861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692929+0000","last_change":"2024-09-17T06:06:45.459635+0000","last_active":"2024-09-17T06:07:50.692929+0000","last_peered":"2024-09-17T06:07:50.692929+0000","last_clean":"2024-09-17T06:07:50.692929+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:07:50.692929+0000","last_undegraded":"2024-09-17T06:07:50.692929+0000","last_fullsized":"2024-09-17T06:07:50.692929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.459406+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:41.152666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699340+0000","last_change":"2024-09-17T06:06:52.519889+0000","last_active":"2024-09-17T06:07:50.699340+0000","last_peered":"2024-09-17T06:07:50.699340+0000","last_clean":"2024-09-17T06:07:50.699340+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:07:50.699340+0000","last_undegraded":"2024-09-17T06:07:50.699340+0000","last_fullsized":"2024-09-17T06:07:50.699340+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.519692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:06.562811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695522+0000","last_change":"2024-09-17T06:06:46.282925+0000","last_active":"2024-09-17T06:07:50.695522+0000","last_peered":"2024-09-17T06:07:50.695522+0000","last_clean":"2024-09-17T06:07:50.695522+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:07:50.695522+0000","last_undegraded":"2024-09-17T06:07:50.695522+0000","last_fullsized":"2024-09-17T06:07:50.695522+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.282607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:45.646843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841556+0000","last_change":"2024-09-17T06:06:47.578055+0000","last_active":"2024-09-17T06:07:50.841556+0000","last_peered":"2024-09-17T06:07:50.841556+0000","last_clean":"2024-09-17T06:07:50.841556+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:07:50.841556+0000","last_undegraded":"2024-09-17T06:07:50.841556+0000","last_fullsized":"2024-09-17T06:07:50.841556+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.577825+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:54.466675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":90,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699740+0000","last_change":"2024-09-17T06:06:48.564278+0000","last_active":"2024-09-17T06:07:50.699740+0000","last_peered":"2024-09-17T06:07:50.699740+0000","last_clean":"2024-09-17T06:07:50.699740+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:07:50.699740+0000","last_undegraded":"2024-09-17T06:07:50.699740+0000","last_fullsized":"2024-09-17T06:07:50.699740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.564076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:09.526182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698488+0000","last_change":"2024-09-17T06:06:45.719909+0000","last_active":"2024-09-17T06:07:50.698488+0000","last_peered":"2024-09-17T06:07:50.698488+0000","last_clean":"2024-09-17T06:07:50.698488+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:07:50.698488+0000","last_undegraded":"2024-09-17T06:07:50.698488+0000","last_fullsized":"2024-09-17T06:07:50.698488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.719724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:58.812630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220979+0000","last_change":"2024-09-17T06:06:39.054952+0000","last_active":"2024-09-17T06:07:51.220979+0000","last_peered":"2024-09-17T06:07:51.220979+0000","last_clean":"2024-09-17T06:07:51.220979+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:07:51.220979+0000","last_undegraded":"2024-09-17T06:07:51.220979+0000","last_fullsized":"2024-09-17T06:07:51.220979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.054879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:22.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700797+0000","last_change":"2024-09-17T06:06:47.595782+0000","last_active":"2024-09-17T06:07:50.700797+0000","last_peered":"2024-09-17T06:07:50.700797+0000","last_clean":"2024-09-17T06:07:50.700797+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:07:50.700797+0000","last_undegraded":"2024-09-17T06:07:50.700797+0000","last_fullsized":"2024-09-17T06:07:50.700797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.595562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.305297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699839+0000","last_change":"2024-09-17T06:06:44.685583+0000","last_active":"2024-09-17T06:07:50.699839+0000","last_peered":"2024-09-17T06:07:50.699839+0000","last_clean":"2024-09-17T06:07:50.699839+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:07:50.699839+0000","last_undegraded":"2024-09-17T06:07:50.699839+0000","last_fullsized":"2024-09-17T06:07:50.699839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.685386+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:42.733827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220852+0000","last_change":"2024-09-17T06:06:41.096528+0000","last_active":"2024-09-17T06:07:51.220852+0000","last_peered":"2024-09-17T06:07:51.220852+0000","last_clean":"2024-09-17T06:07:51.220852+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:07:51.220852+0000","last_undegraded":"2024-09-17T06:07:51.220852+0000","last_fullsized":"2024-09-17T06:07:51.220852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.096443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.182798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222996+0000","last_change":"2024-09-17T06:06:51.955862+0000","last_active":"2024-09-17T06:07:51.222996+0000","last_peered":"2024-09-17T06:07:51.222996+0000","last_clean":"2024-09-17T06:07:51.222996+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:07:51.222996+0000","last_undegraded":"2024-09-17T06:07:51.222996+0000","last_fullsized":"2024-09-17T06:07:51.222996+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.955662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.579450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":72,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695621+0000","last_change":"2024-09-17T06:06:41.561023+0000","last_active":"2024-09-17T06:07:50.695621+0000","last_peered":"2024-09-17T06:07:50.695621+0000","last_clean":"2024-09-17T06:07:50.695621+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:07:50.695621+0000","last_undegraded":"2024-09-17T06:07:50.695621+0000","last_fullsized":"2024-09-17T06:07:50.695621+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.560833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:35.979151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840638+0000","last_change":"2024-09-17T06:06:51.569920+0000","last_active":"2024-09-17T06:07:50.840638+0000","last_peered":"2024-09-17T06:07:50.840638+0000","last_clean":"2024-09-17T06:07:50.840638+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:07:50.840638+0000","last_undegraded":"2024-09-17T06:07:50.840638+0000","last_fullsized":"2024-09-17T06:07:50.840638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.569724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:16.044884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699737+0000","last_change":"2024-09-17T06:06:54.534994+0000","last_active":"2024-09-17T06:07:50.699737+0000","last_peered":"2024-09-17T06:07:50.699737+0000","last_clean":"2024-09-17T06:07:50.699737+0000","last_became_active":"2024-09-17T06:06:49.862233+0000","last_became_peered":"2024-09-17T06:06:49.862233+0000","last_unstale":"2024-09-17T06:07:50.699737+0000","last_undegraded":"2024-09-17T06:07:50.699737+0000","last_fullsized":"2024-09-17T06:07:50.699737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.534811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:53.555338+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.534811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:09.975013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,1],"acting":[4,2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225543+0000","last_change":"2024-09-17T06:06:39.595362+0000","last_active":"2024-09-17T06:07:51.225543+0000","last_peered":"2024-09-17T06:07:51.225543+0000","last_clean":"2024-09-17T06:07:51.225543+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:07:51.225543+0000","last_undegraded":"2024-09-17T06:07:51.225543+0000","last_fullsized":"2024-09-17T06:07:51.225543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.595150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:36.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697579+0000","last_change":"2024-09-17T06:06:41.345210+0000","last_active":"2024-09-17T06:07:50.697579+0000","last_peered":"2024-09-17T06:07:50.697579+0000","last_clean":"2024-09-17T06:07:50.697579+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:07:50.697579+0000","last_undegraded":"2024-09-17T06:07:50.697579+0000","last_fullsized":"2024-09-17T06:07:50.697579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.345015+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:38.207077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696210+0000","last_change":"2024-09-17T06:06:44.540629+0000","last_active":"2024-09-17T06:07:50.696210+0000","last_peered":"2024-09-17T06:07:50.696210+0000","last_clean":"2024-09-17T06:07:50.696210+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:07:50.696210+0000","last_undegraded":"2024-09-17T06:07:50.696210+0000","last_fullsized":"2024-09-17T06:07:50.696210+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.540426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:03.473101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700365+0000","last_change":"2024-09-17T06:06:43.669448+0000","last_active":"2024-09-17T06:07:50.700365+0000","last_peered":"2024-09-17T06:07:50.700365+0000","last_clean":"2024-09-17T06:07:50.700365+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:07:50.700365+0000","last_undegraded":"2024-09-17T06:07:50.700365+0000","last_fullsized":"2024-09-17T06:07:50.700365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.669209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:54.877316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222274+0000","last_change":"2024-09-17T06:06:38.067895+0000","last_active":"2024-09-17T06:07:51.222274+0000","last_peered":"2024-09-17T06:07:51.222274+0000","last_clean":"2024-09-17T06:07:51.222274+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:07:51.222274+0000","last_undegraded":"2024-09-17T06:07:51.222274+0000","last_fullsized":"2024-09-17T06:07:51.222274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.067715+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:26.508119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.228515+0000","last_change":"2024-09-17T06:07:51.228200+0000","last_active":"2024-09-17T06:07:51.228515+0000","last_peered":"2024-09-17T06:07:51.228515+0000","last_clean":"2024-09-17T06:07:51.228515+0000","last_became_active":"2024-09-17T06:07:51.226510+0000","last_became_peered":"2024-09-17T06:07:51.226510+0000","last_unstale":"2024-09-17T06:07:51.228515+0000","last_undegraded":"2024-09-17T06:07:51.228515+0000","last_fullsized":"2024-09-17T06:07:51.228515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.651441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:14.647137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221540+0000","last_change":"2024-09-17T06:06:45.060936+0000","last_active":"2024-09-17T06:07:51.221540+0000","last_peered":"2024-09-17T06:07:51.221540+0000","last_clean":"2024-09-17T06:07:51.221540+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:07:51.221540+0000","last_undegraded":"2024-09-17T06:07:51.221540+0000","last_fullsized":"2024-09-17T06:07:51.221540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.060719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:03.842916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842303+0000","last_change":"2024-09-17T06:06:43.537259+0000","last_active":"2024-09-17T06:07:50.842303+0000","last_peered":"2024-09-17T06:07:50.842303+0000","last_clean":"2024-09-17T06:07:50.842303+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:07:50.842303+0000","last_undegraded":"2024-09-17T06:07:50.842303+0000","last_fullsized":"2024-09-17T06:07:50.842303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.537064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:53.557183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224537+0000","last_change":"2024-09-17T06:06:50.588334+0000","last_active":"2024-09-17T06:07:51.224537+0000","last_peered":"2024-09-17T06:07:51.224537+0000","last_clean":"2024-09-17T06:07:51.224537+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:07:51.224537+0000","last_undegraded":"2024-09-17T06:07:51.224537+0000","last_fullsized":"2024-09-17T06:07:51.224537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.588146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:34.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220007+0000","last_change":"2024-09-17T06:06:45.560755+0000","last_active":"2024-09-17T06:07:51.220007+0000","last_peered":"2024-09-17T06:07:51.220007+0000","last_clean":"2024-09-17T06:07:51.220007+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:07:51.220007+0000","last_undegraded":"2024-09-17T06:07:51.220007+0000","last_fullsized":"2024-09-17T06:07:51.220007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.560562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.352415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221700+0000","last_change":"2024-09-17T06:06:40.077709+0000","last_active":"2024-09-17T06:07:51.221700+0000","last_peered":"2024-09-17T06:07:51.221700+0000","last_clean":"2024-09-17T06:07:51.221700+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:07:51.221700+0000","last_undegraded":"2024-09-17T06:07:51.221700+0000","last_fullsized":"2024-09-17T06:07:51.221700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.077616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:13.235085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219846+0000","last_change":"2024-09-17T06:06:50.943563+0000","last_active":"2024-09-17T06:07:51.219846+0000","last_peered":"2024-09-17T06:07:51.219846+0000","last_clean":"2024-09-17T06:07:51.219846+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:07:51.219846+0000","last_undegraded":"2024-09-17T06:07:51.219846+0000","last_fullsized":"2024-09-17T06:07:51.219846+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.943366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.661632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700373+0000","last_change":"2024-09-17T06:06:39.544246+0000","last_active":"2024-09-17T06:07:50.700373+0000","last_peered":"2024-09-17T06:07:50.700373+0000","last_clean":"2024-09-17T06:07:50.700373+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:07:50.700373+0000","last_undegraded":"2024-09-17T06:07:50.700373+0000","last_fullsized":"2024-09-17T06:07:50.700373+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.544002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:04.906600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219248+0000","last_change":"2024-09-17T06:06:41.601594+0000","last_active":"2024-09-17T06:07:51.219248+0000","last_peered":"2024-09-17T06:07:51.219248+0000","last_clean":"2024-09-17T06:07:51.219248+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:07:51.219248+0000","last_undegraded":"2024-09-17T06:07:51.219248+0000","last_fullsized":"2024-09-17T06:07:51.219248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.601393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.687748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221364+0000","last_change":"2024-09-17T06:06:49.922504+0000","last_active":"2024-09-17T06:07:51.221364+0000","last_peered":"2024-09-17T06:07:51.221364+0000","last_clean":"2024-09-17T06:07:51.221364+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:07:51.221364+0000","last_undegraded":"2024-09-17T06:07:51.221364+0000","last_fullsized":"2024-09-17T06:07:51.221364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.922302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:53.344154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222840+0000","last_change":"2024-09-17T06:06:42.067931+0000","last_active":"2024-09-17T06:07:51.222840+0000","last_peered":"2024-09-17T06:07:51.222840+0000","last_clean":"2024-09-17T06:07:51.222840+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:07:51.222840+0000","last_undegraded":"2024-09-17T06:07:51.222840+0000","last_fullsized":"2024-09-17T06:07:51.222840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.067737+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.818001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692963+0000","last_change":"2024-09-17T06:06:38.338953+0000","last_active":"2024-09-17T06:07:50.692963+0000","last_peered":"2024-09-17T06:07:50.692963+0000","last_clean":"2024-09-17T06:07:50.692963+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:07:50.692963+0000","last_undegraded":"2024-09-17T06:07:50.692963+0000","last_fullsized":"2024-09-17T06:07:50.692963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.338737+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:58.670904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223274+0000","last_change":"2024-09-17T06:06:47.938470+0000","last_active":"2024-09-17T06:07:51.223274+0000","last_peered":"2024-09-17T06:07:51.223274+0000","last_clean":"2024-09-17T06:07:51.223274+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:07:51.223274+0000","last_undegraded":"2024-09-17T06:07:51.223274+0000","last_fullsized":"2024-09-17T06:07:51.223274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.938263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.607027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221464+0000","last_change":"2024-09-17T06:06:41.585374+0000","last_active":"2024-09-17T06:07:51.221464+0000","last_peered":"2024-09-17T06:07:51.221464+0000","last_clean":"2024-09-17T06:07:51.221464+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:07:51.221464+0000","last_undegraded":"2024-09-17T06:07:51.221464+0000","last_fullsized":"2024-09-17T06:07:51.221464+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.585183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:11.929990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840827+0000","last_change":"2024-09-17T06:06:42.536575+0000","last_active":"2024-09-17T06:07:50.840827+0000","last_peered":"2024-09-17T06:07:50.840827+0000","last_clean":"2024-09-17T06:07:50.840827+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:07:50.840827+0000","last_undegraded":"2024-09-17T06:07:50.840827+0000","last_fullsized":"2024-09-17T06:07:50.840827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.536371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:23.547872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225184+0000","last_change":"2024-09-17T06:06:47.627398+0000","last_active":"2024-09-17T06:07:51.225184+0000","last_peered":"2024-09-17T06:07:51.225184+0000","last_clean":"2024-09-17T06:07:51.225184+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:07:51.225184+0000","last_undegraded":"2024-09-17T06:07:51.225184+0000","last_fullsized":"2024-09-17T06:07:51.225184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.627188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:28.206295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699094+0000","last_change":"2024-09-17T06:06:42.642781+0000","last_active":"2024-09-17T06:07:50.699094+0000","last_peered":"2024-09-17T06:07:50.699094+0000","last_clean":"2024-09-17T06:07:50.699094+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:07:50.699094+0000","last_undegraded":"2024-09-17T06:07:50.699094+0000","last_fullsized":"2024-09-17T06:07:50.699094+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.642468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:03.874053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219334+0000","last_change":"2024-09-17T06:06:40.563124+0000","last_active":"2024-09-17T06:07:51.219334+0000","last_peered":"2024-09-17T06:07:51.219334+0000","last_clean":"2024-09-17T06:07:51.219334+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:07:51.219334+0000","last_undegraded":"2024-09-17T06:07:51.219334+0000","last_fullsized":"2024-09-17T06:07:51.219334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.562781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:51.528772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"81'74","reported_seq":247,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841078+0000","last_change":"2024-09-17T06:06:41.529207+0000","last_active":"2024-09-17T06:07:50.841078+0000","last_peered":"2024-09-17T06:07:50.841078+0000","last_clean":"2024-09-17T06:07:50.841078+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:07:50.841078+0000","last_undegraded":"2024-09-17T06:07:50.841078+0000","last_fullsized":"2024-09-17T06:07:50.841078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'74","last_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_deep_scrub":"81'74","last_deep_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.529006+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:17.811347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698024+0000","last_change":"2024-09-17T06:06:50.168189+0000","last_active":"2024-09-17T06:07:50.698024+0000","last_peered":"2024-09-17T06:07:50.698024+0000","last_clean":"2024-09-17T06:07:50.698024+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:07:50.698024+0000","last_undegraded":"2024-09-17T06:07:50.698024+0000","last_fullsized":"2024-09-17T06:07:50.698024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.167993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:53.277144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693347+0000","last_change":"2024-09-17T06:06:46.470862+0000","last_active":"2024-09-17T06:07:50.693347+0000","last_peered":"2024-09-17T06:07:50.693347+0000","last_clean":"2024-09-17T06:07:50.693347+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:07:50.693347+0000","last_undegraded":"2024-09-17T06:07:50.693347+0000","last_fullsized":"2024-09-17T06:07:50.693347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.470640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:54.803752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693596+0000","last_change":"2024-09-17T06:06:39.308543+0000","last_active":"2024-09-17T06:07:50.693596+0000","last_peered":"2024-09-17T06:07:50.693596+0000","last_clean":"2024-09-17T06:07:50.693596+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:07:50.693596+0000","last_undegraded":"2024-09-17T06:07:50.693596+0000","last_fullsized":"2024-09-17T06:07:50.693596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.308468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:26.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695170+0000","last_change":"2024-09-17T06:06:55.194732+0000","last_active":"2024-09-17T06:07:50.695170+0000","last_peered":"2024-09-17T06:07:50.695170+0000","last_clean":"2024-09-17T06:07:50.695170+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:07:50.695170+0000","last_undegraded":"2024-09-17T06:07:50.695170+0000","last_fullsized":"2024-09-17T06:07:50.695170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.194477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:46.395618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219942+0000","last_change":"2024-09-17T06:06:47.481798+0000","last_active":"2024-09-17T06:07:51.219942+0000","last_peered":"2024-09-17T06:07:51.219942+0000","last_clean":"2024-09-17T06:07:51.219942+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:07:51.219942+0000","last_undegraded":"2024-09-17T06:07:51.219942+0000","last_fullsized":"2024-09-17T06:07:51.219942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.481588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.150352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220891+0000","last_change":"2024-09-17T06:06:43.064298+0000","last_active":"2024-09-17T06:07:51.220891+0000","last_peered":"2024-09-17T06:07:51.220891+0000","last_clean":"2024-09-17T06:07:51.220891+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:07:51.220891+0000","last_undegraded":"2024-09-17T06:07:51.220891+0000","last_fullsized":"2024-09-17T06:07:51.220891+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.064096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:30.993498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225161+0000","last_change":"2024-09-17T06:06:52.593990+0000","last_active":"2024-09-17T06:07:51.225161+0000","last_peered":"2024-09-17T06:07:51.225161+0000","last_clean":"2024-09-17T06:07:51.225161+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:07:51.225161+0000","last_undegraded":"2024-09-17T06:07:51.225161+0000","last_fullsized":"2024-09-17T06:07:51.225161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.593787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:04.850781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842652+0000","last_change":"2024-09-17T06:06:46.576306+0000","last_active":"2024-09-17T06:07:50.842652+0000","last_peered":"2024-09-17T06:07:50.842652+0000","last_clean":"2024-09-17T06:07:50.842652+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:07:50.842652+0000","last_undegraded":"2024-09-17T06:07:50.842652+0000","last_fullsized":"2024-09-17T06:07:50.842652+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:36.552616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'3","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693902+0000","last_change":"2024-09-17T06:06:40.289371+0000","last_active":"2024-09-17T06:07:50.693902+0000","last_peered":"2024-09-17T06:07:50.693902+0000","last_clean":"2024-09-17T06:07:50.693902+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:07:50.693902+0000","last_undegraded":"2024-09-17T06:07:50.693902+0000","last_fullsized":"2024-09-17T06:07:50.693902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.289195+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.187275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218554+0000","last_change":"2024-09-17T06:06:57.580034+0000","last_active":"2024-09-17T06:07:51.218554+0000","last_peered":"2024-09-17T06:07:51.218554+0000","last_clean":"2024-09-17T06:07:51.218554+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:07:51.218554+0000","last_undegraded":"2024-09-17T06:07:51.218554+0000","last_fullsized":"2024-09-17T06:07:51.218554+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.579707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:15.990501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842381+0000","last_change":"2024-09-17T06:06:53.554156+0000","last_active":"2024-09-17T06:07:50.842381+0000","last_peered":"2024-09-17T06:07:50.842381+0000","last_clean":"2024-09-17T06:07:50.842381+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:07:50.842381+0000","last_undegraded":"2024-09-17T06:07:50.842381+0000","last_fullsized":"2024-09-17T06:07:50.842381+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.553919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:37.374837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":84,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699951+0000","last_change":"2024-09-17T06:06:40.545470+0000","last_active":"2024-09-17T06:07:50.699951+0000","last_peered":"2024-09-17T06:07:50.699951+0000","last_clean":"2024-09-17T06:07:50.699951+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:07:50.699951+0000","last_undegraded":"2024-09-17T06:07:50.699951+0000","last_fullsized":"2024-09-17T06:07:50.699951+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.545271+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:41.942375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696595+0000","last_change":"2024-09-17T06:06:46.553900+0000","last_active":"2024-09-17T06:07:50.696595+0000","last_peered":"2024-09-17T06:07:50.696595+0000","last_clean":"2024-09-17T06:07:50.696595+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:07:50.696595+0000","last_undegraded":"2024-09-17T06:07:50.696595+0000","last_fullsized":"2024-09-17T06:07:50.696595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.553594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:37.347089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841069+0000","last_change":"2024-09-17T06:06:49.557072+0000","last_active":"2024-09-17T06:07:50.841069+0000","last_peered":"2024-09-17T06:07:50.841069+0000","last_clean":"2024-09-17T06:07:50.841069+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:07:50.841069+0000","last_undegraded":"2024-09-17T06:07:50.841069+0000","last_fullsized":"2024-09-17T06:07:50.841069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.556746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:02.173527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'13","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692561+0000","last_change":"2024-09-17T06:06:41.327726+0000","last_active":"2024-09-17T06:07:50.692561+0000","last_peered":"2024-09-17T06:07:50.692561+0000","last_clean":"2024-09-17T06:07:50.692561+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:07:50.692561+0000","last_undegraded":"2024-09-17T06:07:50.692561+0000","last_fullsized":"2024-09-17T06:07:50.692561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'13","last_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_deep_scrub":"81'13","last_deep_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.327620+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:41.975086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224922+0000","last_change":"2024-09-17T06:06:48.590089+0000","last_active":"2024-09-17T06:07:51.224922+0000","last_peered":"2024-09-17T06:07:51.224922+0000","last_clean":"2024-09-17T06:07:51.224922+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:07:51.224922+0000","last_undegraded":"2024-09-17T06:07:51.224922+0000","last_fullsized":"2024-09-17T06:07:51.224922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.589881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:13.065040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695546+0000","last_change":"2024-09-17T06:06:47.234619+0000","last_active":"2024-09-17T06:07:50.695546+0000","last_peered":"2024-09-17T06:07:50.695546+0000","last_clean":"2024-09-17T06:07:50.695546+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:07:50.695546+0000","last_undegraded":"2024-09-17T06:07:50.695546+0000","last_fullsized":"2024-09-17T06:07:50.695546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.234392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:10.297041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696180+0000","last_change":"2024-09-17T06:06:42.362985+0000","last_active":"2024-09-17T06:07:50.696180+0000","last_peered":"2024-09-17T06:07:50.696180+0000","last_clean":"2024-09-17T06:07:50.696180+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:07:50.696180+0000","last_undegraded":"2024-09-17T06:07:50.696180+0000","last_fullsized":"2024-09-17T06:07:50.696180+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.362795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:21.306942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700003+0000","last_change":"2024-09-17T06:06:54.645399+0000","last_active":"2024-09-17T06:07:50.700003+0000","last_peered":"2024-09-17T06:07:50.700003+0000","last_clean":"2024-09-17T06:07:50.700003+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:07:50.700003+0000","last_undegraded":"2024-09-17T06:07:50.700003+0000","last_fullsized":"2024-09-17T06:07:50.700003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.645200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:04.728298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841322+0000","last_change":"2024-09-17T06:06:48.595269+0000","last_active":"2024-09-17T06:07:50.841322+0000","last_peered":"2024-09-17T06:07:50.841322+0000","last_clean":"2024-09-17T06:07:50.841322+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:07:50.841322+0000","last_undegraded":"2024-09-17T06:07:50.841322+0000","last_fullsized":"2024-09-17T06:07:50.841322+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.595073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:51.297831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219063+0000","last_change":"2024-09-17T06:06:42.583243+0000","last_active":"2024-09-17T06:07:51.219063+0000","last_peered":"2024-09-17T06:07:51.219063+0000","last_clean":"2024-09-17T06:07:51.219063+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:07:51.219063+0000","last_undegraded":"2024-09-17T06:07:51.219063+0000","last_fullsized":"2024-09-17T06:07:51.219063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.583048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:54.333313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699331+0000","last_change":"2024-09-17T06:06:57.607574+0000","last_active":"2024-09-17T06:07:50.699331+0000","last_peered":"2024-09-17T06:07:50.699331+0000","last_clean":"2024-09-17T06:07:50.699331+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:07:50.699331+0000","last_undegraded":"2024-09-17T06:07:50.699331+0000","last_fullsized":"2024-09-17T06:07:50.699331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.607379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:56.898447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222448+0000","last_change":"2024-09-17T06:06:45.591584+0000","last_active":"2024-09-17T06:07:51.222448+0000","last_peered":"2024-09-17T06:07:51.222448+0000","last_clean":"2024-09-17T06:07:51.222448+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:07:51.222448+0000","last_undegraded":"2024-09-17T06:07:51.222448+0000","last_fullsized":"2024-09-17T06:07:51.222448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.591276+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:08.653925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.226091+0000","last_change":"2024-09-17T06:06:37.667757+0000","last_active":"2024-09-17T06:07:51.226091+0000","last_peered":"2024-09-17T06:07:51.226091+0000","last_clean":"2024-09-17T06:07:51.226091+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:07:51.226091+0000","last_undegraded":"2024-09-17T06:07:51.226091+0000","last_fullsized":"2024-09-17T06:07:51.226091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_clean_scrub_stamp":"2024-09-17T06:06:37.667675+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:46.885860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219774+0000","last_change":"2024-09-17T06:06:56.615164+0000","last_active":"2024-09-17T06:07:51.219774+0000","last_peered":"2024-09-17T06:07:51.219774+0000","last_clean":"2024-09-17T06:07:51.219774+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:07:51.219774+0000","last_undegraded":"2024-09-17T06:07:51.219774+0000","last_fullsized":"2024-09-17T06:07:51.219774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.614970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:07.482666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841716+0000","last_change":"2024-09-17T06:06:52.577732+0000","last_active":"2024-09-17T06:07:50.841716+0000","last_peered":"2024-09-17T06:07:50.841716+0000","last_clean":"2024-09-17T06:07:50.841716+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:07:50.841716+0000","last_undegraded":"2024-09-17T06:07:50.841716+0000","last_fullsized":"2024-09-17T06:07:50.841716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.577533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:34.161856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":173,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697698+0000","last_change":"2024-09-17T06:06:43.358428+0000","last_active":"2024-09-17T06:07:50.697698+0000","last_peered":"2024-09-17T06:07:50.697698+0000","last_clean":"2024-09-17T06:07:50.697698+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:07:50.697698+0000","last_undegraded":"2024-09-17T06:07:50.697698+0000","last_fullsized":"2024-09-17T06:07:50.697698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'27","last_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_deep_scrub":"81'27","last_deep_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.358219+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:13.703025+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220232+0000","last_change":"2024-09-17T06:06:52.944474+0000","last_active":"2024-09-17T06:07:51.220232+0000","last_peered":"2024-09-17T06:07:51.220232+0000","last_clean":"2024-09-17T06:07:51.220232+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:07:51.220232+0000","last_undegraded":"2024-09-17T06:07:51.220232+0000","last_fullsized":"2024-09-17T06:07:51.220232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.944213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.533972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":81,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699690+0000","last_change":"2024-09-17T06:06:43.557285+0000","last_active":"2024-09-17T06:07:50.699690+0000","last_peered":"2024-09-17T06:07:50.699690+0000","last_clean":"2024-09-17T06:07:50.699690+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:07:50.699690+0000","last_undegraded":"2024-09-17T06:07:50.699690+0000","last_fullsized":"2024-09-17T06:07:50.699690+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.557090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:01.412234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"81'9","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220308+0000","last_change":"2024-09-17T06:06:43.599342+0000","last_active":"2024-09-17T06:07:51.220308+0000","last_peered":"2024-09-17T06:07:51.220308+0000","last_clean":"2024-09-17T06:07:51.220308+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:07:51.220308+0000","last_undegraded":"2024-09-17T06:07:51.220308+0000","last_fullsized":"2024-09-17T06:07:51.220308+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.599114+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:49.432076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699542+0000","last_change":"2024-09-17T06:06:49.561761+0000","last_active":"2024-09-17T06:07:50.699542+0000","last_peered":"2024-09-17T06:07:50.699542+0000","last_clean":"2024-09-17T06:07:50.699542+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:07:50.699542+0000","last_undegraded":"2024-09-17T06:07:50.699542+0000","last_fullsized":"2024-09-17T06:07:50.699542+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.561572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:15.208406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223520+0000","last_change":"2024-09-17T06:06:40.581076+0000","last_active":"2024-09-17T06:07:51.223520+0000","last_peered":"2024-09-17T06:07:51.223520+0000","last_clean":"2024-09-17T06:07:51.223520+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:07:51.223520+0000","last_undegraded":"2024-09-17T06:07:51.223520+0000","last_fullsized":"2024-09-17T06:07:51.223520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.580978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:19.525125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220070+0000","last_change":"2024-09-17T06:06:44.589361+0000","last_active":"2024-09-17T06:07:51.220070+0000","last_peered":"2024-09-17T06:07:51.220070+0000","last_clean":"2024-09-17T06:07:51.220070+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:07:51.220070+0000","last_undegraded":"2024-09-17T06:07:51.220070+0000","last_fullsized":"2024-09-17T06:07:51.220070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.589149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.705503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698292+0000","last_change":"2024-09-17T06:06:58.599122+0000","last_active":"2024-09-17T06:07:50.698292+0000","last_peered":"2024-09-17T06:07:50.698292+0000","last_clean":"2024-09-17T06:07:50.698292+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:07:50.698292+0000","last_undegraded":"2024-09-17T06:07:50.698292+0000","last_fullsized":"2024-09-17T06:07:50.698292+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_clean_scrub_stamp":"2024-09-17T06:06:58.598909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.505821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219917+0000","last_change":"2024-09-17T06:06:48.493667+0000","last_active":"2024-09-17T06:07:51.219917+0000","last_peered":"2024-09-17T06:07:51.219917+0000","last_clean":"2024-09-17T06:07:51.219917+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:07:51.219917+0000","last_undegraded":"2024-09-17T06:07:51.219917+0000","last_fullsized":"2024-09-17T06:07:51.219917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.493470+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.837170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":147,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697097+0000","last_change":"2024-09-17T06:06:44.333474+0000","last_active":"2024-09-17T06:07:50.697097+0000","last_peered":"2024-09-17T06:07:50.697097+0000","last_clean":"2024-09-17T06:07:50.697097+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:07:50.697097+0000","last_undegraded":"2024-09-17T06:07:50.697097+0000","last_fullsized":"2024-09-17T06:07:50.697097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.333150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.158751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698343+0000","last_change":"2024-09-17T06:06:52.699338+0000","last_active":"2024-09-17T06:07:50.698343+0000","last_peered":"2024-09-17T06:07:50.698343+0000","last_clean":"2024-09-17T06:07:50.698343+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:07:50.698343+0000","last_undegraded":"2024-09-17T06:07:50.698343+0000","last_fullsized":"2024-09-17T06:07:50.698343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.699134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:51.626769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222343+0000","last_change":"2024-09-17T06:06:49.633934+0000","last_active":"2024-09-17T06:07:51.222343+0000","last_peered":"2024-09-17T06:07:51.222343+0000","last_clean":"2024-09-17T06:07:51.222343+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:07:51.222343+0000","last_undegraded":"2024-09-17T06:07:51.222343+0000","last_fullsized":"2024-09-17T06:07:51.222343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.633660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.217982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220089+0000","last_change":"2024-09-17T06:06:46.974853+0000","last_active":"2024-09-17T06:07:51.220089+0000","last_peered":"2024-09-17T06:07:51.220089+0000","last_clean":"2024-09-17T06:07:51.220089+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:07:51.220089+0000","last_undegraded":"2024-09-17T06:07:51.220089+0000","last_fullsized":"2024-09-17T06:07:51.220089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.974637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:26.337532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218927+0000","last_change":"2024-09-17T06:06:46.527438+0000","last_active":"2024-09-17T06:07:51.218927+0000","last_peered":"2024-09-17T06:07:51.218927+0000","last_clean":"2024-09-17T06:07:51.218927+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:07:51.218927+0000","last_undegraded":"2024-09-17T06:07:51.218927+0000","last_fullsized":"2024-09-17T06:07:51.218927+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.527230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:25.890125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696597+0000","last_change":"2024-09-17T06:06:54.199209+0000","last_active":"2024-09-17T06:07:50.696597+0000","last_peered":"2024-09-17T06:07:50.696597+0000","last_clean":"2024-09-17T06:07:50.696597+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:07:50.696597+0000","last_undegraded":"2024-09-17T06:07:50.696597+0000","last_fullsized":"2024-09-17T06:07:50.696597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.198989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:51.609301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":84,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699671+0000","last_change":"2024-09-17T06:06:46.699017+0000","last_active":"2024-09-17T06:07:50.699671+0000","last_peered":"2024-09-17T06:07:50.699671+0000","last_clean":"2024-09-17T06:07:50.699671+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:07:50.699671+0000","last_undegraded":"2024-09-17T06:07:50.699671+0000","last_fullsized":"2024-09-17T06:07:50.699671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.698821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:33.586359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698678+0000","last_change":"2024-09-17T06:06:40.624617+0000","last_active":"2024-09-17T06:07:50.698678+0000","last_peered":"2024-09-17T06:07:50.698678+0000","last_clean":"2024-09-17T06:07:50.698678+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:07:50.698678+0000","last_undegraded":"2024-09-17T06:07:50.698678+0000","last_fullsized":"2024-09-17T06:07:50.698678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.624540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:48.054970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696085+0000","last_change":"2024-09-17T06:06:45.311790+0000","last_active":"2024-09-17T06:07:50.696085+0000","last_peered":"2024-09-17T06:07:50.696085+0000","last_clean":"2024-09-17T06:07:50.696085+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:07:50.696085+0000","last_undegraded":"2024-09-17T06:07:50.696085+0000","last_fullsized":"2024-09-17T06:07:50.696085+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.311572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:05.215110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225756+0000","last_change":"2024-09-17T06:06:43.594929+0000","last_active":"2024-09-17T06:07:51.225756+0000","last_peered":"2024-09-17T06:07:51.225756+0000","last_clean":"2024-09-17T06:07:51.225756+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:07:51.225756+0000","last_undegraded":"2024-09-17T06:07:51.225756+0000","last_fullsized":"2024-09-17T06:07:51.225756+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.594608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:54.666206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693105+0000","last_change":"2024-09-17T06:06:44.420446+0000","last_active":"2024-09-17T06:07:50.693105+0000","last_peered":"2024-09-17T06:07:50.693105+0000","last_clean":"2024-09-17T06:07:50.693105+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:07:50.693105+0000","last_undegraded":"2024-09-17T06:07:50.693105+0000","last_fullsized":"2024-09-17T06:07:50.693105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.420226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:35.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698825+0000","last_change":"2024-09-17T06:06:39.644661+0000","last_active":"2024-09-17T06:07:50.698825+0000","last_peered":"2024-09-17T06:07:50.698825+0000","last_clean":"2024-09-17T06:07:50.698825+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:07:50.698825+0000","last_undegraded":"2024-09-17T06:07:50.698825+0000","last_fullsized":"2024-09-17T06:07:50.698825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.644581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:43.034866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695060+0000","last_change":"2024-09-17T06:06:42.552587+0000","last_active":"2024-09-17T06:07:50.695060+0000","last_peered":"2024-09-17T06:07:50.695060+0000","last_clean":"2024-09-17T06:07:50.695060+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:07:50.695060+0000","last_undegraded":"2024-09-17T06:07:50.695060+0000","last_fullsized":"2024-09-17T06:07:50.695060+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.552253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:16.204277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":133,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699293+0000","last_change":"2024-09-17T06:06:59.590058+0000","last_active":"2024-09-17T06:07:50.699293+0000","last_peered":"2024-09-17T06:07:50.699293+0000","last_clean":"2024-09-17T06:07:50.699293+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:07:50.699293+0000","last_undegraded":"2024-09-17T06:07:50.699293+0000","last_fullsized":"2024-09-17T06:07:50.699293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_clean_scrub_stamp":"2024-09-17T06:06:59.589844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:13.777383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.694980+0000","last_change":"2024-09-17T06:06:49.212293+0000","last_active":"2024-09-17T06:07:50.694980+0000","last_peered":"2024-09-17T06:07:50.694980+0000","last_clean":"2024-09-17T06:07:50.694980+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:07:50.694980+0000","last_undegraded":"2024-09-17T06:07:50.694980+0000","last_fullsized":"2024-09-17T06:07:50.694980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.211966+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:29.791073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692855+0000","last_change":"2024-09-17T06:06:43.370824+0000","last_active":"2024-09-17T06:07:50.692855+0000","last_peered":"2024-09-17T06:07:50.692855+0000","last_clean":"2024-09-17T06:07:50.692855+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:07:50.692855+0000","last_undegraded":"2024-09-17T06:07:50.692855+0000","last_fullsized":"2024-09-17T06:07:50.692855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.370630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:28.698931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218905+0000","last_change":"2024-09-17T06:06:50.490824+0000","last_active":"2024-09-17T06:07:51.218905+0000","last_peered":"2024-09-17T06:07:51.218905+0000","last_clean":"2024-09-17T06:07:51.218905+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:07:51.218905+0000","last_undegraded":"2024-09-17T06:07:51.218905+0000","last_fullsized":"2024-09-17T06:07:51.218905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.490494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.208761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":169,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225406+0000","last_change":"2024-09-17T06:06:54.564398+0000","last_active":"2024-09-17T06:07:51.225406+0000","last_peered":"2024-09-17T06:07:51.225406+0000","last_clean":"2024-09-17T06:07:51.225406+0000","last_became_active":"2024-09-17T06:06:49.863977+0000","last_became_peered":"2024-09-17T06:06:49.863977+0000","last_unstale":"2024-09-17T06:07:51.225406+0000","last_undegraded":"2024-09-17T06:07:51.225406+0000","last_fullsized":"2024-09-17T06:07:51.225406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:54.564097+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:53.583377+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.564097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:45.765238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":119,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700171+0000","last_change":"2024-09-17T06:06:48.701826+0000","last_active":"2024-09-17T06:07:50.700171+0000","last_peered":"2024-09-17T06:07:50.700171+0000","last_clean":"2024-09-17T06:07:50.700171+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:07:50.700171+0000","last_undegraded":"2024-09-17T06:07:50.700171+0000","last_fullsized":"2024-09-17T06:07:50.700171+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.701596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:43:38.318752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220523+0000","last_change":"2024-09-17T06:06:44.071550+0000","last_active":"2024-09-17T06:07:51.220523+0000","last_peered":"2024-09-17T06:07:51.220523+0000","last_clean":"2024-09-17T06:07:51.220523+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:07:51.220523+0000","last_undegraded":"2024-09-17T06:07:51.220523+0000","last_fullsized":"2024-09-17T06:07:51.220523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.071343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:50.902738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698939+0000","last_change":"2024-09-17T06:06:48.219488+0000","last_active":"2024-09-17T06:07:50.698939+0000","last_peered":"2024-09-17T06:07:50.698939+0000","last_clean":"2024-09-17T06:07:50.698939+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:07:50.698939+0000","last_undegraded":"2024-09-17T06:07:50.698939+0000","last_fullsized":"2024-09-17T06:07:50.698939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.219293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:00.836074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700244+0000","last_change":"2024-09-17T06:06:50.710122+0000","last_active":"2024-09-17T06:07:50.700244+0000","last_peered":"2024-09-17T06:07:50.700244+0000","last_clean":"2024-09-17T06:07:50.700244+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:07:50.700244+0000","last_undegraded":"2024-09-17T06:07:50.700244+0000","last_fullsized":"2024-09-17T06:07:50.700244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.709804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:24.696128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218361+0000","last_change":"2024-09-17T06:06:51.502240+0000","last_active":"2024-09-17T06:07:51.218361+0000","last_peered":"2024-09-17T06:07:51.218361+0000","last_clean":"2024-09-17T06:07:51.218361+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:07:51.218361+0000","last_undegraded":"2024-09-17T06:07:51.218361+0000","last_fullsized":"2024-09-17T06:07:51.218361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.502041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.125829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":123,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698250+0000","last_change":"2024-09-17T06:06:49.687515+0000","last_active":"2024-09-17T06:07:50.698250+0000","last_peered":"2024-09-17T06:07:50.698250+0000","last_clean":"2024-09-17T06:07:50.698250+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:07:50.698250+0000","last_undegraded":"2024-09-17T06:07:50.698250+0000","last_fullsized":"2024-09-17T06:07:50.698250+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.687322+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:09.182168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692664+0000","last_change":"2024-09-17T06:06:49.761230+0000","last_active":"2024-09-17T06:07:50.692664+0000","last_peered":"2024-09-17T06:07:50.692664+0000","last_clean":"2024-09-17T06:07:50.692664+0000","last_became_active":"2024-09-17T06:06:49.760405+0000","last_became_peered":"2024-09-17T06:06:49.760405+0000","last_unstale":"2024-09-17T06:07:50.692664+0000","last_undegraded":"2024-09-17T06:07:50.692664+0000","last_fullsized":"2024-09-17T06:07:50.692664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:18.198271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224902+0000","last_change":"2024-09-17T06:06:51.561891+0000","last_active":"2024-09-17T06:07:51.224902+0000","last_peered":"2024-09-17T06:07:51.224902+0000","last_clean":"2024-09-17T06:07:51.224902+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:07:51.224902+0000","last_undegraded":"2024-09-17T06:07:51.224902+0000","last_fullsized":"2024-09-17T06:07:51.224902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.561576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:27.536230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697580+0000","last_change":"2024-09-17T06:06:51.171689+0000","last_active":"2024-09-17T06:07:50.697580+0000","last_peered":"2024-09-17T06:07:50.697580+0000","last_clean":"2024-09-17T06:07:50.697580+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:07:50.697580+0000","last_undegraded":"2024-09-17T06:07:50.697580+0000","last_fullsized":"2024-09-17T06:07:50.697580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.171493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:39.452849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842010+0000","last_change":"2024-09-17T06:06:55.610932+0000","last_active":"2024-09-17T06:07:50.842010+0000","last_peered":"2024-09-17T06:07:50.842010+0000","last_clean":"2024-09-17T06:07:50.842010+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:07:50.842010+0000","last_undegraded":"2024-09-17T06:07:50.842010+0000","last_fullsized":"2024-09-17T06:07:50.842010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.610700+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:07.867694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693815+0000","last_change":"2024-09-17T06:06:42.353051+0000","last_active":"2024-09-17T06:07:50.693815+0000","last_peered":"2024-09-17T06:07:50.693815+0000","last_clean":"2024-09-17T06:07:50.693815+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:07:50.693815+0000","last_undegraded":"2024-09-17T06:07:50.693815+0000","last_fullsized":"2024-09-17T06:07:50.693815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.352711+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:14.862093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220510+0000","last_change":"2024-09-17T06:06:52.529037+0000","last_active":"2024-09-17T06:07:51.220510+0000","last_peered":"2024-09-17T06:07:51.220510+0000","last_clean":"2024-09-17T06:07:51.220510+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:07:51.220510+0000","last_undegraded":"2024-09-17T06:07:51.220510+0000","last_fullsized":"2024-09-17T06:07:51.220510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.528843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.118602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218857+0000","last_change":"2024-09-17T06:06:53.547108+0000","last_active":"2024-09-17T06:07:51.218857+0000","last_peered":"2024-09-17T06:07:51.218857+0000","last_clean":"2024-09-17T06:07:51.218857+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:07:51.218857+0000","last_undegraded":"2024-09-17T06:07:51.218857+0000","last_fullsized":"2024-09-17T06:07:51.218857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.546853+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:05.208153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220476+0000","last_change":"2024-09-17T06:06:48.919436+0000","last_active":"2024-09-17T06:07:51.220476+0000","last_peered":"2024-09-17T06:07:51.220476+0000","last_clean":"2024-09-17T06:07:51.220476+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:07:51.220476+0000","last_undegraded":"2024-09-17T06:07:51.220476+0000","last_fullsized":"2024-09-17T06:07:51.220476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.919235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:27.262935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222436+0000","last_change":"2024-09-17T06:06:44.636882+0000","last_active":"2024-09-17T06:07:51.222436+0000","last_peered":"2024-09-17T06:07:51.222436+0000","last_clean":"2024-09-17T06:07:51.222436+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:07:51.222436+0000","last_undegraded":"2024-09-17T06:07:51.222436+0000","last_fullsized":"2024-09-17T06:07:51.222436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.636626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:44.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698346+0000","last_change":"2024-09-17T06:06:51.717905+0000","last_active":"2024-09-17T06:07:50.698346+0000","last_peered":"2024-09-17T06:07:50.698346+0000","last_clean":"2024-09-17T06:07:50.698346+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:07:50.698346+0000","last_undegraded":"2024-09-17T06:07:50.698346+0000","last_fullsized":"2024-09-17T06:07:50.698346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.717694+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:59.444208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700277+0000","last_change":"2024-09-17T06:06:45.539679+0000","last_active":"2024-09-17T06:07:50.700277+0000","last_peered":"2024-09-17T06:07:50.700277+0000","last_clean":"2024-09-17T06:07:50.700277+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:07:50.700277+0000","last_undegraded":"2024-09-17T06:07:50.700277+0000","last_fullsized":"2024-09-17T06:07:50.700277+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.539468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:55.832105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698493+0000","last_change":"2024-09-17T06:06:52.213250+0000","last_active":"2024-09-17T06:07:50.698493+0000","last_peered":"2024-09-17T06:07:50.698493+0000","last_clean":"2024-09-17T06:07:50.698493+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:07:50.698493+0000","last_undegraded":"2024-09-17T06:07:50.698493+0000","last_fullsized":"2024-09-17T06:07:50.698493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.213042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:36.033960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698927+0000","last_change":"2024-09-17T06:06:53.226240+0000","last_active":"2024-09-17T06:07:50.698927+0000","last_peered":"2024-09-17T06:07:50.698927+0000","last_clean":"2024-09-17T06:07:50.698927+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:07:50.698927+0000","last_undegraded":"2024-09-17T06:07:50.698927+0000","last_fullsized":"2024-09-17T06:07:50.698927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'16","last_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_deep_scrub":"81'16","last_deep_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.226044+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:15.604828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842503+0000","last_change":"2024-09-17T06:06:50.593476+0000","last_active":"2024-09-17T06:07:50.842503+0000","last_peered":"2024-09-17T06:07:50.842503+0000","last_clean":"2024-09-17T06:07:50.842503+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:07:50.842503+0000","last_undegraded":"2024-09-17T06:07:50.842503+0000","last_fullsized":"2024-09-17T06:07:50.842503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.593281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.041524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697951+0000","last_change":"2024-09-17T06:06:53.662277+0000","last_active":"2024-09-17T06:07:50.697951+0000","last_peered":"2024-09-17T06:07:50.697951+0000","last_clean":"2024-09-17T06:07:50.697951+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:07:50.697951+0000","last_undegraded":"2024-09-17T06:07:50.697951+0000","last_fullsized":"2024-09-17T06:07:50.697951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.662083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:09.458813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840621+0000","last_change":"2024-09-17T06:06:54.601401+0000","last_active":"2024-09-17T06:07:50.840621+0000","last_peered":"2024-09-17T06:07:50.840621+0000","last_clean":"2024-09-17T06:07:50.840621+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:07:50.840621+0000","last_undegraded":"2024-09-17T06:07:50.840621+0000","last_fullsized":"2024-09-17T06:07:50.840621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.601206+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:30.575859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218778+0000","last_change":"2024-09-17T06:06:54.592256+0000","last_active":"2024-09-17T06:07:51.218778+0000","last_peered":"2024-09-17T06:07:51.218778+0000","last_clean":"2024-09-17T06:07:51.218778+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:07:51.218778+0000","last_undegraded":"2024-09-17T06:07:51.218778+0000","last_fullsized":"2024-09-17T06:07:51.218778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.591916+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:43.180179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840639+0000","last_change":"2024-09-17T06:06:57.597911+0000","last_active":"2024-09-17T06:07:50.840639+0000","last_peered":"2024-09-17T06:07:50.840639+0000","last_clean":"2024-09-17T06:07:50.840639+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:07:50.840639+0000","last_undegraded":"2024-09-17T06:07:50.840639+0000","last_fullsized":"2024-09-17T06:07:50.840639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.597715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:05.028145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219614+0000","last_change":"2024-09-17T06:06:55.569378+0000","last_active":"2024-09-17T06:07:51.219614+0000","last_peered":"2024-09-17T06:07:51.219614+0000","last_clean":"2024-09-17T06:07:51.219614+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:07:51.219614+0000","last_undegraded":"2024-09-17T06:07:51.219614+0000","last_fullsized":"2024-09-17T06:07:51.219614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.569171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:50.988830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222167+0000","last_change":"2024-09-17T06:06:46.576687+0000","last_active":"2024-09-17T06:07:51.222167+0000","last_peered":"2024-09-17T06:07:51.222167+0000","last_clean":"2024-09-17T06:07:51.222167+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:07:51.222167+0000","last_undegraded":"2024-09-17T06:07:51.222167+0000","last_fullsized":"2024-09-17T06:07:51.222167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:36.143901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222017+0000","last_change":"2024-09-17T06:06:46.022759+0000","last_active":"2024-09-17T06:07:51.222017+0000","last_peered":"2024-09-17T06:07:51.222017+0000","last_clean":"2024-09-17T06:07:51.222017+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:07:51.222017+0000","last_undegraded":"2024-09-17T06:07:51.222017+0000","last_fullsized":"2024-09-17T06:07:51.222017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.022447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.814300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842307+0000","last_change":"2024-09-17T06:06:56.620251+0000","last_active":"2024-09-17T06:07:50.842307+0000","last_peered":"2024-09-17T06:07:50.842307+0000","last_clean":"2024-09-17T06:07:50.842307+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:07:50.842307+0000","last_undegraded":"2024-09-17T06:07:50.842307+0000","last_fullsized":"2024-09-17T06:07:50.842307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.619933+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:00.010218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1044480,"data_stored":558879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":522541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509494,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1605632,"data_stored":1113225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1593344,"data_stored":1113079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509492,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":558467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906970,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":1007616,"data_stored":522255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509494,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":999424,"data_stored":522199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542197,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":999424,"data_stored":522219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:08:02.937 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:08:02.937 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T06:08:06.042 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:08:06.045 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:08:22.938 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:08:23.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.102+0000 7ff194e18640 1 -- 172.21.15.122:0/1151831774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1900c67a0 msgr2=0x7ff19014e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:23.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.102+0000 7ff194e18640 1 --2- 172.21.15.122:0/1151831774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1900c67a0 0x7ff19014e9e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff180009840 tx=0x7ff18001f010 comp rx=0 tx=0).stop 2024-09-17T06:08:23.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.102+0000 7ff194e18640 1 -- 172.21.15.122:0/1151831774 shutdown_connections 2024-09-17T06:08:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.102+0000 7ff194e18640 1 --2- 172.21.15.122:0/1151831774 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff190072270 0x7ff190072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.102+0000 7ff194e18640 1 --2- 172.21.15.122:0/1151831774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1900c67a0 0x7ff19014e9e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.102+0000 7ff194e18640 1 -- 172.21.15.122:0/1151831774 >> 172.21.15.122:0/1151831774 conn(0x7ff1900746d0 msgr2=0x7ff190074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:08:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.102+0000 7ff194e18640 1 -- 172.21.15.122:0/1151831774 shutdown_connections 2024-09-17T06:08:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.102+0000 7ff194e18640 1 -- 172.21.15.122:0/1151831774 wait complete. 2024-09-17T06:08:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff194e18640 1 Processor -- start 2024-09-17T06:08:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff194e18640 1 -- start start 2024-09-17T06:08:23.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff194e18640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff190072270 0x7ff190148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:08:23.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff194e18640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1900c67a0 0x7ff190159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:08:23.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff194e18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19015b7b0 0x7ff190159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:08:23.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff194e18640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff190158a70 con 0x7ff19015b7b0 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff194e18640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff190158790 con 0x7ff1900c67a0 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff194e18640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff190158d50 con 0x7ff190072270 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff18ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19015b7b0 0x7ff190159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff18ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19015b7b0 0x7ff190159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40190/0 (socket says 172.21.15.122:40190) 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff18ed9d640 1 -- 172.21.15.122:0/2751000764 learned_addr learned my addr 172.21.15.122:0/2751000764 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff18e59c640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff190072270 0x7ff190148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff18dd9b640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1900c67a0 0x7ff190159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff18ed9d640 1 -- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff190072270 msgr2=0x7ff190148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff18ed9d640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff190072270 0x7ff190148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff18ed9d640 1 -- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1900c67a0 msgr2=0x7ff190159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff18ed9d640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1900c67a0 0x7ff190159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff18ed9d640 1 -- 172.21.15.122:0/2751000764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19015ad60 con 0x7ff19015b7b0 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff18ed9d640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19015b7b0 0x7ff190159c70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff18800c6b0 tx=0x7ff18800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:08:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff17effd640 1 -- 172.21.15.122:0/2751000764 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff188017070 con 0x7ff19015b7b0 2024-09-17T06:08:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff17effd640 1 -- 172.21.15.122:0/2751000764 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff188003c70 con 0x7ff19015b7b0 2024-09-17T06:08:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff17effd640 1 -- 172.21.15.122:0/2751000764 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff188003e60 con 0x7ff19015b7b0 2024-09-17T06:08:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff194e18640 1 -- 172.21.15.122:0/2751000764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19015a5f0 con 0x7ff19015b7b0 2024-09-17T06:08:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.106+0000 7ff194e18640 1 -- 172.21.15.122:0/2751000764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1901f08f0 con 0x7ff19015b7b0 2024-09-17T06:08:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.110+0000 7ff194e18640 1 -- 172.21.15.122:0/2751000764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff190152620 con 0x7ff19015b7b0 2024-09-17T06:08:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.110+0000 7ff17effd640 1 -- 172.21.15.122:0/2751000764 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff18801a070 con 0x7ff19015b7b0 2024-09-17T06:08:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.110+0000 7ff17effd640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff170073200 0x7ff170075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:08:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.110+0000 7ff17effd640 1 -- 172.21.15.122:0/2751000764 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6854+0+0 (secure 0 0 0) 0x7ff188093b60 con 0x7ff19015b7b0 2024-09-17T06:08:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.110+0000 7ff18e59c640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff170073200 0x7ff170075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:08:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.110+0000 7ff18e59c640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff170073200 0x7ff170075710 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff1800b2000 tx=0x7ff18001d850 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:08:23.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.114+0000 7ff17effd640 1 -- 172.21.15.122:0/2751000764 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff18805e130 con 0x7ff19015b7b0 2024-09-17T06:08:23.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.278+0000 7ff194e18640 1 -- 172.21.15.122:0/2751000764 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff19015b260 con 0x7ff170073200 2024-09-17T06:08:23.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.298+0000 7ff17effd640 1 -- 172.21.15.122:0/2751000764 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332987 (secure 0 0 0) 0x7ff1800040c0 con 0x7ff170073200 2024-09-17T06:08:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:08:23.305 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:08:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.302+0000 7ff194e18640 1 -- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff170073200 msgr2=0x7ff170075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:23.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.302+0000 7ff194e18640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff170073200 0x7ff170075710 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff1800b2000 tx=0x7ff18001d850 comp rx=0 tx=0).stop 2024-09-17T06:08:23.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.302+0000 7ff194e18640 1 -- 172.21.15.122:0/2751000764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19015b7b0 msgr2=0x7ff190159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:23.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.302+0000 7ff194e18640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19015b7b0 0x7ff190159c70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff18800c6b0 tx=0x7ff18800cb70 comp rx=0 tx=0).stop 2024-09-17T06:08:23.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.302+0000 7ff194e18640 1 -- 172.21.15.122:0/2751000764 shutdown_connections 2024-09-17T06:08:23.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.302+0000 7ff194e18640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19015b7b0 0x7ff190159c70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:23.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.302+0000 7ff194e18640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff170073200 0x7ff170075710 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:23.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.302+0000 7ff194e18640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1900c67a0 0x7ff190159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:23.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.302+0000 7ff194e18640 1 --2- 172.21.15.122:0/2751000764 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff190072270 0x7ff190148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:23.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.302+0000 7ff194e18640 1 -- 172.21.15.122:0/2751000764 >> 172.21.15.122:0/2751000764 conn(0x7ff1900746d0 msgr2=0x7ff19013fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:08:23.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.302+0000 7ff194e18640 1 -- 172.21.15.122:0/2751000764 shutdown_connections 2024-09-17T06:08:23.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:23.302+0000 7ff194e18640 1 -- 172.21.15.122:0/2751000764 wait complete. 2024-09-17T06:08:23.324 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-17T06:08:21.624491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247140,"kb_used_data":9072,"kb_used_omap":17,"kb_used_meta":237870,"kb_avail":754727580,"statfs":{"total":773094113280,"available":772841041920,"internally_reserved":0,"allocated":9289728,"data_stored":5432864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":243579629},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005419"},"pg_stats":[{"pgid":"2.1f","version":"81'6","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224051+0000","last_change":"2024-09-17T06:06:38.646633+0000","last_active":"2024-09-17T06:07:51.224051+0000","last_peered":"2024-09-17T06:07:51.224051+0000","last_clean":"2024-09-17T06:07:51.224051+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:07:51.224051+0000","last_undegraded":"2024-09-17T06:07:51.224051+0000","last_fullsized":"2024-09-17T06:07:51.224051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.646522+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:55.373873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699959+0000","last_change":"2024-09-17T06:06:47.678984+0000","last_active":"2024-09-17T06:07:50.699959+0000","last_peered":"2024-09-17T06:07:50.699959+0000","last_clean":"2024-09-17T06:07:50.699959+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:07:50.699959+0000","last_undegraded":"2024-09-17T06:07:50.699959+0000","last_fullsized":"2024-09-17T06:07:50.699959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.678793+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:31.584591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697854+0000","last_change":"2024-09-17T06:06:55.606541+0000","last_active":"2024-09-17T06:07:50.697854+0000","last_peered":"2024-09-17T06:07:50.697854+0000","last_clean":"2024-09-17T06:07:50.697854+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:07:50.697854+0000","last_undegraded":"2024-09-17T06:07:50.697854+0000","last_fullsized":"2024-09-17T06:07:50.697854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.606346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:05.514205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700296+0000","last_change":"2024-09-17T06:06:41.626922+0000","last_active":"2024-09-17T06:07:50.700296+0000","last_peered":"2024-09-17T06:07:50.700296+0000","last_clean":"2024-09-17T06:07:50.700296+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:07:50.700296+0000","last_undegraded":"2024-09-17T06:07:50.700296+0000","last_fullsized":"2024-09-17T06:07:50.700296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.626723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:41.581056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222997+0000","last_change":"2024-09-17T06:06:42.561017+0000","last_active":"2024-09-17T06:07:51.222997+0000","last_peered":"2024-09-17T06:07:51.222997+0000","last_clean":"2024-09-17T06:07:51.222997+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:07:51.222997+0000","last_undegraded":"2024-09-17T06:07:51.222997+0000","last_fullsized":"2024-09-17T06:07:51.222997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.560815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:06.386417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.694947+0000","last_change":"2024-09-17T06:06:50.581741+0000","last_active":"2024-09-17T06:07:50.694947+0000","last_peered":"2024-09-17T06:07:50.694947+0000","last_clean":"2024-09-17T06:07:50.694947+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:07:50.694947+0000","last_undegraded":"2024-09-17T06:07:50.694947+0000","last_fullsized":"2024-09-17T06:07:50.694947+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.581526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:27.538796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841990+0000","last_change":"2024-09-17T06:06:44.503792+0000","last_active":"2024-09-17T06:07:50.841990+0000","last_peered":"2024-09-17T06:07:50.841990+0000","last_clean":"2024-09-17T06:07:50.841990+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:07:50.841990+0000","last_undegraded":"2024-09-17T06:07:50.841990+0000","last_fullsized":"2024-09-17T06:07:50.841990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.503569+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.329171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219618+0000","last_change":"2024-09-17T06:06:49.490282+0000","last_active":"2024-09-17T06:07:51.219618+0000","last_peered":"2024-09-17T06:07:51.219618+0000","last_clean":"2024-09-17T06:07:51.219618+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:07:51.219618+0000","last_undegraded":"2024-09-17T06:07:51.219618+0000","last_fullsized":"2024-09-17T06:07:51.219618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.490084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:52.911935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700188+0000","last_change":"2024-09-17T06:06:51.542004+0000","last_active":"2024-09-17T06:07:50.700188+0000","last_peered":"2024-09-17T06:07:50.700188+0000","last_clean":"2024-09-17T06:07:50.700188+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:07:50.700188+0000","last_undegraded":"2024-09-17T06:07:50.700188+0000","last_fullsized":"2024-09-17T06:07:50.700188+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.541795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.542454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841533+0000","last_change":"2024-09-17T06:06:45.535472+0000","last_active":"2024-09-17T06:07:50.841533+0000","last_peered":"2024-09-17T06:07:50.841533+0000","last_clean":"2024-09-17T06:07:50.841533+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:07:50.841533+0000","last_undegraded":"2024-09-17T06:07:50.841533+0000","last_fullsized":"2024-09-17T06:07:50.841533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.535262+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:56.606861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692929+0000","last_change":"2024-09-17T06:06:45.459635+0000","last_active":"2024-09-17T06:07:50.692929+0000","last_peered":"2024-09-17T06:07:50.692929+0000","last_clean":"2024-09-17T06:07:50.692929+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:07:50.692929+0000","last_undegraded":"2024-09-17T06:07:50.692929+0000","last_fullsized":"2024-09-17T06:07:50.692929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.459406+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:41.152666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699340+0000","last_change":"2024-09-17T06:06:52.519889+0000","last_active":"2024-09-17T06:07:50.699340+0000","last_peered":"2024-09-17T06:07:50.699340+0000","last_clean":"2024-09-17T06:07:50.699340+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:07:50.699340+0000","last_undegraded":"2024-09-17T06:07:50.699340+0000","last_fullsized":"2024-09-17T06:07:50.699340+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.519692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:06.562811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695522+0000","last_change":"2024-09-17T06:06:46.282925+0000","last_active":"2024-09-17T06:07:50.695522+0000","last_peered":"2024-09-17T06:07:50.695522+0000","last_clean":"2024-09-17T06:07:50.695522+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:07:50.695522+0000","last_undegraded":"2024-09-17T06:07:50.695522+0000","last_fullsized":"2024-09-17T06:07:50.695522+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.282607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:45.646843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841556+0000","last_change":"2024-09-17T06:06:47.578055+0000","last_active":"2024-09-17T06:07:50.841556+0000","last_peered":"2024-09-17T06:07:50.841556+0000","last_clean":"2024-09-17T06:07:50.841556+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:07:50.841556+0000","last_undegraded":"2024-09-17T06:07:50.841556+0000","last_fullsized":"2024-09-17T06:07:50.841556+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.577825+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:54.466675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699912+0000","last_change":"2024-09-17T06:06:48.564278+0000","last_active":"2024-09-17T06:07:50.699912+0000","last_peered":"2024-09-17T06:07:50.699912+0000","last_clean":"2024-09-17T06:07:50.699912+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:07:50.699912+0000","last_undegraded":"2024-09-17T06:07:50.699912+0000","last_fullsized":"2024-09-17T06:07:50.699912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.564076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:09.526182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698488+0000","last_change":"2024-09-17T06:06:45.719909+0000","last_active":"2024-09-17T06:07:50.698488+0000","last_peered":"2024-09-17T06:07:50.698488+0000","last_clean":"2024-09-17T06:07:50.698488+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:07:50.698488+0000","last_undegraded":"2024-09-17T06:07:50.698488+0000","last_fullsized":"2024-09-17T06:07:50.698488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.719724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:58.812630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220979+0000","last_change":"2024-09-17T06:06:39.054952+0000","last_active":"2024-09-17T06:07:51.220979+0000","last_peered":"2024-09-17T06:07:51.220979+0000","last_clean":"2024-09-17T06:07:51.220979+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:07:51.220979+0000","last_undegraded":"2024-09-17T06:07:51.220979+0000","last_fullsized":"2024-09-17T06:07:51.220979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.054879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:22.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700935+0000","last_change":"2024-09-17T06:06:47.595782+0000","last_active":"2024-09-17T06:07:50.700935+0000","last_peered":"2024-09-17T06:07:50.700935+0000","last_clean":"2024-09-17T06:07:50.700935+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:07:50.700935+0000","last_undegraded":"2024-09-17T06:07:50.700935+0000","last_fullsized":"2024-09-17T06:07:50.700935+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.595562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.305297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699839+0000","last_change":"2024-09-17T06:06:44.685583+0000","last_active":"2024-09-17T06:07:50.699839+0000","last_peered":"2024-09-17T06:07:50.699839+0000","last_clean":"2024-09-17T06:07:50.699839+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:07:50.699839+0000","last_undegraded":"2024-09-17T06:07:50.699839+0000","last_fullsized":"2024-09-17T06:07:50.699839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.685386+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:42.733827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220852+0000","last_change":"2024-09-17T06:06:41.096528+0000","last_active":"2024-09-17T06:07:51.220852+0000","last_peered":"2024-09-17T06:07:51.220852+0000","last_clean":"2024-09-17T06:07:51.220852+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:07:51.220852+0000","last_undegraded":"2024-09-17T06:07:51.220852+0000","last_fullsized":"2024-09-17T06:07:51.220852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.096443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.182798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222996+0000","last_change":"2024-09-17T06:06:51.955862+0000","last_active":"2024-09-17T06:07:51.222996+0000","last_peered":"2024-09-17T06:07:51.222996+0000","last_clean":"2024-09-17T06:07:51.222996+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:07:51.222996+0000","last_undegraded":"2024-09-17T06:07:51.222996+0000","last_fullsized":"2024-09-17T06:07:51.222996+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.955662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.579450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":73,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695797+0000","last_change":"2024-09-17T06:06:41.561023+0000","last_active":"2024-09-17T06:07:50.695797+0000","last_peered":"2024-09-17T06:07:50.695797+0000","last_clean":"2024-09-17T06:07:50.695797+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:07:50.695797+0000","last_undegraded":"2024-09-17T06:07:50.695797+0000","last_fullsized":"2024-09-17T06:07:50.695797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.560833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:35.979151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840638+0000","last_change":"2024-09-17T06:06:51.569920+0000","last_active":"2024-09-17T06:07:50.840638+0000","last_peered":"2024-09-17T06:07:50.840638+0000","last_clean":"2024-09-17T06:07:50.840638+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:07:50.840638+0000","last_undegraded":"2024-09-17T06:07:50.840638+0000","last_fullsized":"2024-09-17T06:07:50.840638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.569724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:16.044884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699903+0000","last_change":"2024-09-17T06:06:54.534994+0000","last_active":"2024-09-17T06:07:50.699903+0000","last_peered":"2024-09-17T06:07:50.699903+0000","last_clean":"2024-09-17T06:07:50.699903+0000","last_became_active":"2024-09-17T06:06:49.862233+0000","last_became_peered":"2024-09-17T06:06:49.862233+0000","last_unstale":"2024-09-17T06:07:50.699903+0000","last_undegraded":"2024-09-17T06:07:50.699903+0000","last_fullsized":"2024-09-17T06:07:50.699903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.534811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:53.555338+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.534811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:09.975013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,1],"acting":[4,2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225543+0000","last_change":"2024-09-17T06:06:39.595362+0000","last_active":"2024-09-17T06:07:51.225543+0000","last_peered":"2024-09-17T06:07:51.225543+0000","last_clean":"2024-09-17T06:07:51.225543+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:07:51.225543+0000","last_undegraded":"2024-09-17T06:07:51.225543+0000","last_fullsized":"2024-09-17T06:07:51.225543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.595150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:36.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697579+0000","last_change":"2024-09-17T06:06:41.345210+0000","last_active":"2024-09-17T06:07:50.697579+0000","last_peered":"2024-09-17T06:07:50.697579+0000","last_clean":"2024-09-17T06:07:50.697579+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:07:50.697579+0000","last_undegraded":"2024-09-17T06:07:50.697579+0000","last_fullsized":"2024-09-17T06:07:50.697579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.345015+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:38.207077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696384+0000","last_change":"2024-09-17T06:06:44.540629+0000","last_active":"2024-09-17T06:07:50.696384+0000","last_peered":"2024-09-17T06:07:50.696384+0000","last_clean":"2024-09-17T06:07:50.696384+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:07:50.696384+0000","last_undegraded":"2024-09-17T06:07:50.696384+0000","last_fullsized":"2024-09-17T06:07:50.696384+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.540426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:03.473101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700365+0000","last_change":"2024-09-17T06:06:43.669448+0000","last_active":"2024-09-17T06:07:50.700365+0000","last_peered":"2024-09-17T06:07:50.700365+0000","last_clean":"2024-09-17T06:07:50.700365+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:07:50.700365+0000","last_undegraded":"2024-09-17T06:07:50.700365+0000","last_fullsized":"2024-09-17T06:07:50.700365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.669209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:54.877316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222274+0000","last_change":"2024-09-17T06:06:38.067895+0000","last_active":"2024-09-17T06:07:51.222274+0000","last_peered":"2024-09-17T06:07:51.222274+0000","last_clean":"2024-09-17T06:07:51.222274+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:07:51.222274+0000","last_undegraded":"2024-09-17T06:07:51.222274+0000","last_fullsized":"2024-09-17T06:07:51.222274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.067715+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:26.508119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.230386+0000","last_change":"2024-09-17T06:07:51.228200+0000","last_active":"2024-09-17T06:07:51.230386+0000","last_peered":"2024-09-17T06:07:51.230386+0000","last_clean":"2024-09-17T06:07:51.230386+0000","last_became_active":"2024-09-17T06:07:51.226510+0000","last_became_peered":"2024-09-17T06:07:51.226510+0000","last_unstale":"2024-09-17T06:07:51.230386+0000","last_undegraded":"2024-09-17T06:07:51.230386+0000","last_fullsized":"2024-09-17T06:07:51.230386+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.651441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:14.647137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221540+0000","last_change":"2024-09-17T06:06:45.060936+0000","last_active":"2024-09-17T06:07:51.221540+0000","last_peered":"2024-09-17T06:07:51.221540+0000","last_clean":"2024-09-17T06:07:51.221540+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:07:51.221540+0000","last_undegraded":"2024-09-17T06:07:51.221540+0000","last_fullsized":"2024-09-17T06:07:51.221540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.060719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:03.842916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842537+0000","last_change":"2024-09-17T06:06:43.537259+0000","last_active":"2024-09-17T06:07:50.842537+0000","last_peered":"2024-09-17T06:07:50.842537+0000","last_clean":"2024-09-17T06:07:50.842537+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:07:50.842537+0000","last_undegraded":"2024-09-17T06:07:50.842537+0000","last_fullsized":"2024-09-17T06:07:50.842537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.537064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:53.557183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224537+0000","last_change":"2024-09-17T06:06:50.588334+0000","last_active":"2024-09-17T06:07:51.224537+0000","last_peered":"2024-09-17T06:07:51.224537+0000","last_clean":"2024-09-17T06:07:51.224537+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:07:51.224537+0000","last_undegraded":"2024-09-17T06:07:51.224537+0000","last_fullsized":"2024-09-17T06:07:51.224537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.588146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:34.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220191+0000","last_change":"2024-09-17T06:06:45.560755+0000","last_active":"2024-09-17T06:07:51.220191+0000","last_peered":"2024-09-17T06:07:51.220191+0000","last_clean":"2024-09-17T06:07:51.220191+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:07:51.220191+0000","last_undegraded":"2024-09-17T06:07:51.220191+0000","last_fullsized":"2024-09-17T06:07:51.220191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.560562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.352415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221768+0000","last_change":"2024-09-17T06:06:40.077709+0000","last_active":"2024-09-17T06:07:51.221768+0000","last_peered":"2024-09-17T06:07:51.221768+0000","last_clean":"2024-09-17T06:07:51.221768+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:07:51.221768+0000","last_undegraded":"2024-09-17T06:07:51.221768+0000","last_fullsized":"2024-09-17T06:07:51.221768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.077616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:13.235085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219846+0000","last_change":"2024-09-17T06:06:50.943563+0000","last_active":"2024-09-17T06:07:51.219846+0000","last_peered":"2024-09-17T06:07:51.219846+0000","last_clean":"2024-09-17T06:07:51.219846+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:07:51.219846+0000","last_undegraded":"2024-09-17T06:07:51.219846+0000","last_fullsized":"2024-09-17T06:07:51.219846+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.943366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.661632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700452+0000","last_change":"2024-09-17T06:06:39.544246+0000","last_active":"2024-09-17T06:07:50.700452+0000","last_peered":"2024-09-17T06:07:50.700452+0000","last_clean":"2024-09-17T06:07:50.700452+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:07:50.700452+0000","last_undegraded":"2024-09-17T06:07:50.700452+0000","last_fullsized":"2024-09-17T06:07:50.700452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.544002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:04.906600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219385+0000","last_change":"2024-09-17T06:06:41.601594+0000","last_active":"2024-09-17T06:07:51.219385+0000","last_peered":"2024-09-17T06:07:51.219385+0000","last_clean":"2024-09-17T06:07:51.219385+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:07:51.219385+0000","last_undegraded":"2024-09-17T06:07:51.219385+0000","last_fullsized":"2024-09-17T06:07:51.219385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.601393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.687748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221364+0000","last_change":"2024-09-17T06:06:49.922504+0000","last_active":"2024-09-17T06:07:51.221364+0000","last_peered":"2024-09-17T06:07:51.221364+0000","last_clean":"2024-09-17T06:07:51.221364+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:07:51.221364+0000","last_undegraded":"2024-09-17T06:07:51.221364+0000","last_fullsized":"2024-09-17T06:07:51.221364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.922302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:53.344154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222935+0000","last_change":"2024-09-17T06:06:42.067931+0000","last_active":"2024-09-17T06:07:51.222935+0000","last_peered":"2024-09-17T06:07:51.222935+0000","last_clean":"2024-09-17T06:07:51.222935+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:07:51.222935+0000","last_undegraded":"2024-09-17T06:07:51.222935+0000","last_fullsized":"2024-09-17T06:07:51.222935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.067737+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.818001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693159+0000","last_change":"2024-09-17T06:06:38.338953+0000","last_active":"2024-09-17T06:07:50.693159+0000","last_peered":"2024-09-17T06:07:50.693159+0000","last_clean":"2024-09-17T06:07:50.693159+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:07:50.693159+0000","last_undegraded":"2024-09-17T06:07:50.693159+0000","last_fullsized":"2024-09-17T06:07:50.693159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.338737+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:58.670904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223274+0000","last_change":"2024-09-17T06:06:47.938470+0000","last_active":"2024-09-17T06:07:51.223274+0000","last_peered":"2024-09-17T06:07:51.223274+0000","last_clean":"2024-09-17T06:07:51.223274+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:07:51.223274+0000","last_undegraded":"2024-09-17T06:07:51.223274+0000","last_fullsized":"2024-09-17T06:07:51.223274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.938263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.607027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221464+0000","last_change":"2024-09-17T06:06:41.585374+0000","last_active":"2024-09-17T06:07:51.221464+0000","last_peered":"2024-09-17T06:07:51.221464+0000","last_clean":"2024-09-17T06:07:51.221464+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:07:51.221464+0000","last_undegraded":"2024-09-17T06:07:51.221464+0000","last_fullsized":"2024-09-17T06:07:51.221464+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.585183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:11.929990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841022+0000","last_change":"2024-09-17T06:06:42.536575+0000","last_active":"2024-09-17T06:07:50.841022+0000","last_peered":"2024-09-17T06:07:50.841022+0000","last_clean":"2024-09-17T06:07:50.841022+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:07:50.841022+0000","last_undegraded":"2024-09-17T06:07:50.841022+0000","last_fullsized":"2024-09-17T06:07:50.841022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.536371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:23.547872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225184+0000","last_change":"2024-09-17T06:06:47.627398+0000","last_active":"2024-09-17T06:07:51.225184+0000","last_peered":"2024-09-17T06:07:51.225184+0000","last_clean":"2024-09-17T06:07:51.225184+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:07:51.225184+0000","last_undegraded":"2024-09-17T06:07:51.225184+0000","last_fullsized":"2024-09-17T06:07:51.225184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.627188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:28.206295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699094+0000","last_change":"2024-09-17T06:06:42.642781+0000","last_active":"2024-09-17T06:07:50.699094+0000","last_peered":"2024-09-17T06:07:50.699094+0000","last_clean":"2024-09-17T06:07:50.699094+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:07:50.699094+0000","last_undegraded":"2024-09-17T06:07:50.699094+0000","last_fullsized":"2024-09-17T06:07:50.699094+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.642468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:03.874053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219489+0000","last_change":"2024-09-17T06:06:40.563124+0000","last_active":"2024-09-17T06:07:51.219489+0000","last_peered":"2024-09-17T06:07:51.219489+0000","last_clean":"2024-09-17T06:07:51.219489+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:07:51.219489+0000","last_undegraded":"2024-09-17T06:07:51.219489+0000","last_fullsized":"2024-09-17T06:07:51.219489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.562781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:51.528772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"81'74","reported_seq":248,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841224+0000","last_change":"2024-09-17T06:06:41.529207+0000","last_active":"2024-09-17T06:07:50.841224+0000","last_peered":"2024-09-17T06:07:50.841224+0000","last_clean":"2024-09-17T06:07:50.841224+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:07:50.841224+0000","last_undegraded":"2024-09-17T06:07:50.841224+0000","last_fullsized":"2024-09-17T06:07:50.841224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'74","last_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_deep_scrub":"81'74","last_deep_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.529006+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:17.811347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698024+0000","last_change":"2024-09-17T06:06:50.168189+0000","last_active":"2024-09-17T06:07:50.698024+0000","last_peered":"2024-09-17T06:07:50.698024+0000","last_clean":"2024-09-17T06:07:50.698024+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:07:50.698024+0000","last_undegraded":"2024-09-17T06:07:50.698024+0000","last_fullsized":"2024-09-17T06:07:50.698024+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.167993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:53.277144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693347+0000","last_change":"2024-09-17T06:06:46.470862+0000","last_active":"2024-09-17T06:07:50.693347+0000","last_peered":"2024-09-17T06:07:50.693347+0000","last_clean":"2024-09-17T06:07:50.693347+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:07:50.693347+0000","last_undegraded":"2024-09-17T06:07:50.693347+0000","last_fullsized":"2024-09-17T06:07:50.693347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.470640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:54.803752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693596+0000","last_change":"2024-09-17T06:06:39.308543+0000","last_active":"2024-09-17T06:07:50.693596+0000","last_peered":"2024-09-17T06:07:50.693596+0000","last_clean":"2024-09-17T06:07:50.693596+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:07:50.693596+0000","last_undegraded":"2024-09-17T06:07:50.693596+0000","last_fullsized":"2024-09-17T06:07:50.693596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.308468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:26.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695170+0000","last_change":"2024-09-17T06:06:55.194732+0000","last_active":"2024-09-17T06:07:50.695170+0000","last_peered":"2024-09-17T06:07:50.695170+0000","last_clean":"2024-09-17T06:07:50.695170+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:07:50.695170+0000","last_undegraded":"2024-09-17T06:07:50.695170+0000","last_fullsized":"2024-09-17T06:07:50.695170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.194477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:46.395618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219942+0000","last_change":"2024-09-17T06:06:47.481798+0000","last_active":"2024-09-17T06:07:51.219942+0000","last_peered":"2024-09-17T06:07:51.219942+0000","last_clean":"2024-09-17T06:07:51.219942+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:07:51.219942+0000","last_undegraded":"2024-09-17T06:07:51.219942+0000","last_fullsized":"2024-09-17T06:07:51.219942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.481588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.150352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220891+0000","last_change":"2024-09-17T06:06:43.064298+0000","last_active":"2024-09-17T06:07:51.220891+0000","last_peered":"2024-09-17T06:07:51.220891+0000","last_clean":"2024-09-17T06:07:51.220891+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:07:51.220891+0000","last_undegraded":"2024-09-17T06:07:51.220891+0000","last_fullsized":"2024-09-17T06:07:51.220891+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.064096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:30.993498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225161+0000","last_change":"2024-09-17T06:06:52.593990+0000","last_active":"2024-09-17T06:07:51.225161+0000","last_peered":"2024-09-17T06:07:51.225161+0000","last_clean":"2024-09-17T06:07:51.225161+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:07:51.225161+0000","last_undegraded":"2024-09-17T06:07:51.225161+0000","last_fullsized":"2024-09-17T06:07:51.225161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.593787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:04.850781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842652+0000","last_change":"2024-09-17T06:06:46.576306+0000","last_active":"2024-09-17T06:07:50.842652+0000","last_peered":"2024-09-17T06:07:50.842652+0000","last_clean":"2024-09-17T06:07:50.842652+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:07:50.842652+0000","last_undegraded":"2024-09-17T06:07:50.842652+0000","last_fullsized":"2024-09-17T06:07:50.842652+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:36.552616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'3","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693902+0000","last_change":"2024-09-17T06:06:40.289371+0000","last_active":"2024-09-17T06:07:50.693902+0000","last_peered":"2024-09-17T06:07:50.693902+0000","last_clean":"2024-09-17T06:07:50.693902+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:07:50.693902+0000","last_undegraded":"2024-09-17T06:07:50.693902+0000","last_fullsized":"2024-09-17T06:07:50.693902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.289195+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.187275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218554+0000","last_change":"2024-09-17T06:06:57.580034+0000","last_active":"2024-09-17T06:07:51.218554+0000","last_peered":"2024-09-17T06:07:51.218554+0000","last_clean":"2024-09-17T06:07:51.218554+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:07:51.218554+0000","last_undegraded":"2024-09-17T06:07:51.218554+0000","last_fullsized":"2024-09-17T06:07:51.218554+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.579707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:15.990501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842381+0000","last_change":"2024-09-17T06:06:53.554156+0000","last_active":"2024-09-17T06:07:50.842381+0000","last_peered":"2024-09-17T06:07:50.842381+0000","last_clean":"2024-09-17T06:07:50.842381+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:07:50.842381+0000","last_undegraded":"2024-09-17T06:07:50.842381+0000","last_fullsized":"2024-09-17T06:07:50.842381+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.553919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:37.374837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700114+0000","last_change":"2024-09-17T06:06:40.545470+0000","last_active":"2024-09-17T06:07:50.700114+0000","last_peered":"2024-09-17T06:07:50.700114+0000","last_clean":"2024-09-17T06:07:50.700114+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:07:50.700114+0000","last_undegraded":"2024-09-17T06:07:50.700114+0000","last_fullsized":"2024-09-17T06:07:50.700114+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.545271+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:41.942375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696784+0000","last_change":"2024-09-17T06:06:46.553900+0000","last_active":"2024-09-17T06:07:50.696784+0000","last_peered":"2024-09-17T06:07:50.696784+0000","last_clean":"2024-09-17T06:07:50.696784+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:07:50.696784+0000","last_undegraded":"2024-09-17T06:07:50.696784+0000","last_fullsized":"2024-09-17T06:07:50.696784+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.553594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:37.347089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841069+0000","last_change":"2024-09-17T06:06:49.557072+0000","last_active":"2024-09-17T06:07:50.841069+0000","last_peered":"2024-09-17T06:07:50.841069+0000","last_clean":"2024-09-17T06:07:50.841069+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:07:50.841069+0000","last_undegraded":"2024-09-17T06:07:50.841069+0000","last_fullsized":"2024-09-17T06:07:50.841069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.556746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:02.173527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'13","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692561+0000","last_change":"2024-09-17T06:06:41.327726+0000","last_active":"2024-09-17T06:07:50.692561+0000","last_peered":"2024-09-17T06:07:50.692561+0000","last_clean":"2024-09-17T06:07:50.692561+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:07:50.692561+0000","last_undegraded":"2024-09-17T06:07:50.692561+0000","last_fullsized":"2024-09-17T06:07:50.692561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'13","last_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_deep_scrub":"81'13","last_deep_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.327620+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:41.975086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224922+0000","last_change":"2024-09-17T06:06:48.590089+0000","last_active":"2024-09-17T06:07:51.224922+0000","last_peered":"2024-09-17T06:07:51.224922+0000","last_clean":"2024-09-17T06:07:51.224922+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:07:51.224922+0000","last_undegraded":"2024-09-17T06:07:51.224922+0000","last_fullsized":"2024-09-17T06:07:51.224922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.589881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:13.065040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695546+0000","last_change":"2024-09-17T06:06:47.234619+0000","last_active":"2024-09-17T06:07:50.695546+0000","last_peered":"2024-09-17T06:07:50.695546+0000","last_clean":"2024-09-17T06:07:50.695546+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:07:50.695546+0000","last_undegraded":"2024-09-17T06:07:50.695546+0000","last_fullsized":"2024-09-17T06:07:50.695546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.234392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:10.297041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696180+0000","last_change":"2024-09-17T06:06:42.362985+0000","last_active":"2024-09-17T06:07:50.696180+0000","last_peered":"2024-09-17T06:07:50.696180+0000","last_clean":"2024-09-17T06:07:50.696180+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:07:50.696180+0000","last_undegraded":"2024-09-17T06:07:50.696180+0000","last_fullsized":"2024-09-17T06:07:50.696180+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.362795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:21.306942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700003+0000","last_change":"2024-09-17T06:06:54.645399+0000","last_active":"2024-09-17T06:07:50.700003+0000","last_peered":"2024-09-17T06:07:50.700003+0000","last_clean":"2024-09-17T06:07:50.700003+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:07:50.700003+0000","last_undegraded":"2024-09-17T06:07:50.700003+0000","last_fullsized":"2024-09-17T06:07:50.700003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.645200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:04.728298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841322+0000","last_change":"2024-09-17T06:06:48.595269+0000","last_active":"2024-09-17T06:07:50.841322+0000","last_peered":"2024-09-17T06:07:50.841322+0000","last_clean":"2024-09-17T06:07:50.841322+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:07:50.841322+0000","last_undegraded":"2024-09-17T06:07:50.841322+0000","last_fullsized":"2024-09-17T06:07:50.841322+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.595073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:51.297831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219063+0000","last_change":"2024-09-17T06:06:42.583243+0000","last_active":"2024-09-17T06:07:51.219063+0000","last_peered":"2024-09-17T06:07:51.219063+0000","last_clean":"2024-09-17T06:07:51.219063+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:07:51.219063+0000","last_undegraded":"2024-09-17T06:07:51.219063+0000","last_fullsized":"2024-09-17T06:07:51.219063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.583048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:54.333313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699331+0000","last_change":"2024-09-17T06:06:57.607574+0000","last_active":"2024-09-17T06:07:50.699331+0000","last_peered":"2024-09-17T06:07:50.699331+0000","last_clean":"2024-09-17T06:07:50.699331+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:07:50.699331+0000","last_undegraded":"2024-09-17T06:07:50.699331+0000","last_fullsized":"2024-09-17T06:07:50.699331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.607379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:56.898447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222448+0000","last_change":"2024-09-17T06:06:45.591584+0000","last_active":"2024-09-17T06:07:51.222448+0000","last_peered":"2024-09-17T06:07:51.222448+0000","last_clean":"2024-09-17T06:07:51.222448+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:07:51.222448+0000","last_undegraded":"2024-09-17T06:07:51.222448+0000","last_fullsized":"2024-09-17T06:07:51.222448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.591276+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:08.653925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.226091+0000","last_change":"2024-09-17T06:06:37.667757+0000","last_active":"2024-09-17T06:07:51.226091+0000","last_peered":"2024-09-17T06:07:51.226091+0000","last_clean":"2024-09-17T06:07:51.226091+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:07:51.226091+0000","last_undegraded":"2024-09-17T06:07:51.226091+0000","last_fullsized":"2024-09-17T06:07:51.226091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_clean_scrub_stamp":"2024-09-17T06:06:37.667675+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:46.885860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219774+0000","last_change":"2024-09-17T06:06:56.615164+0000","last_active":"2024-09-17T06:07:51.219774+0000","last_peered":"2024-09-17T06:07:51.219774+0000","last_clean":"2024-09-17T06:07:51.219774+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:07:51.219774+0000","last_undegraded":"2024-09-17T06:07:51.219774+0000","last_fullsized":"2024-09-17T06:07:51.219774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.614970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:07.482666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841716+0000","last_change":"2024-09-17T06:06:52.577732+0000","last_active":"2024-09-17T06:07:50.841716+0000","last_peered":"2024-09-17T06:07:50.841716+0000","last_clean":"2024-09-17T06:07:50.841716+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:07:50.841716+0000","last_undegraded":"2024-09-17T06:07:50.841716+0000","last_fullsized":"2024-09-17T06:07:50.841716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.577533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:34.161856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":173,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697698+0000","last_change":"2024-09-17T06:06:43.358428+0000","last_active":"2024-09-17T06:07:50.697698+0000","last_peered":"2024-09-17T06:07:50.697698+0000","last_clean":"2024-09-17T06:07:50.697698+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:07:50.697698+0000","last_undegraded":"2024-09-17T06:07:50.697698+0000","last_fullsized":"2024-09-17T06:07:50.697698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'27","last_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_deep_scrub":"81'27","last_deep_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.358219+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:13.703025+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220232+0000","last_change":"2024-09-17T06:06:52.944474+0000","last_active":"2024-09-17T06:07:51.220232+0000","last_peered":"2024-09-17T06:07:51.220232+0000","last_clean":"2024-09-17T06:07:51.220232+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:07:51.220232+0000","last_undegraded":"2024-09-17T06:07:51.220232+0000","last_fullsized":"2024-09-17T06:07:51.220232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.944213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.533972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699872+0000","last_change":"2024-09-17T06:06:43.557285+0000","last_active":"2024-09-17T06:07:50.699872+0000","last_peered":"2024-09-17T06:07:50.699872+0000","last_clean":"2024-09-17T06:07:50.699872+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:07:50.699872+0000","last_undegraded":"2024-09-17T06:07:50.699872+0000","last_fullsized":"2024-09-17T06:07:50.699872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.557090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:01.412234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"81'9","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220308+0000","last_change":"2024-09-17T06:06:43.599342+0000","last_active":"2024-09-17T06:07:51.220308+0000","last_peered":"2024-09-17T06:07:51.220308+0000","last_clean":"2024-09-17T06:07:51.220308+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:07:51.220308+0000","last_undegraded":"2024-09-17T06:07:51.220308+0000","last_fullsized":"2024-09-17T06:07:51.220308+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.599114+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:49.432076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699698+0000","last_change":"2024-09-17T06:06:49.561761+0000","last_active":"2024-09-17T06:07:50.699698+0000","last_peered":"2024-09-17T06:07:50.699698+0000","last_clean":"2024-09-17T06:07:50.699698+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:07:50.699698+0000","last_undegraded":"2024-09-17T06:07:50.699698+0000","last_fullsized":"2024-09-17T06:07:50.699698+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.561572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:15.208406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223520+0000","last_change":"2024-09-17T06:06:40.581076+0000","last_active":"2024-09-17T06:07:51.223520+0000","last_peered":"2024-09-17T06:07:51.223520+0000","last_clean":"2024-09-17T06:07:51.223520+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:07:51.223520+0000","last_undegraded":"2024-09-17T06:07:51.223520+0000","last_fullsized":"2024-09-17T06:07:51.223520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.580978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:19.525125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220070+0000","last_change":"2024-09-17T06:06:44.589361+0000","last_active":"2024-09-17T06:07:51.220070+0000","last_peered":"2024-09-17T06:07:51.220070+0000","last_clean":"2024-09-17T06:07:51.220070+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:07:51.220070+0000","last_undegraded":"2024-09-17T06:07:51.220070+0000","last_fullsized":"2024-09-17T06:07:51.220070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.589149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.705503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698292+0000","last_change":"2024-09-17T06:06:58.599122+0000","last_active":"2024-09-17T06:07:50.698292+0000","last_peered":"2024-09-17T06:07:50.698292+0000","last_clean":"2024-09-17T06:07:50.698292+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:07:50.698292+0000","last_undegraded":"2024-09-17T06:07:50.698292+0000","last_fullsized":"2024-09-17T06:07:50.698292+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_clean_scrub_stamp":"2024-09-17T06:06:58.598909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.505821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219917+0000","last_change":"2024-09-17T06:06:48.493667+0000","last_active":"2024-09-17T06:07:51.219917+0000","last_peered":"2024-09-17T06:07:51.219917+0000","last_clean":"2024-09-17T06:07:51.219917+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:07:51.219917+0000","last_undegraded":"2024-09-17T06:07:51.219917+0000","last_fullsized":"2024-09-17T06:07:51.219917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.493470+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.837170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":147,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697097+0000","last_change":"2024-09-17T06:06:44.333474+0000","last_active":"2024-09-17T06:07:50.697097+0000","last_peered":"2024-09-17T06:07:50.697097+0000","last_clean":"2024-09-17T06:07:50.697097+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:07:50.697097+0000","last_undegraded":"2024-09-17T06:07:50.697097+0000","last_fullsized":"2024-09-17T06:07:50.697097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.333150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.158751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698343+0000","last_change":"2024-09-17T06:06:52.699338+0000","last_active":"2024-09-17T06:07:50.698343+0000","last_peered":"2024-09-17T06:07:50.698343+0000","last_clean":"2024-09-17T06:07:50.698343+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:07:50.698343+0000","last_undegraded":"2024-09-17T06:07:50.698343+0000","last_fullsized":"2024-09-17T06:07:50.698343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.699134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:51.626769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224692+0000","last_change":"2024-09-17T06:06:49.633934+0000","last_active":"2024-09-17T06:07:51.224692+0000","last_peered":"2024-09-17T06:07:51.224692+0000","last_clean":"2024-09-17T06:07:51.224692+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:07:51.224692+0000","last_undegraded":"2024-09-17T06:07:51.224692+0000","last_fullsized":"2024-09-17T06:07:51.224692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.633660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.217982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220089+0000","last_change":"2024-09-17T06:06:46.974853+0000","last_active":"2024-09-17T06:07:51.220089+0000","last_peered":"2024-09-17T06:07:51.220089+0000","last_clean":"2024-09-17T06:07:51.220089+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:07:51.220089+0000","last_undegraded":"2024-09-17T06:07:51.220089+0000","last_fullsized":"2024-09-17T06:07:51.220089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.974637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:26.337532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218927+0000","last_change":"2024-09-17T06:06:46.527438+0000","last_active":"2024-09-17T06:07:51.218927+0000","last_peered":"2024-09-17T06:07:51.218927+0000","last_clean":"2024-09-17T06:07:51.218927+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:07:51.218927+0000","last_undegraded":"2024-09-17T06:07:51.218927+0000","last_fullsized":"2024-09-17T06:07:51.218927+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.527230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:25.890125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696597+0000","last_change":"2024-09-17T06:06:54.199209+0000","last_active":"2024-09-17T06:07:50.696597+0000","last_peered":"2024-09-17T06:07:50.696597+0000","last_clean":"2024-09-17T06:07:50.696597+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:07:50.696597+0000","last_undegraded":"2024-09-17T06:07:50.696597+0000","last_fullsized":"2024-09-17T06:07:50.696597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.198989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:51.609301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":84,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699671+0000","last_change":"2024-09-17T06:06:46.699017+0000","last_active":"2024-09-17T06:07:50.699671+0000","last_peered":"2024-09-17T06:07:50.699671+0000","last_clean":"2024-09-17T06:07:50.699671+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:07:50.699671+0000","last_undegraded":"2024-09-17T06:07:50.699671+0000","last_fullsized":"2024-09-17T06:07:50.699671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.698821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:33.586359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698678+0000","last_change":"2024-09-17T06:06:40.624617+0000","last_active":"2024-09-17T06:07:50.698678+0000","last_peered":"2024-09-17T06:07:50.698678+0000","last_clean":"2024-09-17T06:07:50.698678+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:07:50.698678+0000","last_undegraded":"2024-09-17T06:07:50.698678+0000","last_fullsized":"2024-09-17T06:07:50.698678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.624540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:48.054970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696085+0000","last_change":"2024-09-17T06:06:45.311790+0000","last_active":"2024-09-17T06:07:50.696085+0000","last_peered":"2024-09-17T06:07:50.696085+0000","last_clean":"2024-09-17T06:07:50.696085+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:07:50.696085+0000","last_undegraded":"2024-09-17T06:07:50.696085+0000","last_fullsized":"2024-09-17T06:07:50.696085+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.311572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:05.215110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225756+0000","last_change":"2024-09-17T06:06:43.594929+0000","last_active":"2024-09-17T06:07:51.225756+0000","last_peered":"2024-09-17T06:07:51.225756+0000","last_clean":"2024-09-17T06:07:51.225756+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:07:51.225756+0000","last_undegraded":"2024-09-17T06:07:51.225756+0000","last_fullsized":"2024-09-17T06:07:51.225756+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.594608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:54.666206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693105+0000","last_change":"2024-09-17T06:06:44.420446+0000","last_active":"2024-09-17T06:07:50.693105+0000","last_peered":"2024-09-17T06:07:50.693105+0000","last_clean":"2024-09-17T06:07:50.693105+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:07:50.693105+0000","last_undegraded":"2024-09-17T06:07:50.693105+0000","last_fullsized":"2024-09-17T06:07:50.693105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.420226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:35.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698825+0000","last_change":"2024-09-17T06:06:39.644661+0000","last_active":"2024-09-17T06:07:50.698825+0000","last_peered":"2024-09-17T06:07:50.698825+0000","last_clean":"2024-09-17T06:07:50.698825+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:07:50.698825+0000","last_undegraded":"2024-09-17T06:07:50.698825+0000","last_fullsized":"2024-09-17T06:07:50.698825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.644581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:43.034866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695060+0000","last_change":"2024-09-17T06:06:42.552587+0000","last_active":"2024-09-17T06:07:50.695060+0000","last_peered":"2024-09-17T06:07:50.695060+0000","last_clean":"2024-09-17T06:07:50.695060+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:07:50.695060+0000","last_undegraded":"2024-09-17T06:07:50.695060+0000","last_fullsized":"2024-09-17T06:07:50.695060+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.552253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:16.204277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":133,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699293+0000","last_change":"2024-09-17T06:06:59.590058+0000","last_active":"2024-09-17T06:07:50.699293+0000","last_peered":"2024-09-17T06:07:50.699293+0000","last_clean":"2024-09-17T06:07:50.699293+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:07:50.699293+0000","last_undegraded":"2024-09-17T06:07:50.699293+0000","last_fullsized":"2024-09-17T06:07:50.699293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_clean_scrub_stamp":"2024-09-17T06:06:59.589844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:13.777383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.694980+0000","last_change":"2024-09-17T06:06:49.212293+0000","last_active":"2024-09-17T06:07:50.694980+0000","last_peered":"2024-09-17T06:07:50.694980+0000","last_clean":"2024-09-17T06:07:50.694980+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:07:50.694980+0000","last_undegraded":"2024-09-17T06:07:50.694980+0000","last_fullsized":"2024-09-17T06:07:50.694980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.211966+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:29.791073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692855+0000","last_change":"2024-09-17T06:06:43.370824+0000","last_active":"2024-09-17T06:07:50.692855+0000","last_peered":"2024-09-17T06:07:50.692855+0000","last_clean":"2024-09-17T06:07:50.692855+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:07:50.692855+0000","last_undegraded":"2024-09-17T06:07:50.692855+0000","last_fullsized":"2024-09-17T06:07:50.692855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.370630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:28.698931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219068+0000","last_change":"2024-09-17T06:06:50.490824+0000","last_active":"2024-09-17T06:07:51.219068+0000","last_peered":"2024-09-17T06:07:51.219068+0000","last_clean":"2024-09-17T06:07:51.219068+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:07:51.219068+0000","last_undegraded":"2024-09-17T06:07:51.219068+0000","last_fullsized":"2024-09-17T06:07:51.219068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.490494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.208761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":169,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225406+0000","last_change":"2024-09-17T06:06:54.564398+0000","last_active":"2024-09-17T06:07:51.225406+0000","last_peered":"2024-09-17T06:07:51.225406+0000","last_clean":"2024-09-17T06:07:51.225406+0000","last_became_active":"2024-09-17T06:06:49.863977+0000","last_became_peered":"2024-09-17T06:06:49.863977+0000","last_unstale":"2024-09-17T06:07:51.225406+0000","last_undegraded":"2024-09-17T06:07:51.225406+0000","last_fullsized":"2024-09-17T06:07:51.225406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:54.564097+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:53.583377+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.564097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:45.765238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":119,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700171+0000","last_change":"2024-09-17T06:06:48.701826+0000","last_active":"2024-09-17T06:07:50.700171+0000","last_peered":"2024-09-17T06:07:50.700171+0000","last_clean":"2024-09-17T06:07:50.700171+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:07:50.700171+0000","last_undegraded":"2024-09-17T06:07:50.700171+0000","last_fullsized":"2024-09-17T06:07:50.700171+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.701596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:43:38.318752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220523+0000","last_change":"2024-09-17T06:06:44.071550+0000","last_active":"2024-09-17T06:07:51.220523+0000","last_peered":"2024-09-17T06:07:51.220523+0000","last_clean":"2024-09-17T06:07:51.220523+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:07:51.220523+0000","last_undegraded":"2024-09-17T06:07:51.220523+0000","last_fullsized":"2024-09-17T06:07:51.220523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.071343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:50.902738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698939+0000","last_change":"2024-09-17T06:06:48.219488+0000","last_active":"2024-09-17T06:07:50.698939+0000","last_peered":"2024-09-17T06:07:50.698939+0000","last_clean":"2024-09-17T06:07:50.698939+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:07:50.698939+0000","last_undegraded":"2024-09-17T06:07:50.698939+0000","last_fullsized":"2024-09-17T06:07:50.698939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.219293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:00.836074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700244+0000","last_change":"2024-09-17T06:06:50.710122+0000","last_active":"2024-09-17T06:07:50.700244+0000","last_peered":"2024-09-17T06:07:50.700244+0000","last_clean":"2024-09-17T06:07:50.700244+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:07:50.700244+0000","last_undegraded":"2024-09-17T06:07:50.700244+0000","last_fullsized":"2024-09-17T06:07:50.700244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.709804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:24.696128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218361+0000","last_change":"2024-09-17T06:06:51.502240+0000","last_active":"2024-09-17T06:07:51.218361+0000","last_peered":"2024-09-17T06:07:51.218361+0000","last_clean":"2024-09-17T06:07:51.218361+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:07:51.218361+0000","last_undegraded":"2024-09-17T06:07:51.218361+0000","last_fullsized":"2024-09-17T06:07:51.218361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.502041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.125829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":123,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698250+0000","last_change":"2024-09-17T06:06:49.687515+0000","last_active":"2024-09-17T06:07:50.698250+0000","last_peered":"2024-09-17T06:07:50.698250+0000","last_clean":"2024-09-17T06:07:50.698250+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:07:50.698250+0000","last_undegraded":"2024-09-17T06:07:50.698250+0000","last_fullsized":"2024-09-17T06:07:50.698250+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.687322+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:09.182168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692664+0000","last_change":"2024-09-17T06:06:49.761230+0000","last_active":"2024-09-17T06:07:50.692664+0000","last_peered":"2024-09-17T06:07:50.692664+0000","last_clean":"2024-09-17T06:07:50.692664+0000","last_became_active":"2024-09-17T06:06:49.760405+0000","last_became_peered":"2024-09-17T06:06:49.760405+0000","last_unstale":"2024-09-17T06:07:50.692664+0000","last_undegraded":"2024-09-17T06:07:50.692664+0000","last_fullsized":"2024-09-17T06:07:50.692664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:18.198271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224902+0000","last_change":"2024-09-17T06:06:51.561891+0000","last_active":"2024-09-17T06:07:51.224902+0000","last_peered":"2024-09-17T06:07:51.224902+0000","last_clean":"2024-09-17T06:07:51.224902+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:07:51.224902+0000","last_undegraded":"2024-09-17T06:07:51.224902+0000","last_fullsized":"2024-09-17T06:07:51.224902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.561576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:27.536230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697580+0000","last_change":"2024-09-17T06:06:51.171689+0000","last_active":"2024-09-17T06:07:50.697580+0000","last_peered":"2024-09-17T06:07:50.697580+0000","last_clean":"2024-09-17T06:07:50.697580+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:07:50.697580+0000","last_undegraded":"2024-09-17T06:07:50.697580+0000","last_fullsized":"2024-09-17T06:07:50.697580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.171493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:39.452849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842010+0000","last_change":"2024-09-17T06:06:55.610932+0000","last_active":"2024-09-17T06:07:50.842010+0000","last_peered":"2024-09-17T06:07:50.842010+0000","last_clean":"2024-09-17T06:07:50.842010+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:07:50.842010+0000","last_undegraded":"2024-09-17T06:07:50.842010+0000","last_fullsized":"2024-09-17T06:07:50.842010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.610700+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:07.867694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693815+0000","last_change":"2024-09-17T06:06:42.353051+0000","last_active":"2024-09-17T06:07:50.693815+0000","last_peered":"2024-09-17T06:07:50.693815+0000","last_clean":"2024-09-17T06:07:50.693815+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:07:50.693815+0000","last_undegraded":"2024-09-17T06:07:50.693815+0000","last_fullsized":"2024-09-17T06:07:50.693815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.352711+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:14.862093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220510+0000","last_change":"2024-09-17T06:06:52.529037+0000","last_active":"2024-09-17T06:07:51.220510+0000","last_peered":"2024-09-17T06:07:51.220510+0000","last_clean":"2024-09-17T06:07:51.220510+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:07:51.220510+0000","last_undegraded":"2024-09-17T06:07:51.220510+0000","last_fullsized":"2024-09-17T06:07:51.220510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.528843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.118602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218857+0000","last_change":"2024-09-17T06:06:53.547108+0000","last_active":"2024-09-17T06:07:51.218857+0000","last_peered":"2024-09-17T06:07:51.218857+0000","last_clean":"2024-09-17T06:07:51.218857+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:07:51.218857+0000","last_undegraded":"2024-09-17T06:07:51.218857+0000","last_fullsized":"2024-09-17T06:07:51.218857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.546853+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:05.208153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220476+0000","last_change":"2024-09-17T06:06:48.919436+0000","last_active":"2024-09-17T06:07:51.220476+0000","last_peered":"2024-09-17T06:07:51.220476+0000","last_clean":"2024-09-17T06:07:51.220476+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:07:51.220476+0000","last_undegraded":"2024-09-17T06:07:51.220476+0000","last_fullsized":"2024-09-17T06:07:51.220476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.919235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:27.262935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222436+0000","last_change":"2024-09-17T06:06:44.636882+0000","last_active":"2024-09-17T06:07:51.222436+0000","last_peered":"2024-09-17T06:07:51.222436+0000","last_clean":"2024-09-17T06:07:51.222436+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:07:51.222436+0000","last_undegraded":"2024-09-17T06:07:51.222436+0000","last_fullsized":"2024-09-17T06:07:51.222436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.636626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:44.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698346+0000","last_change":"2024-09-17T06:06:51.717905+0000","last_active":"2024-09-17T06:07:50.698346+0000","last_peered":"2024-09-17T06:07:50.698346+0000","last_clean":"2024-09-17T06:07:50.698346+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:07:50.698346+0000","last_undegraded":"2024-09-17T06:07:50.698346+0000","last_fullsized":"2024-09-17T06:07:50.698346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.717694+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:59.444208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700277+0000","last_change":"2024-09-17T06:06:45.539679+0000","last_active":"2024-09-17T06:07:50.700277+0000","last_peered":"2024-09-17T06:07:50.700277+0000","last_clean":"2024-09-17T06:07:50.700277+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:07:50.700277+0000","last_undegraded":"2024-09-17T06:07:50.700277+0000","last_fullsized":"2024-09-17T06:07:50.700277+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.539468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:55.832105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698493+0000","last_change":"2024-09-17T06:06:52.213250+0000","last_active":"2024-09-17T06:07:50.698493+0000","last_peered":"2024-09-17T06:07:50.698493+0000","last_clean":"2024-09-17T06:07:50.698493+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:07:50.698493+0000","last_undegraded":"2024-09-17T06:07:50.698493+0000","last_fullsized":"2024-09-17T06:07:50.698493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.213042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:36.033960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698927+0000","last_change":"2024-09-17T06:06:53.226240+0000","last_active":"2024-09-17T06:07:50.698927+0000","last_peered":"2024-09-17T06:07:50.698927+0000","last_clean":"2024-09-17T06:07:50.698927+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:07:50.698927+0000","last_undegraded":"2024-09-17T06:07:50.698927+0000","last_fullsized":"2024-09-17T06:07:50.698927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'16","last_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_deep_scrub":"81'16","last_deep_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.226044+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:15.604828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842503+0000","last_change":"2024-09-17T06:06:50.593476+0000","last_active":"2024-09-17T06:07:50.842503+0000","last_peered":"2024-09-17T06:07:50.842503+0000","last_clean":"2024-09-17T06:07:50.842503+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:07:50.842503+0000","last_undegraded":"2024-09-17T06:07:50.842503+0000","last_fullsized":"2024-09-17T06:07:50.842503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.593281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.041524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697951+0000","last_change":"2024-09-17T06:06:53.662277+0000","last_active":"2024-09-17T06:07:50.697951+0000","last_peered":"2024-09-17T06:07:50.697951+0000","last_clean":"2024-09-17T06:07:50.697951+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:07:50.697951+0000","last_undegraded":"2024-09-17T06:07:50.697951+0000","last_fullsized":"2024-09-17T06:07:50.697951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.662083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:09.458813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840621+0000","last_change":"2024-09-17T06:06:54.601401+0000","last_active":"2024-09-17T06:07:50.840621+0000","last_peered":"2024-09-17T06:07:50.840621+0000","last_clean":"2024-09-17T06:07:50.840621+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:07:50.840621+0000","last_undegraded":"2024-09-17T06:07:50.840621+0000","last_fullsized":"2024-09-17T06:07:50.840621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.601206+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:30.575859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218778+0000","last_change":"2024-09-17T06:06:54.592256+0000","last_active":"2024-09-17T06:07:51.218778+0000","last_peered":"2024-09-17T06:07:51.218778+0000","last_clean":"2024-09-17T06:07:51.218778+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:07:51.218778+0000","last_undegraded":"2024-09-17T06:07:51.218778+0000","last_fullsized":"2024-09-17T06:07:51.218778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.591916+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:43.180179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840639+0000","last_change":"2024-09-17T06:06:57.597911+0000","last_active":"2024-09-17T06:07:50.840639+0000","last_peered":"2024-09-17T06:07:50.840639+0000","last_clean":"2024-09-17T06:07:50.840639+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:07:50.840639+0000","last_undegraded":"2024-09-17T06:07:50.840639+0000","last_fullsized":"2024-09-17T06:07:50.840639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.597715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:05.028145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219802+0000","last_change":"2024-09-17T06:06:55.569378+0000","last_active":"2024-09-17T06:07:51.219802+0000","last_peered":"2024-09-17T06:07:51.219802+0000","last_clean":"2024-09-17T06:07:51.219802+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:07:51.219802+0000","last_undegraded":"2024-09-17T06:07:51.219802+0000","last_fullsized":"2024-09-17T06:07:51.219802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.569171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:50.988830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222167+0000","last_change":"2024-09-17T06:06:46.576687+0000","last_active":"2024-09-17T06:07:51.222167+0000","last_peered":"2024-09-17T06:07:51.222167+0000","last_clean":"2024-09-17T06:07:51.222167+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:07:51.222167+0000","last_undegraded":"2024-09-17T06:07:51.222167+0000","last_fullsized":"2024-09-17T06:07:51.222167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:36.143901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222017+0000","last_change":"2024-09-17T06:06:46.022759+0000","last_active":"2024-09-17T06:07:51.222017+0000","last_peered":"2024-09-17T06:07:51.222017+0000","last_clean":"2024-09-17T06:07:51.222017+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:07:51.222017+0000","last_undegraded":"2024-09-17T06:07:51.222017+0000","last_fullsized":"2024-09-17T06:07:51.222017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.022447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.814300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842307+0000","last_change":"2024-09-17T06:06:56.620251+0000","last_active":"2024-09-17T06:07:50.842307+0000","last_peered":"2024-09-17T06:07:50.842307+0000","last_clean":"2024-09-17T06:07:50.842307+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:07:50.842307+0000","last_undegraded":"2024-09-17T06:07:50.842307+0000","last_fullsized":"2024-09-17T06:07:50.842307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.619933+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:00.010218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509497,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1044480,"data_stored":558879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509498,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":522541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1605632,"data_stored":1113225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1593344,"data_stored":1113079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":558467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906974,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":1007616,"data_stored":522255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":999424,"data_stored":522199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":999424,"data_stored":522219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:08:23.331 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:08:23.332 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T06:08:36.091 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:08:36.094 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:08:43.332 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:08:43.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.493+0000 7f8396a6a640 1 -- 172.21.15.122:0/3989788436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83900727b0 msgr2=0x7f839015aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.493+0000 7f8396a6a640 1 --2- 172.21.15.122:0/3989788436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83900727b0 0x7f839015aa30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8388009bc0 tx=0x7f838801f3b0 comp rx=0 tx=0).stop 2024-09-17T06:08:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.493+0000 7f8396a6a640 1 -- 172.21.15.122:0/3989788436 shutdown_connections 2024-09-17T06:08:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.493+0000 7f8396a6a640 1 --2- 172.21.15.122:0/3989788436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83900727b0 0x7f839015aa30 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.493+0000 7f8396a6a640 1 --2- 172.21.15.122:0/3989788436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8390159b30 0x7f8390072270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.493+0000 7f8396a6a640 1 -- 172.21.15.122:0/3989788436 >> 172.21.15.122:0/3989788436 conn(0x7f83900746d0 msgr2=0x7f8390074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:08:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.493+0000 7f8396a6a640 1 -- 172.21.15.122:0/3989788436 shutdown_connections 2024-09-17T06:08:43.499 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.493+0000 7f8396a6a640 1 -- 172.21.15.122:0/3989788436 wait complete. 2024-09-17T06:08:43.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8396a6a640 1 Processor -- start 2024-09-17T06:08:43.500 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8396a6a640 1 -- start start 2024-09-17T06:08:43.502 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8396a6a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83900727b0 0x7f83901efde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:08:43.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8396a6a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83900c6780 0x7f83901484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:08:43.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8396a6a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8390159b30 0x7f8390154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:08:43.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8396a6a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f839015d470 con 0x7f83900727b0 2024-09-17T06:08:43.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8396a6a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f839015d190 con 0x7f83900c6780 2024-09-17T06:08:43.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8396a6a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8390159f40 con 0x7f8390159b30 2024-09-17T06:08:43.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8394806640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83900727b0 0x7f83901efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:08:43.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8394806640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83900727b0 0x7f83901efde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51842/0 (socket says 172.21.15.122:51842) 2024-09-17T06:08:43.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8394806640 1 -- 172.21.15.122:0/3450005158 learned_addr learned my addr 172.21.15.122:0/3450005158 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:08:43.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8395007640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8390159b30 0x7f8390154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:08:43.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f838ffff640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83900c6780 0x7f83901484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:08:43.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8394806640 1 -- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8390159b30 msgr2=0x7f8390154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:43.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8394806640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8390159b30 0x7f8390154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:43.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8394806640 1 -- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83900c6780 msgr2=0x7f83901484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:43.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8394806640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83900c6780 0x7f83901484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:43.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8394806640 1 -- 172.21.15.122:0/3450005158 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8390156a70 con 0x7f83900727b0 2024-09-17T06:08:43.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f838ffff640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83900c6780 0x7f83901484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:08:43.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8394806640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83900727b0 0x7f83901efde0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f838400c460 tx=0x7f838400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:08:43.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f838d7fa640 1 -- 172.21.15.122:0/3450005158 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8384016020 con 0x7f83900727b0 2024-09-17T06:08:43.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f838d7fa640 1 -- 172.21.15.122:0/3450005158 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8384012920 con 0x7f83900727b0 2024-09-17T06:08:43.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8396a6a640 1 -- 172.21.15.122:0/3450005158 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83900ccf50 con 0x7f83900727b0 2024-09-17T06:08:43.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f838d7fa640 1 -- 172.21.15.122:0/3450005158 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8384012d70 con 0x7f83900727b0 2024-09-17T06:08:43.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.497+0000 7f8396a6a640 1 -- 172.21.15.122:0/3450005158 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83900ca4b0 con 0x7f83900727b0 2024-09-17T06:08:43.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.501+0000 7f8396a6a640 1 -- 172.21.15.122:0/3450005158 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8390072270 con 0x7f83900727b0 2024-09-17T06:08:43.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.501+0000 7f838d7fa640 1 -- 172.21.15.122:0/3450005158 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8384019020 con 0x7f83900727b0 2024-09-17T06:08:43.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.501+0000 7f838d7fa640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8374073230 0x7f8374075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:08:43.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.501+0000 7f838d7fa640 1 -- 172.21.15.122:0/3450005158 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6854+0+0 (secure 0 0 0) 0x7f83840945c0 con 0x7f83900727b0 2024-09-17T06:08:43.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.501+0000 7f838ffff640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8374073230 0x7f8374075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:08:43.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.501+0000 7f838ffff640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8374073230 0x7f8374075740 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8390147d50 tx=0x7f837c005cc0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:08:43.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.505+0000 7f838d7fa640 1 -- 172.21.15.122:0/3450005158 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8384020020 con 0x7f83900727b0 2024-09-17T06:08:43.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.665+0000 7f8396a6a640 1 -- 172.21.15.122:0/3450005158 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83900c3650 con 0x7f8374073230 2024-09-17T06:08:43.687 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.685+0000 7f838d7fa640 1 -- 172.21.15.122:0/3450005158 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332987 (secure 0 0 0) 0x7f83900c3650 con 0x7f8374073230 2024-09-17T06:08:43.691 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:08:43.693 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:08:43.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.689+0000 7f8396a6a640 1 -- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8374073230 msgr2=0x7f8374075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:43.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.689+0000 7f8396a6a640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8374073230 0x7f8374075740 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8390147d50 tx=0x7f837c005cc0 comp rx=0 tx=0).stop 2024-09-17T06:08:43.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.689+0000 7f8396a6a640 1 -- 172.21.15.122:0/3450005158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83900727b0 msgr2=0x7f83901efde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:08:43.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.689+0000 7f8396a6a640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83900727b0 0x7f83901efde0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f838400c460 tx=0x7f838400c920 comp rx=0 tx=0).stop 2024-09-17T06:08:43.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.689+0000 7f8396a6a640 1 -- 172.21.15.122:0/3450005158 shutdown_connections 2024-09-17T06:08:43.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.689+0000 7f8396a6a640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8390159b30 0x7f8390154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:43.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.689+0000 7f8396a6a640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f8374073230 0x7f8374075740 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:43.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.689+0000 7f8396a6a640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83900c6780 0x7f83901484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:43.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.689+0000 7f8396a6a640 1 --2- 172.21.15.122:0/3450005158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83900727b0 0x7f83901efde0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:08:43.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.689+0000 7f8396a6a640 1 -- 172.21.15.122:0/3450005158 >> 172.21.15.122:0/3450005158 conn(0x7f83900746d0 msgr2=0x7f83901491c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:08:43.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.689+0000 7f8396a6a640 1 -- 172.21.15.122:0/3450005158 shutdown_connections 2024-09-17T06:08:43.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:08:43.689+0000 7f8396a6a640 1 -- 172.21.15.122:0/3450005158 wait complete. 2024-09-17T06:08:43.712 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-17T06:08:43.634645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247140,"kb_used_data":9072,"kb_used_omap":17,"kb_used_meta":237870,"kb_avail":754727580,"statfs":{"total":773094113280,"available":772841041920,"internally_reserved":0,"allocated":9289728,"data_stored":5432864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":243579629},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005530"},"pg_stats":[{"pgid":"2.1f","version":"81'6","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224051+0000","last_change":"2024-09-17T06:06:38.646633+0000","last_active":"2024-09-17T06:07:51.224051+0000","last_peered":"2024-09-17T06:07:51.224051+0000","last_clean":"2024-09-17T06:07:51.224051+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:07:51.224051+0000","last_undegraded":"2024-09-17T06:07:51.224051+0000","last_fullsized":"2024-09-17T06:07:51.224051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.646522+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:55.373873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699959+0000","last_change":"2024-09-17T06:06:47.678984+0000","last_active":"2024-09-17T06:07:50.699959+0000","last_peered":"2024-09-17T06:07:50.699959+0000","last_clean":"2024-09-17T06:07:50.699959+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:07:50.699959+0000","last_undegraded":"2024-09-17T06:07:50.699959+0000","last_fullsized":"2024-09-17T06:07:50.699959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.678793+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:31.584591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698029+0000","last_change":"2024-09-17T06:06:55.606541+0000","last_active":"2024-09-17T06:07:50.698029+0000","last_peered":"2024-09-17T06:07:50.698029+0000","last_clean":"2024-09-17T06:07:50.698029+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:07:50.698029+0000","last_undegraded":"2024-09-17T06:07:50.698029+0000","last_fullsized":"2024-09-17T06:07:50.698029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.606346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:05.514205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700296+0000","last_change":"2024-09-17T06:06:41.626922+0000","last_active":"2024-09-17T06:07:50.700296+0000","last_peered":"2024-09-17T06:07:50.700296+0000","last_clean":"2024-09-17T06:07:50.700296+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:07:50.700296+0000","last_undegraded":"2024-09-17T06:07:50.700296+0000","last_fullsized":"2024-09-17T06:07:50.700296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.626723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:41.581056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223163+0000","last_change":"2024-09-17T06:06:42.561017+0000","last_active":"2024-09-17T06:07:51.223163+0000","last_peered":"2024-09-17T06:07:51.223163+0000","last_clean":"2024-09-17T06:07:51.223163+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:07:51.223163+0000","last_undegraded":"2024-09-17T06:07:51.223163+0000","last_fullsized":"2024-09-17T06:07:51.223163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.560815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:06.386417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695113+0000","last_change":"2024-09-17T06:06:50.581741+0000","last_active":"2024-09-17T06:07:50.695113+0000","last_peered":"2024-09-17T06:07:50.695113+0000","last_clean":"2024-09-17T06:07:50.695113+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:07:50.695113+0000","last_undegraded":"2024-09-17T06:07:50.695113+0000","last_fullsized":"2024-09-17T06:07:50.695113+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.581526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:27.538796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841990+0000","last_change":"2024-09-17T06:06:44.503792+0000","last_active":"2024-09-17T06:07:50.841990+0000","last_peered":"2024-09-17T06:07:50.841990+0000","last_clean":"2024-09-17T06:07:50.841990+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:07:50.841990+0000","last_undegraded":"2024-09-17T06:07:50.841990+0000","last_fullsized":"2024-09-17T06:07:50.841990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.503569+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.329171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219618+0000","last_change":"2024-09-17T06:06:49.490282+0000","last_active":"2024-09-17T06:07:51.219618+0000","last_peered":"2024-09-17T06:07:51.219618+0000","last_clean":"2024-09-17T06:07:51.219618+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:07:51.219618+0000","last_undegraded":"2024-09-17T06:07:51.219618+0000","last_fullsized":"2024-09-17T06:07:51.219618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.490084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:52.911935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700279+0000","last_change":"2024-09-17T06:06:51.542004+0000","last_active":"2024-09-17T06:07:50.700279+0000","last_peered":"2024-09-17T06:07:50.700279+0000","last_clean":"2024-09-17T06:07:50.700279+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:07:50.700279+0000","last_undegraded":"2024-09-17T06:07:50.700279+0000","last_fullsized":"2024-09-17T06:07:50.700279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.541795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.542454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841533+0000","last_change":"2024-09-17T06:06:45.535472+0000","last_active":"2024-09-17T06:07:50.841533+0000","last_peered":"2024-09-17T06:07:50.841533+0000","last_clean":"2024-09-17T06:07:50.841533+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:07:50.841533+0000","last_undegraded":"2024-09-17T06:07:50.841533+0000","last_fullsized":"2024-09-17T06:07:50.841533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.535262+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:56.606861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692929+0000","last_change":"2024-09-17T06:06:45.459635+0000","last_active":"2024-09-17T06:07:50.692929+0000","last_peered":"2024-09-17T06:07:50.692929+0000","last_clean":"2024-09-17T06:07:50.692929+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:07:50.692929+0000","last_undegraded":"2024-09-17T06:07:50.692929+0000","last_fullsized":"2024-09-17T06:07:50.692929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.459406+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:41.152666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699444+0000","last_change":"2024-09-17T06:06:52.519889+0000","last_active":"2024-09-17T06:07:50.699444+0000","last_peered":"2024-09-17T06:07:50.699444+0000","last_clean":"2024-09-17T06:07:50.699444+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:07:50.699444+0000","last_undegraded":"2024-09-17T06:07:50.699444+0000","last_fullsized":"2024-09-17T06:07:50.699444+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.519692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:06.562811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695680+0000","last_change":"2024-09-17T06:06:46.282925+0000","last_active":"2024-09-17T06:07:50.695680+0000","last_peered":"2024-09-17T06:07:50.695680+0000","last_clean":"2024-09-17T06:07:50.695680+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:07:50.695680+0000","last_undegraded":"2024-09-17T06:07:50.695680+0000","last_fullsized":"2024-09-17T06:07:50.695680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.282607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:45.646843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841728+0000","last_change":"2024-09-17T06:06:47.578055+0000","last_active":"2024-09-17T06:07:50.841728+0000","last_peered":"2024-09-17T06:07:50.841728+0000","last_clean":"2024-09-17T06:07:50.841728+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:07:50.841728+0000","last_undegraded":"2024-09-17T06:07:50.841728+0000","last_fullsized":"2024-09-17T06:07:50.841728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.577825+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:54.466675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699912+0000","last_change":"2024-09-17T06:06:48.564278+0000","last_active":"2024-09-17T06:07:50.699912+0000","last_peered":"2024-09-17T06:07:50.699912+0000","last_clean":"2024-09-17T06:07:50.699912+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:07:50.699912+0000","last_undegraded":"2024-09-17T06:07:50.699912+0000","last_fullsized":"2024-09-17T06:07:50.699912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.564076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:09.526182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698658+0000","last_change":"2024-09-17T06:06:45.719909+0000","last_active":"2024-09-17T06:07:50.698658+0000","last_peered":"2024-09-17T06:07:50.698658+0000","last_clean":"2024-09-17T06:07:50.698658+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:07:50.698658+0000","last_undegraded":"2024-09-17T06:07:50.698658+0000","last_fullsized":"2024-09-17T06:07:50.698658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.719724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:58.812630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221112+0000","last_change":"2024-09-17T06:06:39.054952+0000","last_active":"2024-09-17T06:07:51.221112+0000","last_peered":"2024-09-17T06:07:51.221112+0000","last_clean":"2024-09-17T06:07:51.221112+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:07:51.221112+0000","last_undegraded":"2024-09-17T06:07:51.221112+0000","last_fullsized":"2024-09-17T06:07:51.221112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.054879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:22.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700935+0000","last_change":"2024-09-17T06:06:47.595782+0000","last_active":"2024-09-17T06:07:50.700935+0000","last_peered":"2024-09-17T06:07:50.700935+0000","last_clean":"2024-09-17T06:07:50.700935+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:07:50.700935+0000","last_undegraded":"2024-09-17T06:07:50.700935+0000","last_fullsized":"2024-09-17T06:07:50.700935+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.595562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.305297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700008+0000","last_change":"2024-09-17T06:06:44.685583+0000","last_active":"2024-09-17T06:07:50.700008+0000","last_peered":"2024-09-17T06:07:50.700008+0000","last_clean":"2024-09-17T06:07:50.700008+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:07:50.700008+0000","last_undegraded":"2024-09-17T06:07:50.700008+0000","last_fullsized":"2024-09-17T06:07:50.700008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.685386+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:42.733827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221010+0000","last_change":"2024-09-17T06:06:41.096528+0000","last_active":"2024-09-17T06:07:51.221010+0000","last_peered":"2024-09-17T06:07:51.221010+0000","last_clean":"2024-09-17T06:07:51.221010+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:07:51.221010+0000","last_undegraded":"2024-09-17T06:07:51.221010+0000","last_fullsized":"2024-09-17T06:07:51.221010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.096443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.182798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223139+0000","last_change":"2024-09-17T06:06:51.955862+0000","last_active":"2024-09-17T06:07:51.223139+0000","last_peered":"2024-09-17T06:07:51.223139+0000","last_clean":"2024-09-17T06:07:51.223139+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:07:51.223139+0000","last_undegraded":"2024-09-17T06:07:51.223139+0000","last_fullsized":"2024-09-17T06:07:51.223139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.955662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.579450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":73,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695797+0000","last_change":"2024-09-17T06:06:41.561023+0000","last_active":"2024-09-17T06:07:50.695797+0000","last_peered":"2024-09-17T06:07:50.695797+0000","last_clean":"2024-09-17T06:07:50.695797+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:07:50.695797+0000","last_undegraded":"2024-09-17T06:07:50.695797+0000","last_fullsized":"2024-09-17T06:07:50.695797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.560833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:35.979151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840821+0000","last_change":"2024-09-17T06:06:51.569920+0000","last_active":"2024-09-17T06:07:50.840821+0000","last_peered":"2024-09-17T06:07:50.840821+0000","last_clean":"2024-09-17T06:07:50.840821+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:07:50.840821+0000","last_undegraded":"2024-09-17T06:07:50.840821+0000","last_fullsized":"2024-09-17T06:07:50.840821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.569724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:16.044884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699903+0000","last_change":"2024-09-17T06:06:54.534994+0000","last_active":"2024-09-17T06:07:50.699903+0000","last_peered":"2024-09-17T06:07:50.699903+0000","last_clean":"2024-09-17T06:07:50.699903+0000","last_became_active":"2024-09-17T06:06:49.862233+0000","last_became_peered":"2024-09-17T06:06:49.862233+0000","last_unstale":"2024-09-17T06:07:50.699903+0000","last_undegraded":"2024-09-17T06:07:50.699903+0000","last_fullsized":"2024-09-17T06:07:50.699903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.534811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:53.555338+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.534811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:09.975013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,1],"acting":[4,2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225630+0000","last_change":"2024-09-17T06:06:39.595362+0000","last_active":"2024-09-17T06:07:51.225630+0000","last_peered":"2024-09-17T06:07:51.225630+0000","last_clean":"2024-09-17T06:07:51.225630+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:07:51.225630+0000","last_undegraded":"2024-09-17T06:07:51.225630+0000","last_fullsized":"2024-09-17T06:07:51.225630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.595150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:36.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697737+0000","last_change":"2024-09-17T06:06:41.345210+0000","last_active":"2024-09-17T06:07:50.697737+0000","last_peered":"2024-09-17T06:07:50.697737+0000","last_clean":"2024-09-17T06:07:50.697737+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:07:50.697737+0000","last_undegraded":"2024-09-17T06:07:50.697737+0000","last_fullsized":"2024-09-17T06:07:50.697737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.345015+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:38.207077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696384+0000","last_change":"2024-09-17T06:06:44.540629+0000","last_active":"2024-09-17T06:07:50.696384+0000","last_peered":"2024-09-17T06:07:50.696384+0000","last_clean":"2024-09-17T06:07:50.696384+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:07:50.696384+0000","last_undegraded":"2024-09-17T06:07:50.696384+0000","last_fullsized":"2024-09-17T06:07:50.696384+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.540426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:03.473101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700607+0000","last_change":"2024-09-17T06:06:43.669448+0000","last_active":"2024-09-17T06:07:50.700607+0000","last_peered":"2024-09-17T06:07:50.700607+0000","last_clean":"2024-09-17T06:07:50.700607+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:07:50.700607+0000","last_undegraded":"2024-09-17T06:07:50.700607+0000","last_fullsized":"2024-09-17T06:07:50.700607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.669209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:54.877316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222424+0000","last_change":"2024-09-17T06:06:38.067895+0000","last_active":"2024-09-17T06:07:51.222424+0000","last_peered":"2024-09-17T06:07:51.222424+0000","last_clean":"2024-09-17T06:07:51.222424+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:07:51.222424+0000","last_undegraded":"2024-09-17T06:07:51.222424+0000","last_fullsized":"2024-09-17T06:07:51.222424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.067715+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:26.508119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.230386+0000","last_change":"2024-09-17T06:07:51.228200+0000","last_active":"2024-09-17T06:07:51.230386+0000","last_peered":"2024-09-17T06:07:51.230386+0000","last_clean":"2024-09-17T06:07:51.230386+0000","last_became_active":"2024-09-17T06:07:51.226510+0000","last_became_peered":"2024-09-17T06:07:51.226510+0000","last_unstale":"2024-09-17T06:07:51.230386+0000","last_undegraded":"2024-09-17T06:07:51.230386+0000","last_fullsized":"2024-09-17T06:07:51.230386+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.651441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:14.647137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221616+0000","last_change":"2024-09-17T06:06:45.060936+0000","last_active":"2024-09-17T06:07:51.221616+0000","last_peered":"2024-09-17T06:07:51.221616+0000","last_clean":"2024-09-17T06:07:51.221616+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:07:51.221616+0000","last_undegraded":"2024-09-17T06:07:51.221616+0000","last_fullsized":"2024-09-17T06:07:51.221616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.060719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:03.842916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842537+0000","last_change":"2024-09-17T06:06:43.537259+0000","last_active":"2024-09-17T06:07:50.842537+0000","last_peered":"2024-09-17T06:07:50.842537+0000","last_clean":"2024-09-17T06:07:50.842537+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:07:50.842537+0000","last_undegraded":"2024-09-17T06:07:50.842537+0000","last_fullsized":"2024-09-17T06:07:50.842537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.537064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:53.557183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224692+0000","last_change":"2024-09-17T06:06:50.588334+0000","last_active":"2024-09-17T06:07:51.224692+0000","last_peered":"2024-09-17T06:07:51.224692+0000","last_clean":"2024-09-17T06:07:51.224692+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:07:51.224692+0000","last_undegraded":"2024-09-17T06:07:51.224692+0000","last_fullsized":"2024-09-17T06:07:51.224692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.588146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:34.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220191+0000","last_change":"2024-09-17T06:06:45.560755+0000","last_active":"2024-09-17T06:07:51.220191+0000","last_peered":"2024-09-17T06:07:51.220191+0000","last_clean":"2024-09-17T06:07:51.220191+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:07:51.220191+0000","last_undegraded":"2024-09-17T06:07:51.220191+0000","last_fullsized":"2024-09-17T06:07:51.220191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.560562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.352415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221768+0000","last_change":"2024-09-17T06:06:40.077709+0000","last_active":"2024-09-17T06:07:51.221768+0000","last_peered":"2024-09-17T06:07:51.221768+0000","last_clean":"2024-09-17T06:07:51.221768+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:07:51.221768+0000","last_undegraded":"2024-09-17T06:07:51.221768+0000","last_fullsized":"2024-09-17T06:07:51.221768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.077616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:13.235085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220023+0000","last_change":"2024-09-17T06:06:50.943563+0000","last_active":"2024-09-17T06:07:51.220023+0000","last_peered":"2024-09-17T06:07:51.220023+0000","last_clean":"2024-09-17T06:07:51.220023+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:07:51.220023+0000","last_undegraded":"2024-09-17T06:07:51.220023+0000","last_fullsized":"2024-09-17T06:07:51.220023+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.943366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.661632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700452+0000","last_change":"2024-09-17T06:06:39.544246+0000","last_active":"2024-09-17T06:07:50.700452+0000","last_peered":"2024-09-17T06:07:50.700452+0000","last_clean":"2024-09-17T06:07:50.700452+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:07:50.700452+0000","last_undegraded":"2024-09-17T06:07:50.700452+0000","last_fullsized":"2024-09-17T06:07:50.700452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.544002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:04.906600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219385+0000","last_change":"2024-09-17T06:06:41.601594+0000","last_active":"2024-09-17T06:07:51.219385+0000","last_peered":"2024-09-17T06:07:51.219385+0000","last_clean":"2024-09-17T06:07:51.219385+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:07:51.219385+0000","last_undegraded":"2024-09-17T06:07:51.219385+0000","last_fullsized":"2024-09-17T06:07:51.219385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.601393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.687748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221448+0000","last_change":"2024-09-17T06:06:49.922504+0000","last_active":"2024-09-17T06:07:51.221448+0000","last_peered":"2024-09-17T06:07:51.221448+0000","last_clean":"2024-09-17T06:07:51.221448+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:07:51.221448+0000","last_undegraded":"2024-09-17T06:07:51.221448+0000","last_fullsized":"2024-09-17T06:07:51.221448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.922302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:53.344154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222935+0000","last_change":"2024-09-17T06:06:42.067931+0000","last_active":"2024-09-17T06:07:51.222935+0000","last_peered":"2024-09-17T06:07:51.222935+0000","last_clean":"2024-09-17T06:07:51.222935+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:07:51.222935+0000","last_undegraded":"2024-09-17T06:07:51.222935+0000","last_fullsized":"2024-09-17T06:07:51.222935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.067737+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.818001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693159+0000","last_change":"2024-09-17T06:06:38.338953+0000","last_active":"2024-09-17T06:07:50.693159+0000","last_peered":"2024-09-17T06:07:50.693159+0000","last_clean":"2024-09-17T06:07:50.693159+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:07:50.693159+0000","last_undegraded":"2024-09-17T06:07:50.693159+0000","last_fullsized":"2024-09-17T06:07:50.693159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.338737+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:58.670904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223389+0000","last_change":"2024-09-17T06:06:47.938470+0000","last_active":"2024-09-17T06:07:51.223389+0000","last_peered":"2024-09-17T06:07:51.223389+0000","last_clean":"2024-09-17T06:07:51.223389+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:07:51.223389+0000","last_undegraded":"2024-09-17T06:07:51.223389+0000","last_fullsized":"2024-09-17T06:07:51.223389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.938263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.607027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221642+0000","last_change":"2024-09-17T06:06:41.585374+0000","last_active":"2024-09-17T06:07:51.221642+0000","last_peered":"2024-09-17T06:07:51.221642+0000","last_clean":"2024-09-17T06:07:51.221642+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:07:51.221642+0000","last_undegraded":"2024-09-17T06:07:51.221642+0000","last_fullsized":"2024-09-17T06:07:51.221642+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.585183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:11.929990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841022+0000","last_change":"2024-09-17T06:06:42.536575+0000","last_active":"2024-09-17T06:07:50.841022+0000","last_peered":"2024-09-17T06:07:50.841022+0000","last_clean":"2024-09-17T06:07:50.841022+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:07:50.841022+0000","last_undegraded":"2024-09-17T06:07:50.841022+0000","last_fullsized":"2024-09-17T06:07:50.841022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.536371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:23.547872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225264+0000","last_change":"2024-09-17T06:06:47.627398+0000","last_active":"2024-09-17T06:07:51.225264+0000","last_peered":"2024-09-17T06:07:51.225264+0000","last_clean":"2024-09-17T06:07:51.225264+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:07:51.225264+0000","last_undegraded":"2024-09-17T06:07:51.225264+0000","last_fullsized":"2024-09-17T06:07:51.225264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.627188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:28.206295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699239+0000","last_change":"2024-09-17T06:06:42.642781+0000","last_active":"2024-09-17T06:07:50.699239+0000","last_peered":"2024-09-17T06:07:50.699239+0000","last_clean":"2024-09-17T06:07:50.699239+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:07:50.699239+0000","last_undegraded":"2024-09-17T06:07:50.699239+0000","last_fullsized":"2024-09-17T06:07:50.699239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.642468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:03.874053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219489+0000","last_change":"2024-09-17T06:06:40.563124+0000","last_active":"2024-09-17T06:07:51.219489+0000","last_peered":"2024-09-17T06:07:51.219489+0000","last_clean":"2024-09-17T06:07:51.219489+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:07:51.219489+0000","last_undegraded":"2024-09-17T06:07:51.219489+0000","last_fullsized":"2024-09-17T06:07:51.219489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.562781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:51.528772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"81'74","reported_seq":248,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841224+0000","last_change":"2024-09-17T06:06:41.529207+0000","last_active":"2024-09-17T06:07:50.841224+0000","last_peered":"2024-09-17T06:07:50.841224+0000","last_clean":"2024-09-17T06:07:50.841224+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:07:50.841224+0000","last_undegraded":"2024-09-17T06:07:50.841224+0000","last_fullsized":"2024-09-17T06:07:50.841224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'74","last_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_deep_scrub":"81'74","last_deep_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.529006+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:17.811347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698161+0000","last_change":"2024-09-17T06:06:50.168189+0000","last_active":"2024-09-17T06:07:50.698161+0000","last_peered":"2024-09-17T06:07:50.698161+0000","last_clean":"2024-09-17T06:07:50.698161+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:07:50.698161+0000","last_undegraded":"2024-09-17T06:07:50.698161+0000","last_fullsized":"2024-09-17T06:07:50.698161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.167993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:53.277144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693347+0000","last_change":"2024-09-17T06:06:46.470862+0000","last_active":"2024-09-17T06:07:50.693347+0000","last_peered":"2024-09-17T06:07:50.693347+0000","last_clean":"2024-09-17T06:07:50.693347+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:07:50.693347+0000","last_undegraded":"2024-09-17T06:07:50.693347+0000","last_fullsized":"2024-09-17T06:07:50.693347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.470640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:54.803752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693739+0000","last_change":"2024-09-17T06:06:39.308543+0000","last_active":"2024-09-17T06:07:50.693739+0000","last_peered":"2024-09-17T06:07:50.693739+0000","last_clean":"2024-09-17T06:07:50.693739+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:07:50.693739+0000","last_undegraded":"2024-09-17T06:07:50.693739+0000","last_fullsized":"2024-09-17T06:07:50.693739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.308468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:26.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695342+0000","last_change":"2024-09-17T06:06:55.194732+0000","last_active":"2024-09-17T06:07:50.695342+0000","last_peered":"2024-09-17T06:07:50.695342+0000","last_clean":"2024-09-17T06:07:50.695342+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:07:50.695342+0000","last_undegraded":"2024-09-17T06:07:50.695342+0000","last_fullsized":"2024-09-17T06:07:50.695342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.194477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:46.395618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220138+0000","last_change":"2024-09-17T06:06:47.481798+0000","last_active":"2024-09-17T06:07:51.220138+0000","last_peered":"2024-09-17T06:07:51.220138+0000","last_clean":"2024-09-17T06:07:51.220138+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:07:51.220138+0000","last_undegraded":"2024-09-17T06:07:51.220138+0000","last_fullsized":"2024-09-17T06:07:51.220138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.481588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.150352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221032+0000","last_change":"2024-09-17T06:06:43.064298+0000","last_active":"2024-09-17T06:07:51.221032+0000","last_peered":"2024-09-17T06:07:51.221032+0000","last_clean":"2024-09-17T06:07:51.221032+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:07:51.221032+0000","last_undegraded":"2024-09-17T06:07:51.221032+0000","last_fullsized":"2024-09-17T06:07:51.221032+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.064096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:30.993498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225249+0000","last_change":"2024-09-17T06:06:52.593990+0000","last_active":"2024-09-17T06:07:51.225249+0000","last_peered":"2024-09-17T06:07:51.225249+0000","last_clean":"2024-09-17T06:07:51.225249+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:07:51.225249+0000","last_undegraded":"2024-09-17T06:07:51.225249+0000","last_fullsized":"2024-09-17T06:07:51.225249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.593787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:04.850781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":166,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842733+0000","last_change":"2024-09-17T06:06:46.576306+0000","last_active":"2024-09-17T06:07:50.842733+0000","last_peered":"2024-09-17T06:07:50.842733+0000","last_clean":"2024-09-17T06:07:50.842733+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:07:50.842733+0000","last_undegraded":"2024-09-17T06:07:50.842733+0000","last_fullsized":"2024-09-17T06:07:50.842733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:36.552616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'3","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.694092+0000","last_change":"2024-09-17T06:06:40.289371+0000","last_active":"2024-09-17T06:07:50.694092+0000","last_peered":"2024-09-17T06:07:50.694092+0000","last_clean":"2024-09-17T06:07:50.694092+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:07:50.694092+0000","last_undegraded":"2024-09-17T06:07:50.694092+0000","last_fullsized":"2024-09-17T06:07:50.694092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.289195+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.187275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218747+0000","last_change":"2024-09-17T06:06:57.580034+0000","last_active":"2024-09-17T06:07:51.218747+0000","last_peered":"2024-09-17T06:07:51.218747+0000","last_clean":"2024-09-17T06:07:51.218747+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:07:51.218747+0000","last_undegraded":"2024-09-17T06:07:51.218747+0000","last_fullsized":"2024-09-17T06:07:51.218747+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.579707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:15.990501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842467+0000","last_change":"2024-09-17T06:06:53.554156+0000","last_active":"2024-09-17T06:07:50.842467+0000","last_peered":"2024-09-17T06:07:50.842467+0000","last_clean":"2024-09-17T06:07:50.842467+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:07:50.842467+0000","last_undegraded":"2024-09-17T06:07:50.842467+0000","last_fullsized":"2024-09-17T06:07:50.842467+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.553919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:37.374837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700114+0000","last_change":"2024-09-17T06:06:40.545470+0000","last_active":"2024-09-17T06:07:50.700114+0000","last_peered":"2024-09-17T06:07:50.700114+0000","last_clean":"2024-09-17T06:07:50.700114+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:07:50.700114+0000","last_undegraded":"2024-09-17T06:07:50.700114+0000","last_fullsized":"2024-09-17T06:07:50.700114+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.545271+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:41.942375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696784+0000","last_change":"2024-09-17T06:06:46.553900+0000","last_active":"2024-09-17T06:07:50.696784+0000","last_peered":"2024-09-17T06:07:50.696784+0000","last_clean":"2024-09-17T06:07:50.696784+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:07:50.696784+0000","last_undegraded":"2024-09-17T06:07:50.696784+0000","last_fullsized":"2024-09-17T06:07:50.696784+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.553594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:37.347089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841069+0000","last_change":"2024-09-17T06:06:49.557072+0000","last_active":"2024-09-17T06:07:50.841069+0000","last_peered":"2024-09-17T06:07:50.841069+0000","last_clean":"2024-09-17T06:07:50.841069+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:07:50.841069+0000","last_undegraded":"2024-09-17T06:07:50.841069+0000","last_fullsized":"2024-09-17T06:07:50.841069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.556746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:02.173527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'13","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692561+0000","last_change":"2024-09-17T06:06:41.327726+0000","last_active":"2024-09-17T06:07:50.692561+0000","last_peered":"2024-09-17T06:07:50.692561+0000","last_clean":"2024-09-17T06:07:50.692561+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:07:50.692561+0000","last_undegraded":"2024-09-17T06:07:50.692561+0000","last_fullsized":"2024-09-17T06:07:50.692561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'13","last_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_deep_scrub":"81'13","last_deep_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.327620+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:41.975086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224922+0000","last_change":"2024-09-17T06:06:48.590089+0000","last_active":"2024-09-17T06:07:51.224922+0000","last_peered":"2024-09-17T06:07:51.224922+0000","last_clean":"2024-09-17T06:07:51.224922+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:07:51.224922+0000","last_undegraded":"2024-09-17T06:07:51.224922+0000","last_fullsized":"2024-09-17T06:07:51.224922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.589881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:13.065040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695546+0000","last_change":"2024-09-17T06:06:47.234619+0000","last_active":"2024-09-17T06:07:50.695546+0000","last_peered":"2024-09-17T06:07:50.695546+0000","last_clean":"2024-09-17T06:07:50.695546+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:07:50.695546+0000","last_undegraded":"2024-09-17T06:07:50.695546+0000","last_fullsized":"2024-09-17T06:07:50.695546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.234392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:10.297041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696180+0000","last_change":"2024-09-17T06:06:42.362985+0000","last_active":"2024-09-17T06:07:50.696180+0000","last_peered":"2024-09-17T06:07:50.696180+0000","last_clean":"2024-09-17T06:07:50.696180+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:07:50.696180+0000","last_undegraded":"2024-09-17T06:07:50.696180+0000","last_fullsized":"2024-09-17T06:07:50.696180+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.362795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:21.306942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700003+0000","last_change":"2024-09-17T06:06:54.645399+0000","last_active":"2024-09-17T06:07:50.700003+0000","last_peered":"2024-09-17T06:07:50.700003+0000","last_clean":"2024-09-17T06:07:50.700003+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:07:50.700003+0000","last_undegraded":"2024-09-17T06:07:50.700003+0000","last_fullsized":"2024-09-17T06:07:50.700003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.645200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:04.728298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841322+0000","last_change":"2024-09-17T06:06:48.595269+0000","last_active":"2024-09-17T06:07:50.841322+0000","last_peered":"2024-09-17T06:07:50.841322+0000","last_clean":"2024-09-17T06:07:50.841322+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:07:50.841322+0000","last_undegraded":"2024-09-17T06:07:50.841322+0000","last_fullsized":"2024-09-17T06:07:50.841322+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.595073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:51.297831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219063+0000","last_change":"2024-09-17T06:06:42.583243+0000","last_active":"2024-09-17T06:07:51.219063+0000","last_peered":"2024-09-17T06:07:51.219063+0000","last_clean":"2024-09-17T06:07:51.219063+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:07:51.219063+0000","last_undegraded":"2024-09-17T06:07:51.219063+0000","last_fullsized":"2024-09-17T06:07:51.219063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.583048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:54.333313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699331+0000","last_change":"2024-09-17T06:06:57.607574+0000","last_active":"2024-09-17T06:07:50.699331+0000","last_peered":"2024-09-17T06:07:50.699331+0000","last_clean":"2024-09-17T06:07:50.699331+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:07:50.699331+0000","last_undegraded":"2024-09-17T06:07:50.699331+0000","last_fullsized":"2024-09-17T06:07:50.699331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.607379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:56.898447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222448+0000","last_change":"2024-09-17T06:06:45.591584+0000","last_active":"2024-09-17T06:07:51.222448+0000","last_peered":"2024-09-17T06:07:51.222448+0000","last_clean":"2024-09-17T06:07:51.222448+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:07:51.222448+0000","last_undegraded":"2024-09-17T06:07:51.222448+0000","last_fullsized":"2024-09-17T06:07:51.222448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.591276+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:08.653925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.226091+0000","last_change":"2024-09-17T06:06:37.667757+0000","last_active":"2024-09-17T06:07:51.226091+0000","last_peered":"2024-09-17T06:07:51.226091+0000","last_clean":"2024-09-17T06:07:51.226091+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:07:51.226091+0000","last_undegraded":"2024-09-17T06:07:51.226091+0000","last_fullsized":"2024-09-17T06:07:51.226091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_clean_scrub_stamp":"2024-09-17T06:06:37.667675+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:46.885860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219774+0000","last_change":"2024-09-17T06:06:56.615164+0000","last_active":"2024-09-17T06:07:51.219774+0000","last_peered":"2024-09-17T06:07:51.219774+0000","last_clean":"2024-09-17T06:07:51.219774+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:07:51.219774+0000","last_undegraded":"2024-09-17T06:07:51.219774+0000","last_fullsized":"2024-09-17T06:07:51.219774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.614970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:07.482666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841716+0000","last_change":"2024-09-17T06:06:52.577732+0000","last_active":"2024-09-17T06:07:50.841716+0000","last_peered":"2024-09-17T06:07:50.841716+0000","last_clean":"2024-09-17T06:07:50.841716+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:07:50.841716+0000","last_undegraded":"2024-09-17T06:07:50.841716+0000","last_fullsized":"2024-09-17T06:07:50.841716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.577533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:34.161856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":173,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697698+0000","last_change":"2024-09-17T06:06:43.358428+0000","last_active":"2024-09-17T06:07:50.697698+0000","last_peered":"2024-09-17T06:07:50.697698+0000","last_clean":"2024-09-17T06:07:50.697698+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:07:50.697698+0000","last_undegraded":"2024-09-17T06:07:50.697698+0000","last_fullsized":"2024-09-17T06:07:50.697698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'27","last_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_deep_scrub":"81'27","last_deep_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.358219+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:13.703025+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220232+0000","last_change":"2024-09-17T06:06:52.944474+0000","last_active":"2024-09-17T06:07:51.220232+0000","last_peered":"2024-09-17T06:07:51.220232+0000","last_clean":"2024-09-17T06:07:51.220232+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:07:51.220232+0000","last_undegraded":"2024-09-17T06:07:51.220232+0000","last_fullsized":"2024-09-17T06:07:51.220232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.944213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.533972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699872+0000","last_change":"2024-09-17T06:06:43.557285+0000","last_active":"2024-09-17T06:07:50.699872+0000","last_peered":"2024-09-17T06:07:50.699872+0000","last_clean":"2024-09-17T06:07:50.699872+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:07:50.699872+0000","last_undegraded":"2024-09-17T06:07:50.699872+0000","last_fullsized":"2024-09-17T06:07:50.699872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.557090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:01.412234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"81'9","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220308+0000","last_change":"2024-09-17T06:06:43.599342+0000","last_active":"2024-09-17T06:07:51.220308+0000","last_peered":"2024-09-17T06:07:51.220308+0000","last_clean":"2024-09-17T06:07:51.220308+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:07:51.220308+0000","last_undegraded":"2024-09-17T06:07:51.220308+0000","last_fullsized":"2024-09-17T06:07:51.220308+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.599114+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:49.432076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699698+0000","last_change":"2024-09-17T06:06:49.561761+0000","last_active":"2024-09-17T06:07:50.699698+0000","last_peered":"2024-09-17T06:07:50.699698+0000","last_clean":"2024-09-17T06:07:50.699698+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:07:50.699698+0000","last_undegraded":"2024-09-17T06:07:50.699698+0000","last_fullsized":"2024-09-17T06:07:50.699698+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.561572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:15.208406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223520+0000","last_change":"2024-09-17T06:06:40.581076+0000","last_active":"2024-09-17T06:07:51.223520+0000","last_peered":"2024-09-17T06:07:51.223520+0000","last_clean":"2024-09-17T06:07:51.223520+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:07:51.223520+0000","last_undegraded":"2024-09-17T06:07:51.223520+0000","last_fullsized":"2024-09-17T06:07:51.223520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.580978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:19.525125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220070+0000","last_change":"2024-09-17T06:06:44.589361+0000","last_active":"2024-09-17T06:07:51.220070+0000","last_peered":"2024-09-17T06:07:51.220070+0000","last_clean":"2024-09-17T06:07:51.220070+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:07:51.220070+0000","last_undegraded":"2024-09-17T06:07:51.220070+0000","last_fullsized":"2024-09-17T06:07:51.220070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.589149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.705503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698292+0000","last_change":"2024-09-17T06:06:58.599122+0000","last_active":"2024-09-17T06:07:50.698292+0000","last_peered":"2024-09-17T06:07:50.698292+0000","last_clean":"2024-09-17T06:07:50.698292+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:07:50.698292+0000","last_undegraded":"2024-09-17T06:07:50.698292+0000","last_fullsized":"2024-09-17T06:07:50.698292+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_clean_scrub_stamp":"2024-09-17T06:06:58.598909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.505821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219917+0000","last_change":"2024-09-17T06:06:48.493667+0000","last_active":"2024-09-17T06:07:51.219917+0000","last_peered":"2024-09-17T06:07:51.219917+0000","last_clean":"2024-09-17T06:07:51.219917+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:07:51.219917+0000","last_undegraded":"2024-09-17T06:07:51.219917+0000","last_fullsized":"2024-09-17T06:07:51.219917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.493470+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.837170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":147,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697097+0000","last_change":"2024-09-17T06:06:44.333474+0000","last_active":"2024-09-17T06:07:50.697097+0000","last_peered":"2024-09-17T06:07:50.697097+0000","last_clean":"2024-09-17T06:07:50.697097+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:07:50.697097+0000","last_undegraded":"2024-09-17T06:07:50.697097+0000","last_fullsized":"2024-09-17T06:07:50.697097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.333150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.158751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698343+0000","last_change":"2024-09-17T06:06:52.699338+0000","last_active":"2024-09-17T06:07:50.698343+0000","last_peered":"2024-09-17T06:07:50.698343+0000","last_clean":"2024-09-17T06:07:50.698343+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:07:50.698343+0000","last_undegraded":"2024-09-17T06:07:50.698343+0000","last_fullsized":"2024-09-17T06:07:50.698343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.699134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:51.626769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224692+0000","last_change":"2024-09-17T06:06:49.633934+0000","last_active":"2024-09-17T06:07:51.224692+0000","last_peered":"2024-09-17T06:07:51.224692+0000","last_clean":"2024-09-17T06:07:51.224692+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:07:51.224692+0000","last_undegraded":"2024-09-17T06:07:51.224692+0000","last_fullsized":"2024-09-17T06:07:51.224692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.633660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.217982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220089+0000","last_change":"2024-09-17T06:06:46.974853+0000","last_active":"2024-09-17T06:07:51.220089+0000","last_peered":"2024-09-17T06:07:51.220089+0000","last_clean":"2024-09-17T06:07:51.220089+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:07:51.220089+0000","last_undegraded":"2024-09-17T06:07:51.220089+0000","last_fullsized":"2024-09-17T06:07:51.220089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.974637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:26.337532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218927+0000","last_change":"2024-09-17T06:06:46.527438+0000","last_active":"2024-09-17T06:07:51.218927+0000","last_peered":"2024-09-17T06:07:51.218927+0000","last_clean":"2024-09-17T06:07:51.218927+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:07:51.218927+0000","last_undegraded":"2024-09-17T06:07:51.218927+0000","last_fullsized":"2024-09-17T06:07:51.218927+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.527230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:25.890125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696741+0000","last_change":"2024-09-17T06:06:54.199209+0000","last_active":"2024-09-17T06:07:50.696741+0000","last_peered":"2024-09-17T06:07:50.696741+0000","last_clean":"2024-09-17T06:07:50.696741+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:07:50.696741+0000","last_undegraded":"2024-09-17T06:07:50.696741+0000","last_fullsized":"2024-09-17T06:07:50.696741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.198989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:51.609301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":84,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699671+0000","last_change":"2024-09-17T06:06:46.699017+0000","last_active":"2024-09-17T06:07:50.699671+0000","last_peered":"2024-09-17T06:07:50.699671+0000","last_clean":"2024-09-17T06:07:50.699671+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:07:50.699671+0000","last_undegraded":"2024-09-17T06:07:50.699671+0000","last_fullsized":"2024-09-17T06:07:50.699671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.698821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:33.586359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698678+0000","last_change":"2024-09-17T06:06:40.624617+0000","last_active":"2024-09-17T06:07:50.698678+0000","last_peered":"2024-09-17T06:07:50.698678+0000","last_clean":"2024-09-17T06:07:50.698678+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:07:50.698678+0000","last_undegraded":"2024-09-17T06:07:50.698678+0000","last_fullsized":"2024-09-17T06:07:50.698678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.624540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:48.054970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696085+0000","last_change":"2024-09-17T06:06:45.311790+0000","last_active":"2024-09-17T06:07:50.696085+0000","last_peered":"2024-09-17T06:07:50.696085+0000","last_clean":"2024-09-17T06:07:50.696085+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:07:50.696085+0000","last_undegraded":"2024-09-17T06:07:50.696085+0000","last_fullsized":"2024-09-17T06:07:50.696085+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.311572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:05.215110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225756+0000","last_change":"2024-09-17T06:06:43.594929+0000","last_active":"2024-09-17T06:07:51.225756+0000","last_peered":"2024-09-17T06:07:51.225756+0000","last_clean":"2024-09-17T06:07:51.225756+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:07:51.225756+0000","last_undegraded":"2024-09-17T06:07:51.225756+0000","last_fullsized":"2024-09-17T06:07:51.225756+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.594608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:54.666206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693105+0000","last_change":"2024-09-17T06:06:44.420446+0000","last_active":"2024-09-17T06:07:50.693105+0000","last_peered":"2024-09-17T06:07:50.693105+0000","last_clean":"2024-09-17T06:07:50.693105+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:07:50.693105+0000","last_undegraded":"2024-09-17T06:07:50.693105+0000","last_fullsized":"2024-09-17T06:07:50.693105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.420226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:35.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698825+0000","last_change":"2024-09-17T06:06:39.644661+0000","last_active":"2024-09-17T06:07:50.698825+0000","last_peered":"2024-09-17T06:07:50.698825+0000","last_clean":"2024-09-17T06:07:50.698825+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:07:50.698825+0000","last_undegraded":"2024-09-17T06:07:50.698825+0000","last_fullsized":"2024-09-17T06:07:50.698825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.644581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:43.034866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695221+0000","last_change":"2024-09-17T06:06:42.552587+0000","last_active":"2024-09-17T06:07:50.695221+0000","last_peered":"2024-09-17T06:07:50.695221+0000","last_clean":"2024-09-17T06:07:50.695221+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:07:50.695221+0000","last_undegraded":"2024-09-17T06:07:50.695221+0000","last_fullsized":"2024-09-17T06:07:50.695221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.552253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:16.204277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":133,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699293+0000","last_change":"2024-09-17T06:06:59.590058+0000","last_active":"2024-09-17T06:07:50.699293+0000","last_peered":"2024-09-17T06:07:50.699293+0000","last_clean":"2024-09-17T06:07:50.699293+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:07:50.699293+0000","last_undegraded":"2024-09-17T06:07:50.699293+0000","last_fullsized":"2024-09-17T06:07:50.699293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_clean_scrub_stamp":"2024-09-17T06:06:59.589844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:13.777383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695142+0000","last_change":"2024-09-17T06:06:49.212293+0000","last_active":"2024-09-17T06:07:50.695142+0000","last_peered":"2024-09-17T06:07:50.695142+0000","last_clean":"2024-09-17T06:07:50.695142+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:07:50.695142+0000","last_undegraded":"2024-09-17T06:07:50.695142+0000","last_fullsized":"2024-09-17T06:07:50.695142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.211966+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:29.791073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693039+0000","last_change":"2024-09-17T06:06:43.370824+0000","last_active":"2024-09-17T06:07:50.693039+0000","last_peered":"2024-09-17T06:07:50.693039+0000","last_clean":"2024-09-17T06:07:50.693039+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:07:50.693039+0000","last_undegraded":"2024-09-17T06:07:50.693039+0000","last_fullsized":"2024-09-17T06:07:50.693039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.370630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:28.698931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219068+0000","last_change":"2024-09-17T06:06:50.490824+0000","last_active":"2024-09-17T06:07:51.219068+0000","last_peered":"2024-09-17T06:07:51.219068+0000","last_clean":"2024-09-17T06:07:51.219068+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:07:51.219068+0000","last_undegraded":"2024-09-17T06:07:51.219068+0000","last_fullsized":"2024-09-17T06:07:51.219068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.490494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.208761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":170,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225578+0000","last_change":"2024-09-17T06:06:54.564398+0000","last_active":"2024-09-17T06:07:51.225578+0000","last_peered":"2024-09-17T06:07:51.225578+0000","last_clean":"2024-09-17T06:07:51.225578+0000","last_became_active":"2024-09-17T06:06:49.863977+0000","last_became_peered":"2024-09-17T06:06:49.863977+0000","last_unstale":"2024-09-17T06:07:51.225578+0000","last_undegraded":"2024-09-17T06:07:51.225578+0000","last_fullsized":"2024-09-17T06:07:51.225578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:54.564097+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:53.583377+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.564097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:45.765238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700309+0000","last_change":"2024-09-17T06:06:48.701826+0000","last_active":"2024-09-17T06:07:50.700309+0000","last_peered":"2024-09-17T06:07:50.700309+0000","last_clean":"2024-09-17T06:07:50.700309+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:07:50.700309+0000","last_undegraded":"2024-09-17T06:07:50.700309+0000","last_fullsized":"2024-09-17T06:07:50.700309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.701596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:43:38.318752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220694+0000","last_change":"2024-09-17T06:06:44.071550+0000","last_active":"2024-09-17T06:07:51.220694+0000","last_peered":"2024-09-17T06:07:51.220694+0000","last_clean":"2024-09-17T06:07:51.220694+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:07:51.220694+0000","last_undegraded":"2024-09-17T06:07:51.220694+0000","last_fullsized":"2024-09-17T06:07:51.220694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.071343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:50.902738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699125+0000","last_change":"2024-09-17T06:06:48.219488+0000","last_active":"2024-09-17T06:07:50.699125+0000","last_peered":"2024-09-17T06:07:50.699125+0000","last_clean":"2024-09-17T06:07:50.699125+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:07:50.699125+0000","last_undegraded":"2024-09-17T06:07:50.699125+0000","last_fullsized":"2024-09-17T06:07:50.699125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.219293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:00.836074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":118,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700371+0000","last_change":"2024-09-17T06:06:50.710122+0000","last_active":"2024-09-17T06:07:50.700371+0000","last_peered":"2024-09-17T06:07:50.700371+0000","last_clean":"2024-09-17T06:07:50.700371+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:07:50.700371+0000","last_undegraded":"2024-09-17T06:07:50.700371+0000","last_fullsized":"2024-09-17T06:07:50.700371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.709804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:24.696128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218361+0000","last_change":"2024-09-17T06:06:51.502240+0000","last_active":"2024-09-17T06:07:51.218361+0000","last_peered":"2024-09-17T06:07:51.218361+0000","last_clean":"2024-09-17T06:07:51.218361+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:07:51.218361+0000","last_undegraded":"2024-09-17T06:07:51.218361+0000","last_fullsized":"2024-09-17T06:07:51.218361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.502041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.125829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":124,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698407+0000","last_change":"2024-09-17T06:06:49.687515+0000","last_active":"2024-09-17T06:07:50.698407+0000","last_peered":"2024-09-17T06:07:50.698407+0000","last_clean":"2024-09-17T06:07:50.698407+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:07:50.698407+0000","last_undegraded":"2024-09-17T06:07:50.698407+0000","last_fullsized":"2024-09-17T06:07:50.698407+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.687322+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:09.182168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692664+0000","last_change":"2024-09-17T06:06:49.761230+0000","last_active":"2024-09-17T06:07:50.692664+0000","last_peered":"2024-09-17T06:07:50.692664+0000","last_clean":"2024-09-17T06:07:50.692664+0000","last_became_active":"2024-09-17T06:06:49.760405+0000","last_became_peered":"2024-09-17T06:06:49.760405+0000","last_unstale":"2024-09-17T06:07:50.692664+0000","last_undegraded":"2024-09-17T06:07:50.692664+0000","last_fullsized":"2024-09-17T06:07:50.692664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:18.198271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224999+0000","last_change":"2024-09-17T06:06:51.561891+0000","last_active":"2024-09-17T06:07:51.224999+0000","last_peered":"2024-09-17T06:07:51.224999+0000","last_clean":"2024-09-17T06:07:51.224999+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:07:51.224999+0000","last_undegraded":"2024-09-17T06:07:51.224999+0000","last_fullsized":"2024-09-17T06:07:51.224999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.561576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:27.536230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697734+0000","last_change":"2024-09-17T06:06:51.171689+0000","last_active":"2024-09-17T06:07:50.697734+0000","last_peered":"2024-09-17T06:07:50.697734+0000","last_clean":"2024-09-17T06:07:50.697734+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:07:50.697734+0000","last_undegraded":"2024-09-17T06:07:50.697734+0000","last_fullsized":"2024-09-17T06:07:50.697734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.171493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:39.452849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842168+0000","last_change":"2024-09-17T06:06:55.610932+0000","last_active":"2024-09-17T06:07:50.842168+0000","last_peered":"2024-09-17T06:07:50.842168+0000","last_clean":"2024-09-17T06:07:50.842168+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:07:50.842168+0000","last_undegraded":"2024-09-17T06:07:50.842168+0000","last_fullsized":"2024-09-17T06:07:50.842168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.610700+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:07.867694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693815+0000","last_change":"2024-09-17T06:06:42.353051+0000","last_active":"2024-09-17T06:07:50.693815+0000","last_peered":"2024-09-17T06:07:50.693815+0000","last_clean":"2024-09-17T06:07:50.693815+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:07:50.693815+0000","last_undegraded":"2024-09-17T06:07:50.693815+0000","last_fullsized":"2024-09-17T06:07:50.693815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.352711+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:14.862093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220510+0000","last_change":"2024-09-17T06:06:52.529037+0000","last_active":"2024-09-17T06:07:51.220510+0000","last_peered":"2024-09-17T06:07:51.220510+0000","last_clean":"2024-09-17T06:07:51.220510+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:07:51.220510+0000","last_undegraded":"2024-09-17T06:07:51.220510+0000","last_fullsized":"2024-09-17T06:07:51.220510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.528843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.118602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218857+0000","last_change":"2024-09-17T06:06:53.547108+0000","last_active":"2024-09-17T06:07:51.218857+0000","last_peered":"2024-09-17T06:07:51.218857+0000","last_clean":"2024-09-17T06:07:51.218857+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:07:51.218857+0000","last_undegraded":"2024-09-17T06:07:51.218857+0000","last_fullsized":"2024-09-17T06:07:51.218857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.546853+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:05.208153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220476+0000","last_change":"2024-09-17T06:06:48.919436+0000","last_active":"2024-09-17T06:07:51.220476+0000","last_peered":"2024-09-17T06:07:51.220476+0000","last_clean":"2024-09-17T06:07:51.220476+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:07:51.220476+0000","last_undegraded":"2024-09-17T06:07:51.220476+0000","last_fullsized":"2024-09-17T06:07:51.220476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.919235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:27.262935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222436+0000","last_change":"2024-09-17T06:06:44.636882+0000","last_active":"2024-09-17T06:07:51.222436+0000","last_peered":"2024-09-17T06:07:51.222436+0000","last_clean":"2024-09-17T06:07:51.222436+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:07:51.222436+0000","last_undegraded":"2024-09-17T06:07:51.222436+0000","last_fullsized":"2024-09-17T06:07:51.222436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.636626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:44.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698346+0000","last_change":"2024-09-17T06:06:51.717905+0000","last_active":"2024-09-17T06:07:50.698346+0000","last_peered":"2024-09-17T06:07:50.698346+0000","last_clean":"2024-09-17T06:07:50.698346+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:07:50.698346+0000","last_undegraded":"2024-09-17T06:07:50.698346+0000","last_fullsized":"2024-09-17T06:07:50.698346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.717694+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:59.444208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700437+0000","last_change":"2024-09-17T06:06:45.539679+0000","last_active":"2024-09-17T06:07:50.700437+0000","last_peered":"2024-09-17T06:07:50.700437+0000","last_clean":"2024-09-17T06:07:50.700437+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:07:50.700437+0000","last_undegraded":"2024-09-17T06:07:50.700437+0000","last_fullsized":"2024-09-17T06:07:50.700437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.539468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:55.832105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698493+0000","last_change":"2024-09-17T06:06:52.213250+0000","last_active":"2024-09-17T06:07:50.698493+0000","last_peered":"2024-09-17T06:07:50.698493+0000","last_clean":"2024-09-17T06:07:50.698493+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:07:50.698493+0000","last_undegraded":"2024-09-17T06:07:50.698493+0000","last_fullsized":"2024-09-17T06:07:50.698493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.213042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:36.033960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698927+0000","last_change":"2024-09-17T06:06:53.226240+0000","last_active":"2024-09-17T06:07:50.698927+0000","last_peered":"2024-09-17T06:07:50.698927+0000","last_clean":"2024-09-17T06:07:50.698927+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:07:50.698927+0000","last_undegraded":"2024-09-17T06:07:50.698927+0000","last_fullsized":"2024-09-17T06:07:50.698927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'16","last_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_deep_scrub":"81'16","last_deep_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.226044+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:15.604828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842503+0000","last_change":"2024-09-17T06:06:50.593476+0000","last_active":"2024-09-17T06:07:50.842503+0000","last_peered":"2024-09-17T06:07:50.842503+0000","last_clean":"2024-09-17T06:07:50.842503+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:07:50.842503+0000","last_undegraded":"2024-09-17T06:07:50.842503+0000","last_fullsized":"2024-09-17T06:07:50.842503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.593281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.041524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697951+0000","last_change":"2024-09-17T06:06:53.662277+0000","last_active":"2024-09-17T06:07:50.697951+0000","last_peered":"2024-09-17T06:07:50.697951+0000","last_clean":"2024-09-17T06:07:50.697951+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:07:50.697951+0000","last_undegraded":"2024-09-17T06:07:50.697951+0000","last_fullsized":"2024-09-17T06:07:50.697951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.662083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:09.458813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840621+0000","last_change":"2024-09-17T06:06:54.601401+0000","last_active":"2024-09-17T06:07:50.840621+0000","last_peered":"2024-09-17T06:07:50.840621+0000","last_clean":"2024-09-17T06:07:50.840621+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:07:50.840621+0000","last_undegraded":"2024-09-17T06:07:50.840621+0000","last_fullsized":"2024-09-17T06:07:50.840621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.601206+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:30.575859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218778+0000","last_change":"2024-09-17T06:06:54.592256+0000","last_active":"2024-09-17T06:07:51.218778+0000","last_peered":"2024-09-17T06:07:51.218778+0000","last_clean":"2024-09-17T06:07:51.218778+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:07:51.218778+0000","last_undegraded":"2024-09-17T06:07:51.218778+0000","last_fullsized":"2024-09-17T06:07:51.218778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.591916+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:43.180179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840639+0000","last_change":"2024-09-17T06:06:57.597911+0000","last_active":"2024-09-17T06:07:50.840639+0000","last_peered":"2024-09-17T06:07:50.840639+0000","last_clean":"2024-09-17T06:07:50.840639+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:07:50.840639+0000","last_undegraded":"2024-09-17T06:07:50.840639+0000","last_fullsized":"2024-09-17T06:07:50.840639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.597715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:05.028145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219802+0000","last_change":"2024-09-17T06:06:55.569378+0000","last_active":"2024-09-17T06:07:51.219802+0000","last_peered":"2024-09-17T06:07:51.219802+0000","last_clean":"2024-09-17T06:07:51.219802+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:07:51.219802+0000","last_undegraded":"2024-09-17T06:07:51.219802+0000","last_fullsized":"2024-09-17T06:07:51.219802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.569171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:50.988830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222343+0000","last_change":"2024-09-17T06:06:46.576687+0000","last_active":"2024-09-17T06:07:51.222343+0000","last_peered":"2024-09-17T06:07:51.222343+0000","last_clean":"2024-09-17T06:07:51.222343+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:07:51.222343+0000","last_undegraded":"2024-09-17T06:07:51.222343+0000","last_fullsized":"2024-09-17T06:07:51.222343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:36.143901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222113+0000","last_change":"2024-09-17T06:06:46.022759+0000","last_active":"2024-09-17T06:07:51.222113+0000","last_peered":"2024-09-17T06:07:51.222113+0000","last_clean":"2024-09-17T06:07:51.222113+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:07:51.222113+0000","last_undegraded":"2024-09-17T06:07:51.222113+0000","last_fullsized":"2024-09-17T06:07:51.222113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.022447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.814300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842464+0000","last_change":"2024-09-17T06:06:56.620251+0000","last_active":"2024-09-17T06:07:50.842464+0000","last_peered":"2024-09-17T06:07:50.842464+0000","last_clean":"2024-09-17T06:07:50.842464+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:07:50.842464+0000","last_undegraded":"2024-09-17T06:07:50.842464+0000","last_fullsized":"2024-09-17T06:07:50.842464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.619933+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:00.010218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509502,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1044480,"data_stored":558879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":522541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509503,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1605632,"data_stored":1113225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1593344,"data_stored":1113079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509501,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":558467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906978,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":1007616,"data_stored":522255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509503,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":999424,"data_stored":522199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542205,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":999424,"data_stored":522219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:08:43.719 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:08:43.719 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T06:09:03.720 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:09:03.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.885+0000 7fd03b292640 1 -- 172.21.15.122:0/673935113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd020003a40 msgr2=0x7fd020003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:03.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.885+0000 7fd03b292640 1 --2- 172.21.15.122:0/673935113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd020003a40 0x7fd020003eb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c260 tx=0x7fd03001cf10 comp rx=0 tx=0).stop 2024-09-17T06:09:03.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.885+0000 7fd03982f640 1 -- 172.21.15.122:0/673935113 reap_dead start 2024-09-17T06:09:03.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.885+0000 7fd03b292640 1 -- 172.21.15.122:0/673935113 shutdown_connections 2024-09-17T06:09:03.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.885+0000 7fd03b292640 1 -- 172.21.15.122:0/673935113 >> 172.21.15.122:0/673935113 conn(0x7fd034070e40 msgr2=0x7fd034071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:03.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.885+0000 7fd03b292640 1 -- 172.21.15.122:0/673935113 shutdown_connections 2024-09-17T06:09:03.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.885+0000 7fd03b292640 1 -- 172.21.15.122:0/673935113 wait complete. 2024-09-17T06:09:03.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03b292640 1 Processor -- start 2024-09-17T06:09:03.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03b292640 1 -- start start 2024-09-17T06:09:03.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03b292640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd020003a40 0x7fd034153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:03.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03b292640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd034161f90 0x7fd034154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:03.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03b292640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0341623a0 0x7fd034155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:03.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03b292640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd0341538e0 con 0x7fd034161f90 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03b292640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd03415a160 con 0x7fd020003a40 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03b292640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd0340ca2a0 con 0x7fd0341623a0 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03882d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd034161f90 0x7fd034154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03882d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd034161f90 0x7fd034154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43160/0 (socket says 172.21.15.122:43160) 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03882d640 1 -- 172.21.15.122:0/899547656 learned_addr learned my addr 172.21.15.122:0/899547656 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03902e640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd020003a40 0x7fd034153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03982f640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0341623a0 0x7fd034155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03882d640 1 -- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0341623a0 msgr2=0x7fd034155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03882d640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0341623a0 0x7fd034155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03882d640 1 -- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd020003a40 msgr2=0x7fd034153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03882d640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd020003a40 0x7fd034153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03882d640 1 -- 172.21.15.122:0/899547656 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd034154200 con 0x7fd034161f90 2024-09-17T06:09:03.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03882d640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd034161f90 0x7fd034154af0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd028004f10 tx=0x7fd0280015e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:03.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd025ffb640 1 -- 172.21.15.122:0/899547656 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028015020 con 0x7fd034161f90 2024-09-17T06:09:03.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd025ffb640 1 -- 172.21.15.122:0/899547656 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd028011960 con 0x7fd034161f90 2024-09-17T06:09:03.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03b292640 1 -- 172.21.15.122:0/899547656 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0340703c0 con 0x7fd034161f90 2024-09-17T06:09:03.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd025ffb640 1 -- 172.21.15.122:0/899547656 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028011d90 con 0x7fd034161f90 2024-09-17T06:09:03.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03b292640 1 -- 172.21.15.122:0/899547656 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0340700b0 con 0x7fd034161f90 2024-09-17T06:09:03.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.889+0000 7fd03b292640 1 -- 172.21.15.122:0/899547656 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0340cf550 con 0x7fd034161f90 2024-09-17T06:09:03.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.893+0000 7fd025ffb640 1 -- 172.21.15.122:0/899547656 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd028018020 con 0x7fd034161f90 2024-09-17T06:09:03.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.893+0000 7fd025ffb640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd018073230 0x7fd018075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:03.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.893+0000 7fd025ffb640 1 -- 172.21.15.122:0/899547656 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6854+0+0 (secure 0 0 0) 0x7fd028095710 con 0x7fd034161f90 2024-09-17T06:09:03.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.893+0000 7fd03902e640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd018073230 0x7fd018075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:03.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.893+0000 7fd03902e640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd018073230 0x7fd018075740 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd0300ac000 tx=0x7fd030019d50 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:03.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:03.897+0000 7fd025ffb640 1 -- 172.21.15.122:0/899547656 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd02801f020 con 0x7fd034161f90 2024-09-17T06:09:04.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.065+0000 7fd03b292640 1 -- 172.21.15.122:0/899547656 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd03414edd0 con 0x7fd018073230 2024-09-17T06:09:04.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.081+0000 7fd025ffb640 1 -- 172.21.15.122:0/899547656 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332987 (secure 0 0 0) 0x7fd03414edd0 con 0x7fd018073230 2024-09-17T06:09:04.089 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:09:04.091 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:09:04.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.085+0000 7fd03b292640 1 -- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd018073230 msgr2=0x7fd018075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:04.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.085+0000 7fd03b292640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd018073230 0x7fd018075740 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd0300ac000 tx=0x7fd030019d50 comp rx=0 tx=0).stop 2024-09-17T06:09:04.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.085+0000 7fd03b292640 1 -- 172.21.15.122:0/899547656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd034161f90 msgr2=0x7fd034154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:04.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.085+0000 7fd03b292640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd034161f90 0x7fd034154af0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd028004f10 tx=0x7fd0280015e0 comp rx=0 tx=0).stop 2024-09-17T06:09:04.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.085+0000 7fd03b292640 1 -- 172.21.15.122:0/899547656 shutdown_connections 2024-09-17T06:09:04.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.085+0000 7fd03b292640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0341623a0 0x7fd034155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:04.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.085+0000 7fd03b292640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd034161f90 0x7fd034154af0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:04.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.085+0000 7fd03b292640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd018073230 0x7fd018075740 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:04.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.085+0000 7fd03b292640 1 --2- 172.21.15.122:0/899547656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd020003a40 0x7fd034153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:04.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.085+0000 7fd03b292640 1 -- 172.21.15.122:0/899547656 >> 172.21.15.122:0/899547656 conn(0x7fd034070e40 msgr2=0x7fd0340b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:04.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.085+0000 7fd03b292640 1 -- 172.21.15.122:0/899547656 shutdown_connections 2024-09-17T06:09:04.093 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:04.085+0000 7fd03b292640 1 -- 172.21.15.122:0/899547656 wait complete. 2024-09-17T06:09:04.112 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-09-17T06:09:03.644096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247140,"kb_used_data":9072,"kb_used_omap":17,"kb_used_meta":237870,"kb_avail":754727580,"statfs":{"total":773094113280,"available":772841041920,"internally_reserved":0,"allocated":9289728,"data_stored":5432864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":243579629},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005723"},"pg_stats":[{"pgid":"2.1f","version":"81'6","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224051+0000","last_change":"2024-09-17T06:06:38.646633+0000","last_active":"2024-09-17T06:07:51.224051+0000","last_peered":"2024-09-17T06:07:51.224051+0000","last_clean":"2024-09-17T06:07:51.224051+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:07:51.224051+0000","last_undegraded":"2024-09-17T06:07:51.224051+0000","last_fullsized":"2024-09-17T06:07:51.224051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.646522+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:55.373873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699959+0000","last_change":"2024-09-17T06:06:47.678984+0000","last_active":"2024-09-17T06:07:50.699959+0000","last_peered":"2024-09-17T06:07:50.699959+0000","last_clean":"2024-09-17T06:07:50.699959+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:07:50.699959+0000","last_undegraded":"2024-09-17T06:07:50.699959+0000","last_fullsized":"2024-09-17T06:07:50.699959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.678793+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:31.584591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698029+0000","last_change":"2024-09-17T06:06:55.606541+0000","last_active":"2024-09-17T06:07:50.698029+0000","last_peered":"2024-09-17T06:07:50.698029+0000","last_clean":"2024-09-17T06:07:50.698029+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:07:50.698029+0000","last_undegraded":"2024-09-17T06:07:50.698029+0000","last_fullsized":"2024-09-17T06:07:50.698029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.606346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:05.514205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700296+0000","last_change":"2024-09-17T06:06:41.626922+0000","last_active":"2024-09-17T06:07:50.700296+0000","last_peered":"2024-09-17T06:07:50.700296+0000","last_clean":"2024-09-17T06:07:50.700296+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:07:50.700296+0000","last_undegraded":"2024-09-17T06:07:50.700296+0000","last_fullsized":"2024-09-17T06:07:50.700296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.626723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:41.581056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223163+0000","last_change":"2024-09-17T06:06:42.561017+0000","last_active":"2024-09-17T06:07:51.223163+0000","last_peered":"2024-09-17T06:07:51.223163+0000","last_clean":"2024-09-17T06:07:51.223163+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:07:51.223163+0000","last_undegraded":"2024-09-17T06:07:51.223163+0000","last_fullsized":"2024-09-17T06:07:51.223163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.560815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:06.386417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695113+0000","last_change":"2024-09-17T06:06:50.581741+0000","last_active":"2024-09-17T06:07:50.695113+0000","last_peered":"2024-09-17T06:07:50.695113+0000","last_clean":"2024-09-17T06:07:50.695113+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:07:50.695113+0000","last_undegraded":"2024-09-17T06:07:50.695113+0000","last_fullsized":"2024-09-17T06:07:50.695113+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.581526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:27.538796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841990+0000","last_change":"2024-09-17T06:06:44.503792+0000","last_active":"2024-09-17T06:07:50.841990+0000","last_peered":"2024-09-17T06:07:50.841990+0000","last_clean":"2024-09-17T06:07:50.841990+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:07:50.841990+0000","last_undegraded":"2024-09-17T06:07:50.841990+0000","last_fullsized":"2024-09-17T06:07:50.841990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.503569+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.329171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219618+0000","last_change":"2024-09-17T06:06:49.490282+0000","last_active":"2024-09-17T06:07:51.219618+0000","last_peered":"2024-09-17T06:07:51.219618+0000","last_clean":"2024-09-17T06:07:51.219618+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:07:51.219618+0000","last_undegraded":"2024-09-17T06:07:51.219618+0000","last_fullsized":"2024-09-17T06:07:51.219618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.490084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:52.911935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700279+0000","last_change":"2024-09-17T06:06:51.542004+0000","last_active":"2024-09-17T06:07:50.700279+0000","last_peered":"2024-09-17T06:07:50.700279+0000","last_clean":"2024-09-17T06:07:50.700279+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:07:50.700279+0000","last_undegraded":"2024-09-17T06:07:50.700279+0000","last_fullsized":"2024-09-17T06:07:50.700279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.541795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.542454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841533+0000","last_change":"2024-09-17T06:06:45.535472+0000","last_active":"2024-09-17T06:07:50.841533+0000","last_peered":"2024-09-17T06:07:50.841533+0000","last_clean":"2024-09-17T06:07:50.841533+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:07:50.841533+0000","last_undegraded":"2024-09-17T06:07:50.841533+0000","last_fullsized":"2024-09-17T06:07:50.841533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.535262+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:56.606861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692929+0000","last_change":"2024-09-17T06:06:45.459635+0000","last_active":"2024-09-17T06:07:50.692929+0000","last_peered":"2024-09-17T06:07:50.692929+0000","last_clean":"2024-09-17T06:07:50.692929+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:07:50.692929+0000","last_undegraded":"2024-09-17T06:07:50.692929+0000","last_fullsized":"2024-09-17T06:07:50.692929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.459406+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:41.152666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699444+0000","last_change":"2024-09-17T06:06:52.519889+0000","last_active":"2024-09-17T06:07:50.699444+0000","last_peered":"2024-09-17T06:07:50.699444+0000","last_clean":"2024-09-17T06:07:50.699444+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:07:50.699444+0000","last_undegraded":"2024-09-17T06:07:50.699444+0000","last_fullsized":"2024-09-17T06:07:50.699444+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.519692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:06.562811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695680+0000","last_change":"2024-09-17T06:06:46.282925+0000","last_active":"2024-09-17T06:07:50.695680+0000","last_peered":"2024-09-17T06:07:50.695680+0000","last_clean":"2024-09-17T06:07:50.695680+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:07:50.695680+0000","last_undegraded":"2024-09-17T06:07:50.695680+0000","last_fullsized":"2024-09-17T06:07:50.695680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.282607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:45.646843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841728+0000","last_change":"2024-09-17T06:06:47.578055+0000","last_active":"2024-09-17T06:07:50.841728+0000","last_peered":"2024-09-17T06:07:50.841728+0000","last_clean":"2024-09-17T06:07:50.841728+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:07:50.841728+0000","last_undegraded":"2024-09-17T06:07:50.841728+0000","last_fullsized":"2024-09-17T06:07:50.841728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.577825+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:54.466675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699912+0000","last_change":"2024-09-17T06:06:48.564278+0000","last_active":"2024-09-17T06:07:50.699912+0000","last_peered":"2024-09-17T06:07:50.699912+0000","last_clean":"2024-09-17T06:07:50.699912+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:07:50.699912+0000","last_undegraded":"2024-09-17T06:07:50.699912+0000","last_fullsized":"2024-09-17T06:07:50.699912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.564076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:09.526182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698658+0000","last_change":"2024-09-17T06:06:45.719909+0000","last_active":"2024-09-17T06:07:50.698658+0000","last_peered":"2024-09-17T06:07:50.698658+0000","last_clean":"2024-09-17T06:07:50.698658+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:07:50.698658+0000","last_undegraded":"2024-09-17T06:07:50.698658+0000","last_fullsized":"2024-09-17T06:07:50.698658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.719724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:58.812630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221112+0000","last_change":"2024-09-17T06:06:39.054952+0000","last_active":"2024-09-17T06:07:51.221112+0000","last_peered":"2024-09-17T06:07:51.221112+0000","last_clean":"2024-09-17T06:07:51.221112+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:07:51.221112+0000","last_undegraded":"2024-09-17T06:07:51.221112+0000","last_fullsized":"2024-09-17T06:07:51.221112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.054879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:22.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700935+0000","last_change":"2024-09-17T06:06:47.595782+0000","last_active":"2024-09-17T06:07:50.700935+0000","last_peered":"2024-09-17T06:07:50.700935+0000","last_clean":"2024-09-17T06:07:50.700935+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:07:50.700935+0000","last_undegraded":"2024-09-17T06:07:50.700935+0000","last_fullsized":"2024-09-17T06:07:50.700935+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.595562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.305297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700008+0000","last_change":"2024-09-17T06:06:44.685583+0000","last_active":"2024-09-17T06:07:50.700008+0000","last_peered":"2024-09-17T06:07:50.700008+0000","last_clean":"2024-09-17T06:07:50.700008+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:07:50.700008+0000","last_undegraded":"2024-09-17T06:07:50.700008+0000","last_fullsized":"2024-09-17T06:07:50.700008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.685386+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:42.733827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221010+0000","last_change":"2024-09-17T06:06:41.096528+0000","last_active":"2024-09-17T06:07:51.221010+0000","last_peered":"2024-09-17T06:07:51.221010+0000","last_clean":"2024-09-17T06:07:51.221010+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:07:51.221010+0000","last_undegraded":"2024-09-17T06:07:51.221010+0000","last_fullsized":"2024-09-17T06:07:51.221010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.096443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.182798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223139+0000","last_change":"2024-09-17T06:06:51.955862+0000","last_active":"2024-09-17T06:07:51.223139+0000","last_peered":"2024-09-17T06:07:51.223139+0000","last_clean":"2024-09-17T06:07:51.223139+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:07:51.223139+0000","last_undegraded":"2024-09-17T06:07:51.223139+0000","last_fullsized":"2024-09-17T06:07:51.223139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.955662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.579450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":73,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695797+0000","last_change":"2024-09-17T06:06:41.561023+0000","last_active":"2024-09-17T06:07:50.695797+0000","last_peered":"2024-09-17T06:07:50.695797+0000","last_clean":"2024-09-17T06:07:50.695797+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:07:50.695797+0000","last_undegraded":"2024-09-17T06:07:50.695797+0000","last_fullsized":"2024-09-17T06:07:50.695797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.560833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:35.979151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840821+0000","last_change":"2024-09-17T06:06:51.569920+0000","last_active":"2024-09-17T06:07:50.840821+0000","last_peered":"2024-09-17T06:07:50.840821+0000","last_clean":"2024-09-17T06:07:50.840821+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:07:50.840821+0000","last_undegraded":"2024-09-17T06:07:50.840821+0000","last_fullsized":"2024-09-17T06:07:50.840821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.569724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:16.044884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699903+0000","last_change":"2024-09-17T06:06:54.534994+0000","last_active":"2024-09-17T06:07:50.699903+0000","last_peered":"2024-09-17T06:07:50.699903+0000","last_clean":"2024-09-17T06:07:50.699903+0000","last_became_active":"2024-09-17T06:06:49.862233+0000","last_became_peered":"2024-09-17T06:06:49.862233+0000","last_unstale":"2024-09-17T06:07:50.699903+0000","last_undegraded":"2024-09-17T06:07:50.699903+0000","last_fullsized":"2024-09-17T06:07:50.699903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.534811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:53.555338+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.534811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:09.975013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,1],"acting":[4,2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225630+0000","last_change":"2024-09-17T06:06:39.595362+0000","last_active":"2024-09-17T06:07:51.225630+0000","last_peered":"2024-09-17T06:07:51.225630+0000","last_clean":"2024-09-17T06:07:51.225630+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:07:51.225630+0000","last_undegraded":"2024-09-17T06:07:51.225630+0000","last_fullsized":"2024-09-17T06:07:51.225630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.595150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:36.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697737+0000","last_change":"2024-09-17T06:06:41.345210+0000","last_active":"2024-09-17T06:07:50.697737+0000","last_peered":"2024-09-17T06:07:50.697737+0000","last_clean":"2024-09-17T06:07:50.697737+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:07:50.697737+0000","last_undegraded":"2024-09-17T06:07:50.697737+0000","last_fullsized":"2024-09-17T06:07:50.697737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.345015+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:38.207077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696384+0000","last_change":"2024-09-17T06:06:44.540629+0000","last_active":"2024-09-17T06:07:50.696384+0000","last_peered":"2024-09-17T06:07:50.696384+0000","last_clean":"2024-09-17T06:07:50.696384+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:07:50.696384+0000","last_undegraded":"2024-09-17T06:07:50.696384+0000","last_fullsized":"2024-09-17T06:07:50.696384+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.540426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:03.473101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700607+0000","last_change":"2024-09-17T06:06:43.669448+0000","last_active":"2024-09-17T06:07:50.700607+0000","last_peered":"2024-09-17T06:07:50.700607+0000","last_clean":"2024-09-17T06:07:50.700607+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:07:50.700607+0000","last_undegraded":"2024-09-17T06:07:50.700607+0000","last_fullsized":"2024-09-17T06:07:50.700607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.669209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:54.877316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222424+0000","last_change":"2024-09-17T06:06:38.067895+0000","last_active":"2024-09-17T06:07:51.222424+0000","last_peered":"2024-09-17T06:07:51.222424+0000","last_clean":"2024-09-17T06:07:51.222424+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:07:51.222424+0000","last_undegraded":"2024-09-17T06:07:51.222424+0000","last_fullsized":"2024-09-17T06:07:51.222424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.067715+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:26.508119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.230386+0000","last_change":"2024-09-17T06:07:51.228200+0000","last_active":"2024-09-17T06:07:51.230386+0000","last_peered":"2024-09-17T06:07:51.230386+0000","last_clean":"2024-09-17T06:07:51.230386+0000","last_became_active":"2024-09-17T06:07:51.226510+0000","last_became_peered":"2024-09-17T06:07:51.226510+0000","last_unstale":"2024-09-17T06:07:51.230386+0000","last_undegraded":"2024-09-17T06:07:51.230386+0000","last_fullsized":"2024-09-17T06:07:51.230386+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.651441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:14.647137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221616+0000","last_change":"2024-09-17T06:06:45.060936+0000","last_active":"2024-09-17T06:07:51.221616+0000","last_peered":"2024-09-17T06:07:51.221616+0000","last_clean":"2024-09-17T06:07:51.221616+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:07:51.221616+0000","last_undegraded":"2024-09-17T06:07:51.221616+0000","last_fullsized":"2024-09-17T06:07:51.221616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.060719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:03.842916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842537+0000","last_change":"2024-09-17T06:06:43.537259+0000","last_active":"2024-09-17T06:07:50.842537+0000","last_peered":"2024-09-17T06:07:50.842537+0000","last_clean":"2024-09-17T06:07:50.842537+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:07:50.842537+0000","last_undegraded":"2024-09-17T06:07:50.842537+0000","last_fullsized":"2024-09-17T06:07:50.842537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.537064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:53.557183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224692+0000","last_change":"2024-09-17T06:06:50.588334+0000","last_active":"2024-09-17T06:07:51.224692+0000","last_peered":"2024-09-17T06:07:51.224692+0000","last_clean":"2024-09-17T06:07:51.224692+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:07:51.224692+0000","last_undegraded":"2024-09-17T06:07:51.224692+0000","last_fullsized":"2024-09-17T06:07:51.224692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.588146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:34.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220191+0000","last_change":"2024-09-17T06:06:45.560755+0000","last_active":"2024-09-17T06:07:51.220191+0000","last_peered":"2024-09-17T06:07:51.220191+0000","last_clean":"2024-09-17T06:07:51.220191+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:07:51.220191+0000","last_undegraded":"2024-09-17T06:07:51.220191+0000","last_fullsized":"2024-09-17T06:07:51.220191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.560562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.352415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221768+0000","last_change":"2024-09-17T06:06:40.077709+0000","last_active":"2024-09-17T06:07:51.221768+0000","last_peered":"2024-09-17T06:07:51.221768+0000","last_clean":"2024-09-17T06:07:51.221768+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:07:51.221768+0000","last_undegraded":"2024-09-17T06:07:51.221768+0000","last_fullsized":"2024-09-17T06:07:51.221768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.077616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:13.235085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220023+0000","last_change":"2024-09-17T06:06:50.943563+0000","last_active":"2024-09-17T06:07:51.220023+0000","last_peered":"2024-09-17T06:07:51.220023+0000","last_clean":"2024-09-17T06:07:51.220023+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:07:51.220023+0000","last_undegraded":"2024-09-17T06:07:51.220023+0000","last_fullsized":"2024-09-17T06:07:51.220023+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.943366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.661632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700452+0000","last_change":"2024-09-17T06:06:39.544246+0000","last_active":"2024-09-17T06:07:50.700452+0000","last_peered":"2024-09-17T06:07:50.700452+0000","last_clean":"2024-09-17T06:07:50.700452+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:07:50.700452+0000","last_undegraded":"2024-09-17T06:07:50.700452+0000","last_fullsized":"2024-09-17T06:07:50.700452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.544002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:04.906600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219385+0000","last_change":"2024-09-17T06:06:41.601594+0000","last_active":"2024-09-17T06:07:51.219385+0000","last_peered":"2024-09-17T06:07:51.219385+0000","last_clean":"2024-09-17T06:07:51.219385+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:07:51.219385+0000","last_undegraded":"2024-09-17T06:07:51.219385+0000","last_fullsized":"2024-09-17T06:07:51.219385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.601393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.687748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221448+0000","last_change":"2024-09-17T06:06:49.922504+0000","last_active":"2024-09-17T06:07:51.221448+0000","last_peered":"2024-09-17T06:07:51.221448+0000","last_clean":"2024-09-17T06:07:51.221448+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:07:51.221448+0000","last_undegraded":"2024-09-17T06:07:51.221448+0000","last_fullsized":"2024-09-17T06:07:51.221448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.922302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:53.344154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222935+0000","last_change":"2024-09-17T06:06:42.067931+0000","last_active":"2024-09-17T06:07:51.222935+0000","last_peered":"2024-09-17T06:07:51.222935+0000","last_clean":"2024-09-17T06:07:51.222935+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:07:51.222935+0000","last_undegraded":"2024-09-17T06:07:51.222935+0000","last_fullsized":"2024-09-17T06:07:51.222935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.067737+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.818001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693159+0000","last_change":"2024-09-17T06:06:38.338953+0000","last_active":"2024-09-17T06:07:50.693159+0000","last_peered":"2024-09-17T06:07:50.693159+0000","last_clean":"2024-09-17T06:07:50.693159+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:07:50.693159+0000","last_undegraded":"2024-09-17T06:07:50.693159+0000","last_fullsized":"2024-09-17T06:07:50.693159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.338737+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:58.670904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223389+0000","last_change":"2024-09-17T06:06:47.938470+0000","last_active":"2024-09-17T06:07:51.223389+0000","last_peered":"2024-09-17T06:07:51.223389+0000","last_clean":"2024-09-17T06:07:51.223389+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:07:51.223389+0000","last_undegraded":"2024-09-17T06:07:51.223389+0000","last_fullsized":"2024-09-17T06:07:51.223389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.938263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.607027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221642+0000","last_change":"2024-09-17T06:06:41.585374+0000","last_active":"2024-09-17T06:07:51.221642+0000","last_peered":"2024-09-17T06:07:51.221642+0000","last_clean":"2024-09-17T06:07:51.221642+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:07:51.221642+0000","last_undegraded":"2024-09-17T06:07:51.221642+0000","last_fullsized":"2024-09-17T06:07:51.221642+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.585183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:11.929990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841022+0000","last_change":"2024-09-17T06:06:42.536575+0000","last_active":"2024-09-17T06:07:50.841022+0000","last_peered":"2024-09-17T06:07:50.841022+0000","last_clean":"2024-09-17T06:07:50.841022+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:07:50.841022+0000","last_undegraded":"2024-09-17T06:07:50.841022+0000","last_fullsized":"2024-09-17T06:07:50.841022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.536371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:23.547872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225264+0000","last_change":"2024-09-17T06:06:47.627398+0000","last_active":"2024-09-17T06:07:51.225264+0000","last_peered":"2024-09-17T06:07:51.225264+0000","last_clean":"2024-09-17T06:07:51.225264+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:07:51.225264+0000","last_undegraded":"2024-09-17T06:07:51.225264+0000","last_fullsized":"2024-09-17T06:07:51.225264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.627188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:28.206295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699239+0000","last_change":"2024-09-17T06:06:42.642781+0000","last_active":"2024-09-17T06:07:50.699239+0000","last_peered":"2024-09-17T06:07:50.699239+0000","last_clean":"2024-09-17T06:07:50.699239+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:07:50.699239+0000","last_undegraded":"2024-09-17T06:07:50.699239+0000","last_fullsized":"2024-09-17T06:07:50.699239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.642468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:03.874053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219489+0000","last_change":"2024-09-17T06:06:40.563124+0000","last_active":"2024-09-17T06:07:51.219489+0000","last_peered":"2024-09-17T06:07:51.219489+0000","last_clean":"2024-09-17T06:07:51.219489+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:07:51.219489+0000","last_undegraded":"2024-09-17T06:07:51.219489+0000","last_fullsized":"2024-09-17T06:07:51.219489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.562781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:51.528772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"81'74","reported_seq":248,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841224+0000","last_change":"2024-09-17T06:06:41.529207+0000","last_active":"2024-09-17T06:07:50.841224+0000","last_peered":"2024-09-17T06:07:50.841224+0000","last_clean":"2024-09-17T06:07:50.841224+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:07:50.841224+0000","last_undegraded":"2024-09-17T06:07:50.841224+0000","last_fullsized":"2024-09-17T06:07:50.841224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'74","last_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_deep_scrub":"81'74","last_deep_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.529006+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:17.811347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698161+0000","last_change":"2024-09-17T06:06:50.168189+0000","last_active":"2024-09-17T06:07:50.698161+0000","last_peered":"2024-09-17T06:07:50.698161+0000","last_clean":"2024-09-17T06:07:50.698161+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:07:50.698161+0000","last_undegraded":"2024-09-17T06:07:50.698161+0000","last_fullsized":"2024-09-17T06:07:50.698161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.167993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:53.277144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693347+0000","last_change":"2024-09-17T06:06:46.470862+0000","last_active":"2024-09-17T06:07:50.693347+0000","last_peered":"2024-09-17T06:07:50.693347+0000","last_clean":"2024-09-17T06:07:50.693347+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:07:50.693347+0000","last_undegraded":"2024-09-17T06:07:50.693347+0000","last_fullsized":"2024-09-17T06:07:50.693347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.470640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:54.803752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693739+0000","last_change":"2024-09-17T06:06:39.308543+0000","last_active":"2024-09-17T06:07:50.693739+0000","last_peered":"2024-09-17T06:07:50.693739+0000","last_clean":"2024-09-17T06:07:50.693739+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:07:50.693739+0000","last_undegraded":"2024-09-17T06:07:50.693739+0000","last_fullsized":"2024-09-17T06:07:50.693739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.308468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:26.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695342+0000","last_change":"2024-09-17T06:06:55.194732+0000","last_active":"2024-09-17T06:07:50.695342+0000","last_peered":"2024-09-17T06:07:50.695342+0000","last_clean":"2024-09-17T06:07:50.695342+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:07:50.695342+0000","last_undegraded":"2024-09-17T06:07:50.695342+0000","last_fullsized":"2024-09-17T06:07:50.695342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.194477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:46.395618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220138+0000","last_change":"2024-09-17T06:06:47.481798+0000","last_active":"2024-09-17T06:07:51.220138+0000","last_peered":"2024-09-17T06:07:51.220138+0000","last_clean":"2024-09-17T06:07:51.220138+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:07:51.220138+0000","last_undegraded":"2024-09-17T06:07:51.220138+0000","last_fullsized":"2024-09-17T06:07:51.220138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.481588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.150352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221032+0000","last_change":"2024-09-17T06:06:43.064298+0000","last_active":"2024-09-17T06:07:51.221032+0000","last_peered":"2024-09-17T06:07:51.221032+0000","last_clean":"2024-09-17T06:07:51.221032+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:07:51.221032+0000","last_undegraded":"2024-09-17T06:07:51.221032+0000","last_fullsized":"2024-09-17T06:07:51.221032+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.064096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:30.993498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225249+0000","last_change":"2024-09-17T06:06:52.593990+0000","last_active":"2024-09-17T06:07:51.225249+0000","last_peered":"2024-09-17T06:07:51.225249+0000","last_clean":"2024-09-17T06:07:51.225249+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:07:51.225249+0000","last_undegraded":"2024-09-17T06:07:51.225249+0000","last_fullsized":"2024-09-17T06:07:51.225249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.593787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:04.850781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":166,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842733+0000","last_change":"2024-09-17T06:06:46.576306+0000","last_active":"2024-09-17T06:07:50.842733+0000","last_peered":"2024-09-17T06:07:50.842733+0000","last_clean":"2024-09-17T06:07:50.842733+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:07:50.842733+0000","last_undegraded":"2024-09-17T06:07:50.842733+0000","last_fullsized":"2024-09-17T06:07:50.842733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:36.552616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'3","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.694092+0000","last_change":"2024-09-17T06:06:40.289371+0000","last_active":"2024-09-17T06:07:50.694092+0000","last_peered":"2024-09-17T06:07:50.694092+0000","last_clean":"2024-09-17T06:07:50.694092+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:07:50.694092+0000","last_undegraded":"2024-09-17T06:07:50.694092+0000","last_fullsized":"2024-09-17T06:07:50.694092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.289195+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.187275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218747+0000","last_change":"2024-09-17T06:06:57.580034+0000","last_active":"2024-09-17T06:07:51.218747+0000","last_peered":"2024-09-17T06:07:51.218747+0000","last_clean":"2024-09-17T06:07:51.218747+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:07:51.218747+0000","last_undegraded":"2024-09-17T06:07:51.218747+0000","last_fullsized":"2024-09-17T06:07:51.218747+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.579707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:15.990501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842467+0000","last_change":"2024-09-17T06:06:53.554156+0000","last_active":"2024-09-17T06:07:50.842467+0000","last_peered":"2024-09-17T06:07:50.842467+0000","last_clean":"2024-09-17T06:07:50.842467+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:07:50.842467+0000","last_undegraded":"2024-09-17T06:07:50.842467+0000","last_fullsized":"2024-09-17T06:07:50.842467+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.553919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:37.374837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700114+0000","last_change":"2024-09-17T06:06:40.545470+0000","last_active":"2024-09-17T06:07:50.700114+0000","last_peered":"2024-09-17T06:07:50.700114+0000","last_clean":"2024-09-17T06:07:50.700114+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:07:50.700114+0000","last_undegraded":"2024-09-17T06:07:50.700114+0000","last_fullsized":"2024-09-17T06:07:50.700114+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.545271+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:41.942375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696784+0000","last_change":"2024-09-17T06:06:46.553900+0000","last_active":"2024-09-17T06:07:50.696784+0000","last_peered":"2024-09-17T06:07:50.696784+0000","last_clean":"2024-09-17T06:07:50.696784+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:07:50.696784+0000","last_undegraded":"2024-09-17T06:07:50.696784+0000","last_fullsized":"2024-09-17T06:07:50.696784+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.553594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:37.347089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841231+0000","last_change":"2024-09-17T06:06:49.557072+0000","last_active":"2024-09-17T06:07:50.841231+0000","last_peered":"2024-09-17T06:07:50.841231+0000","last_clean":"2024-09-17T06:07:50.841231+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:07:50.841231+0000","last_undegraded":"2024-09-17T06:07:50.841231+0000","last_fullsized":"2024-09-17T06:07:50.841231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.556746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:02.173527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'13","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693261+0000","last_change":"2024-09-17T06:06:41.327726+0000","last_active":"2024-09-17T06:07:50.693261+0000","last_peered":"2024-09-17T06:07:50.693261+0000","last_clean":"2024-09-17T06:07:50.693261+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:07:50.693261+0000","last_undegraded":"2024-09-17T06:07:50.693261+0000","last_fullsized":"2024-09-17T06:07:50.693261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'13","last_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_deep_scrub":"81'13","last_deep_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.327620+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:41.975086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225072+0000","last_change":"2024-09-17T06:06:48.590089+0000","last_active":"2024-09-17T06:07:51.225072+0000","last_peered":"2024-09-17T06:07:51.225072+0000","last_clean":"2024-09-17T06:07:51.225072+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:07:51.225072+0000","last_undegraded":"2024-09-17T06:07:51.225072+0000","last_fullsized":"2024-09-17T06:07:51.225072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.589881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:13.065040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695729+0000","last_change":"2024-09-17T06:06:47.234619+0000","last_active":"2024-09-17T06:07:50.695729+0000","last_peered":"2024-09-17T06:07:50.695729+0000","last_clean":"2024-09-17T06:07:50.695729+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:07:50.695729+0000","last_undegraded":"2024-09-17T06:07:50.695729+0000","last_fullsized":"2024-09-17T06:07:50.695729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.234392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:10.297041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696310+0000","last_change":"2024-09-17T06:06:42.362985+0000","last_active":"2024-09-17T06:07:50.696310+0000","last_peered":"2024-09-17T06:07:50.696310+0000","last_clean":"2024-09-17T06:07:50.696310+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:07:50.696310+0000","last_undegraded":"2024-09-17T06:07:50.696310+0000","last_fullsized":"2024-09-17T06:07:50.696310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.362795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:21.306942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700186+0000","last_change":"2024-09-17T06:06:54.645399+0000","last_active":"2024-09-17T06:07:50.700186+0000","last_peered":"2024-09-17T06:07:50.700186+0000","last_clean":"2024-09-17T06:07:50.700186+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:07:50.700186+0000","last_undegraded":"2024-09-17T06:07:50.700186+0000","last_fullsized":"2024-09-17T06:07:50.700186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.645200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:04.728298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841519+0000","last_change":"2024-09-17T06:06:48.595269+0000","last_active":"2024-09-17T06:07:50.841519+0000","last_peered":"2024-09-17T06:07:50.841519+0000","last_clean":"2024-09-17T06:07:50.841519+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:07:50.841519+0000","last_undegraded":"2024-09-17T06:07:50.841519+0000","last_fullsized":"2024-09-17T06:07:50.841519+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.595073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:51.297831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219232+0000","last_change":"2024-09-17T06:06:42.583243+0000","last_active":"2024-09-17T06:07:51.219232+0000","last_peered":"2024-09-17T06:07:51.219232+0000","last_clean":"2024-09-17T06:07:51.219232+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:07:51.219232+0000","last_undegraded":"2024-09-17T06:07:51.219232+0000","last_fullsized":"2024-09-17T06:07:51.219232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.583048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:54.333313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699457+0000","last_change":"2024-09-17T06:06:57.607574+0000","last_active":"2024-09-17T06:07:50.699457+0000","last_peered":"2024-09-17T06:07:50.699457+0000","last_clean":"2024-09-17T06:07:50.699457+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:07:50.699457+0000","last_undegraded":"2024-09-17T06:07:50.699457+0000","last_fullsized":"2024-09-17T06:07:50.699457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.607379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:56.898447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222617+0000","last_change":"2024-09-17T06:06:45.591584+0000","last_active":"2024-09-17T06:07:51.222617+0000","last_peered":"2024-09-17T06:07:51.222617+0000","last_clean":"2024-09-17T06:07:51.222617+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:07:51.222617+0000","last_undegraded":"2024-09-17T06:07:51.222617+0000","last_fullsized":"2024-09-17T06:07:51.222617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.591276+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:08.653925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.226251+0000","last_change":"2024-09-17T06:06:37.667757+0000","last_active":"2024-09-17T06:07:51.226251+0000","last_peered":"2024-09-17T06:07:51.226251+0000","last_clean":"2024-09-17T06:07:51.226251+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:07:51.226251+0000","last_undegraded":"2024-09-17T06:07:51.226251+0000","last_fullsized":"2024-09-17T06:07:51.226251+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_clean_scrub_stamp":"2024-09-17T06:06:37.667675+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:46.885860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219774+0000","last_change":"2024-09-17T06:06:56.615164+0000","last_active":"2024-09-17T06:07:51.219774+0000","last_peered":"2024-09-17T06:07:51.219774+0000","last_clean":"2024-09-17T06:07:51.219774+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:07:51.219774+0000","last_undegraded":"2024-09-17T06:07:51.219774+0000","last_fullsized":"2024-09-17T06:07:51.219774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.614970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:07.482666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841824+0000","last_change":"2024-09-17T06:06:52.577732+0000","last_active":"2024-09-17T06:07:50.841824+0000","last_peered":"2024-09-17T06:07:50.841824+0000","last_clean":"2024-09-17T06:07:50.841824+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:07:50.841824+0000","last_undegraded":"2024-09-17T06:07:50.841824+0000","last_fullsized":"2024-09-17T06:07:50.841824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.577533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:34.161856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":174,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697843+0000","last_change":"2024-09-17T06:06:43.358428+0000","last_active":"2024-09-17T06:07:50.697843+0000","last_peered":"2024-09-17T06:07:50.697843+0000","last_clean":"2024-09-17T06:07:50.697843+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:07:50.697843+0000","last_undegraded":"2024-09-17T06:07:50.697843+0000","last_fullsized":"2024-09-17T06:07:50.697843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'27","last_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_deep_scrub":"81'27","last_deep_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.358219+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:13.703025+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":145,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220392+0000","last_change":"2024-09-17T06:06:52.944474+0000","last_active":"2024-09-17T06:07:51.220392+0000","last_peered":"2024-09-17T06:07:51.220392+0000","last_clean":"2024-09-17T06:07:51.220392+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:07:51.220392+0000","last_undegraded":"2024-09-17T06:07:51.220392+0000","last_fullsized":"2024-09-17T06:07:51.220392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.944213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.533972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699872+0000","last_change":"2024-09-17T06:06:43.557285+0000","last_active":"2024-09-17T06:07:50.699872+0000","last_peered":"2024-09-17T06:07:50.699872+0000","last_clean":"2024-09-17T06:07:50.699872+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:07:50.699872+0000","last_undegraded":"2024-09-17T06:07:50.699872+0000","last_fullsized":"2024-09-17T06:07:50.699872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.557090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:01.412234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"81'9","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220308+0000","last_change":"2024-09-17T06:06:43.599342+0000","last_active":"2024-09-17T06:07:51.220308+0000","last_peered":"2024-09-17T06:07:51.220308+0000","last_clean":"2024-09-17T06:07:51.220308+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:07:51.220308+0000","last_undegraded":"2024-09-17T06:07:51.220308+0000","last_fullsized":"2024-09-17T06:07:51.220308+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.599114+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:49.432076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699698+0000","last_change":"2024-09-17T06:06:49.561761+0000","last_active":"2024-09-17T06:07:50.699698+0000","last_peered":"2024-09-17T06:07:50.699698+0000","last_clean":"2024-09-17T06:07:50.699698+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:07:50.699698+0000","last_undegraded":"2024-09-17T06:07:50.699698+0000","last_fullsized":"2024-09-17T06:07:50.699698+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.561572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:15.208406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223672+0000","last_change":"2024-09-17T06:06:40.581076+0000","last_active":"2024-09-17T06:07:51.223672+0000","last_peered":"2024-09-17T06:07:51.223672+0000","last_clean":"2024-09-17T06:07:51.223672+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:07:51.223672+0000","last_undegraded":"2024-09-17T06:07:51.223672+0000","last_fullsized":"2024-09-17T06:07:51.223672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.580978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:19.525125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220215+0000","last_change":"2024-09-17T06:06:44.589361+0000","last_active":"2024-09-17T06:07:51.220215+0000","last_peered":"2024-09-17T06:07:51.220215+0000","last_clean":"2024-09-17T06:07:51.220215+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:07:51.220215+0000","last_undegraded":"2024-09-17T06:07:51.220215+0000","last_fullsized":"2024-09-17T06:07:51.220215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.589149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.705503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":118,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699654+0000","last_change":"2024-09-17T06:06:58.599122+0000","last_active":"2024-09-17T06:07:50.699654+0000","last_peered":"2024-09-17T06:07:50.699654+0000","last_clean":"2024-09-17T06:07:50.699654+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:07:50.699654+0000","last_undegraded":"2024-09-17T06:07:50.699654+0000","last_fullsized":"2024-09-17T06:07:50.699654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_clean_scrub_stamp":"2024-09-17T06:06:58.598909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.505821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220121+0000","last_change":"2024-09-17T06:06:48.493667+0000","last_active":"2024-09-17T06:07:51.220121+0000","last_peered":"2024-09-17T06:07:51.220121+0000","last_clean":"2024-09-17T06:07:51.220121+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:07:51.220121+0000","last_undegraded":"2024-09-17T06:07:51.220121+0000","last_fullsized":"2024-09-17T06:07:51.220121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.493470+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.837170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697241+0000","last_change":"2024-09-17T06:06:44.333474+0000","last_active":"2024-09-17T06:07:50.697241+0000","last_peered":"2024-09-17T06:07:50.697241+0000","last_clean":"2024-09-17T06:07:50.697241+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:07:50.697241+0000","last_undegraded":"2024-09-17T06:07:50.697241+0000","last_fullsized":"2024-09-17T06:07:50.697241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.333150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.158751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698517+0000","last_change":"2024-09-17T06:06:52.699338+0000","last_active":"2024-09-17T06:07:50.698517+0000","last_peered":"2024-09-17T06:07:50.698517+0000","last_clean":"2024-09-17T06:07:50.698517+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:07:50.698517+0000","last_undegraded":"2024-09-17T06:07:50.698517+0000","last_fullsized":"2024-09-17T06:07:50.698517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.699134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:51.626769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224692+0000","last_change":"2024-09-17T06:06:49.633934+0000","last_active":"2024-09-17T06:07:51.224692+0000","last_peered":"2024-09-17T06:07:51.224692+0000","last_clean":"2024-09-17T06:07:51.224692+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:07:51.224692+0000","last_undegraded":"2024-09-17T06:07:51.224692+0000","last_fullsized":"2024-09-17T06:07:51.224692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.633660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.217982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220316+0000","last_change":"2024-09-17T06:06:46.974853+0000","last_active":"2024-09-17T06:07:51.220316+0000","last_peered":"2024-09-17T06:07:51.220316+0000","last_clean":"2024-09-17T06:07:51.220316+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:07:51.220316+0000","last_undegraded":"2024-09-17T06:07:51.220316+0000","last_fullsized":"2024-09-17T06:07:51.220316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.974637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:26.337532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219068+0000","last_change":"2024-09-17T06:06:46.527438+0000","last_active":"2024-09-17T06:07:51.219068+0000","last_peered":"2024-09-17T06:07:51.219068+0000","last_clean":"2024-09-17T06:07:51.219068+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:07:51.219068+0000","last_undegraded":"2024-09-17T06:07:51.219068+0000","last_fullsized":"2024-09-17T06:07:51.219068+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.527230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:25.890125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696741+0000","last_change":"2024-09-17T06:06:54.199209+0000","last_active":"2024-09-17T06:07:50.696741+0000","last_peered":"2024-09-17T06:07:50.696741+0000","last_clean":"2024-09-17T06:07:50.696741+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:07:50.696741+0000","last_undegraded":"2024-09-17T06:07:50.696741+0000","last_fullsized":"2024-09-17T06:07:50.696741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.198989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:51.609301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699785+0000","last_change":"2024-09-17T06:06:46.699017+0000","last_active":"2024-09-17T06:07:50.699785+0000","last_peered":"2024-09-17T06:07:50.699785+0000","last_clean":"2024-09-17T06:07:50.699785+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:07:50.699785+0000","last_undegraded":"2024-09-17T06:07:50.699785+0000","last_fullsized":"2024-09-17T06:07:50.699785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.698821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:33.586359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698807+0000","last_change":"2024-09-17T06:06:40.624617+0000","last_active":"2024-09-17T06:07:50.698807+0000","last_peered":"2024-09-17T06:07:50.698807+0000","last_clean":"2024-09-17T06:07:50.698807+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:07:50.698807+0000","last_undegraded":"2024-09-17T06:07:50.698807+0000","last_fullsized":"2024-09-17T06:07:50.698807+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.624540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:48.054970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696085+0000","last_change":"2024-09-17T06:06:45.311790+0000","last_active":"2024-09-17T06:07:50.696085+0000","last_peered":"2024-09-17T06:07:50.696085+0000","last_clean":"2024-09-17T06:07:50.696085+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:07:50.696085+0000","last_undegraded":"2024-09-17T06:07:50.696085+0000","last_fullsized":"2024-09-17T06:07:50.696085+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.311572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:05.215110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225756+0000","last_change":"2024-09-17T06:06:43.594929+0000","last_active":"2024-09-17T06:07:51.225756+0000","last_peered":"2024-09-17T06:07:51.225756+0000","last_clean":"2024-09-17T06:07:51.225756+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:07:51.225756+0000","last_undegraded":"2024-09-17T06:07:51.225756+0000","last_fullsized":"2024-09-17T06:07:51.225756+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.594608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:54.666206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693105+0000","last_change":"2024-09-17T06:06:44.420446+0000","last_active":"2024-09-17T06:07:50.693105+0000","last_peered":"2024-09-17T06:07:50.693105+0000","last_clean":"2024-09-17T06:07:50.693105+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:07:50.693105+0000","last_undegraded":"2024-09-17T06:07:50.693105+0000","last_fullsized":"2024-09-17T06:07:50.693105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.420226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:35.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698825+0000","last_change":"2024-09-17T06:06:39.644661+0000","last_active":"2024-09-17T06:07:50.698825+0000","last_peered":"2024-09-17T06:07:50.698825+0000","last_clean":"2024-09-17T06:07:50.698825+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:07:50.698825+0000","last_undegraded":"2024-09-17T06:07:50.698825+0000","last_fullsized":"2024-09-17T06:07:50.698825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.644581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:43.034866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695221+0000","last_change":"2024-09-17T06:06:42.552587+0000","last_active":"2024-09-17T06:07:50.695221+0000","last_peered":"2024-09-17T06:07:50.695221+0000","last_clean":"2024-09-17T06:07:50.695221+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:07:50.695221+0000","last_undegraded":"2024-09-17T06:07:50.695221+0000","last_fullsized":"2024-09-17T06:07:50.695221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.552253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:16.204277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":133,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699293+0000","last_change":"2024-09-17T06:06:59.590058+0000","last_active":"2024-09-17T06:07:50.699293+0000","last_peered":"2024-09-17T06:07:50.699293+0000","last_clean":"2024-09-17T06:07:50.699293+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:07:50.699293+0000","last_undegraded":"2024-09-17T06:07:50.699293+0000","last_fullsized":"2024-09-17T06:07:50.699293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_clean_scrub_stamp":"2024-09-17T06:06:59.589844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:13.777383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695142+0000","last_change":"2024-09-17T06:06:49.212293+0000","last_active":"2024-09-17T06:07:50.695142+0000","last_peered":"2024-09-17T06:07:50.695142+0000","last_clean":"2024-09-17T06:07:50.695142+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:07:50.695142+0000","last_undegraded":"2024-09-17T06:07:50.695142+0000","last_fullsized":"2024-09-17T06:07:50.695142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.211966+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:29.791073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693039+0000","last_change":"2024-09-17T06:06:43.370824+0000","last_active":"2024-09-17T06:07:50.693039+0000","last_peered":"2024-09-17T06:07:50.693039+0000","last_clean":"2024-09-17T06:07:50.693039+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:07:50.693039+0000","last_undegraded":"2024-09-17T06:07:50.693039+0000","last_fullsized":"2024-09-17T06:07:50.693039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.370630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:28.698931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219068+0000","last_change":"2024-09-17T06:06:50.490824+0000","last_active":"2024-09-17T06:07:51.219068+0000","last_peered":"2024-09-17T06:07:51.219068+0000","last_clean":"2024-09-17T06:07:51.219068+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:07:51.219068+0000","last_undegraded":"2024-09-17T06:07:51.219068+0000","last_fullsized":"2024-09-17T06:07:51.219068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.490494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.208761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":170,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225578+0000","last_change":"2024-09-17T06:06:54.564398+0000","last_active":"2024-09-17T06:07:51.225578+0000","last_peered":"2024-09-17T06:07:51.225578+0000","last_clean":"2024-09-17T06:07:51.225578+0000","last_became_active":"2024-09-17T06:06:49.863977+0000","last_became_peered":"2024-09-17T06:06:49.863977+0000","last_unstale":"2024-09-17T06:07:51.225578+0000","last_undegraded":"2024-09-17T06:07:51.225578+0000","last_fullsized":"2024-09-17T06:07:51.225578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:54.564097+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:53.583377+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.564097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:45.765238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700309+0000","last_change":"2024-09-17T06:06:48.701826+0000","last_active":"2024-09-17T06:07:50.700309+0000","last_peered":"2024-09-17T06:07:50.700309+0000","last_clean":"2024-09-17T06:07:50.700309+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:07:50.700309+0000","last_undegraded":"2024-09-17T06:07:50.700309+0000","last_fullsized":"2024-09-17T06:07:50.700309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.701596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:43:38.318752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220694+0000","last_change":"2024-09-17T06:06:44.071550+0000","last_active":"2024-09-17T06:07:51.220694+0000","last_peered":"2024-09-17T06:07:51.220694+0000","last_clean":"2024-09-17T06:07:51.220694+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:07:51.220694+0000","last_undegraded":"2024-09-17T06:07:51.220694+0000","last_fullsized":"2024-09-17T06:07:51.220694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.071343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:50.902738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699125+0000","last_change":"2024-09-17T06:06:48.219488+0000","last_active":"2024-09-17T06:07:50.699125+0000","last_peered":"2024-09-17T06:07:50.699125+0000","last_clean":"2024-09-17T06:07:50.699125+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:07:50.699125+0000","last_undegraded":"2024-09-17T06:07:50.699125+0000","last_fullsized":"2024-09-17T06:07:50.699125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.219293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:00.836074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":118,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700371+0000","last_change":"2024-09-17T06:06:50.710122+0000","last_active":"2024-09-17T06:07:50.700371+0000","last_peered":"2024-09-17T06:07:50.700371+0000","last_clean":"2024-09-17T06:07:50.700371+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:07:50.700371+0000","last_undegraded":"2024-09-17T06:07:50.700371+0000","last_fullsized":"2024-09-17T06:07:50.700371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.709804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:24.696128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218361+0000","last_change":"2024-09-17T06:06:51.502240+0000","last_active":"2024-09-17T06:07:51.218361+0000","last_peered":"2024-09-17T06:07:51.218361+0000","last_clean":"2024-09-17T06:07:51.218361+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:07:51.218361+0000","last_undegraded":"2024-09-17T06:07:51.218361+0000","last_fullsized":"2024-09-17T06:07:51.218361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.502041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.125829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":124,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698407+0000","last_change":"2024-09-17T06:06:49.687515+0000","last_active":"2024-09-17T06:07:50.698407+0000","last_peered":"2024-09-17T06:07:50.698407+0000","last_clean":"2024-09-17T06:07:50.698407+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:07:50.698407+0000","last_undegraded":"2024-09-17T06:07:50.698407+0000","last_fullsized":"2024-09-17T06:07:50.698407+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.687322+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:09.182168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692664+0000","last_change":"2024-09-17T06:06:49.761230+0000","last_active":"2024-09-17T06:07:50.692664+0000","last_peered":"2024-09-17T06:07:50.692664+0000","last_clean":"2024-09-17T06:07:50.692664+0000","last_became_active":"2024-09-17T06:06:49.760405+0000","last_became_peered":"2024-09-17T06:06:49.760405+0000","last_unstale":"2024-09-17T06:07:50.692664+0000","last_undegraded":"2024-09-17T06:07:50.692664+0000","last_fullsized":"2024-09-17T06:07:50.692664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:18.198271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224999+0000","last_change":"2024-09-17T06:06:51.561891+0000","last_active":"2024-09-17T06:07:51.224999+0000","last_peered":"2024-09-17T06:07:51.224999+0000","last_clean":"2024-09-17T06:07:51.224999+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:07:51.224999+0000","last_undegraded":"2024-09-17T06:07:51.224999+0000","last_fullsized":"2024-09-17T06:07:51.224999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.561576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:27.536230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697734+0000","last_change":"2024-09-17T06:06:51.171689+0000","last_active":"2024-09-17T06:07:50.697734+0000","last_peered":"2024-09-17T06:07:50.697734+0000","last_clean":"2024-09-17T06:07:50.697734+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:07:50.697734+0000","last_undegraded":"2024-09-17T06:07:50.697734+0000","last_fullsized":"2024-09-17T06:07:50.697734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.171493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:39.452849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842168+0000","last_change":"2024-09-17T06:06:55.610932+0000","last_active":"2024-09-17T06:07:50.842168+0000","last_peered":"2024-09-17T06:07:50.842168+0000","last_clean":"2024-09-17T06:07:50.842168+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:07:50.842168+0000","last_undegraded":"2024-09-17T06:07:50.842168+0000","last_fullsized":"2024-09-17T06:07:50.842168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.610700+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:07.867694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693902+0000","last_change":"2024-09-17T06:06:42.353051+0000","last_active":"2024-09-17T06:07:50.693902+0000","last_peered":"2024-09-17T06:07:50.693902+0000","last_clean":"2024-09-17T06:07:50.693902+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:07:50.693902+0000","last_undegraded":"2024-09-17T06:07:50.693902+0000","last_fullsized":"2024-09-17T06:07:50.693902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.352711+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:14.862093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220663+0000","last_change":"2024-09-17T06:06:52.529037+0000","last_active":"2024-09-17T06:07:51.220663+0000","last_peered":"2024-09-17T06:07:51.220663+0000","last_clean":"2024-09-17T06:07:51.220663+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:07:51.220663+0000","last_undegraded":"2024-09-17T06:07:51.220663+0000","last_fullsized":"2024-09-17T06:07:51.220663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.528843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.118602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219034+0000","last_change":"2024-09-17T06:06:53.547108+0000","last_active":"2024-09-17T06:07:51.219034+0000","last_peered":"2024-09-17T06:07:51.219034+0000","last_clean":"2024-09-17T06:07:51.219034+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:07:51.219034+0000","last_undegraded":"2024-09-17T06:07:51.219034+0000","last_fullsized":"2024-09-17T06:07:51.219034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.546853+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:05.208153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220626+0000","last_change":"2024-09-17T06:06:48.919436+0000","last_active":"2024-09-17T06:07:51.220626+0000","last_peered":"2024-09-17T06:07:51.220626+0000","last_clean":"2024-09-17T06:07:51.220626+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:07:51.220626+0000","last_undegraded":"2024-09-17T06:07:51.220626+0000","last_fullsized":"2024-09-17T06:07:51.220626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.919235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:27.262935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222606+0000","last_change":"2024-09-17T06:06:44.636882+0000","last_active":"2024-09-17T06:07:51.222606+0000","last_peered":"2024-09-17T06:07:51.222606+0000","last_clean":"2024-09-17T06:07:51.222606+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:07:51.222606+0000","last_undegraded":"2024-09-17T06:07:51.222606+0000","last_fullsized":"2024-09-17T06:07:51.222606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.636626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:44.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":88,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699044+0000","last_change":"2024-09-17T06:06:51.717905+0000","last_active":"2024-09-17T06:07:50.699044+0000","last_peered":"2024-09-17T06:07:50.699044+0000","last_clean":"2024-09-17T06:07:50.699044+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:07:50.699044+0000","last_undegraded":"2024-09-17T06:07:50.699044+0000","last_fullsized":"2024-09-17T06:07:50.699044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.717694+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:59.444208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700437+0000","last_change":"2024-09-17T06:06:45.539679+0000","last_active":"2024-09-17T06:07:50.700437+0000","last_peered":"2024-09-17T06:07:50.700437+0000","last_clean":"2024-09-17T06:07:50.700437+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:07:50.700437+0000","last_undegraded":"2024-09-17T06:07:50.700437+0000","last_fullsized":"2024-09-17T06:07:50.700437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.539468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:55.832105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698700+0000","last_change":"2024-09-17T06:06:52.213250+0000","last_active":"2024-09-17T06:07:50.698700+0000","last_peered":"2024-09-17T06:07:50.698700+0000","last_clean":"2024-09-17T06:07:50.698700+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:07:50.698700+0000","last_undegraded":"2024-09-17T06:07:50.698700+0000","last_fullsized":"2024-09-17T06:07:50.698700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.213042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:36.033960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699125+0000","last_change":"2024-09-17T06:06:53.226240+0000","last_active":"2024-09-17T06:07:50.699125+0000","last_peered":"2024-09-17T06:07:50.699125+0000","last_clean":"2024-09-17T06:07:50.699125+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:07:50.699125+0000","last_undegraded":"2024-09-17T06:07:50.699125+0000","last_fullsized":"2024-09-17T06:07:50.699125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'16","last_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_deep_scrub":"81'16","last_deep_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.226044+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:15.604828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842608+0000","last_change":"2024-09-17T06:06:50.593476+0000","last_active":"2024-09-17T06:07:50.842608+0000","last_peered":"2024-09-17T06:07:50.842608+0000","last_clean":"2024-09-17T06:07:50.842608+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:07:50.842608+0000","last_undegraded":"2024-09-17T06:07:50.842608+0000","last_fullsized":"2024-09-17T06:07:50.842608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.593281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.041524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697951+0000","last_change":"2024-09-17T06:06:53.662277+0000","last_active":"2024-09-17T06:07:50.697951+0000","last_peered":"2024-09-17T06:07:50.697951+0000","last_clean":"2024-09-17T06:07:50.697951+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:07:50.697951+0000","last_undegraded":"2024-09-17T06:07:50.697951+0000","last_fullsized":"2024-09-17T06:07:50.697951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.662083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:09.458813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840621+0000","last_change":"2024-09-17T06:06:54.601401+0000","last_active":"2024-09-17T06:07:50.840621+0000","last_peered":"2024-09-17T06:07:50.840621+0000","last_clean":"2024-09-17T06:07:50.840621+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:07:50.840621+0000","last_undegraded":"2024-09-17T06:07:50.840621+0000","last_fullsized":"2024-09-17T06:07:50.840621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.601206+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:30.575859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218778+0000","last_change":"2024-09-17T06:06:54.592256+0000","last_active":"2024-09-17T06:07:51.218778+0000","last_peered":"2024-09-17T06:07:51.218778+0000","last_clean":"2024-09-17T06:07:51.218778+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:07:51.218778+0000","last_undegraded":"2024-09-17T06:07:51.218778+0000","last_fullsized":"2024-09-17T06:07:51.218778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.591916+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:43.180179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840639+0000","last_change":"2024-09-17T06:06:57.597911+0000","last_active":"2024-09-17T06:07:50.840639+0000","last_peered":"2024-09-17T06:07:50.840639+0000","last_clean":"2024-09-17T06:07:50.840639+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:07:50.840639+0000","last_undegraded":"2024-09-17T06:07:50.840639+0000","last_fullsized":"2024-09-17T06:07:50.840639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.597715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:05.028145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219802+0000","last_change":"2024-09-17T06:06:55.569378+0000","last_active":"2024-09-17T06:07:51.219802+0000","last_peered":"2024-09-17T06:07:51.219802+0000","last_clean":"2024-09-17T06:07:51.219802+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:07:51.219802+0000","last_undegraded":"2024-09-17T06:07:51.219802+0000","last_fullsized":"2024-09-17T06:07:51.219802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.569171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:50.988830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222343+0000","last_change":"2024-09-17T06:06:46.576687+0000","last_active":"2024-09-17T06:07:51.222343+0000","last_peered":"2024-09-17T06:07:51.222343+0000","last_clean":"2024-09-17T06:07:51.222343+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:07:51.222343+0000","last_undegraded":"2024-09-17T06:07:51.222343+0000","last_fullsized":"2024-09-17T06:07:51.222343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:36.143901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222113+0000","last_change":"2024-09-17T06:06:46.022759+0000","last_active":"2024-09-17T06:07:51.222113+0000","last_peered":"2024-09-17T06:07:51.222113+0000","last_clean":"2024-09-17T06:07:51.222113+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:07:51.222113+0000","last_undegraded":"2024-09-17T06:07:51.222113+0000","last_fullsized":"2024-09-17T06:07:51.222113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.022447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.814300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842464+0000","last_change":"2024-09-17T06:06:56.620251+0000","last_active":"2024-09-17T06:07:50.842464+0000","last_peered":"2024-09-17T06:07:50.842464+0000","last_clean":"2024-09-17T06:07:50.842464+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:07:50.842464+0000","last_undegraded":"2024-09-17T06:07:50.842464+0000","last_fullsized":"2024-09-17T06:07:50.842464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.619933+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:00.010218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509506,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1044480,"data_stored":558879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509507,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":522541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509507,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1605632,"data_stored":1113225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1593344,"data_stored":1113079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509505,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":558467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906982,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":1007616,"data_stored":522255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509507,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":999424,"data_stored":522199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542209,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":999424,"data_stored":522219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:09:04.119 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:09:04.119 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T06:09:06.240 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:09:06.243 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:09:24.121 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:09:24.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.285+0000 7fb3bc587640 1 -- 172.21.15.122:0/2348352419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3a0003fe0 msgr2=0x7fb3a0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:24.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.285+0000 7fb3bc587640 1 --2- 172.21.15.122:0/2348352419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3a0003fe0 0x7fb3a0004810 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4074230 tx=0x7fb3a401d2c0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.285+0000 7fb3bab24640 1 -- 172.21.15.122:0/2348352419 reap_dead start 2024-09-17T06:09:24.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.285+0000 7fb3bc587640 1 -- 172.21.15.122:0/2348352419 shutdown_connections 2024-09-17T06:09:24.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.285+0000 7fb3bc587640 1 -- 172.21.15.122:0/2348352419 >> 172.21.15.122:0/2348352419 conn(0x7fb3b40746d0 msgr2=0x7fb3b4074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:24.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.285+0000 7fb3bc587640 1 -- 172.21.15.122:0/2348352419 shutdown_connections 2024-09-17T06:09:24.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.285+0000 7fb3bc587640 1 -- 172.21.15.122:0/2348352419 wait complete. 2024-09-17T06:09:24.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3bc587640 1 Processor -- start 2024-09-17T06:09:24.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3bc587640 1 -- start start 2024-09-17T06:09:24.293 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3bc587640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3b4153960 0x7fb3b40c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3bc587640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3b4145030 0x7fb3b4145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3bc587640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3b40c7280 0x7fb3b40c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3bc587640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b4158a70 con 0x7fb3b4145030 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3bc587640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b4158790 con 0x7fb3b40c7280 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3bc587640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b4158d50 con 0x7fb3b4153960 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3b9b22640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3b4145030 0x7fb3b4145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3b9b22640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3b4145030 0x7fb3b4145440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45218/0 (socket says 172.21.15.122:45218) 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3b9b22640 1 -- 172.21.15.122:0/2453528374 learned_addr learned my addr 172.21.15.122:0/2453528374 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3ba323640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3b4153960 0x7fb3b40c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3bab24640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3b40c7280 0x7fb3b40c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3b9b22640 1 -- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3b4153960 msgr2=0x7fb3b40c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3b9b22640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3b4153960 0x7fb3b40c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.294 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3b9b22640 1 -- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3b40c7280 msgr2=0x7fb3b40c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:24.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3b9b22640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3b40c7280 0x7fb3b40c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3b9b22640 1 -- 172.21.15.122:0/2453528374 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b4145980 con 0x7fb3b4145030 2024-09-17T06:09:24.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3b9b22640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3b4145030 0x7fb3b4145440 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb3a401d0f0 tx=0x7fb3a4009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:24.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3aaffd640 1 -- 172.21.15.122:0/2453528374 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a40bb030 con 0x7fb3b4145030 2024-09-17T06:09:24.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3aaffd640 1 -- 172.21.15.122:0/2453528374 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3a4004a90 con 0x7fb3b4145030 2024-09-17T06:09:24.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3bc587640 1 -- 172.21.15.122:0/2453528374 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b40c7bd0 con 0x7fb3b4145030 2024-09-17T06:09:24.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3aaffd640 1 -- 172.21.15.122:0/2453528374 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a40b7440 con 0x7fb3b4145030 2024-09-17T06:09:24.295 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3bc587640 1 -- 172.21.15.122:0/2453528374 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b415ada0 con 0x7fb3b4145030 2024-09-17T06:09:24.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.289+0000 7fb3bc587640 1 -- 172.21.15.122:0/2453528374 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b40c9f70 con 0x7fb3b4145030 2024-09-17T06:09:24.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.293+0000 7fb3aaffd640 1 -- 172.21.15.122:0/2453528374 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb3a40be030 con 0x7fb3b4145030 2024-09-17T06:09:24.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.293+0000 7fb3aaffd640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb398073200 0x7fb398075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:24.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.293+0000 7fb3aaffd640 1 -- 172.21.15.122:0/2453528374 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6854+0+0 (secure 0 0 0) 0x7fb3a412fd70 con 0x7fb3b4145030 2024-09-17T06:09:24.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.293+0000 7fb3ba323640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb398073200 0x7fb398075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:24.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.293+0000 7fb3ba323640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb398073200 0x7fb398075710 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009470 tx=0x7fb3b0009380 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:24.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.297+0000 7fb3aaffd640 1 -- 172.21.15.122:0/2453528374 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb3b40c7bd0 con 0x7fb3b4145030 2024-09-17T06:09:24.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.465+0000 7fb3bc587640 1 -- 172.21.15.122:0/2453528374 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3b40c33d0 con 0x7fb398073200 2024-09-17T06:09:24.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.481+0000 7fb3aaffd640 1 -- 172.21.15.122:0/2453528374 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332987 (secure 0 0 0) 0x7fb3b40c33d0 con 0x7fb398073200 2024-09-17T06:09:24.489 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:09:24.491 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:09:24.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.485+0000 7fb3bc587640 1 -- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb398073200 msgr2=0x7fb398075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:24.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.485+0000 7fb3bc587640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb398073200 0x7fb398075710 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009470 tx=0x7fb3b0009380 comp rx=0 tx=0).stop 2024-09-17T06:09:24.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.485+0000 7fb3bc587640 1 -- 172.21.15.122:0/2453528374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3b4145030 msgr2=0x7fb3b4145440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:24.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.485+0000 7fb3bc587640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3b4145030 0x7fb3b4145440 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb3a401d0f0 tx=0x7fb3a4009820 comp rx=0 tx=0).stop 2024-09-17T06:09:24.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.485+0000 7fb3bc587640 1 -- 172.21.15.122:0/2453528374 shutdown_connections 2024-09-17T06:09:24.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.485+0000 7fb3bc587640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb398073200 0x7fb398075710 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.485+0000 7fb3bc587640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3b40c7280 0x7fb3b40c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.485+0000 7fb3bc587640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb3b4145030 0x7fb3b4145440 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.485+0000 7fb3bc587640 1 --2- 172.21.15.122:0/2453528374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3b4153960 0x7fb3b40c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.485+0000 7fb3bc587640 1 -- 172.21.15.122:0/2453528374 >> 172.21.15.122:0/2453528374 conn(0x7fb3b40746d0 msgr2=0x7fb3b4068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:24.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.485+0000 7fb3bc587640 1 -- 172.21.15.122:0/2453528374 shutdown_connections 2024-09-17T06:09:24.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.489+0000 7fb3bc587640 1 -- 172.21.15.122:0/2453528374 wait complete. 2024-09-17T06:09:24.512 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-17T06:09:23.653826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247140,"kb_used_data":9072,"kb_used_omap":17,"kb_used_meta":237870,"kb_avail":754727580,"statfs":{"total":773094113280,"available":772841041920,"internally_reserved":0,"allocated":9289728,"data_stored":5432864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":243579629},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005711"},"pg_stats":[{"pgid":"2.1f","version":"81'6","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224051+0000","last_change":"2024-09-17T06:06:38.646633+0000","last_active":"2024-09-17T06:07:51.224051+0000","last_peered":"2024-09-17T06:07:51.224051+0000","last_clean":"2024-09-17T06:07:51.224051+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:07:51.224051+0000","last_undegraded":"2024-09-17T06:07:51.224051+0000","last_fullsized":"2024-09-17T06:07:51.224051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.646522+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:55.373873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699959+0000","last_change":"2024-09-17T06:06:47.678984+0000","last_active":"2024-09-17T06:07:50.699959+0000","last_peered":"2024-09-17T06:07:50.699959+0000","last_clean":"2024-09-17T06:07:50.699959+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:07:50.699959+0000","last_undegraded":"2024-09-17T06:07:50.699959+0000","last_fullsized":"2024-09-17T06:07:50.699959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.678793+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:31.584591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698029+0000","last_change":"2024-09-17T06:06:55.606541+0000","last_active":"2024-09-17T06:07:50.698029+0000","last_peered":"2024-09-17T06:07:50.698029+0000","last_clean":"2024-09-17T06:07:50.698029+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:07:50.698029+0000","last_undegraded":"2024-09-17T06:07:50.698029+0000","last_fullsized":"2024-09-17T06:07:50.698029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.606346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:05.514205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700296+0000","last_change":"2024-09-17T06:06:41.626922+0000","last_active":"2024-09-17T06:07:50.700296+0000","last_peered":"2024-09-17T06:07:50.700296+0000","last_clean":"2024-09-17T06:07:50.700296+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:07:50.700296+0000","last_undegraded":"2024-09-17T06:07:50.700296+0000","last_fullsized":"2024-09-17T06:07:50.700296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.626723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:41.581056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223163+0000","last_change":"2024-09-17T06:06:42.561017+0000","last_active":"2024-09-17T06:07:51.223163+0000","last_peered":"2024-09-17T06:07:51.223163+0000","last_clean":"2024-09-17T06:07:51.223163+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:07:51.223163+0000","last_undegraded":"2024-09-17T06:07:51.223163+0000","last_fullsized":"2024-09-17T06:07:51.223163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.560815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:06.386417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695113+0000","last_change":"2024-09-17T06:06:50.581741+0000","last_active":"2024-09-17T06:07:50.695113+0000","last_peered":"2024-09-17T06:07:50.695113+0000","last_clean":"2024-09-17T06:07:50.695113+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:07:50.695113+0000","last_undegraded":"2024-09-17T06:07:50.695113+0000","last_fullsized":"2024-09-17T06:07:50.695113+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.581526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:27.538796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842144+0000","last_change":"2024-09-17T06:06:44.503792+0000","last_active":"2024-09-17T06:07:50.842144+0000","last_peered":"2024-09-17T06:07:50.842144+0000","last_clean":"2024-09-17T06:07:50.842144+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:07:50.842144+0000","last_undegraded":"2024-09-17T06:07:50.842144+0000","last_fullsized":"2024-09-17T06:07:50.842144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.503569+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.329171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":166,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219809+0000","last_change":"2024-09-17T06:06:49.490282+0000","last_active":"2024-09-17T06:07:51.219809+0000","last_peered":"2024-09-17T06:07:51.219809+0000","last_clean":"2024-09-17T06:07:51.219809+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:07:51.219809+0000","last_undegraded":"2024-09-17T06:07:51.219809+0000","last_fullsized":"2024-09-17T06:07:51.219809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.490084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:52.911935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700279+0000","last_change":"2024-09-17T06:06:51.542004+0000","last_active":"2024-09-17T06:07:50.700279+0000","last_peered":"2024-09-17T06:07:50.700279+0000","last_clean":"2024-09-17T06:07:50.700279+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:07:50.700279+0000","last_undegraded":"2024-09-17T06:07:50.700279+0000","last_fullsized":"2024-09-17T06:07:50.700279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.541795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.542454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841688+0000","last_change":"2024-09-17T06:06:45.535472+0000","last_active":"2024-09-17T06:07:50.841688+0000","last_peered":"2024-09-17T06:07:50.841688+0000","last_clean":"2024-09-17T06:07:50.841688+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:07:50.841688+0000","last_undegraded":"2024-09-17T06:07:50.841688+0000","last_fullsized":"2024-09-17T06:07:50.841688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.535262+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:56.606861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692929+0000","last_change":"2024-09-17T06:06:45.459635+0000","last_active":"2024-09-17T06:07:50.692929+0000","last_peered":"2024-09-17T06:07:50.692929+0000","last_clean":"2024-09-17T06:07:50.692929+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:07:50.692929+0000","last_undegraded":"2024-09-17T06:07:50.692929+0000","last_fullsized":"2024-09-17T06:07:50.692929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.459406+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:41.152666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699444+0000","last_change":"2024-09-17T06:06:52.519889+0000","last_active":"2024-09-17T06:07:50.699444+0000","last_peered":"2024-09-17T06:07:50.699444+0000","last_clean":"2024-09-17T06:07:50.699444+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:07:50.699444+0000","last_undegraded":"2024-09-17T06:07:50.699444+0000","last_fullsized":"2024-09-17T06:07:50.699444+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.519692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:06.562811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695680+0000","last_change":"2024-09-17T06:06:46.282925+0000","last_active":"2024-09-17T06:07:50.695680+0000","last_peered":"2024-09-17T06:07:50.695680+0000","last_clean":"2024-09-17T06:07:50.695680+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:07:50.695680+0000","last_undegraded":"2024-09-17T06:07:50.695680+0000","last_fullsized":"2024-09-17T06:07:50.695680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.282607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:45.646843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841728+0000","last_change":"2024-09-17T06:06:47.578055+0000","last_active":"2024-09-17T06:07:50.841728+0000","last_peered":"2024-09-17T06:07:50.841728+0000","last_clean":"2024-09-17T06:07:50.841728+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:07:50.841728+0000","last_undegraded":"2024-09-17T06:07:50.841728+0000","last_fullsized":"2024-09-17T06:07:50.841728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.577825+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:54.466675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699912+0000","last_change":"2024-09-17T06:06:48.564278+0000","last_active":"2024-09-17T06:07:50.699912+0000","last_peered":"2024-09-17T06:07:50.699912+0000","last_clean":"2024-09-17T06:07:50.699912+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:07:50.699912+0000","last_undegraded":"2024-09-17T06:07:50.699912+0000","last_fullsized":"2024-09-17T06:07:50.699912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.564076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:09.526182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698658+0000","last_change":"2024-09-17T06:06:45.719909+0000","last_active":"2024-09-17T06:07:50.698658+0000","last_peered":"2024-09-17T06:07:50.698658+0000","last_clean":"2024-09-17T06:07:50.698658+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:07:50.698658+0000","last_undegraded":"2024-09-17T06:07:50.698658+0000","last_fullsized":"2024-09-17T06:07:50.698658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.719724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:58.812630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221112+0000","last_change":"2024-09-17T06:06:39.054952+0000","last_active":"2024-09-17T06:07:51.221112+0000","last_peered":"2024-09-17T06:07:51.221112+0000","last_clean":"2024-09-17T06:07:51.221112+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:07:51.221112+0000","last_undegraded":"2024-09-17T06:07:51.221112+0000","last_fullsized":"2024-09-17T06:07:51.221112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.054879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:22.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700935+0000","last_change":"2024-09-17T06:06:47.595782+0000","last_active":"2024-09-17T06:07:50.700935+0000","last_peered":"2024-09-17T06:07:50.700935+0000","last_clean":"2024-09-17T06:07:50.700935+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:07:50.700935+0000","last_undegraded":"2024-09-17T06:07:50.700935+0000","last_fullsized":"2024-09-17T06:07:50.700935+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.595562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.305297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700008+0000","last_change":"2024-09-17T06:06:44.685583+0000","last_active":"2024-09-17T06:07:50.700008+0000","last_peered":"2024-09-17T06:07:50.700008+0000","last_clean":"2024-09-17T06:07:50.700008+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:07:50.700008+0000","last_undegraded":"2024-09-17T06:07:50.700008+0000","last_fullsized":"2024-09-17T06:07:50.700008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.685386+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:42.733827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221010+0000","last_change":"2024-09-17T06:06:41.096528+0000","last_active":"2024-09-17T06:07:51.221010+0000","last_peered":"2024-09-17T06:07:51.221010+0000","last_clean":"2024-09-17T06:07:51.221010+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:07:51.221010+0000","last_undegraded":"2024-09-17T06:07:51.221010+0000","last_fullsized":"2024-09-17T06:07:51.221010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.096443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.182798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223139+0000","last_change":"2024-09-17T06:06:51.955862+0000","last_active":"2024-09-17T06:07:51.223139+0000","last_peered":"2024-09-17T06:07:51.223139+0000","last_clean":"2024-09-17T06:07:51.223139+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:07:51.223139+0000","last_undegraded":"2024-09-17T06:07:51.223139+0000","last_fullsized":"2024-09-17T06:07:51.223139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.955662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.579450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":73,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695797+0000","last_change":"2024-09-17T06:06:41.561023+0000","last_active":"2024-09-17T06:07:50.695797+0000","last_peered":"2024-09-17T06:07:50.695797+0000","last_clean":"2024-09-17T06:07:50.695797+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:07:50.695797+0000","last_undegraded":"2024-09-17T06:07:50.695797+0000","last_fullsized":"2024-09-17T06:07:50.695797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.560833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:35.979151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840821+0000","last_change":"2024-09-17T06:06:51.569920+0000","last_active":"2024-09-17T06:07:50.840821+0000","last_peered":"2024-09-17T06:07:50.840821+0000","last_clean":"2024-09-17T06:07:50.840821+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:07:50.840821+0000","last_undegraded":"2024-09-17T06:07:50.840821+0000","last_fullsized":"2024-09-17T06:07:50.840821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.569724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:16.044884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699903+0000","last_change":"2024-09-17T06:06:54.534994+0000","last_active":"2024-09-17T06:07:50.699903+0000","last_peered":"2024-09-17T06:07:50.699903+0000","last_clean":"2024-09-17T06:07:50.699903+0000","last_became_active":"2024-09-17T06:06:49.862233+0000","last_became_peered":"2024-09-17T06:06:49.862233+0000","last_unstale":"2024-09-17T06:07:50.699903+0000","last_undegraded":"2024-09-17T06:07:50.699903+0000","last_fullsized":"2024-09-17T06:07:50.699903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.534811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:53.555338+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.534811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:09.975013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,1],"acting":[4,2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225630+0000","last_change":"2024-09-17T06:06:39.595362+0000","last_active":"2024-09-17T06:07:51.225630+0000","last_peered":"2024-09-17T06:07:51.225630+0000","last_clean":"2024-09-17T06:07:51.225630+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:07:51.225630+0000","last_undegraded":"2024-09-17T06:07:51.225630+0000","last_fullsized":"2024-09-17T06:07:51.225630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.595150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:36.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697737+0000","last_change":"2024-09-17T06:06:41.345210+0000","last_active":"2024-09-17T06:07:50.697737+0000","last_peered":"2024-09-17T06:07:50.697737+0000","last_clean":"2024-09-17T06:07:50.697737+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:07:50.697737+0000","last_undegraded":"2024-09-17T06:07:50.697737+0000","last_fullsized":"2024-09-17T06:07:50.697737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.345015+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:38.207077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696384+0000","last_change":"2024-09-17T06:06:44.540629+0000","last_active":"2024-09-17T06:07:50.696384+0000","last_peered":"2024-09-17T06:07:50.696384+0000","last_clean":"2024-09-17T06:07:50.696384+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:07:50.696384+0000","last_undegraded":"2024-09-17T06:07:50.696384+0000","last_fullsized":"2024-09-17T06:07:50.696384+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.540426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:03.473101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700607+0000","last_change":"2024-09-17T06:06:43.669448+0000","last_active":"2024-09-17T06:07:50.700607+0000","last_peered":"2024-09-17T06:07:50.700607+0000","last_clean":"2024-09-17T06:07:50.700607+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:07:50.700607+0000","last_undegraded":"2024-09-17T06:07:50.700607+0000","last_fullsized":"2024-09-17T06:07:50.700607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.669209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:54.877316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222424+0000","last_change":"2024-09-17T06:06:38.067895+0000","last_active":"2024-09-17T06:07:51.222424+0000","last_peered":"2024-09-17T06:07:51.222424+0000","last_clean":"2024-09-17T06:07:51.222424+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:07:51.222424+0000","last_undegraded":"2024-09-17T06:07:51.222424+0000","last_fullsized":"2024-09-17T06:07:51.222424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.067715+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:26.508119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.230386+0000","last_change":"2024-09-17T06:07:51.228200+0000","last_active":"2024-09-17T06:07:51.230386+0000","last_peered":"2024-09-17T06:07:51.230386+0000","last_clean":"2024-09-17T06:07:51.230386+0000","last_became_active":"2024-09-17T06:07:51.226510+0000","last_became_peered":"2024-09-17T06:07:51.226510+0000","last_unstale":"2024-09-17T06:07:51.230386+0000","last_undegraded":"2024-09-17T06:07:51.230386+0000","last_fullsized":"2024-09-17T06:07:51.230386+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.651441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:14.647137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221616+0000","last_change":"2024-09-17T06:06:45.060936+0000","last_active":"2024-09-17T06:07:51.221616+0000","last_peered":"2024-09-17T06:07:51.221616+0000","last_clean":"2024-09-17T06:07:51.221616+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:07:51.221616+0000","last_undegraded":"2024-09-17T06:07:51.221616+0000","last_fullsized":"2024-09-17T06:07:51.221616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.060719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:03.842916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842537+0000","last_change":"2024-09-17T06:06:43.537259+0000","last_active":"2024-09-17T06:07:50.842537+0000","last_peered":"2024-09-17T06:07:50.842537+0000","last_clean":"2024-09-17T06:07:50.842537+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:07:50.842537+0000","last_undegraded":"2024-09-17T06:07:50.842537+0000","last_fullsized":"2024-09-17T06:07:50.842537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.537064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:53.557183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224692+0000","last_change":"2024-09-17T06:06:50.588334+0000","last_active":"2024-09-17T06:07:51.224692+0000","last_peered":"2024-09-17T06:07:51.224692+0000","last_clean":"2024-09-17T06:07:51.224692+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:07:51.224692+0000","last_undegraded":"2024-09-17T06:07:51.224692+0000","last_fullsized":"2024-09-17T06:07:51.224692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.588146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:34.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220191+0000","last_change":"2024-09-17T06:06:45.560755+0000","last_active":"2024-09-17T06:07:51.220191+0000","last_peered":"2024-09-17T06:07:51.220191+0000","last_clean":"2024-09-17T06:07:51.220191+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:07:51.220191+0000","last_undegraded":"2024-09-17T06:07:51.220191+0000","last_fullsized":"2024-09-17T06:07:51.220191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.560562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.352415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221768+0000","last_change":"2024-09-17T06:06:40.077709+0000","last_active":"2024-09-17T06:07:51.221768+0000","last_peered":"2024-09-17T06:07:51.221768+0000","last_clean":"2024-09-17T06:07:51.221768+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:07:51.221768+0000","last_undegraded":"2024-09-17T06:07:51.221768+0000","last_fullsized":"2024-09-17T06:07:51.221768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.077616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:13.235085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220023+0000","last_change":"2024-09-17T06:06:50.943563+0000","last_active":"2024-09-17T06:07:51.220023+0000","last_peered":"2024-09-17T06:07:51.220023+0000","last_clean":"2024-09-17T06:07:51.220023+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:07:51.220023+0000","last_undegraded":"2024-09-17T06:07:51.220023+0000","last_fullsized":"2024-09-17T06:07:51.220023+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.943366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.661632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700452+0000","last_change":"2024-09-17T06:06:39.544246+0000","last_active":"2024-09-17T06:07:50.700452+0000","last_peered":"2024-09-17T06:07:50.700452+0000","last_clean":"2024-09-17T06:07:50.700452+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:07:50.700452+0000","last_undegraded":"2024-09-17T06:07:50.700452+0000","last_fullsized":"2024-09-17T06:07:50.700452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.544002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:04.906600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219385+0000","last_change":"2024-09-17T06:06:41.601594+0000","last_active":"2024-09-17T06:07:51.219385+0000","last_peered":"2024-09-17T06:07:51.219385+0000","last_clean":"2024-09-17T06:07:51.219385+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:07:51.219385+0000","last_undegraded":"2024-09-17T06:07:51.219385+0000","last_fullsized":"2024-09-17T06:07:51.219385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.601393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.687748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221448+0000","last_change":"2024-09-17T06:06:49.922504+0000","last_active":"2024-09-17T06:07:51.221448+0000","last_peered":"2024-09-17T06:07:51.221448+0000","last_clean":"2024-09-17T06:07:51.221448+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:07:51.221448+0000","last_undegraded":"2024-09-17T06:07:51.221448+0000","last_fullsized":"2024-09-17T06:07:51.221448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.922302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:53.344154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222935+0000","last_change":"2024-09-17T06:06:42.067931+0000","last_active":"2024-09-17T06:07:51.222935+0000","last_peered":"2024-09-17T06:07:51.222935+0000","last_clean":"2024-09-17T06:07:51.222935+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:07:51.222935+0000","last_undegraded":"2024-09-17T06:07:51.222935+0000","last_fullsized":"2024-09-17T06:07:51.222935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.067737+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.818001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693159+0000","last_change":"2024-09-17T06:06:38.338953+0000","last_active":"2024-09-17T06:07:50.693159+0000","last_peered":"2024-09-17T06:07:50.693159+0000","last_clean":"2024-09-17T06:07:50.693159+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:07:50.693159+0000","last_undegraded":"2024-09-17T06:07:50.693159+0000","last_fullsized":"2024-09-17T06:07:50.693159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.338737+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:58.670904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223389+0000","last_change":"2024-09-17T06:06:47.938470+0000","last_active":"2024-09-17T06:07:51.223389+0000","last_peered":"2024-09-17T06:07:51.223389+0000","last_clean":"2024-09-17T06:07:51.223389+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:07:51.223389+0000","last_undegraded":"2024-09-17T06:07:51.223389+0000","last_fullsized":"2024-09-17T06:07:51.223389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.938263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.607027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221642+0000","last_change":"2024-09-17T06:06:41.585374+0000","last_active":"2024-09-17T06:07:51.221642+0000","last_peered":"2024-09-17T06:07:51.221642+0000","last_clean":"2024-09-17T06:07:51.221642+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:07:51.221642+0000","last_undegraded":"2024-09-17T06:07:51.221642+0000","last_fullsized":"2024-09-17T06:07:51.221642+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.585183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:11.929990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841022+0000","last_change":"2024-09-17T06:06:42.536575+0000","last_active":"2024-09-17T06:07:50.841022+0000","last_peered":"2024-09-17T06:07:50.841022+0000","last_clean":"2024-09-17T06:07:50.841022+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:07:50.841022+0000","last_undegraded":"2024-09-17T06:07:50.841022+0000","last_fullsized":"2024-09-17T06:07:50.841022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.536371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:23.547872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225264+0000","last_change":"2024-09-17T06:06:47.627398+0000","last_active":"2024-09-17T06:07:51.225264+0000","last_peered":"2024-09-17T06:07:51.225264+0000","last_clean":"2024-09-17T06:07:51.225264+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:07:51.225264+0000","last_undegraded":"2024-09-17T06:07:51.225264+0000","last_fullsized":"2024-09-17T06:07:51.225264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.627188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:28.206295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699239+0000","last_change":"2024-09-17T06:06:42.642781+0000","last_active":"2024-09-17T06:07:50.699239+0000","last_peered":"2024-09-17T06:07:50.699239+0000","last_clean":"2024-09-17T06:07:50.699239+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:07:50.699239+0000","last_undegraded":"2024-09-17T06:07:50.699239+0000","last_fullsized":"2024-09-17T06:07:50.699239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.642468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:03.874053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219489+0000","last_change":"2024-09-17T06:06:40.563124+0000","last_active":"2024-09-17T06:07:51.219489+0000","last_peered":"2024-09-17T06:07:51.219489+0000","last_clean":"2024-09-17T06:07:51.219489+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:07:51.219489+0000","last_undegraded":"2024-09-17T06:07:51.219489+0000","last_fullsized":"2024-09-17T06:07:51.219489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.562781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:51.528772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"81'74","reported_seq":248,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841224+0000","last_change":"2024-09-17T06:06:41.529207+0000","last_active":"2024-09-17T06:07:50.841224+0000","last_peered":"2024-09-17T06:07:50.841224+0000","last_clean":"2024-09-17T06:07:50.841224+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:07:50.841224+0000","last_undegraded":"2024-09-17T06:07:50.841224+0000","last_fullsized":"2024-09-17T06:07:50.841224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'74","last_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_deep_scrub":"81'74","last_deep_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.529006+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:17.811347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698161+0000","last_change":"2024-09-17T06:06:50.168189+0000","last_active":"2024-09-17T06:07:50.698161+0000","last_peered":"2024-09-17T06:07:50.698161+0000","last_clean":"2024-09-17T06:07:50.698161+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:07:50.698161+0000","last_undegraded":"2024-09-17T06:07:50.698161+0000","last_fullsized":"2024-09-17T06:07:50.698161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.167993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:53.277144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693507+0000","last_change":"2024-09-17T06:06:46.470862+0000","last_active":"2024-09-17T06:07:50.693507+0000","last_peered":"2024-09-17T06:07:50.693507+0000","last_clean":"2024-09-17T06:07:50.693507+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:07:50.693507+0000","last_undegraded":"2024-09-17T06:07:50.693507+0000","last_fullsized":"2024-09-17T06:07:50.693507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.470640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:54.803752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693739+0000","last_change":"2024-09-17T06:06:39.308543+0000","last_active":"2024-09-17T06:07:50.693739+0000","last_peered":"2024-09-17T06:07:50.693739+0000","last_clean":"2024-09-17T06:07:50.693739+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:07:50.693739+0000","last_undegraded":"2024-09-17T06:07:50.693739+0000","last_fullsized":"2024-09-17T06:07:50.693739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.308468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:26.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695342+0000","last_change":"2024-09-17T06:06:55.194732+0000","last_active":"2024-09-17T06:07:50.695342+0000","last_peered":"2024-09-17T06:07:50.695342+0000","last_clean":"2024-09-17T06:07:50.695342+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:07:50.695342+0000","last_undegraded":"2024-09-17T06:07:50.695342+0000","last_fullsized":"2024-09-17T06:07:50.695342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.194477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:46.395618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220138+0000","last_change":"2024-09-17T06:06:47.481798+0000","last_active":"2024-09-17T06:07:51.220138+0000","last_peered":"2024-09-17T06:07:51.220138+0000","last_clean":"2024-09-17T06:07:51.220138+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:07:51.220138+0000","last_undegraded":"2024-09-17T06:07:51.220138+0000","last_fullsized":"2024-09-17T06:07:51.220138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.481588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.150352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221032+0000","last_change":"2024-09-17T06:06:43.064298+0000","last_active":"2024-09-17T06:07:51.221032+0000","last_peered":"2024-09-17T06:07:51.221032+0000","last_clean":"2024-09-17T06:07:51.221032+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:07:51.221032+0000","last_undegraded":"2024-09-17T06:07:51.221032+0000","last_fullsized":"2024-09-17T06:07:51.221032+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.064096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:30.993498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225249+0000","last_change":"2024-09-17T06:06:52.593990+0000","last_active":"2024-09-17T06:07:51.225249+0000","last_peered":"2024-09-17T06:07:51.225249+0000","last_clean":"2024-09-17T06:07:51.225249+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:07:51.225249+0000","last_undegraded":"2024-09-17T06:07:51.225249+0000","last_fullsized":"2024-09-17T06:07:51.225249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.593787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:04.850781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":166,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842733+0000","last_change":"2024-09-17T06:06:46.576306+0000","last_active":"2024-09-17T06:07:50.842733+0000","last_peered":"2024-09-17T06:07:50.842733+0000","last_clean":"2024-09-17T06:07:50.842733+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:07:50.842733+0000","last_undegraded":"2024-09-17T06:07:50.842733+0000","last_fullsized":"2024-09-17T06:07:50.842733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:36.552616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'3","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.694092+0000","last_change":"2024-09-17T06:06:40.289371+0000","last_active":"2024-09-17T06:07:50.694092+0000","last_peered":"2024-09-17T06:07:50.694092+0000","last_clean":"2024-09-17T06:07:50.694092+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:07:50.694092+0000","last_undegraded":"2024-09-17T06:07:50.694092+0000","last_fullsized":"2024-09-17T06:07:50.694092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.289195+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.187275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218747+0000","last_change":"2024-09-17T06:06:57.580034+0000","last_active":"2024-09-17T06:07:51.218747+0000","last_peered":"2024-09-17T06:07:51.218747+0000","last_clean":"2024-09-17T06:07:51.218747+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:07:51.218747+0000","last_undegraded":"2024-09-17T06:07:51.218747+0000","last_fullsized":"2024-09-17T06:07:51.218747+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.579707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:15.990501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842467+0000","last_change":"2024-09-17T06:06:53.554156+0000","last_active":"2024-09-17T06:07:50.842467+0000","last_peered":"2024-09-17T06:07:50.842467+0000","last_clean":"2024-09-17T06:07:50.842467+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:07:50.842467+0000","last_undegraded":"2024-09-17T06:07:50.842467+0000","last_fullsized":"2024-09-17T06:07:50.842467+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.553919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:37.374837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700114+0000","last_change":"2024-09-17T06:06:40.545470+0000","last_active":"2024-09-17T06:07:50.700114+0000","last_peered":"2024-09-17T06:07:50.700114+0000","last_clean":"2024-09-17T06:07:50.700114+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:07:50.700114+0000","last_undegraded":"2024-09-17T06:07:50.700114+0000","last_fullsized":"2024-09-17T06:07:50.700114+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.545271+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:41.942375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696784+0000","last_change":"2024-09-17T06:06:46.553900+0000","last_active":"2024-09-17T06:07:50.696784+0000","last_peered":"2024-09-17T06:07:50.696784+0000","last_clean":"2024-09-17T06:07:50.696784+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:07:50.696784+0000","last_undegraded":"2024-09-17T06:07:50.696784+0000","last_fullsized":"2024-09-17T06:07:50.696784+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.553594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:37.347089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841231+0000","last_change":"2024-09-17T06:06:49.557072+0000","last_active":"2024-09-17T06:07:50.841231+0000","last_peered":"2024-09-17T06:07:50.841231+0000","last_clean":"2024-09-17T06:07:50.841231+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:07:50.841231+0000","last_undegraded":"2024-09-17T06:07:50.841231+0000","last_fullsized":"2024-09-17T06:07:50.841231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.556746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:02.173527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'13","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693261+0000","last_change":"2024-09-17T06:06:41.327726+0000","last_active":"2024-09-17T06:07:50.693261+0000","last_peered":"2024-09-17T06:07:50.693261+0000","last_clean":"2024-09-17T06:07:50.693261+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:07:50.693261+0000","last_undegraded":"2024-09-17T06:07:50.693261+0000","last_fullsized":"2024-09-17T06:07:50.693261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'13","last_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_deep_scrub":"81'13","last_deep_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.327620+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:41.975086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225072+0000","last_change":"2024-09-17T06:06:48.590089+0000","last_active":"2024-09-17T06:07:51.225072+0000","last_peered":"2024-09-17T06:07:51.225072+0000","last_clean":"2024-09-17T06:07:51.225072+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:07:51.225072+0000","last_undegraded":"2024-09-17T06:07:51.225072+0000","last_fullsized":"2024-09-17T06:07:51.225072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.589881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:13.065040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695729+0000","last_change":"2024-09-17T06:06:47.234619+0000","last_active":"2024-09-17T06:07:50.695729+0000","last_peered":"2024-09-17T06:07:50.695729+0000","last_clean":"2024-09-17T06:07:50.695729+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:07:50.695729+0000","last_undegraded":"2024-09-17T06:07:50.695729+0000","last_fullsized":"2024-09-17T06:07:50.695729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.234392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:10.297041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696310+0000","last_change":"2024-09-17T06:06:42.362985+0000","last_active":"2024-09-17T06:07:50.696310+0000","last_peered":"2024-09-17T06:07:50.696310+0000","last_clean":"2024-09-17T06:07:50.696310+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:07:50.696310+0000","last_undegraded":"2024-09-17T06:07:50.696310+0000","last_fullsized":"2024-09-17T06:07:50.696310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.362795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:21.306942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700186+0000","last_change":"2024-09-17T06:06:54.645399+0000","last_active":"2024-09-17T06:07:50.700186+0000","last_peered":"2024-09-17T06:07:50.700186+0000","last_clean":"2024-09-17T06:07:50.700186+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:07:50.700186+0000","last_undegraded":"2024-09-17T06:07:50.700186+0000","last_fullsized":"2024-09-17T06:07:50.700186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.645200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:04.728298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841519+0000","last_change":"2024-09-17T06:06:48.595269+0000","last_active":"2024-09-17T06:07:50.841519+0000","last_peered":"2024-09-17T06:07:50.841519+0000","last_clean":"2024-09-17T06:07:50.841519+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:07:50.841519+0000","last_undegraded":"2024-09-17T06:07:50.841519+0000","last_fullsized":"2024-09-17T06:07:50.841519+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.595073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:51.297831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219232+0000","last_change":"2024-09-17T06:06:42.583243+0000","last_active":"2024-09-17T06:07:51.219232+0000","last_peered":"2024-09-17T06:07:51.219232+0000","last_clean":"2024-09-17T06:07:51.219232+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:07:51.219232+0000","last_undegraded":"2024-09-17T06:07:51.219232+0000","last_fullsized":"2024-09-17T06:07:51.219232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.583048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:54.333313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699457+0000","last_change":"2024-09-17T06:06:57.607574+0000","last_active":"2024-09-17T06:07:50.699457+0000","last_peered":"2024-09-17T06:07:50.699457+0000","last_clean":"2024-09-17T06:07:50.699457+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:07:50.699457+0000","last_undegraded":"2024-09-17T06:07:50.699457+0000","last_fullsized":"2024-09-17T06:07:50.699457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.607379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:56.898447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222617+0000","last_change":"2024-09-17T06:06:45.591584+0000","last_active":"2024-09-17T06:07:51.222617+0000","last_peered":"2024-09-17T06:07:51.222617+0000","last_clean":"2024-09-17T06:07:51.222617+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:07:51.222617+0000","last_undegraded":"2024-09-17T06:07:51.222617+0000","last_fullsized":"2024-09-17T06:07:51.222617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.591276+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:08.653925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.226251+0000","last_change":"2024-09-17T06:06:37.667757+0000","last_active":"2024-09-17T06:07:51.226251+0000","last_peered":"2024-09-17T06:07:51.226251+0000","last_clean":"2024-09-17T06:07:51.226251+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:07:51.226251+0000","last_undegraded":"2024-09-17T06:07:51.226251+0000","last_fullsized":"2024-09-17T06:07:51.226251+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_clean_scrub_stamp":"2024-09-17T06:06:37.667675+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:46.885860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219934+0000","last_change":"2024-09-17T06:06:56.615164+0000","last_active":"2024-09-17T06:07:51.219934+0000","last_peered":"2024-09-17T06:07:51.219934+0000","last_clean":"2024-09-17T06:07:51.219934+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:07:51.219934+0000","last_undegraded":"2024-09-17T06:07:51.219934+0000","last_fullsized":"2024-09-17T06:07:51.219934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.614970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:07.482666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841824+0000","last_change":"2024-09-17T06:06:52.577732+0000","last_active":"2024-09-17T06:07:50.841824+0000","last_peered":"2024-09-17T06:07:50.841824+0000","last_clean":"2024-09-17T06:07:50.841824+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:07:50.841824+0000","last_undegraded":"2024-09-17T06:07:50.841824+0000","last_fullsized":"2024-09-17T06:07:50.841824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.577533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:34.161856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":174,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697843+0000","last_change":"2024-09-17T06:06:43.358428+0000","last_active":"2024-09-17T06:07:50.697843+0000","last_peered":"2024-09-17T06:07:50.697843+0000","last_clean":"2024-09-17T06:07:50.697843+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:07:50.697843+0000","last_undegraded":"2024-09-17T06:07:50.697843+0000","last_fullsized":"2024-09-17T06:07:50.697843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'27","last_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_deep_scrub":"81'27","last_deep_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.358219+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:13.703025+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":145,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220392+0000","last_change":"2024-09-17T06:06:52.944474+0000","last_active":"2024-09-17T06:07:51.220392+0000","last_peered":"2024-09-17T06:07:51.220392+0000","last_clean":"2024-09-17T06:07:51.220392+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:07:51.220392+0000","last_undegraded":"2024-09-17T06:07:51.220392+0000","last_fullsized":"2024-09-17T06:07:51.220392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.944213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.533972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699872+0000","last_change":"2024-09-17T06:06:43.557285+0000","last_active":"2024-09-17T06:07:50.699872+0000","last_peered":"2024-09-17T06:07:50.699872+0000","last_clean":"2024-09-17T06:07:50.699872+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:07:50.699872+0000","last_undegraded":"2024-09-17T06:07:50.699872+0000","last_fullsized":"2024-09-17T06:07:50.699872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.557090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:01.412234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"81'9","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220308+0000","last_change":"2024-09-17T06:06:43.599342+0000","last_active":"2024-09-17T06:07:51.220308+0000","last_peered":"2024-09-17T06:07:51.220308+0000","last_clean":"2024-09-17T06:07:51.220308+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:07:51.220308+0000","last_undegraded":"2024-09-17T06:07:51.220308+0000","last_fullsized":"2024-09-17T06:07:51.220308+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.599114+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:49.432076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699698+0000","last_change":"2024-09-17T06:06:49.561761+0000","last_active":"2024-09-17T06:07:50.699698+0000","last_peered":"2024-09-17T06:07:50.699698+0000","last_clean":"2024-09-17T06:07:50.699698+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:07:50.699698+0000","last_undegraded":"2024-09-17T06:07:50.699698+0000","last_fullsized":"2024-09-17T06:07:50.699698+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.561572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:15.208406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223672+0000","last_change":"2024-09-17T06:06:40.581076+0000","last_active":"2024-09-17T06:07:51.223672+0000","last_peered":"2024-09-17T06:07:51.223672+0000","last_clean":"2024-09-17T06:07:51.223672+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:07:51.223672+0000","last_undegraded":"2024-09-17T06:07:51.223672+0000","last_fullsized":"2024-09-17T06:07:51.223672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.580978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:19.525125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220215+0000","last_change":"2024-09-17T06:06:44.589361+0000","last_active":"2024-09-17T06:07:51.220215+0000","last_peered":"2024-09-17T06:07:51.220215+0000","last_clean":"2024-09-17T06:07:51.220215+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:07:51.220215+0000","last_undegraded":"2024-09-17T06:07:51.220215+0000","last_fullsized":"2024-09-17T06:07:51.220215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.589149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.705503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":118,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699654+0000","last_change":"2024-09-17T06:06:58.599122+0000","last_active":"2024-09-17T06:07:50.699654+0000","last_peered":"2024-09-17T06:07:50.699654+0000","last_clean":"2024-09-17T06:07:50.699654+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:07:50.699654+0000","last_undegraded":"2024-09-17T06:07:50.699654+0000","last_fullsized":"2024-09-17T06:07:50.699654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_clean_scrub_stamp":"2024-09-17T06:06:58.598909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.505821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220121+0000","last_change":"2024-09-17T06:06:48.493667+0000","last_active":"2024-09-17T06:07:51.220121+0000","last_peered":"2024-09-17T06:07:51.220121+0000","last_clean":"2024-09-17T06:07:51.220121+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:07:51.220121+0000","last_undegraded":"2024-09-17T06:07:51.220121+0000","last_fullsized":"2024-09-17T06:07:51.220121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.493470+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.837170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697241+0000","last_change":"2024-09-17T06:06:44.333474+0000","last_active":"2024-09-17T06:07:50.697241+0000","last_peered":"2024-09-17T06:07:50.697241+0000","last_clean":"2024-09-17T06:07:50.697241+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:07:50.697241+0000","last_undegraded":"2024-09-17T06:07:50.697241+0000","last_fullsized":"2024-09-17T06:07:50.697241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.333150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.158751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698517+0000","last_change":"2024-09-17T06:06:52.699338+0000","last_active":"2024-09-17T06:07:50.698517+0000","last_peered":"2024-09-17T06:07:50.698517+0000","last_clean":"2024-09-17T06:07:50.698517+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:07:50.698517+0000","last_undegraded":"2024-09-17T06:07:50.698517+0000","last_fullsized":"2024-09-17T06:07:50.698517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.699134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:51.626769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224692+0000","last_change":"2024-09-17T06:06:49.633934+0000","last_active":"2024-09-17T06:07:51.224692+0000","last_peered":"2024-09-17T06:07:51.224692+0000","last_clean":"2024-09-17T06:07:51.224692+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:07:51.224692+0000","last_undegraded":"2024-09-17T06:07:51.224692+0000","last_fullsized":"2024-09-17T06:07:51.224692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.633660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.217982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220316+0000","last_change":"2024-09-17T06:06:46.974853+0000","last_active":"2024-09-17T06:07:51.220316+0000","last_peered":"2024-09-17T06:07:51.220316+0000","last_clean":"2024-09-17T06:07:51.220316+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:07:51.220316+0000","last_undegraded":"2024-09-17T06:07:51.220316+0000","last_fullsized":"2024-09-17T06:07:51.220316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.974637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:26.337532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219068+0000","last_change":"2024-09-17T06:06:46.527438+0000","last_active":"2024-09-17T06:07:51.219068+0000","last_peered":"2024-09-17T06:07:51.219068+0000","last_clean":"2024-09-17T06:07:51.219068+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:07:51.219068+0000","last_undegraded":"2024-09-17T06:07:51.219068+0000","last_fullsized":"2024-09-17T06:07:51.219068+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.527230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:25.890125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696741+0000","last_change":"2024-09-17T06:06:54.199209+0000","last_active":"2024-09-17T06:07:50.696741+0000","last_peered":"2024-09-17T06:07:50.696741+0000","last_clean":"2024-09-17T06:07:50.696741+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:07:50.696741+0000","last_undegraded":"2024-09-17T06:07:50.696741+0000","last_fullsized":"2024-09-17T06:07:50.696741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.198989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:51.609301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699785+0000","last_change":"2024-09-17T06:06:46.699017+0000","last_active":"2024-09-17T06:07:50.699785+0000","last_peered":"2024-09-17T06:07:50.699785+0000","last_clean":"2024-09-17T06:07:50.699785+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:07:50.699785+0000","last_undegraded":"2024-09-17T06:07:50.699785+0000","last_fullsized":"2024-09-17T06:07:50.699785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.698821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:33.586359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698807+0000","last_change":"2024-09-17T06:06:40.624617+0000","last_active":"2024-09-17T06:07:50.698807+0000","last_peered":"2024-09-17T06:07:50.698807+0000","last_clean":"2024-09-17T06:07:50.698807+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:07:50.698807+0000","last_undegraded":"2024-09-17T06:07:50.698807+0000","last_fullsized":"2024-09-17T06:07:50.698807+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.624540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:48.054970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696244+0000","last_change":"2024-09-17T06:06:45.311790+0000","last_active":"2024-09-17T06:07:50.696244+0000","last_peered":"2024-09-17T06:07:50.696244+0000","last_clean":"2024-09-17T06:07:50.696244+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:07:50.696244+0000","last_undegraded":"2024-09-17T06:07:50.696244+0000","last_fullsized":"2024-09-17T06:07:50.696244+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.311572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:05.215110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":166,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225908+0000","last_change":"2024-09-17T06:06:43.594929+0000","last_active":"2024-09-17T06:07:51.225908+0000","last_peered":"2024-09-17T06:07:51.225908+0000","last_clean":"2024-09-17T06:07:51.225908+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:07:51.225908+0000","last_undegraded":"2024-09-17T06:07:51.225908+0000","last_fullsized":"2024-09-17T06:07:51.225908+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.594608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:54.666206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693267+0000","last_change":"2024-09-17T06:06:44.420446+0000","last_active":"2024-09-17T06:07:50.693267+0000","last_peered":"2024-09-17T06:07:50.693267+0000","last_clean":"2024-09-17T06:07:50.693267+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:07:50.693267+0000","last_undegraded":"2024-09-17T06:07:50.693267+0000","last_fullsized":"2024-09-17T06:07:50.693267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.420226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:35.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":81,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698991+0000","last_change":"2024-09-17T06:06:39.644661+0000","last_active":"2024-09-17T06:07:50.698991+0000","last_peered":"2024-09-17T06:07:50.698991+0000","last_clean":"2024-09-17T06:07:50.698991+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:07:50.698991+0000","last_undegraded":"2024-09-17T06:07:50.698991+0000","last_fullsized":"2024-09-17T06:07:50.698991+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.644581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:43.034866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695221+0000","last_change":"2024-09-17T06:06:42.552587+0000","last_active":"2024-09-17T06:07:50.695221+0000","last_peered":"2024-09-17T06:07:50.695221+0000","last_clean":"2024-09-17T06:07:50.695221+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:07:50.695221+0000","last_undegraded":"2024-09-17T06:07:50.695221+0000","last_fullsized":"2024-09-17T06:07:50.695221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.552253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:16.204277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":134,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699461+0000","last_change":"2024-09-17T06:06:59.590058+0000","last_active":"2024-09-17T06:07:50.699461+0000","last_peered":"2024-09-17T06:07:50.699461+0000","last_clean":"2024-09-17T06:07:50.699461+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:07:50.699461+0000","last_undegraded":"2024-09-17T06:07:50.699461+0000","last_fullsized":"2024-09-17T06:07:50.699461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_clean_scrub_stamp":"2024-09-17T06:06:59.589844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:13.777383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695142+0000","last_change":"2024-09-17T06:06:49.212293+0000","last_active":"2024-09-17T06:07:50.695142+0000","last_peered":"2024-09-17T06:07:50.695142+0000","last_clean":"2024-09-17T06:07:50.695142+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:07:50.695142+0000","last_undegraded":"2024-09-17T06:07:50.695142+0000","last_fullsized":"2024-09-17T06:07:50.695142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.211966+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:29.791073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693039+0000","last_change":"2024-09-17T06:06:43.370824+0000","last_active":"2024-09-17T06:07:50.693039+0000","last_peered":"2024-09-17T06:07:50.693039+0000","last_clean":"2024-09-17T06:07:50.693039+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:07:50.693039+0000","last_undegraded":"2024-09-17T06:07:50.693039+0000","last_fullsized":"2024-09-17T06:07:50.693039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.370630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:28.698931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219068+0000","last_change":"2024-09-17T06:06:50.490824+0000","last_active":"2024-09-17T06:07:51.219068+0000","last_peered":"2024-09-17T06:07:51.219068+0000","last_clean":"2024-09-17T06:07:51.219068+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:07:51.219068+0000","last_undegraded":"2024-09-17T06:07:51.219068+0000","last_fullsized":"2024-09-17T06:07:51.219068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.490494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.208761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":170,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225578+0000","last_change":"2024-09-17T06:06:54.564398+0000","last_active":"2024-09-17T06:07:51.225578+0000","last_peered":"2024-09-17T06:07:51.225578+0000","last_clean":"2024-09-17T06:07:51.225578+0000","last_became_active":"2024-09-17T06:06:49.863977+0000","last_became_peered":"2024-09-17T06:06:49.863977+0000","last_unstale":"2024-09-17T06:07:51.225578+0000","last_undegraded":"2024-09-17T06:07:51.225578+0000","last_fullsized":"2024-09-17T06:07:51.225578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:54.564097+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:53.583377+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.564097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:45.765238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700309+0000","last_change":"2024-09-17T06:06:48.701826+0000","last_active":"2024-09-17T06:07:50.700309+0000","last_peered":"2024-09-17T06:07:50.700309+0000","last_clean":"2024-09-17T06:07:50.700309+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:07:50.700309+0000","last_undegraded":"2024-09-17T06:07:50.700309+0000","last_fullsized":"2024-09-17T06:07:50.700309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.701596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:43:38.318752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220694+0000","last_change":"2024-09-17T06:06:44.071550+0000","last_active":"2024-09-17T06:07:51.220694+0000","last_peered":"2024-09-17T06:07:51.220694+0000","last_clean":"2024-09-17T06:07:51.220694+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:07:51.220694+0000","last_undegraded":"2024-09-17T06:07:51.220694+0000","last_fullsized":"2024-09-17T06:07:51.220694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.071343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:50.902738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699125+0000","last_change":"2024-09-17T06:06:48.219488+0000","last_active":"2024-09-17T06:07:50.699125+0000","last_peered":"2024-09-17T06:07:50.699125+0000","last_clean":"2024-09-17T06:07:50.699125+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:07:50.699125+0000","last_undegraded":"2024-09-17T06:07:50.699125+0000","last_fullsized":"2024-09-17T06:07:50.699125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.219293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:00.836074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":118,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700371+0000","last_change":"2024-09-17T06:06:50.710122+0000","last_active":"2024-09-17T06:07:50.700371+0000","last_peered":"2024-09-17T06:07:50.700371+0000","last_clean":"2024-09-17T06:07:50.700371+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:07:50.700371+0000","last_undegraded":"2024-09-17T06:07:50.700371+0000","last_fullsized":"2024-09-17T06:07:50.700371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.709804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:24.696128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218361+0000","last_change":"2024-09-17T06:06:51.502240+0000","last_active":"2024-09-17T06:07:51.218361+0000","last_peered":"2024-09-17T06:07:51.218361+0000","last_clean":"2024-09-17T06:07:51.218361+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:07:51.218361+0000","last_undegraded":"2024-09-17T06:07:51.218361+0000","last_fullsized":"2024-09-17T06:07:51.218361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.502041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.125829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":124,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698407+0000","last_change":"2024-09-17T06:06:49.687515+0000","last_active":"2024-09-17T06:07:50.698407+0000","last_peered":"2024-09-17T06:07:50.698407+0000","last_clean":"2024-09-17T06:07:50.698407+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:07:50.698407+0000","last_undegraded":"2024-09-17T06:07:50.698407+0000","last_fullsized":"2024-09-17T06:07:50.698407+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.687322+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:09.182168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692877+0000","last_change":"2024-09-17T06:06:49.761230+0000","last_active":"2024-09-17T06:07:50.692877+0000","last_peered":"2024-09-17T06:07:50.692877+0000","last_clean":"2024-09-17T06:07:50.692877+0000","last_became_active":"2024-09-17T06:06:49.760405+0000","last_became_peered":"2024-09-17T06:06:49.760405+0000","last_unstale":"2024-09-17T06:07:50.692877+0000","last_undegraded":"2024-09-17T06:07:50.692877+0000","last_fullsized":"2024-09-17T06:07:50.692877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:04:07.793905+0000","last_clean_scrub_stamp":"2024-09-17T06:04:07.793905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:18.198271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224999+0000","last_change":"2024-09-17T06:06:51.561891+0000","last_active":"2024-09-17T06:07:51.224999+0000","last_peered":"2024-09-17T06:07:51.224999+0000","last_clean":"2024-09-17T06:07:51.224999+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:07:51.224999+0000","last_undegraded":"2024-09-17T06:07:51.224999+0000","last_fullsized":"2024-09-17T06:07:51.224999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.561576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:27.536230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697734+0000","last_change":"2024-09-17T06:06:51.171689+0000","last_active":"2024-09-17T06:07:50.697734+0000","last_peered":"2024-09-17T06:07:50.697734+0000","last_clean":"2024-09-17T06:07:50.697734+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:07:50.697734+0000","last_undegraded":"2024-09-17T06:07:50.697734+0000","last_fullsized":"2024-09-17T06:07:50.697734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.171493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:39.452849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842168+0000","last_change":"2024-09-17T06:06:55.610932+0000","last_active":"2024-09-17T06:07:50.842168+0000","last_peered":"2024-09-17T06:07:50.842168+0000","last_clean":"2024-09-17T06:07:50.842168+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:07:50.842168+0000","last_undegraded":"2024-09-17T06:07:50.842168+0000","last_fullsized":"2024-09-17T06:07:50.842168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.610700+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:07.867694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693902+0000","last_change":"2024-09-17T06:06:42.353051+0000","last_active":"2024-09-17T06:07:50.693902+0000","last_peered":"2024-09-17T06:07:50.693902+0000","last_clean":"2024-09-17T06:07:50.693902+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:07:50.693902+0000","last_undegraded":"2024-09-17T06:07:50.693902+0000","last_fullsized":"2024-09-17T06:07:50.693902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.352711+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:14.862093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220663+0000","last_change":"2024-09-17T06:06:52.529037+0000","last_active":"2024-09-17T06:07:51.220663+0000","last_peered":"2024-09-17T06:07:51.220663+0000","last_clean":"2024-09-17T06:07:51.220663+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:07:51.220663+0000","last_undegraded":"2024-09-17T06:07:51.220663+0000","last_fullsized":"2024-09-17T06:07:51.220663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.528843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.118602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219034+0000","last_change":"2024-09-17T06:06:53.547108+0000","last_active":"2024-09-17T06:07:51.219034+0000","last_peered":"2024-09-17T06:07:51.219034+0000","last_clean":"2024-09-17T06:07:51.219034+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:07:51.219034+0000","last_undegraded":"2024-09-17T06:07:51.219034+0000","last_fullsized":"2024-09-17T06:07:51.219034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.546853+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:05.208153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220626+0000","last_change":"2024-09-17T06:06:48.919436+0000","last_active":"2024-09-17T06:07:51.220626+0000","last_peered":"2024-09-17T06:07:51.220626+0000","last_clean":"2024-09-17T06:07:51.220626+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:07:51.220626+0000","last_undegraded":"2024-09-17T06:07:51.220626+0000","last_fullsized":"2024-09-17T06:07:51.220626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.919235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:27.262935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222606+0000","last_change":"2024-09-17T06:06:44.636882+0000","last_active":"2024-09-17T06:07:51.222606+0000","last_peered":"2024-09-17T06:07:51.222606+0000","last_clean":"2024-09-17T06:07:51.222606+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:07:51.222606+0000","last_undegraded":"2024-09-17T06:07:51.222606+0000","last_fullsized":"2024-09-17T06:07:51.222606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.636626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:44.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":88,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699044+0000","last_change":"2024-09-17T06:06:51.717905+0000","last_active":"2024-09-17T06:07:50.699044+0000","last_peered":"2024-09-17T06:07:50.699044+0000","last_clean":"2024-09-17T06:07:50.699044+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:07:50.699044+0000","last_undegraded":"2024-09-17T06:07:50.699044+0000","last_fullsized":"2024-09-17T06:07:50.699044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.717694+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:59.444208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700437+0000","last_change":"2024-09-17T06:06:45.539679+0000","last_active":"2024-09-17T06:07:50.700437+0000","last_peered":"2024-09-17T06:07:50.700437+0000","last_clean":"2024-09-17T06:07:50.700437+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:07:50.700437+0000","last_undegraded":"2024-09-17T06:07:50.700437+0000","last_fullsized":"2024-09-17T06:07:50.700437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.539468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:55.832105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698700+0000","last_change":"2024-09-17T06:06:52.213250+0000","last_active":"2024-09-17T06:07:50.698700+0000","last_peered":"2024-09-17T06:07:50.698700+0000","last_clean":"2024-09-17T06:07:50.698700+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:07:50.698700+0000","last_undegraded":"2024-09-17T06:07:50.698700+0000","last_fullsized":"2024-09-17T06:07:50.698700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.213042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:36.033960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699125+0000","last_change":"2024-09-17T06:06:53.226240+0000","last_active":"2024-09-17T06:07:50.699125+0000","last_peered":"2024-09-17T06:07:50.699125+0000","last_clean":"2024-09-17T06:07:50.699125+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:07:50.699125+0000","last_undegraded":"2024-09-17T06:07:50.699125+0000","last_fullsized":"2024-09-17T06:07:50.699125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'16","last_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_deep_scrub":"81'16","last_deep_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.226044+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:15.604828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842608+0000","last_change":"2024-09-17T06:06:50.593476+0000","last_active":"2024-09-17T06:07:50.842608+0000","last_peered":"2024-09-17T06:07:50.842608+0000","last_clean":"2024-09-17T06:07:50.842608+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:07:50.842608+0000","last_undegraded":"2024-09-17T06:07:50.842608+0000","last_fullsized":"2024-09-17T06:07:50.842608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.593281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.041524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698111+0000","last_change":"2024-09-17T06:06:53.662277+0000","last_active":"2024-09-17T06:07:50.698111+0000","last_peered":"2024-09-17T06:07:50.698111+0000","last_clean":"2024-09-17T06:07:50.698111+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:07:50.698111+0000","last_undegraded":"2024-09-17T06:07:50.698111+0000","last_fullsized":"2024-09-17T06:07:50.698111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.662083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:09.458813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840853+0000","last_change":"2024-09-17T06:06:54.601401+0000","last_active":"2024-09-17T06:07:50.840853+0000","last_peered":"2024-09-17T06:07:50.840853+0000","last_clean":"2024-09-17T06:07:50.840853+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:07:50.840853+0000","last_undegraded":"2024-09-17T06:07:50.840853+0000","last_fullsized":"2024-09-17T06:07:50.840853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.601206+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:30.575859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218920+0000","last_change":"2024-09-17T06:06:54.592256+0000","last_active":"2024-09-17T06:07:51.218920+0000","last_peered":"2024-09-17T06:07:51.218920+0000","last_clean":"2024-09-17T06:07:51.218920+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:07:51.218920+0000","last_undegraded":"2024-09-17T06:07:51.218920+0000","last_fullsized":"2024-09-17T06:07:51.218920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.591916+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:43.180179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840826+0000","last_change":"2024-09-17T06:06:57.597911+0000","last_active":"2024-09-17T06:07:50.840826+0000","last_peered":"2024-09-17T06:07:50.840826+0000","last_clean":"2024-09-17T06:07:50.840826+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:07:50.840826+0000","last_undegraded":"2024-09-17T06:07:50.840826+0000","last_fullsized":"2024-09-17T06:07:50.840826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.597715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:05.028145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219802+0000","last_change":"2024-09-17T06:06:55.569378+0000","last_active":"2024-09-17T06:07:51.219802+0000","last_peered":"2024-09-17T06:07:51.219802+0000","last_clean":"2024-09-17T06:07:51.219802+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:07:51.219802+0000","last_undegraded":"2024-09-17T06:07:51.219802+0000","last_fullsized":"2024-09-17T06:07:51.219802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.569171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:50.988830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222343+0000","last_change":"2024-09-17T06:06:46.576687+0000","last_active":"2024-09-17T06:07:51.222343+0000","last_peered":"2024-09-17T06:07:51.222343+0000","last_clean":"2024-09-17T06:07:51.222343+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:07:51.222343+0000","last_undegraded":"2024-09-17T06:07:51.222343+0000","last_fullsized":"2024-09-17T06:07:51.222343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:36.143901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222113+0000","last_change":"2024-09-17T06:06:46.022759+0000","last_active":"2024-09-17T06:07:51.222113+0000","last_peered":"2024-09-17T06:07:51.222113+0000","last_clean":"2024-09-17T06:07:51.222113+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:07:51.222113+0000","last_undegraded":"2024-09-17T06:07:51.222113+0000","last_fullsized":"2024-09-17T06:07:51.222113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.022447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.814300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842464+0000","last_change":"2024-09-17T06:06:56.620251+0000","last_active":"2024-09-17T06:07:50.842464+0000","last_peered":"2024-09-17T06:07:50.842464+0000","last_clean":"2024-09-17T06:07:50.842464+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:07:50.842464+0000","last_undegraded":"2024-09-17T06:07:50.842464+0000","last_fullsized":"2024-09-17T06:07:50.842464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.619933+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:00.010218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1044480,"data_stored":558879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509511,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":522541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509511,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1605632,"data_stored":1113225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509511,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1593344,"data_stored":1113079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":558467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906986,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":1007616,"data_stored":522255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509511,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":999424,"data_stored":522199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542213,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":999424,"data_stored":522219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:09:24.519 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-17T06:04:07.793905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=4, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=35, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T06:09:24.519 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2a 2024-09-17T06:09:24.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.709+0000 7fd1b14eb640 1 -- 172.21.15.122:0/149708360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1ac153310 msgr2=0x7fd1ac15aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:24.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.709+0000 7fd1b14eb640 1 --2- 172.21.15.122:0/149708360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1ac153310 0x7fd1ac15aa30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009c80 tx=0x7fd1a401f5a0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.709+0000 7fd1b14eb640 1 -- 172.21.15.122:0/149708360 shutdown_connections 2024-09-17T06:09:24.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.709+0000 7fd1b14eb640 1 --2- 172.21.15.122:0/149708360 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1ac153310 0x7fd1ac15aa30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.709+0000 7fd1b14eb640 1 --2- 172.21.15.122:0/149708360 >> v2:172.21.15.173:3300/0 conn(0x7fd1ac0c6780 0x7fd1ac159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.709+0000 7fd1b14eb640 1 -- 172.21.15.122:0/149708360 >> 172.21.15.122:0/149708360 conn(0x7fd1ac0746d0 msgr2=0x7fd1ac074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:24.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.709+0000 7fd1b14eb640 1 -- 172.21.15.122:0/149708360 shutdown_connections 2024-09-17T06:09:24.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.709+0000 7fd1b14eb640 1 -- 172.21.15.122:0/149708360 wait complete. 2024-09-17T06:09:24.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1b14eb640 1 Processor -- start 2024-09-17T06:09:24.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1b14eb640 1 -- start start 2024-09-17T06:09:24.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1b14eb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1ac0c6780 0x7fd1ac154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:24.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1b14eb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ac152f00 0x7fd1ac1f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:24.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1b14eb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1ac153310 0x7fd1ac146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:24.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1b14eb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac15d470 con 0x7fd1ac152f00 2024-09-17T06:09:24.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1b14eb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac15d190 con 0x7fd1ac0c6780 2024-09-17T06:09:24.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1b14eb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ac0b8cf0 con 0x7fd1ac153310 2024-09-17T06:09:24.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1aa7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ac152f00 0x7fd1ac1f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:24.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1aa7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ac152f00 0x7fd1ac1f31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:50466/0 (socket says 172.21.15.122:50466) 2024-09-17T06:09:24.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1aa7fc640 1 -- 172.21.15.122:0/127685289 learned_addr learned my addr 172.21.15.122:0/127685289 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:24.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1ab7fe640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1ac153310 0x7fd1ac146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:24.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1aaffd640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1ac0c6780 0x7fd1ac154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:24.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1aa7fc640 1 -- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1ac153310 msgr2=0x7fd1ac146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:24.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1aa7fc640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1ac153310 0x7fd1ac146960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1aa7fc640 1 -- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1ac0c6780 msgr2=0x7fd1ac154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:24.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1aa7fc640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1ac0c6780 0x7fd1ac154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1aa7fc640 1 -- 172.21.15.122:0/127685289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac1f36e0 con 0x7fd1ac152f00 2024-09-17T06:09:24.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1aaffd640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1ac0c6780 0x7fd1ac154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T06:09:24.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1aa7fc640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ac152f00 0x7fd1ac1f31a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000c430 tx=0x7fd1a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:24.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1937fe640 1 -- 172.21.15.122:0/127685289 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0017070 con 0x7fd1ac152f00 2024-09-17T06:09:24.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1937fe640 1 -- 172.21.15.122:0/127685289 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1a00053c0 con 0x7fd1ac152f00 2024-09-17T06:09:24.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1b14eb640 1 -- 172.21.15.122:0/127685289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ac1525a0 con 0x7fd1ac152f00 2024-09-17T06:09:24.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1937fe640 1 -- 172.21.15.122:0/127685289 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0003860 con 0x7fd1ac152f00 2024-09-17T06:09:24.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.713+0000 7fd1b14eb640 1 -- 172.21.15.122:0/127685289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ac0cab60 con 0x7fd1ac152f00 2024-09-17T06:09:24.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.717+0000 7fd1b14eb640 1 -- 172.21.15.122:0/127685289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ac072a60 con 0x7fd1ac152f00 2024-09-17T06:09:24.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.717+0000 7fd1937fe640 1 -- 172.21.15.122:0/127685289 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd1a001a070 con 0x7fd1ac152f00 2024-09-17T06:09:24.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.717+0000 7fd1937fe640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd198073200 0x7fd198075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:24.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.717+0000 7fd1937fe640 1 -- 172.21.15.122:0/127685289 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6854+0+0 (secure 0 0 0) 0x7fd1a00938e0 con 0x7fd1ac152f00 2024-09-17T06:09:24.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.717+0000 7fd1aaffd640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd198073200 0x7fd198075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:24.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.717+0000 7fd1aaffd640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd198073200 0x7fd198075710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009b90 tx=0x7fd19c0091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:24.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.721+0000 7fd1937fe640 1 -- 172.21.15.122:0/127685289 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd1a005df50 con 0x7fd1ac152f00 2024-09-17T06:09:24.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.881+0000 7fd1b14eb640 1 -- 172.21.15.122:0/127685289 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg deep-scrub", "pgid": "3.2a", "target": ["mon-mgr", ""]}) -- 0x7fd1ac0c3650 con 0x7fd198073200 2024-09-17T06:09:24.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.881+0000 7fd1937fe640 1 -- 172.21.15.122:0/127685289 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 instructing pg 3.2a on osd.2 to deep-scrub) ==== 50+0+0 (secure 0 0 0) 0x7fd1ac0c3650 con 0x7fd198073200 2024-09-17T06:09:24.886 INFO:teuthology.orchestra.run.smithi122.stderr:instructing pg 3.2a on osd.2 to deep-scrub 2024-09-17T06:09:24.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.885+0000 7fd1b14eb640 1 -- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd198073200 msgr2=0x7fd198075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:24.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.885+0000 7fd1b14eb640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd198073200 0x7fd198075710 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009b90 tx=0x7fd19c0091e0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.885+0000 7fd1b14eb640 1 -- 172.21.15.122:0/127685289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ac152f00 msgr2=0x7fd1ac1f31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:24.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.885+0000 7fd1b14eb640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ac152f00 0x7fd1ac1f31a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000c430 tx=0x7fd1a000c8f0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.885+0000 7fd1b14eb640 1 -- 172.21.15.122:0/127685289 shutdown_connections 2024-09-17T06:09:24.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.885+0000 7fd1b14eb640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd1ac153310 0x7fd1ac146960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.885+0000 7fd1b14eb640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ac152f00 0x7fd1ac1f31a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.885+0000 7fd1b14eb640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fd198073200 0x7fd198075710 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.885+0000 7fd1b14eb640 1 --2- 172.21.15.122:0/127685289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd1ac0c6780 0x7fd1ac154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:24.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.885+0000 7fd1b14eb640 1 -- 172.21.15.122:0/127685289 >> 172.21.15.122:0/127685289 conn(0x7fd1ac0746d0 msgr2=0x7fd1ac1e49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:24.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.885+0000 7fd1b14eb640 1 -- 172.21.15.122:0/127685289 shutdown_connections 2024-09-17T06:09:24.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:24.885+0000 7fd1b14eb640 1 -- 172.21.15.122:0/127685289 wait complete. 2024-09-17T06:09:24.907 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T06:09:36.284 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:09:36.287 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:09:44.907 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T06:09:45.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.072+0000 7fb737fbf640 1 -- 172.21.15.122:0/2021728507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73006e4d0 msgr2=0x7fb730153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.072+0000 7fb737fbf640 1 --2- 172.21.15.122:0/2021728507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73006e4d0 0x7fb730153350 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb7300c4b50 tx=0x7fb72001c890 comp rx=0 tx=0).stop 2024-09-17T06:09:45.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.072+0000 7fb737fbf640 1 -- 172.21.15.122:0/2021728507 shutdown_connections 2024-09-17T06:09:45.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.072+0000 7fb737fbf640 1 --2- 172.21.15.122:0/2021728507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73006e4d0 0x7fb730153350 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.072+0000 7fb737fbf640 1 --2- 172.21.15.122:0/2021728507 >> v2:172.21.15.173:3300/0 conn(0x7fb73006f520 0x7fb73006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.072+0000 7fb737fbf640 1 -- 172.21.15.122:0/2021728507 >> 172.21.15.122:0/2021728507 conn(0x7fb730072fe0 msgr2=0x7fb7300733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:45.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.072+0000 7fb737fbf640 1 -- 172.21.15.122:0/2021728507 shutdown_connections 2024-09-17T06:09:45.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.072+0000 7fb737fbf640 1 -- 172.21.15.122:0/2021728507 wait complete. 2024-09-17T06:09:45.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb737fbf640 1 Processor -- start 2024-09-17T06:09:45.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb737fbf640 1 -- start start 2024-09-17T06:09:45.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb737fbf640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb73006e4d0 0x7fb730142470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb737fbf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73006ea20 0x7fb730145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb737fbf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb73006f520 0x7fb730145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb737fbf640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb73015a190 con 0x7fb73006ea20 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb737fbf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb73015a010 con 0x7fb73006f520 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb737fbf640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb73006ee30 con 0x7fb73006e4d0 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb73555a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73006ea20 0x7fb730145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb73555a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73006ea20 0x7fb730145740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56540/0 (socket says 172.21.15.122:56540) 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb73555a640 1 -- 172.21.15.122:0/3507659492 learned_addr learned my addr 172.21.15.122:0/3507659492 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb735d5b640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb73006e4d0 0x7fb730142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb73555a640 1 -- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb73006e4d0 msgr2=0x7fb730142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb73555a640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb73006e4d0 0x7fb730142470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb73555a640 1 -- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb73006f520 msgr2=0x7fb730145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb73555a640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb73006f520 0x7fb730145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb73555a640 1 -- 172.21.15.122:0/3507659492 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73014abe0 con 0x7fb73006ea20 2024-09-17T06:09:45.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb73555a640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73006ea20 0x7fb730145740 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb7200b0040 tx=0x7fb7200040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:45.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb7267fc640 1 -- 172.21.15.122:0/3507659492 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7200b2040 con 0x7fb73006ea20 2024-09-17T06:09:45.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb7267fc640 1 -- 172.21.15.122:0/3507659492 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb720003600 con 0x7fb73006ea20 2024-09-17T06:09:45.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb7267fc640 1 -- 172.21.15.122:0/3507659492 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720003a50 con 0x7fb73006ea20 2024-09-17T06:09:45.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb737fbf640 1 -- 172.21.15.122:0/3507659492 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb730157e60 con 0x7fb73006ea20 2024-09-17T06:09:45.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb737fbf640 1 -- 172.21.15.122:0/3507659492 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73014d2c0 con 0x7fb73006ea20 2024-09-17T06:09:45.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.076+0000 7fb737fbf640 1 -- 172.21.15.122:0/3507659492 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb73006f9c0 con 0x7fb73006ea20 2024-09-17T06:09:45.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.080+0000 7fb7267fc640 1 -- 172.21.15.122:0/3507659492 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb720003bf0 con 0x7fb73006ea20 2024-09-17T06:09:45.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.080+0000 7fb7267fc640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb714073200 0x7fb714075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:45.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.080+0000 7fb7267fc640 1 -- 172.21.15.122:0/3507659492 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6854+0+0 (secure 0 0 0) 0x7fb72012e3a0 con 0x7fb73006ea20 2024-09-17T06:09:45.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.080+0000 7fb735d5b640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb714073200 0x7fb714075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:45.085 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.080+0000 7fb735d5b640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb714073200 0x7fb714075710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0058d0 tx=0x7fb72c005bd0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:45.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.084+0000 7fb7267fc640 1 -- 172.21.15.122:0/3507659492 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb7200164b0 con 0x7fb73006ea20 2024-09-17T06:09:45.256 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.252+0000 7fb737fbf640 1 -- 172.21.15.122:0/3507659492 --> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb730158570 con 0x7fb714073200 2024-09-17T06:09:45.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.268+0000 7fb7267fc640 1 -- 172.21.15.122:0/3507659492 <== mgr.4120 v2:172.21.15.173:6800/1192300952 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332991 (secure 0 0 0) 0x7fb72c00b570 con 0x7fb714073200 2024-09-17T06:09:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:09:45.277 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-17T06:09:45.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.272+0000 7fb737fbf640 1 -- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb714073200 msgr2=0x7fb714075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.272+0000 7fb737fbf640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb714073200 0x7fb714075710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0058d0 tx=0x7fb72c005bd0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.272+0000 7fb737fbf640 1 -- 172.21.15.122:0/3507659492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73006ea20 msgr2=0x7fb730145740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.272+0000 7fb737fbf640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73006ea20 0x7fb730145740 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb7200b0040 tx=0x7fb7200040c0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.272+0000 7fb737fbf640 1 -- 172.21.15.122:0/3507659492 shutdown_connections 2024-09-17T06:09:45.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.272+0000 7fb737fbf640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fb714073200 0x7fb714075710 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.272+0000 7fb737fbf640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb73006f520 0x7fb730145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.272+0000 7fb737fbf640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb73006ea20 0x7fb730145740 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.272+0000 7fb737fbf640 1 --2- 172.21.15.122:0/3507659492 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb73006e4d0 0x7fb730142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.272+0000 7fb737fbf640 1 -- 172.21.15.122:0/3507659492 >> 172.21.15.122:0/3507659492 conn(0x7fb730072fe0 msgr2=0x7fb73014ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:45.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.272+0000 7fb737fbf640 1 -- 172.21.15.122:0/3507659492 shutdown_connections 2024-09-17T06:09:45.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.272+0000 7fb737fbf640 1 -- 172.21.15.122:0/3507659492 wait complete. 2024-09-17T06:09:45.299 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-17T06:09:43.663059+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":627916,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":190,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247136,"kb_used_data":9072,"kb_used_omap":17,"kb_used_meta":237870,"kb_avail":754727584,"statfs":{"total":773094113280,"available":772841046016,"internally_reserved":0,"allocated":9289728,"data_stored":5432864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17683,"internal_metadata":243579629},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005454"},"pg_stats":[{"pgid":"2.1f","version":"81'6","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224051+0000","last_change":"2024-09-17T06:06:38.646633+0000","last_active":"2024-09-17T06:07:51.224051+0000","last_peered":"2024-09-17T06:07:51.224051+0000","last_clean":"2024-09-17T06:07:51.224051+0000","last_became_active":"2024-09-17T06:04:07.836743+0000","last_became_peered":"2024-09-17T06:04:07.836743+0000","last_unstale":"2024-09-17T06:07:51.224051+0000","last_undegraded":"2024-09-17T06:07:51.224051+0000","last_fullsized":"2024-09-17T06:07:51.224051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:38.646522+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.646522+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:55.373873+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699959+0000","last_change":"2024-09-17T06:06:47.678984+0000","last_active":"2024-09-17T06:07:50.699959+0000","last_peered":"2024-09-17T06:07:50.699959+0000","last_clean":"2024-09-17T06:07:50.699959+0000","last_became_active":"2024-09-17T06:06:14.882375+0000","last_became_peered":"2024-09-17T06:06:14.882375+0000","last_unstale":"2024-09-17T06:07:50.699959+0000","last_undegraded":"2024-09-17T06:07:50.699959+0000","last_fullsized":"2024-09-17T06:07:50.699959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:47.678793+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.678793+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:31.584591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698029+0000","last_change":"2024-09-17T06:06:55.606541+0000","last_active":"2024-09-17T06:07:50.698029+0000","last_peered":"2024-09-17T06:07:50.698029+0000","last_clean":"2024-09-17T06:07:50.698029+0000","last_became_active":"2024-09-17T06:06:15.368123+0000","last_became_peered":"2024-09-17T06:06:15.368123+0000","last_unstale":"2024-09-17T06:07:50.698029+0000","last_undegraded":"2024-09-17T06:07:50.698029+0000","last_fullsized":"2024-09-17T06:07:50.698029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.606346+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.606346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:05.514205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700296+0000","last_change":"2024-09-17T06:06:41.626922+0000","last_active":"2024-09-17T06:07:50.700296+0000","last_peered":"2024-09-17T06:07:50.700296+0000","last_clean":"2024-09-17T06:07:50.700296+0000","last_became_active":"2024-09-17T06:06:14.876359+0000","last_became_peered":"2024-09-17T06:06:14.876359+0000","last_unstale":"2024-09-17T06:07:50.700296+0000","last_undegraded":"2024-09-17T06:07:50.700296+0000","last_fullsized":"2024-09-17T06:07:50.700296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:41.626723+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.626723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:41.581056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223163+0000","last_change":"2024-09-17T06:06:42.561017+0000","last_active":"2024-09-17T06:07:51.223163+0000","last_peered":"2024-09-17T06:07:51.223163+0000","last_clean":"2024-09-17T06:07:51.223163+0000","last_became_active":"2024-09-17T06:04:08.839032+0000","last_became_peered":"2024-09-17T06:04:08.839032+0000","last_unstale":"2024-09-17T06:07:51.223163+0000","last_undegraded":"2024-09-17T06:07:51.223163+0000","last_fullsized":"2024-09-17T06:07:51.223163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:42.560815+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.560815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:06.386417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695113+0000","last_change":"2024-09-17T06:06:50.581741+0000","last_active":"2024-09-17T06:07:50.695113+0000","last_peered":"2024-09-17T06:07:50.695113+0000","last_clean":"2024-09-17T06:07:50.695113+0000","last_became_active":"2024-09-17T06:06:02.756443+0000","last_became_peered":"2024-09-17T06:06:02.756443+0000","last_unstale":"2024-09-17T06:07:50.695113+0000","last_undegraded":"2024-09-17T06:07:50.695113+0000","last_fullsized":"2024-09-17T06:07:50.695113+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.581526+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.581526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:27.538796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842144+0000","last_change":"2024-09-17T06:06:44.503792+0000","last_active":"2024-09-17T06:07:50.842144+0000","last_peered":"2024-09-17T06:07:50.842144+0000","last_clean":"2024-09-17T06:07:50.842144+0000","last_became_active":"2024-09-17T06:04:07.850659+0000","last_became_peered":"2024-09-17T06:04:07.850659+0000","last_unstale":"2024-09-17T06:07:50.842144+0000","last_undegraded":"2024-09-17T06:07:50.842144+0000","last_fullsized":"2024-09-17T06:07:50.842144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:44.503569+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.503569+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.329171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":166,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219809+0000","last_change":"2024-09-17T06:06:49.490282+0000","last_active":"2024-09-17T06:07:51.219809+0000","last_peered":"2024-09-17T06:07:51.219809+0000","last_clean":"2024-09-17T06:07:51.219809+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:07:51.219809+0000","last_undegraded":"2024-09-17T06:07:51.219809+0000","last_fullsized":"2024-09-17T06:07:51.219809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.490084+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.490084+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:52.911935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700279+0000","last_change":"2024-09-17T06:06:51.542004+0000","last_active":"2024-09-17T06:07:50.700279+0000","last_peered":"2024-09-17T06:07:50.700279+0000","last_clean":"2024-09-17T06:07:50.700279+0000","last_became_active":"2024-09-17T06:06:02.761210+0000","last_became_peered":"2024-09-17T06:06:02.761210+0000","last_unstale":"2024-09-17T06:07:50.700279+0000","last_undegraded":"2024-09-17T06:07:50.700279+0000","last_fullsized":"2024-09-17T06:07:50.700279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.541795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.541795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:02.542454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'3","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841688+0000","last_change":"2024-09-17T06:06:45.535472+0000","last_active":"2024-09-17T06:07:50.841688+0000","last_peered":"2024-09-17T06:07:50.841688+0000","last_clean":"2024-09-17T06:07:50.841688+0000","last_became_active":"2024-09-17T06:04:07.859269+0000","last_became_peered":"2024-09-17T06:04:07.859269+0000","last_unstale":"2024-09-17T06:07:50.841688+0000","last_undegraded":"2024-09-17T06:07:50.841688+0000","last_fullsized":"2024-09-17T06:07:50.841688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:45.535262+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.535262+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:56.606861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.692929+0000","last_change":"2024-09-17T06:06:45.459635+0000","last_active":"2024-09-17T06:07:50.692929+0000","last_peered":"2024-09-17T06:07:50.692929+0000","last_clean":"2024-09-17T06:07:50.692929+0000","last_became_active":"2024-09-17T06:06:02.746732+0000","last_became_peered":"2024-09-17T06:06:02.746732+0000","last_unstale":"2024-09-17T06:07:50.692929+0000","last_undegraded":"2024-09-17T06:07:50.692929+0000","last_fullsized":"2024-09-17T06:07:50.692929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:45.459406+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.459406+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:41.152666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699444+0000","last_change":"2024-09-17T06:06:52.519889+0000","last_active":"2024-09-17T06:07:50.699444+0000","last_peered":"2024-09-17T06:07:50.699444+0000","last_clean":"2024-09-17T06:07:50.699444+0000","last_became_active":"2024-09-17T06:06:02.756533+0000","last_became_peered":"2024-09-17T06:06:02.756533+0000","last_unstale":"2024-09-17T06:07:50.699444+0000","last_undegraded":"2024-09-17T06:07:50.699444+0000","last_fullsized":"2024-09-17T06:07:50.699444+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.519692+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.519692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:06.562811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695680+0000","last_change":"2024-09-17T06:06:46.282925+0000","last_active":"2024-09-17T06:07:50.695680+0000","last_peered":"2024-09-17T06:07:50.695680+0000","last_clean":"2024-09-17T06:07:50.695680+0000","last_became_active":"2024-09-17T06:06:02.771129+0000","last_became_peered":"2024-09-17T06:06:02.771129+0000","last_unstale":"2024-09-17T06:07:50.695680+0000","last_undegraded":"2024-09-17T06:07:50.695680+0000","last_fullsized":"2024-09-17T06:07:50.695680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:46.282607+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.282607+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:45.646843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841728+0000","last_change":"2024-09-17T06:06:47.578055+0000","last_active":"2024-09-17T06:07:50.841728+0000","last_peered":"2024-09-17T06:07:50.841728+0000","last_clean":"2024-09-17T06:07:50.841728+0000","last_became_active":"2024-09-17T06:06:02.763194+0000","last_became_peered":"2024-09-17T06:06:02.763194+0000","last_unstale":"2024-09-17T06:07:50.841728+0000","last_undegraded":"2024-09-17T06:07:50.841728+0000","last_fullsized":"2024-09-17T06:07:50.841728+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:47.577825+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.577825+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:54.466675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699912+0000","last_change":"2024-09-17T06:06:48.564278+0000","last_active":"2024-09-17T06:07:50.699912+0000","last_peered":"2024-09-17T06:07:50.699912+0000","last_clean":"2024-09-17T06:07:50.699912+0000","last_became_active":"2024-09-17T06:06:02.761034+0000","last_became_peered":"2024-09-17T06:06:02.761034+0000","last_unstale":"2024-09-17T06:07:50.699912+0000","last_undegraded":"2024-09-17T06:07:50.699912+0000","last_fullsized":"2024-09-17T06:07:50.699912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.564076+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.564076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:09.526182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698658+0000","last_change":"2024-09-17T06:06:45.719909+0000","last_active":"2024-09-17T06:07:50.698658+0000","last_peered":"2024-09-17T06:07:50.698658+0000","last_clean":"2024-09-17T06:07:50.698658+0000","last_became_active":"2024-09-17T06:06:14.875649+0000","last_became_peered":"2024-09-17T06:06:14.875649+0000","last_unstale":"2024-09-17T06:07:50.698658+0000","last_undegraded":"2024-09-17T06:07:50.698658+0000","last_fullsized":"2024-09-17T06:07:50.698658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:45.719724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.719724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:01:58.812630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221112+0000","last_change":"2024-09-17T06:06:39.054952+0000","last_active":"2024-09-17T06:07:51.221112+0000","last_peered":"2024-09-17T06:07:51.221112+0000","last_clean":"2024-09-17T06:07:51.221112+0000","last_became_active":"2024-09-17T06:04:07.835590+0000","last_became_peered":"2024-09-17T06:04:07.835590+0000","last_unstale":"2024-09-17T06:07:51.221112+0000","last_undegraded":"2024-09-17T06:07:51.221112+0000","last_fullsized":"2024-09-17T06:07:51.221112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.054879+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.054879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:22.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700935+0000","last_change":"2024-09-17T06:06:47.595782+0000","last_active":"2024-09-17T06:07:50.700935+0000","last_peered":"2024-09-17T06:07:50.700935+0000","last_clean":"2024-09-17T06:07:50.700935+0000","last_became_active":"2024-09-17T06:06:02.776099+0000","last_became_peered":"2024-09-17T06:06:02.776099+0000","last_unstale":"2024-09-17T06:07:50.700935+0000","last_undegraded":"2024-09-17T06:07:50.700935+0000","last_fullsized":"2024-09-17T06:07:50.700935+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.595562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.595562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.305297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700008+0000","last_change":"2024-09-17T06:06:44.685583+0000","last_active":"2024-09-17T06:07:50.700008+0000","last_peered":"2024-09-17T06:07:50.700008+0000","last_clean":"2024-09-17T06:07:50.700008+0000","last_became_active":"2024-09-17T06:06:14.859346+0000","last_became_peered":"2024-09-17T06:06:14.859346+0000","last_unstale":"2024-09-17T06:07:50.700008+0000","last_undegraded":"2024-09-17T06:07:50.700008+0000","last_fullsized":"2024-09-17T06:07:50.700008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:44.685386+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.685386+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:42.733827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221010+0000","last_change":"2024-09-17T06:06:41.096528+0000","last_active":"2024-09-17T06:07:51.221010+0000","last_peered":"2024-09-17T06:07:51.221010+0000","last_clean":"2024-09-17T06:07:51.221010+0000","last_became_active":"2024-09-17T06:04:07.847696+0000","last_became_peered":"2024-09-17T06:04:07.847696+0000","last_unstale":"2024-09-17T06:07:51.221010+0000","last_undegraded":"2024-09-17T06:07:51.221010+0000","last_fullsized":"2024-09-17T06:07:51.221010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.096443+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.096443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.182798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223139+0000","last_change":"2024-09-17T06:06:51.955862+0000","last_active":"2024-09-17T06:07:51.223139+0000","last_peered":"2024-09-17T06:07:51.223139+0000","last_clean":"2024-09-17T06:07:51.223139+0000","last_became_active":"2024-09-17T06:06:02.770986+0000","last_became_peered":"2024-09-17T06:06:02.770986+0000","last_unstale":"2024-09-17T06:07:51.223139+0000","last_undegraded":"2024-09-17T06:07:51.223139+0000","last_fullsized":"2024-09-17T06:07:51.223139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.955662+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.955662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.579450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":73,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695797+0000","last_change":"2024-09-17T06:06:41.561023+0000","last_active":"2024-09-17T06:07:50.695797+0000","last_peered":"2024-09-17T06:07:50.695797+0000","last_clean":"2024-09-17T06:07:50.695797+0000","last_became_active":"2024-09-17T06:06:02.741598+0000","last_became_peered":"2024-09-17T06:06:02.741598+0000","last_unstale":"2024-09-17T06:07:50.695797+0000","last_undegraded":"2024-09-17T06:07:50.695797+0000","last_fullsized":"2024-09-17T06:07:50.695797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:41.560833+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.560833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:35.979151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840821+0000","last_change":"2024-09-17T06:06:51.569920+0000","last_active":"2024-09-17T06:07:50.840821+0000","last_peered":"2024-09-17T06:07:50.840821+0000","last_clean":"2024-09-17T06:07:50.840821+0000","last_became_active":"2024-09-17T06:04:07.844357+0000","last_became_peered":"2024-09-17T06:04:07.844357+0000","last_unstale":"2024-09-17T06:07:50.840821+0000","last_undegraded":"2024-09-17T06:07:50.840821+0000","last_fullsized":"2024-09-17T06:07:50.840821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:51.569724+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.569724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:16.044884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699903+0000","last_change":"2024-09-17T06:06:54.534994+0000","last_active":"2024-09-17T06:07:50.699903+0000","last_peered":"2024-09-17T06:07:50.699903+0000","last_clean":"2024-09-17T06:07:50.699903+0000","last_became_active":"2024-09-17T06:06:49.862233+0000","last_became_peered":"2024-09-17T06:06:49.862233+0000","last_unstale":"2024-09-17T06:07:50.699903+0000","last_undegraded":"2024-09-17T06:07:50.699903+0000","last_fullsized":"2024-09-17T06:07:50.699903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.534811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:53.555338+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.534811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:09.975013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,1],"acting":[4,2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225630+0000","last_change":"2024-09-17T06:06:39.595362+0000","last_active":"2024-09-17T06:07:51.225630+0000","last_peered":"2024-09-17T06:07:51.225630+0000","last_clean":"2024-09-17T06:07:51.225630+0000","last_became_active":"2024-09-17T06:04:08.842385+0000","last_became_peered":"2024-09-17T06:04:08.842385+0000","last_unstale":"2024-09-17T06:07:51.225630+0000","last_undegraded":"2024-09-17T06:07:51.225630+0000","last_fullsized":"2024-09-17T06:07:51.225630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.595150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.595150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:36.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697737+0000","last_change":"2024-09-17T06:06:41.345210+0000","last_active":"2024-09-17T06:07:50.697737+0000","last_peered":"2024-09-17T06:07:50.697737+0000","last_clean":"2024-09-17T06:07:50.697737+0000","last_became_active":"2024-09-17T06:04:07.847043+0000","last_became_peered":"2024-09-17T06:04:07.847043+0000","last_unstale":"2024-09-17T06:07:50.697737+0000","last_undegraded":"2024-09-17T06:07:50.697737+0000","last_fullsized":"2024-09-17T06:07:50.697737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:41.345015+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.345015+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:38.207077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696384+0000","last_change":"2024-09-17T06:06:44.540629+0000","last_active":"2024-09-17T06:07:50.696384+0000","last_peered":"2024-09-17T06:07:50.696384+0000","last_clean":"2024-09-17T06:07:50.696384+0000","last_became_active":"2024-09-17T06:06:02.766864+0000","last_became_peered":"2024-09-17T06:06:02.766864+0000","last_unstale":"2024-09-17T06:07:50.696384+0000","last_undegraded":"2024-09-17T06:07:50.696384+0000","last_fullsized":"2024-09-17T06:07:50.696384+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.540426+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.540426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:03.473101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700607+0000","last_change":"2024-09-17T06:06:43.669448+0000","last_active":"2024-09-17T06:07:50.700607+0000","last_peered":"2024-09-17T06:07:50.700607+0000","last_clean":"2024-09-17T06:07:50.700607+0000","last_became_active":"2024-09-17T06:06:14.875205+0000","last_became_peered":"2024-09-17T06:06:14.875205+0000","last_unstale":"2024-09-17T06:07:50.700607+0000","last_undegraded":"2024-09-17T06:07:50.700607+0000","last_fullsized":"2024-09-17T06:07:50.700607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:43.669209+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.669209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:54.877316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222424+0000","last_change":"2024-09-17T06:06:38.067895+0000","last_active":"2024-09-17T06:07:51.222424+0000","last_peered":"2024-09-17T06:07:51.222424+0000","last_clean":"2024-09-17T06:07:51.222424+0000","last_became_active":"2024-09-17T06:04:07.846043+0000","last_became_peered":"2024-09-17T06:04:07.846043+0000","last_unstale":"2024-09-17T06:07:51.222424+0000","last_undegraded":"2024-09-17T06:07:51.222424+0000","last_fullsized":"2024-09-17T06:07:51.222424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:38.067715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.067715+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:26.508119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.230386+0000","last_change":"2024-09-17T06:07:51.228200+0000","last_active":"2024-09-17T06:07:51.230386+0000","last_peered":"2024-09-17T06:07:51.230386+0000","last_clean":"2024-09-17T06:07:51.230386+0000","last_became_active":"2024-09-17T06:07:51.226510+0000","last_became_peered":"2024-09-17T06:07:51.226510+0000","last_unstale":"2024-09-17T06:07:51.230386+0000","last_undegraded":"2024-09-17T06:07:51.230386+0000","last_fullsized":"2024-09-17T06:07:51.230386+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.651441+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.651441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:14.647137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221616+0000","last_change":"2024-09-17T06:06:45.060936+0000","last_active":"2024-09-17T06:07:51.221616+0000","last_peered":"2024-09-17T06:07:51.221616+0000","last_clean":"2024-09-17T06:07:51.221616+0000","last_became_active":"2024-09-17T06:04:08.830964+0000","last_became_peered":"2024-09-17T06:04:08.830964+0000","last_unstale":"2024-09-17T06:07:51.221616+0000","last_undegraded":"2024-09-17T06:07:51.221616+0000","last_fullsized":"2024-09-17T06:07:51.221616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.060719+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.060719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:03.842916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842537+0000","last_change":"2024-09-17T06:06:43.537259+0000","last_active":"2024-09-17T06:07:50.842537+0000","last_peered":"2024-09-17T06:07:50.842537+0000","last_clean":"2024-09-17T06:07:50.842537+0000","last_became_active":"2024-09-17T06:04:07.854923+0000","last_became_peered":"2024-09-17T06:04:07.854923+0000","last_unstale":"2024-09-17T06:07:50.842537+0000","last_undegraded":"2024-09-17T06:07:50.842537+0000","last_fullsized":"2024-09-17T06:07:50.842537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:43.537064+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.537064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:53.557183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224692+0000","last_change":"2024-09-17T06:06:50.588334+0000","last_active":"2024-09-17T06:07:51.224692+0000","last_peered":"2024-09-17T06:07:51.224692+0000","last_clean":"2024-09-17T06:07:51.224692+0000","last_became_active":"2024-09-17T06:04:13.033964+0000","last_became_peered":"2024-09-17T06:04:13.033964+0000","last_unstale":"2024-09-17T06:07:51.224692+0000","last_undegraded":"2024-09-17T06:07:51.224692+0000","last_fullsized":"2024-09-17T06:07:51.224692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.588146+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.588146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:34.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220191+0000","last_change":"2024-09-17T06:06:45.560755+0000","last_active":"2024-09-17T06:07:51.220191+0000","last_peered":"2024-09-17T06:07:51.220191+0000","last_clean":"2024-09-17T06:07:51.220191+0000","last_became_active":"2024-09-17T06:04:08.855474+0000","last_became_peered":"2024-09-17T06:04:08.855474+0000","last_unstale":"2024-09-17T06:07:51.220191+0000","last_undegraded":"2024-09-17T06:07:51.220191+0000","last_fullsized":"2024-09-17T06:07:51.220191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:45.560562+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.560562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.352415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221768+0000","last_change":"2024-09-17T06:06:40.077709+0000","last_active":"2024-09-17T06:07:51.221768+0000","last_peered":"2024-09-17T06:07:51.221768+0000","last_clean":"2024-09-17T06:07:51.221768+0000","last_became_active":"2024-09-17T06:04:07.831460+0000","last_became_peered":"2024-09-17T06:04:07.831460+0000","last_unstale":"2024-09-17T06:07:51.221768+0000","last_undegraded":"2024-09-17T06:07:51.221768+0000","last_fullsized":"2024-09-17T06:07:51.221768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.077616+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.077616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:13.235085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220023+0000","last_change":"2024-09-17T06:06:50.943563+0000","last_active":"2024-09-17T06:07:51.220023+0000","last_peered":"2024-09-17T06:07:51.220023+0000","last_clean":"2024-09-17T06:07:51.220023+0000","last_became_active":"2024-09-17T06:06:02.749461+0000","last_became_peered":"2024-09-17T06:06:02.749461+0000","last_unstale":"2024-09-17T06:07:51.220023+0000","last_undegraded":"2024-09-17T06:07:51.220023+0000","last_fullsized":"2024-09-17T06:07:51.220023+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.943366+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.943366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.661632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700452+0000","last_change":"2024-09-17T06:06:39.544246+0000","last_active":"2024-09-17T06:07:50.700452+0000","last_peered":"2024-09-17T06:07:50.700452+0000","last_clean":"2024-09-17T06:07:50.700452+0000","last_became_active":"2024-09-17T06:06:02.777526+0000","last_became_peered":"2024-09-17T06:06:02.777526+0000","last_unstale":"2024-09-17T06:07:50.700452+0000","last_undegraded":"2024-09-17T06:07:50.700452+0000","last_fullsized":"2024-09-17T06:07:50.700452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:39.544002+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.544002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:04.906600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219385+0000","last_change":"2024-09-17T06:06:41.601594+0000","last_active":"2024-09-17T06:07:51.219385+0000","last_peered":"2024-09-17T06:07:51.219385+0000","last_clean":"2024-09-17T06:07:51.219385+0000","last_became_active":"2024-09-17T06:04:07.853542+0000","last_became_peered":"2024-09-17T06:04:07.853542+0000","last_unstale":"2024-09-17T06:07:51.219385+0000","last_undegraded":"2024-09-17T06:07:51.219385+0000","last_fullsized":"2024-09-17T06:07:51.219385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:41.601393+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.601393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.687748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221448+0000","last_change":"2024-09-17T06:06:49.922504+0000","last_active":"2024-09-17T06:07:51.221448+0000","last_peered":"2024-09-17T06:07:51.221448+0000","last_clean":"2024-09-17T06:07:51.221448+0000","last_became_active":"2024-09-17T06:04:12.948194+0000","last_became_peered":"2024-09-17T06:04:12.948194+0000","last_unstale":"2024-09-17T06:07:51.221448+0000","last_undegraded":"2024-09-17T06:07:51.221448+0000","last_fullsized":"2024-09-17T06:07:51.221448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.922302+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.922302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:53.344154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222935+0000","last_change":"2024-09-17T06:06:42.067931+0000","last_active":"2024-09-17T06:07:51.222935+0000","last_peered":"2024-09-17T06:07:51.222935+0000","last_clean":"2024-09-17T06:07:51.222935+0000","last_became_active":"2024-09-17T06:04:08.830922+0000","last_became_peered":"2024-09-17T06:04:08.830922+0000","last_unstale":"2024-09-17T06:07:51.222935+0000","last_undegraded":"2024-09-17T06:07:51.222935+0000","last_fullsized":"2024-09-17T06:07:51.222935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.067737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.067737+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.818001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693159+0000","last_change":"2024-09-17T06:06:38.338953+0000","last_active":"2024-09-17T06:07:50.693159+0000","last_peered":"2024-09-17T06:07:50.693159+0000","last_clean":"2024-09-17T06:07:50.693159+0000","last_became_active":"2024-09-17T06:04:07.835468+0000","last_became_peered":"2024-09-17T06:04:07.835468+0000","last_unstale":"2024-09-17T06:07:50.693159+0000","last_undegraded":"2024-09-17T06:07:50.693159+0000","last_fullsized":"2024-09-17T06:07:50.693159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:38.338737+0000","last_clean_scrub_stamp":"2024-09-17T06:06:38.338737+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:58.670904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223389+0000","last_change":"2024-09-17T06:06:47.938470+0000","last_active":"2024-09-17T06:07:51.223389+0000","last_peered":"2024-09-17T06:07:51.223389+0000","last_clean":"2024-09-17T06:07:51.223389+0000","last_became_active":"2024-09-17T06:04:12.946534+0000","last_became_peered":"2024-09-17T06:04:12.946534+0000","last_unstale":"2024-09-17T06:07:51.223389+0000","last_undegraded":"2024-09-17T06:07:51.223389+0000","last_fullsized":"2024-09-17T06:07:51.223389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.938263+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.938263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.607027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221642+0000","last_change":"2024-09-17T06:06:41.585374+0000","last_active":"2024-09-17T06:07:51.221642+0000","last_peered":"2024-09-17T06:07:51.221642+0000","last_clean":"2024-09-17T06:07:51.221642+0000","last_became_active":"2024-09-17T06:06:02.774053+0000","last_became_peered":"2024-09-17T06:06:02.774053+0000","last_unstale":"2024-09-17T06:07:51.221642+0000","last_undegraded":"2024-09-17T06:07:51.221642+0000","last_fullsized":"2024-09-17T06:07:51.221642+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:41.585183+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.585183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:11.929990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841022+0000","last_change":"2024-09-17T06:06:42.536575+0000","last_active":"2024-09-17T06:07:50.841022+0000","last_peered":"2024-09-17T06:07:50.841022+0000","last_clean":"2024-09-17T06:07:50.841022+0000","last_became_active":"2024-09-17T06:04:07.838662+0000","last_became_peered":"2024-09-17T06:04:07.838662+0000","last_unstale":"2024-09-17T06:07:50.841022+0000","last_undegraded":"2024-09-17T06:07:50.841022+0000","last_fullsized":"2024-09-17T06:07:50.841022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.536371+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.536371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:23.547872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225264+0000","last_change":"2024-09-17T06:06:47.627398+0000","last_active":"2024-09-17T06:07:51.225264+0000","last_peered":"2024-09-17T06:07:51.225264+0000","last_clean":"2024-09-17T06:07:51.225264+0000","last_became_active":"2024-09-17T06:04:13.034296+0000","last_became_peered":"2024-09-17T06:04:13.034296+0000","last_unstale":"2024-09-17T06:07:51.225264+0000","last_undegraded":"2024-09-17T06:07:51.225264+0000","last_fullsized":"2024-09-17T06:07:51.225264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:47.627188+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.627188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:28.206295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":92,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699239+0000","last_change":"2024-09-17T06:06:42.642781+0000","last_active":"2024-09-17T06:07:50.699239+0000","last_peered":"2024-09-17T06:07:50.699239+0000","last_clean":"2024-09-17T06:07:50.699239+0000","last_became_active":"2024-09-17T06:06:14.860948+0000","last_became_peered":"2024-09-17T06:06:14.860948+0000","last_unstale":"2024-09-17T06:07:50.699239+0000","last_undegraded":"2024-09-17T06:07:50.699239+0000","last_fullsized":"2024-09-17T06:07:50.699239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:42.642468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.642468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:03.874053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219489+0000","last_change":"2024-09-17T06:06:40.563124+0000","last_active":"2024-09-17T06:07:51.219489+0000","last_peered":"2024-09-17T06:07:51.219489+0000","last_clean":"2024-09-17T06:07:51.219489+0000","last_became_active":"2024-09-17T06:04:07.852581+0000","last_became_peered":"2024-09-17T06:04:07.852581+0000","last_unstale":"2024-09-17T06:07:51.219489+0000","last_undegraded":"2024-09-17T06:07:51.219489+0000","last_fullsized":"2024-09-17T06:07:51.219489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.562781+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.562781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:51.528772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"81'74","reported_seq":248,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841224+0000","last_change":"2024-09-17T06:06:41.529207+0000","last_active":"2024-09-17T06:07:50.841224+0000","last_peered":"2024-09-17T06:07:50.841224+0000","last_clean":"2024-09-17T06:07:50.841224+0000","last_became_active":"2024-09-17T06:03:59.191285+0000","last_became_peered":"2024-09-17T06:03:59.191285+0000","last_unstale":"2024-09-17T06:07:50.841224+0000","last_undegraded":"2024-09-17T06:07:50.841224+0000","last_fullsized":"2024-09-17T06:07:50.841224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'74","last_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_deep_scrub":"81'74","last_deep_scrub_stamp":"2024-09-17T06:06:41.529006+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.529006+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:17.811347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698161+0000","last_change":"2024-09-17T06:06:50.168189+0000","last_active":"2024-09-17T06:07:50.698161+0000","last_peered":"2024-09-17T06:07:50.698161+0000","last_clean":"2024-09-17T06:07:50.698161+0000","last_became_active":"2024-09-17T06:06:02.750443+0000","last_became_peered":"2024-09-17T06:06:02.750443+0000","last_unstale":"2024-09-17T06:07:50.698161+0000","last_undegraded":"2024-09-17T06:07:50.698161+0000","last_fullsized":"2024-09-17T06:07:50.698161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:50.167993+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.167993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:53.277144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693507+0000","last_change":"2024-09-17T06:06:46.470862+0000","last_active":"2024-09-17T06:07:50.693507+0000","last_peered":"2024-09-17T06:07:50.693507+0000","last_clean":"2024-09-17T06:07:50.693507+0000","last_became_active":"2024-09-17T06:04:49.135136+0000","last_became_peered":"2024-09-17T06:04:49.135136+0000","last_unstale":"2024-09-17T06:07:50.693507+0000","last_undegraded":"2024-09-17T06:07:50.693507+0000","last_fullsized":"2024-09-17T06:07:50.693507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.470640+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.470640+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:54.803752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693739+0000","last_change":"2024-09-17T06:06:39.308543+0000","last_active":"2024-09-17T06:07:50.693739+0000","last_peered":"2024-09-17T06:07:50.693739+0000","last_clean":"2024-09-17T06:07:50.693739+0000","last_became_active":"2024-09-17T06:04:07.857040+0000","last_became_peered":"2024-09-17T06:04:07.857040+0000","last_unstale":"2024-09-17T06:07:50.693739+0000","last_undegraded":"2024-09-17T06:07:50.693739+0000","last_fullsized":"2024-09-17T06:07:50.693739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:39.308468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.308468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:26.385603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695342+0000","last_change":"2024-09-17T06:06:55.194732+0000","last_active":"2024-09-17T06:07:50.695342+0000","last_peered":"2024-09-17T06:07:50.695342+0000","last_clean":"2024-09-17T06:07:50.695342+0000","last_became_active":"2024-09-17T06:04:13.035353+0000","last_became_peered":"2024-09-17T06:04:13.035353+0000","last_unstale":"2024-09-17T06:07:50.695342+0000","last_undegraded":"2024-09-17T06:07:50.695342+0000","last_fullsized":"2024-09-17T06:07:50.695342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:55.194477+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.194477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:46.395618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"81'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220138+0000","last_change":"2024-09-17T06:06:47.481798+0000","last_active":"2024-09-17T06:07:51.220138+0000","last_peered":"2024-09-17T06:07:51.220138+0000","last_clean":"2024-09-17T06:07:51.220138+0000","last_became_active":"2024-09-17T06:04:08.837482+0000","last_became_peered":"2024-09-17T06:04:08.837482+0000","last_unstale":"2024-09-17T06:07:51.220138+0000","last_undegraded":"2024-09-17T06:07:51.220138+0000","last_fullsized":"2024-09-17T06:07:51.220138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.481588+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.481588+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:09.150352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"81'2","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.221032+0000","last_change":"2024-09-17T06:06:43.064298+0000","last_active":"2024-09-17T06:07:51.221032+0000","last_peered":"2024-09-17T06:07:51.221032+0000","last_clean":"2024-09-17T06:07:51.221032+0000","last_became_active":"2024-09-17T06:06:02.749500+0000","last_became_peered":"2024-09-17T06:06:02.749500+0000","last_unstale":"2024-09-17T06:07:51.221032+0000","last_undegraded":"2024-09-17T06:07:51.221032+0000","last_fullsized":"2024-09-17T06:07:51.221032+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:43.064096+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.064096+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:30.993498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225249+0000","last_change":"2024-09-17T06:06:52.593990+0000","last_active":"2024-09-17T06:07:51.225249+0000","last_peered":"2024-09-17T06:07:51.225249+0000","last_clean":"2024-09-17T06:07:51.225249+0000","last_became_active":"2024-09-17T06:06:02.771360+0000","last_became_peered":"2024-09-17T06:06:02.771360+0000","last_unstale":"2024-09-17T06:07:51.225249+0000","last_undegraded":"2024-09-17T06:07:51.225249+0000","last_fullsized":"2024-09-17T06:07:51.225249+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.593787+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.593787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:04.850781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":166,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842733+0000","last_change":"2024-09-17T06:06:46.576306+0000","last_active":"2024-09-17T06:07:50.842733+0000","last_peered":"2024-09-17T06:07:50.842733+0000","last_clean":"2024-09-17T06:07:50.842733+0000","last_became_active":"2024-09-17T06:06:02.742065+0000","last_became_peered":"2024-09-17T06:06:02.742065+0000","last_unstale":"2024-09-17T06:07:50.842733+0000","last_undegraded":"2024-09-17T06:07:50.842733+0000","last_fullsized":"2024-09-17T06:07:50.842733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:46.576073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576073+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:36.552616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'3","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.694092+0000","last_change":"2024-09-17T06:06:40.289371+0000","last_active":"2024-09-17T06:07:50.694092+0000","last_peered":"2024-09-17T06:07:50.694092+0000","last_clean":"2024-09-17T06:07:50.694092+0000","last_became_active":"2024-09-17T06:04:07.836557+0000","last_became_peered":"2024-09-17T06:04:07.836557+0000","last_unstale":"2024-09-17T06:07:50.694092+0000","last_undegraded":"2024-09-17T06:07:50.694092+0000","last_fullsized":"2024-09-17T06:07:50.694092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-09-17T06:06:40.289195+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.289195+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.187275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218747+0000","last_change":"2024-09-17T06:06:57.580034+0000","last_active":"2024-09-17T06:07:51.218747+0000","last_peered":"2024-09-17T06:07:51.218747+0000","last_clean":"2024-09-17T06:07:51.218747+0000","last_became_active":"2024-09-17T06:06:02.748619+0000","last_became_peered":"2024-09-17T06:06:02.748619+0000","last_unstale":"2024-09-17T06:07:51.218747+0000","last_undegraded":"2024-09-17T06:07:51.218747+0000","last_fullsized":"2024-09-17T06:07:51.218747+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.579707+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.579707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:15.990501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842467+0000","last_change":"2024-09-17T06:06:53.554156+0000","last_active":"2024-09-17T06:07:50.842467+0000","last_peered":"2024-09-17T06:07:50.842467+0000","last_clean":"2024-09-17T06:07:50.842467+0000","last_became_active":"2024-09-17T06:06:02.742178+0000","last_became_peered":"2024-09-17T06:06:02.742178+0000","last_unstale":"2024-09-17T06:07:50.842467+0000","last_undegraded":"2024-09-17T06:07:50.842467+0000","last_fullsized":"2024-09-17T06:07:50.842467+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:53.553919+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.553919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:37.374837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700114+0000","last_change":"2024-09-17T06:06:40.545470+0000","last_active":"2024-09-17T06:07:50.700114+0000","last_peered":"2024-09-17T06:07:50.700114+0000","last_clean":"2024-09-17T06:07:50.700114+0000","last_became_active":"2024-09-17T06:06:02.747094+0000","last_became_peered":"2024-09-17T06:06:02.747094+0000","last_unstale":"2024-09-17T06:07:50.700114+0000","last_undegraded":"2024-09-17T06:07:50.700114+0000","last_fullsized":"2024-09-17T06:07:50.700114+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:40.545271+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.545271+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:41.942375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696784+0000","last_change":"2024-09-17T06:06:46.553900+0000","last_active":"2024-09-17T06:07:50.696784+0000","last_peered":"2024-09-17T06:07:50.696784+0000","last_clean":"2024-09-17T06:07:50.696784+0000","last_became_active":"2024-09-17T06:06:02.755789+0000","last_became_peered":"2024-09-17T06:06:02.755789+0000","last_unstale":"2024-09-17T06:07:50.696784+0000","last_undegraded":"2024-09-17T06:07:50.696784+0000","last_fullsized":"2024-09-17T06:07:50.696784+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.553594+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.553594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:37.347089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841231+0000","last_change":"2024-09-17T06:06:49.557072+0000","last_active":"2024-09-17T06:07:50.841231+0000","last_peered":"2024-09-17T06:07:50.841231+0000","last_clean":"2024-09-17T06:07:50.841231+0000","last_became_active":"2024-09-17T06:06:02.770622+0000","last_became_peered":"2024-09-17T06:06:02.770622+0000","last_unstale":"2024-09-17T06:07:50.841231+0000","last_undegraded":"2024-09-17T06:07:50.841231+0000","last_fullsized":"2024-09-17T06:07:50.841231+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:49.556746+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.556746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:02.173527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'13","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693261+0000","last_change":"2024-09-17T06:06:41.327726+0000","last_active":"2024-09-17T06:07:50.693261+0000","last_peered":"2024-09-17T06:07:50.693261+0000","last_clean":"2024-09-17T06:07:50.693261+0000","last_became_active":"2024-09-17T06:04:07.832989+0000","last_became_peered":"2024-09-17T06:04:07.832989+0000","last_unstale":"2024-09-17T06:07:50.693261+0000","last_undegraded":"2024-09-17T06:07:50.693261+0000","last_fullsized":"2024-09-17T06:07:50.693261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'13","last_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_deep_scrub":"81'13","last_deep_scrub_stamp":"2024-09-17T06:06:41.327620+0000","last_clean_scrub_stamp":"2024-09-17T06:06:41.327620+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:41.975086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225072+0000","last_change":"2024-09-17T06:06:48.590089+0000","last_active":"2024-09-17T06:07:51.225072+0000","last_peered":"2024-09-17T06:07:51.225072+0000","last_clean":"2024-09-17T06:07:51.225072+0000","last_became_active":"2024-09-17T06:04:12.946429+0000","last_became_peered":"2024-09-17T06:04:12.946429+0000","last_unstale":"2024-09-17T06:07:51.225072+0000","last_undegraded":"2024-09-17T06:07:51.225072+0000","last_fullsized":"2024-09-17T06:07:51.225072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:48.589881+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.589881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:13.065040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695729+0000","last_change":"2024-09-17T06:06:47.234619+0000","last_active":"2024-09-17T06:07:50.695729+0000","last_peered":"2024-09-17T06:07:50.695729+0000","last_clean":"2024-09-17T06:07:50.695729+0000","last_became_active":"2024-09-17T06:04:08.840296+0000","last_became_peered":"2024-09-17T06:04:08.840296+0000","last_unstale":"2024-09-17T06:07:50.695729+0000","last_undegraded":"2024-09-17T06:07:50.695729+0000","last_fullsized":"2024-09-17T06:07:50.695729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:47.234392+0000","last_clean_scrub_stamp":"2024-09-17T06:06:47.234392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:10.297041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696310+0000","last_change":"2024-09-17T06:06:42.362985+0000","last_active":"2024-09-17T06:07:50.696310+0000","last_peered":"2024-09-17T06:07:50.696310+0000","last_clean":"2024-09-17T06:07:50.696310+0000","last_became_active":"2024-09-17T06:06:02.771699+0000","last_became_peered":"2024-09-17T06:06:02.771699+0000","last_unstale":"2024-09-17T06:07:50.696310+0000","last_undegraded":"2024-09-17T06:07:50.696310+0000","last_fullsized":"2024-09-17T06:07:50.696310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:42.362795+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.362795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:21.306942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700186+0000","last_change":"2024-09-17T06:06:54.645399+0000","last_active":"2024-09-17T06:07:50.700186+0000","last_peered":"2024-09-17T06:07:50.700186+0000","last_clean":"2024-09-17T06:07:50.700186+0000","last_became_active":"2024-09-17T06:06:14.882626+0000","last_became_peered":"2024-09-17T06:06:14.882626+0000","last_unstale":"2024-09-17T06:07:50.700186+0000","last_undegraded":"2024-09-17T06:07:50.700186+0000","last_fullsized":"2024-09-17T06:07:50.700186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.645200+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.645200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:47:04.728298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841519+0000","last_change":"2024-09-17T06:06:48.595269+0000","last_active":"2024-09-17T06:07:50.841519+0000","last_peered":"2024-09-17T06:07:50.841519+0000","last_clean":"2024-09-17T06:07:50.841519+0000","last_became_active":"2024-09-17T06:06:02.766656+0000","last_became_peered":"2024-09-17T06:06:02.766656+0000","last_unstale":"2024-09-17T06:07:50.841519+0000","last_undegraded":"2024-09-17T06:07:50.841519+0000","last_fullsized":"2024-09-17T06:07:50.841519+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.595073+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.595073+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:51.297831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219232+0000","last_change":"2024-09-17T06:06:42.583243+0000","last_active":"2024-09-17T06:07:51.219232+0000","last_peered":"2024-09-17T06:07:51.219232+0000","last_clean":"2024-09-17T06:07:51.219232+0000","last_became_active":"2024-09-17T06:04:07.853244+0000","last_became_peered":"2024-09-17T06:04:07.853244+0000","last_unstale":"2024-09-17T06:07:51.219232+0000","last_undegraded":"2024-09-17T06:07:51.219232+0000","last_fullsized":"2024-09-17T06:07:51.219232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:42.583048+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.583048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:54.333313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699457+0000","last_change":"2024-09-17T06:06:57.607574+0000","last_active":"2024-09-17T06:07:50.699457+0000","last_peered":"2024-09-17T06:07:50.699457+0000","last_clean":"2024-09-17T06:07:50.699457+0000","last_became_active":"2024-09-17T06:06:15.370902+0000","last_became_peered":"2024-09-17T06:06:15.370902+0000","last_unstale":"2024-09-17T06:07:50.699457+0000","last_undegraded":"2024-09-17T06:07:50.699457+0000","last_fullsized":"2024-09-17T06:07:50.699457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:57.607379+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.607379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:56.898447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222617+0000","last_change":"2024-09-17T06:06:45.591584+0000","last_active":"2024-09-17T06:07:51.222617+0000","last_peered":"2024-09-17T06:07:51.222617+0000","last_clean":"2024-09-17T06:07:51.222617+0000","last_became_active":"2024-09-17T06:04:08.843145+0000","last_became_peered":"2024-09-17T06:04:08.843145+0000","last_unstale":"2024-09-17T06:07:51.222617+0000","last_undegraded":"2024-09-17T06:07:51.222617+0000","last_fullsized":"2024-09-17T06:07:51.222617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:45.591276+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.591276+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:08.653925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"81'4","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.226251+0000","last_change":"2024-09-17T06:06:37.667757+0000","last_active":"2024-09-17T06:07:51.226251+0000","last_peered":"2024-09-17T06:07:51.226251+0000","last_clean":"2024-09-17T06:07:51.226251+0000","last_became_active":"2024-09-17T06:06:02.770999+0000","last_became_peered":"2024-09-17T06:06:02.770999+0000","last_unstale":"2024-09-17T06:07:51.226251+0000","last_undegraded":"2024-09-17T06:07:51.226251+0000","last_fullsized":"2024-09-17T06:07:51.226251+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:37.667675+0000","last_clean_scrub_stamp":"2024-09-17T06:06:37.667675+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:46.885860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219934+0000","last_change":"2024-09-17T06:06:56.615164+0000","last_active":"2024-09-17T06:07:51.219934+0000","last_peered":"2024-09-17T06:07:51.219934+0000","last_clean":"2024-09-17T06:07:51.219934+0000","last_became_active":"2024-09-17T06:04:13.035376+0000","last_became_peered":"2024-09-17T06:04:13.035376+0000","last_unstale":"2024-09-17T06:07:51.219934+0000","last_undegraded":"2024-09-17T06:07:51.219934+0000","last_fullsized":"2024-09-17T06:07:51.219934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:56.614970+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.614970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:07.482666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.841824+0000","last_change":"2024-09-17T06:06:52.577732+0000","last_active":"2024-09-17T06:07:50.841824+0000","last_peered":"2024-09-17T06:07:50.841824+0000","last_clean":"2024-09-17T06:07:50.841824+0000","last_became_active":"2024-09-17T06:04:08.852890+0000","last_became_peered":"2024-09-17T06:04:08.852890+0000","last_unstale":"2024-09-17T06:07:50.841824+0000","last_undegraded":"2024-09-17T06:07:50.841824+0000","last_fullsized":"2024-09-17T06:07:50.841824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.577533+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.577533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:34.161856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":174,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697843+0000","last_change":"2024-09-17T06:06:43.358428+0000","last_active":"2024-09-17T06:07:50.697843+0000","last_peered":"2024-09-17T06:07:50.697843+0000","last_clean":"2024-09-17T06:07:50.697843+0000","last_became_active":"2024-09-17T06:04:07.839988+0000","last_became_peered":"2024-09-17T06:04:07.839988+0000","last_unstale":"2024-09-17T06:07:50.697843+0000","last_undegraded":"2024-09-17T06:07:50.697843+0000","last_fullsized":"2024-09-17T06:07:50.697843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'27","last_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_deep_scrub":"81'27","last_deep_scrub_stamp":"2024-09-17T06:06:43.358219+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.358219+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:13.703025+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":145,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220392+0000","last_change":"2024-09-17T06:06:52.944474+0000","last_active":"2024-09-17T06:07:51.220392+0000","last_peered":"2024-09-17T06:07:51.220392+0000","last_clean":"2024-09-17T06:07:51.220392+0000","last_became_active":"2024-09-17T06:04:12.953651+0000","last_became_peered":"2024-09-17T06:04:12.953651+0000","last_unstale":"2024-09-17T06:07:51.220392+0000","last_undegraded":"2024-09-17T06:07:51.220392+0000","last_fullsized":"2024-09-17T06:07:51.220392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-17T06:06:52.944213+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.944213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.533972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699872+0000","last_change":"2024-09-17T06:06:43.557285+0000","last_active":"2024-09-17T06:07:50.699872+0000","last_peered":"2024-09-17T06:07:50.699872+0000","last_clean":"2024-09-17T06:07:50.699872+0000","last_became_active":"2024-09-17T06:06:02.775883+0000","last_became_peered":"2024-09-17T06:06:02.775883+0000","last_unstale":"2024-09-17T06:07:50.699872+0000","last_undegraded":"2024-09-17T06:07:50.699872+0000","last_fullsized":"2024-09-17T06:07:50.699872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:43.557090+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.557090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:01.412234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"81'9","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220308+0000","last_change":"2024-09-17T06:06:43.599342+0000","last_active":"2024-09-17T06:07:51.220308+0000","last_peered":"2024-09-17T06:07:51.220308+0000","last_clean":"2024-09-17T06:07:51.220308+0000","last_became_active":"2024-09-17T06:05:20.628111+0000","last_became_peered":"2024-09-17T06:05:20.628111+0000","last_unstale":"2024-09-17T06:07:51.220308+0000","last_undegraded":"2024-09-17T06:07:51.220308+0000","last_fullsized":"2024-09-17T06:07:51.220308+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:43.599114+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.599114+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:49.432076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699698+0000","last_change":"2024-09-17T06:06:49.561761+0000","last_active":"2024-09-17T06:07:50.699698+0000","last_peered":"2024-09-17T06:07:50.699698+0000","last_clean":"2024-09-17T06:07:50.699698+0000","last_became_active":"2024-09-17T06:06:02.761110+0000","last_became_peered":"2024-09-17T06:06:02.761110+0000","last_unstale":"2024-09-17T06:07:50.699698+0000","last_undegraded":"2024-09-17T06:07:50.699698+0000","last_fullsized":"2024-09-17T06:07:50.699698+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.561572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.561572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:15.208406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.223672+0000","last_change":"2024-09-17T06:06:40.581076+0000","last_active":"2024-09-17T06:07:51.223672+0000","last_peered":"2024-09-17T06:07:51.223672+0000","last_clean":"2024-09-17T06:07:51.223672+0000","last_became_active":"2024-09-17T06:04:08.839661+0000","last_became_peered":"2024-09-17T06:04:08.839661+0000","last_unstale":"2024-09-17T06:07:51.223672+0000","last_undegraded":"2024-09-17T06:07:51.223672+0000","last_fullsized":"2024-09-17T06:07:51.223672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:40.580978+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.580978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:19.525125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220215+0000","last_change":"2024-09-17T06:06:44.589361+0000","last_active":"2024-09-17T06:07:51.220215+0000","last_peered":"2024-09-17T06:07:51.220215+0000","last_clean":"2024-09-17T06:07:51.220215+0000","last_became_active":"2024-09-17T06:04:07.852142+0000","last_became_peered":"2024-09-17T06:04:07.852142+0000","last_unstale":"2024-09-17T06:07:51.220215+0000","last_undegraded":"2024-09-17T06:07:51.220215+0000","last_fullsized":"2024-09-17T06:07:51.220215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.589149+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.589149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.705503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":118,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699654+0000","last_change":"2024-09-17T06:06:58.599122+0000","last_active":"2024-09-17T06:07:50.699654+0000","last_peered":"2024-09-17T06:07:50.699654+0000","last_clean":"2024-09-17T06:07:50.699654+0000","last_became_active":"2024-09-17T06:06:14.879108+0000","last_became_peered":"2024-09-17T06:06:14.879108+0000","last_unstale":"2024-09-17T06:07:50.699654+0000","last_undegraded":"2024-09-17T06:07:50.699654+0000","last_fullsized":"2024-09-17T06:07:50.699654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:58.598909+0000","last_clean_scrub_stamp":"2024-09-17T06:06:58.598909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.505821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220121+0000","last_change":"2024-09-17T06:06:48.493667+0000","last_active":"2024-09-17T06:07:51.220121+0000","last_peered":"2024-09-17T06:07:51.220121+0000","last_clean":"2024-09-17T06:07:51.220121+0000","last_became_active":"2024-09-17T06:04:08.846588+0000","last_became_peered":"2024-09-17T06:04:08.846588+0000","last_unstale":"2024-09-17T06:07:51.220121+0000","last_undegraded":"2024-09-17T06:07:51.220121+0000","last_fullsized":"2024-09-17T06:07:51.220121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:48.493470+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.493470+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:26.837170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697241+0000","last_change":"2024-09-17T06:06:44.333474+0000","last_active":"2024-09-17T06:07:50.697241+0000","last_peered":"2024-09-17T06:07:50.697241+0000","last_clean":"2024-09-17T06:07:50.697241+0000","last_became_active":"2024-09-17T06:04:07.858757+0000","last_became_peered":"2024-09-17T06:04:07.858757+0000","last_unstale":"2024-09-17T06:07:50.697241+0000","last_undegraded":"2024-09-17T06:07:50.697241+0000","last_fullsized":"2024-09-17T06:07:50.697241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-17T06:06:44.333150+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.333150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:08.158751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698517+0000","last_change":"2024-09-17T06:06:52.699338+0000","last_active":"2024-09-17T06:07:50.698517+0000","last_peered":"2024-09-17T06:07:50.698517+0000","last_clean":"2024-09-17T06:07:50.698517+0000","last_became_active":"2024-09-17T06:06:14.881665+0000","last_became_peered":"2024-09-17T06:06:14.881665+0000","last_unstale":"2024-09-17T06:07:50.698517+0000","last_undegraded":"2024-09-17T06:07:50.698517+0000","last_fullsized":"2024-09-17T06:07:50.698517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:52.699134+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.699134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:51.626769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224692+0000","last_change":"2024-09-17T06:06:49.633934+0000","last_active":"2024-09-17T06:07:51.224692+0000","last_peered":"2024-09-17T06:07:51.224692+0000","last_clean":"2024-09-17T06:07:51.224692+0000","last_became_active":"2024-09-17T06:04:13.039863+0000","last_became_peered":"2024-09-17T06:04:13.039863+0000","last_unstale":"2024-09-17T06:07:51.224692+0000","last_undegraded":"2024-09-17T06:07:51.224692+0000","last_fullsized":"2024-09-17T06:07:51.224692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:49.633660+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.633660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.217982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"81'10","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220316+0000","last_change":"2024-09-17T06:06:46.974853+0000","last_active":"2024-09-17T06:07:51.220316+0000","last_peered":"2024-09-17T06:07:51.220316+0000","last_clean":"2024-09-17T06:07:51.220316+0000","last_became_active":"2024-09-17T06:04:08.832311+0000","last_became_peered":"2024-09-17T06:04:08.832311+0000","last_unstale":"2024-09-17T06:07:51.220316+0000","last_undegraded":"2024-09-17T06:07:51.220316+0000","last_fullsized":"2024-09-17T06:07:51.220316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:46.974637+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.974637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:26.337532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219068+0000","last_change":"2024-09-17T06:06:46.527438+0000","last_active":"2024-09-17T06:07:51.219068+0000","last_peered":"2024-09-17T06:07:51.219068+0000","last_clean":"2024-09-17T06:07:51.219068+0000","last_became_active":"2024-09-17T06:06:02.747344+0000","last_became_peered":"2024-09-17T06:06:02.747344+0000","last_unstale":"2024-09-17T06:07:51.219068+0000","last_undegraded":"2024-09-17T06:07:51.219068+0000","last_fullsized":"2024-09-17T06:07:51.219068+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:46.527230+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.527230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:25.890125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696741+0000","last_change":"2024-09-17T06:06:54.199209+0000","last_active":"2024-09-17T06:07:50.696741+0000","last_peered":"2024-09-17T06:07:50.696741+0000","last_clean":"2024-09-17T06:07:50.696741+0000","last_became_active":"2024-09-17T06:04:12.960248+0000","last_became_peered":"2024-09-17T06:04:12.960248+0000","last_unstale":"2024-09-17T06:07:50.696741+0000","last_undegraded":"2024-09-17T06:07:50.696741+0000","last_fullsized":"2024-09-17T06:07:50.696741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:54.198989+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.198989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:51.609301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699785+0000","last_change":"2024-09-17T06:06:46.699017+0000","last_active":"2024-09-17T06:07:50.699785+0000","last_peered":"2024-09-17T06:07:50.699785+0000","last_clean":"2024-09-17T06:07:50.699785+0000","last_became_active":"2024-09-17T06:06:14.875613+0000","last_became_peered":"2024-09-17T06:06:14.875613+0000","last_unstale":"2024-09-17T06:07:50.699785+0000","last_undegraded":"2024-09-17T06:07:50.699785+0000","last_fullsized":"2024-09-17T06:07:50.699785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:46.698821+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.698821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:33.586359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698807+0000","last_change":"2024-09-17T06:06:40.624617+0000","last_active":"2024-09-17T06:07:50.698807+0000","last_peered":"2024-09-17T06:07:50.698807+0000","last_clean":"2024-09-17T06:07:50.698807+0000","last_became_active":"2024-09-17T06:06:14.882725+0000","last_became_peered":"2024-09-17T06:06:14.882725+0000","last_unstale":"2024-09-17T06:07:50.698807+0000","last_undegraded":"2024-09-17T06:07:50.698807+0000","last_fullsized":"2024-09-17T06:07:50.698807+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:40.624540+0000","last_clean_scrub_stamp":"2024-09-17T06:06:40.624540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:48.054970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.696244+0000","last_change":"2024-09-17T06:06:45.311790+0000","last_active":"2024-09-17T06:07:50.696244+0000","last_peered":"2024-09-17T06:07:50.696244+0000","last_clean":"2024-09-17T06:07:50.696244+0000","last_became_active":"2024-09-17T06:06:02.749857+0000","last_became_peered":"2024-09-17T06:06:02.749857+0000","last_unstale":"2024-09-17T06:07:50.696244+0000","last_undegraded":"2024-09-17T06:07:50.696244+0000","last_fullsized":"2024-09-17T06:07:50.696244+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:45.311572+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.311572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:05.215110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":166,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225908+0000","last_change":"2024-09-17T06:06:43.594929+0000","last_active":"2024-09-17T06:07:51.225908+0000","last_peered":"2024-09-17T06:07:51.225908+0000","last_clean":"2024-09-17T06:07:51.225908+0000","last_became_active":"2024-09-17T06:06:02.773910+0000","last_became_peered":"2024-09-17T06:06:02.773910+0000","last_unstale":"2024-09-17T06:07:51.225908+0000","last_undegraded":"2024-09-17T06:07:51.225908+0000","last_fullsized":"2024-09-17T06:07:51.225908+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:43.594608+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.594608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:54.666206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693267+0000","last_change":"2024-09-17T06:06:44.420446+0000","last_active":"2024-09-17T06:07:50.693267+0000","last_peered":"2024-09-17T06:07:50.693267+0000","last_clean":"2024-09-17T06:07:50.693267+0000","last_became_active":"2024-09-17T06:04:12.947097+0000","last_became_peered":"2024-09-17T06:04:12.947097+0000","last_unstale":"2024-09-17T06:07:50.693267+0000","last_undegraded":"2024-09-17T06:07:50.693267+0000","last_fullsized":"2024-09-17T06:07:50.693267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:44.420226+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.420226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:35.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":81,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698991+0000","last_change":"2024-09-17T06:06:39.644661+0000","last_active":"2024-09-17T06:07:50.698991+0000","last_peered":"2024-09-17T06:07:50.698991+0000","last_clean":"2024-09-17T06:07:50.698991+0000","last_became_active":"2024-09-17T06:06:14.874311+0000","last_became_peered":"2024-09-17T06:06:14.874311+0000","last_unstale":"2024-09-17T06:07:50.698991+0000","last_undegraded":"2024-09-17T06:07:50.698991+0000","last_fullsized":"2024-09-17T06:07:50.698991+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-17T06:06:39.644581+0000","last_clean_scrub_stamp":"2024-09-17T06:06:39.644581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:43.034866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695221+0000","last_change":"2024-09-17T06:06:42.552587+0000","last_active":"2024-09-17T06:07:50.695221+0000","last_peered":"2024-09-17T06:07:50.695221+0000","last_clean":"2024-09-17T06:07:50.695221+0000","last_became_active":"2024-09-17T06:06:02.745148+0000","last_became_peered":"2024-09-17T06:06:02.745148+0000","last_unstale":"2024-09-17T06:07:50.695221+0000","last_undegraded":"2024-09-17T06:07:50.695221+0000","last_fullsized":"2024-09-17T06:07:50.695221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:42.552253+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.552253+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:16.204277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":134,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699461+0000","last_change":"2024-09-17T06:06:59.590058+0000","last_active":"2024-09-17T06:07:50.699461+0000","last_peered":"2024-09-17T06:07:50.699461+0000","last_clean":"2024-09-17T06:07:50.699461+0000","last_became_active":"2024-09-17T06:06:15.370791+0000","last_became_peered":"2024-09-17T06:06:15.370791+0000","last_unstale":"2024-09-17T06:07:50.699461+0000","last_undegraded":"2024-09-17T06:07:50.699461+0000","last_fullsized":"2024-09-17T06:07:50.699461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T06:06:59.589844+0000","last_clean_scrub_stamp":"2024-09-17T06:06:59.589844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:13.777383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.695142+0000","last_change":"2024-09-17T06:06:49.212293+0000","last_active":"2024-09-17T06:07:50.695142+0000","last_peered":"2024-09-17T06:07:50.695142+0000","last_clean":"2024-09-17T06:07:50.695142+0000","last_became_active":"2024-09-17T06:04:08.840241+0000","last_became_peered":"2024-09-17T06:04:08.840241+0000","last_unstale":"2024-09-17T06:07:50.695142+0000","last_undegraded":"2024-09-17T06:07:50.695142+0000","last_fullsized":"2024-09-17T06:07:50.695142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:49.211966+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.211966+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:29.791073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693039+0000","last_change":"2024-09-17T06:06:43.370824+0000","last_active":"2024-09-17T06:07:50.693039+0000","last_peered":"2024-09-17T06:07:50.693039+0000","last_clean":"2024-09-17T06:07:50.693039+0000","last_became_active":"2024-09-17T06:04:08.837713+0000","last_became_peered":"2024-09-17T06:04:08.837713+0000","last_unstale":"2024-09-17T06:07:50.693039+0000","last_undegraded":"2024-09-17T06:07:50.693039+0000","last_fullsized":"2024-09-17T06:07:50.693039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-09-17T06:06:43.370630+0000","last_clean_scrub_stamp":"2024-09-17T06:06:43.370630+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:28.698931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219068+0000","last_change":"2024-09-17T06:06:50.490824+0000","last_active":"2024-09-17T06:07:51.219068+0000","last_peered":"2024-09-17T06:07:51.219068+0000","last_clean":"2024-09-17T06:07:51.219068+0000","last_became_active":"2024-09-17T06:04:08.851350+0000","last_became_peered":"2024-09-17T06:04:08.851350+0000","last_unstale":"2024-09-17T06:07:51.219068+0000","last_undegraded":"2024-09-17T06:07:51.219068+0000","last_fullsized":"2024-09-17T06:07:51.219068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:50.490494+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.490494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.208761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":170,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.225578+0000","last_change":"2024-09-17T06:06:54.564398+0000","last_active":"2024-09-17T06:07:51.225578+0000","last_peered":"2024-09-17T06:07:51.225578+0000","last_clean":"2024-09-17T06:07:51.225578+0000","last_became_active":"2024-09-17T06:06:49.863977+0000","last_became_peered":"2024-09-17T06:06:49.863977+0000","last_unstale":"2024-09-17T06:07:51.225578+0000","last_undegraded":"2024-09-17T06:07:51.225578+0000","last_fullsized":"2024-09-17T06:07:51.225578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:54.564097+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:53.583377+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.564097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:45.765238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700309+0000","last_change":"2024-09-17T06:06:48.701826+0000","last_active":"2024-09-17T06:07:50.700309+0000","last_peered":"2024-09-17T06:07:50.700309+0000","last_clean":"2024-09-17T06:07:50.700309+0000","last_became_active":"2024-09-17T06:06:14.862681+0000","last_became_peered":"2024-09-17T06:06:14.862681+0000","last_unstale":"2024-09-17T06:07:50.700309+0000","last_undegraded":"2024-09-17T06:07:50.700309+0000","last_fullsized":"2024-09-17T06:07:50.700309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:48.701596+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.701596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:43:38.318752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220694+0000","last_change":"2024-09-17T06:06:44.071550+0000","last_active":"2024-09-17T06:07:51.220694+0000","last_peered":"2024-09-17T06:07:51.220694+0000","last_clean":"2024-09-17T06:07:51.220694+0000","last_became_active":"2024-09-17T06:04:08.835957+0000","last_became_peered":"2024-09-17T06:04:08.835957+0000","last_unstale":"2024-09-17T06:07:51.220694+0000","last_undegraded":"2024-09-17T06:07:51.220694+0000","last_fullsized":"2024-09-17T06:07:51.220694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:44.071343+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.071343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:50.902738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699125+0000","last_change":"2024-09-17T06:06:48.219488+0000","last_active":"2024-09-17T06:07:50.699125+0000","last_peered":"2024-09-17T06:07:50.699125+0000","last_clean":"2024-09-17T06:07:50.699125+0000","last_became_active":"2024-09-17T06:04:08.850595+0000","last_became_peered":"2024-09-17T06:04:08.850595+0000","last_unstale":"2024-09-17T06:07:50.699125+0000","last_undegraded":"2024-09-17T06:07:50.699125+0000","last_fullsized":"2024-09-17T06:07:50.699125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'15","last_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_deep_scrub":"81'15","last_deep_scrub_stamp":"2024-09-17T06:06:48.219293+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.219293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:00.836074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":118,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700371+0000","last_change":"2024-09-17T06:06:50.710122+0000","last_active":"2024-09-17T06:07:50.700371+0000","last_peered":"2024-09-17T06:07:50.700371+0000","last_clean":"2024-09-17T06:07:50.700371+0000","last_became_active":"2024-09-17T06:06:14.869692+0000","last_became_peered":"2024-09-17T06:06:14.869692+0000","last_unstale":"2024-09-17T06:07:50.700371+0000","last_undegraded":"2024-09-17T06:07:50.700371+0000","last_fullsized":"2024-09-17T06:07:50.700371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-09-17T06:06:50.709804+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.709804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:24.696128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":118,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218560+0000","last_change":"2024-09-17T06:06:51.502240+0000","last_active":"2024-09-17T06:07:51.218560+0000","last_peered":"2024-09-17T06:07:51.218560+0000","last_clean":"2024-09-17T06:07:51.218560+0000","last_became_active":"2024-09-17T06:05:13.534842+0000","last_became_peered":"2024-09-17T06:05:13.534842+0000","last_unstale":"2024-09-17T06:07:51.218560+0000","last_undegraded":"2024-09-17T06:07:51.218560+0000","last_fullsized":"2024-09-17T06:07:51.218560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:51.502041+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.502041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:22.125829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":124,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698407+0000","last_change":"2024-09-17T06:06:49.687515+0000","last_active":"2024-09-17T06:07:50.698407+0000","last_peered":"2024-09-17T06:07:50.698407+0000","last_clean":"2024-09-17T06:07:50.698407+0000","last_became_active":"2024-09-17T06:06:14.861663+0000","last_became_peered":"2024-09-17T06:06:14.861663+0000","last_unstale":"2024-09-17T06:07:50.698407+0000","last_undegraded":"2024-09-17T06:07:50.698407+0000","last_fullsized":"2024-09-17T06:07:50.698407+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:49.687322+0000","last_clean_scrub_stamp":"2024-09-17T06:06:49.687322+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:09.182168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:09:25.562300+0000","last_change":"2024-09-17T06:09:25.562300+0000","last_active":"2024-09-17T06:09:25.562300+0000","last_peered":"2024-09-17T06:09:25.562300+0000","last_clean":"2024-09-17T06:09:25.562300+0000","last_became_active":"2024-09-17T06:06:49.760405+0000","last_became_peered":"2024-09-17T06:06:49.760405+0000","last_unstale":"2024-09-17T06:09:25.562300+0000","last_undegraded":"2024-09-17T06:09:25.562300+0000","last_fullsized":"2024-09-17T06:09:25.562300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:09:25.562074+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:09:25.562074+0000","last_clean_scrub_stamp":"2024-09-17T06:09:25.562074+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:45.465612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.224999+0000","last_change":"2024-09-17T06:06:51.561891+0000","last_active":"2024-09-17T06:07:51.224999+0000","last_peered":"2024-09-17T06:07:51.224999+0000","last_clean":"2024-09-17T06:07:51.224999+0000","last_became_active":"2024-09-17T06:04:08.841934+0000","last_became_peered":"2024-09-17T06:04:08.841934+0000","last_unstale":"2024-09-17T06:07:51.224999+0000","last_undegraded":"2024-09-17T06:07:51.224999+0000","last_fullsized":"2024-09-17T06:07:51.224999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:51.561576+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.561576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:27.536230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.697734+0000","last_change":"2024-09-17T06:06:51.171689+0000","last_active":"2024-09-17T06:07:50.697734+0000","last_peered":"2024-09-17T06:07:50.697734+0000","last_clean":"2024-09-17T06:07:50.697734+0000","last_became_active":"2024-09-17T06:06:02.780955+0000","last_became_peered":"2024-09-17T06:06:02.780955+0000","last_unstale":"2024-09-17T06:07:50.697734+0000","last_undegraded":"2024-09-17T06:07:50.697734+0000","last_fullsized":"2024-09-17T06:07:50.697734+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:51.171493+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.171493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:39.452849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842168+0000","last_change":"2024-09-17T06:06:55.610932+0000","last_active":"2024-09-17T06:07:50.842168+0000","last_peered":"2024-09-17T06:07:50.842168+0000","last_clean":"2024-09-17T06:07:50.842168+0000","last_became_active":"2024-09-17T06:04:08.838440+0000","last_became_peered":"2024-09-17T06:04:08.838440+0000","last_unstale":"2024-09-17T06:07:50.842168+0000","last_undegraded":"2024-09-17T06:07:50.842168+0000","last_fullsized":"2024-09-17T06:07:50.842168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:55.610700+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.610700+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:07.867694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.693902+0000","last_change":"2024-09-17T06:06:42.353051+0000","last_active":"2024-09-17T06:07:50.693902+0000","last_peered":"2024-09-17T06:07:50.693902+0000","last_clean":"2024-09-17T06:07:50.693902+0000","last_became_active":"2024-09-17T06:04:08.844263+0000","last_became_peered":"2024-09-17T06:04:08.844263+0000","last_unstale":"2024-09-17T06:07:50.693902+0000","last_undegraded":"2024-09-17T06:07:50.693902+0000","last_fullsized":"2024-09-17T06:07:50.693902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:42.352711+0000","last_clean_scrub_stamp":"2024-09-17T06:06:42.352711+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:14.862093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220663+0000","last_change":"2024-09-17T06:06:52.529037+0000","last_active":"2024-09-17T06:07:51.220663+0000","last_peered":"2024-09-17T06:07:51.220663+0000","last_clean":"2024-09-17T06:07:51.220663+0000","last_became_active":"2024-09-17T06:04:08.851977+0000","last_became_peered":"2024-09-17T06:04:08.851977+0000","last_unstale":"2024-09-17T06:07:51.220663+0000","last_undegraded":"2024-09-17T06:07:51.220663+0000","last_fullsized":"2024-09-17T06:07:51.220663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:52.528843+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.528843+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:34.118602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219034+0000","last_change":"2024-09-17T06:06:53.547108+0000","last_active":"2024-09-17T06:07:51.219034+0000","last_peered":"2024-09-17T06:07:51.219034+0000","last_clean":"2024-09-17T06:07:51.219034+0000","last_became_active":"2024-09-17T06:04:08.839922+0000","last_became_peered":"2024-09-17T06:04:08.839922+0000","last_unstale":"2024-09-17T06:07:51.219034+0000","last_undegraded":"2024-09-17T06:07:51.219034+0000","last_fullsized":"2024-09-17T06:07:51.219034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.546853+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.546853+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:05.208153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":163,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.220626+0000","last_change":"2024-09-17T06:06:48.919436+0000","last_active":"2024-09-17T06:07:51.220626+0000","last_peered":"2024-09-17T06:07:51.220626+0000","last_clean":"2024-09-17T06:07:51.220626+0000","last_became_active":"2024-09-17T06:06:02.776400+0000","last_became_peered":"2024-09-17T06:06:02.776400+0000","last_unstale":"2024-09-17T06:07:51.220626+0000","last_undegraded":"2024-09-17T06:07:51.220626+0000","last_fullsized":"2024-09-17T06:07:51.220626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:48.919235+0000","last_clean_scrub_stamp":"2024-09-17T06:06:48.919235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:27.262935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"81'8","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222606+0000","last_change":"2024-09-17T06:06:44.636882+0000","last_active":"2024-09-17T06:07:51.222606+0000","last_peered":"2024-09-17T06:07:51.222606+0000","last_clean":"2024-09-17T06:07:51.222606+0000","last_became_active":"2024-09-17T06:04:08.842619+0000","last_became_peered":"2024-09-17T06:04:08.842619+0000","last_unstale":"2024-09-17T06:07:51.222606+0000","last_undegraded":"2024-09-17T06:07:51.222606+0000","last_fullsized":"2024-09-17T06:07:51.222606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:44.636626+0000","last_clean_scrub_stamp":"2024-09-17T06:06:44.636626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:44.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":88,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699044+0000","last_change":"2024-09-17T06:06:51.717905+0000","last_active":"2024-09-17T06:07:50.699044+0000","last_peered":"2024-09-17T06:07:50.699044+0000","last_clean":"2024-09-17T06:07:50.699044+0000","last_became_active":"2024-09-17T06:06:14.882386+0000","last_became_peered":"2024-09-17T06:06:14.882386+0000","last_unstale":"2024-09-17T06:07:50.699044+0000","last_undegraded":"2024-09-17T06:07:50.699044+0000","last_fullsized":"2024-09-17T06:07:50.699044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-09-17T06:06:51.717694+0000","last_clean_scrub_stamp":"2024-09-17T06:06:51.717694+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:59.444208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":78,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.700437+0000","last_change":"2024-09-17T06:06:45.539679+0000","last_active":"2024-09-17T06:07:50.700437+0000","last_peered":"2024-09-17T06:07:50.700437+0000","last_clean":"2024-09-17T06:07:50.700437+0000","last_became_active":"2024-09-17T06:06:02.768530+0000","last_became_peered":"2024-09-17T06:06:02.768530+0000","last_unstale":"2024-09-17T06:07:50.700437+0000","last_undegraded":"2024-09-17T06:07:50.700437+0000","last_fullsized":"2024-09-17T06:07:50.700437+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:45.539468+0000","last_clean_scrub_stamp":"2024-09-17T06:06:45.539468+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:55.832105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698700+0000","last_change":"2024-09-17T06:06:52.213250+0000","last_active":"2024-09-17T06:07:50.698700+0000","last_peered":"2024-09-17T06:07:50.698700+0000","last_clean":"2024-09-17T06:07:50.698700+0000","last_became_active":"2024-09-17T06:04:08.839718+0000","last_became_peered":"2024-09-17T06:04:08.839718+0000","last_unstale":"2024-09-17T06:07:50.698700+0000","last_undegraded":"2024-09-17T06:07:50.698700+0000","last_fullsized":"2024-09-17T06:07:50.698700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:52.213042+0000","last_clean_scrub_stamp":"2024-09-17T06:06:52.213042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:36.033960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.699125+0000","last_change":"2024-09-17T06:06:53.226240+0000","last_active":"2024-09-17T06:07:50.699125+0000","last_peered":"2024-09-17T06:07:50.699125+0000","last_clean":"2024-09-17T06:07:50.699125+0000","last_became_active":"2024-09-17T06:04:08.844172+0000","last_became_peered":"2024-09-17T06:04:08.844172+0000","last_unstale":"2024-09-17T06:07:50.699125+0000","last_undegraded":"2024-09-17T06:07:50.699125+0000","last_fullsized":"2024-09-17T06:07:50.699125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'16","last_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_deep_scrub":"81'16","last_deep_scrub_stamp":"2024-09-17T06:06:53.226044+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.226044+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:15.604828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842608+0000","last_change":"2024-09-17T06:06:50.593476+0000","last_active":"2024-09-17T06:07:50.842608+0000","last_peered":"2024-09-17T06:07:50.842608+0000","last_clean":"2024-09-17T06:07:50.842608+0000","last_became_active":"2024-09-17T06:04:08.852151+0000","last_became_peered":"2024-09-17T06:04:08.852151+0000","last_unstale":"2024-09-17T06:07:50.842608+0000","last_undegraded":"2024-09-17T06:07:50.842608+0000","last_fullsized":"2024-09-17T06:07:50.842608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'11","last_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_deep_scrub":"81'11","last_deep_scrub_stamp":"2024-09-17T06:06:50.593281+0000","last_clean_scrub_stamp":"2024-09-17T06:06:50.593281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.041524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.698111+0000","last_change":"2024-09-17T06:06:53.662277+0000","last_active":"2024-09-17T06:07:50.698111+0000","last_peered":"2024-09-17T06:07:50.698111+0000","last_clean":"2024-09-17T06:07:50.698111+0000","last_became_active":"2024-09-17T06:06:14.861176+0000","last_became_peered":"2024-09-17T06:06:14.861176+0000","last_unstale":"2024-09-17T06:07:50.698111+0000","last_undegraded":"2024-09-17T06:07:50.698111+0000","last_fullsized":"2024-09-17T06:07:50.698111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'9","last_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_deep_scrub":"81'9","last_deep_scrub_stamp":"2024-09-17T06:06:53.662083+0000","last_clean_scrub_stamp":"2024-09-17T06:06:53.662083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:09.458813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840853+0000","last_change":"2024-09-17T06:06:54.601401+0000","last_active":"2024-09-17T06:07:50.840853+0000","last_peered":"2024-09-17T06:07:50.840853+0000","last_clean":"2024-09-17T06:07:50.840853+0000","last_became_active":"2024-09-17T06:04:08.839104+0000","last_became_peered":"2024-09-17T06:04:08.839104+0000","last_unstale":"2024-09-17T06:07:50.840853+0000","last_undegraded":"2024-09-17T06:07:50.840853+0000","last_fullsized":"2024-09-17T06:07:50.840853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-09-17T06:06:54.601206+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.601206+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:30.575859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.218920+0000","last_change":"2024-09-17T06:06:54.592256+0000","last_active":"2024-09-17T06:07:51.218920+0000","last_peered":"2024-09-17T06:07:51.218920+0000","last_clean":"2024-09-17T06:07:51.218920+0000","last_became_active":"2024-09-17T06:04:08.840380+0000","last_became_peered":"2024-09-17T06:04:08.840380+0000","last_unstale":"2024-09-17T06:07:51.218920+0000","last_undegraded":"2024-09-17T06:07:51.218920+0000","last_fullsized":"2024-09-17T06:07:51.218920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-09-17T06:06:54.591916+0000","last_clean_scrub_stamp":"2024-09-17T06:06:54.591916+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:43.180179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.840826+0000","last_change":"2024-09-17T06:06:57.597911+0000","last_active":"2024-09-17T06:07:50.840826+0000","last_peered":"2024-09-17T06:07:50.840826+0000","last_clean":"2024-09-17T06:07:50.840826+0000","last_became_active":"2024-09-17T06:04:08.852131+0000","last_became_peered":"2024-09-17T06:04:08.852131+0000","last_unstale":"2024-09-17T06:07:50.840826+0000","last_undegraded":"2024-09-17T06:07:50.840826+0000","last_fullsized":"2024-09-17T06:07:50.840826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:57.597715+0000","last_clean_scrub_stamp":"2024-09-17T06:06:57.597715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:05.028145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.219802+0000","last_change":"2024-09-17T06:06:55.569378+0000","last_active":"2024-09-17T06:07:51.219802+0000","last_peered":"2024-09-17T06:07:51.219802+0000","last_clean":"2024-09-17T06:07:51.219802+0000","last_became_active":"2024-09-17T06:04:08.855803+0000","last_became_peered":"2024-09-17T06:04:08.855803+0000","last_unstale":"2024-09-17T06:07:51.219802+0000","last_undegraded":"2024-09-17T06:07:51.219802+0000","last_fullsized":"2024-09-17T06:07:51.219802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:55.569171+0000","last_clean_scrub_stamp":"2024-09-17T06:06:55.569171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:50.988830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222343+0000","last_change":"2024-09-17T06:06:46.576687+0000","last_active":"2024-09-17T06:07:51.222343+0000","last_peered":"2024-09-17T06:07:51.222343+0000","last_clean":"2024-09-17T06:07:51.222343+0000","last_became_active":"2024-09-17T06:04:08.839167+0000","last_became_peered":"2024-09-17T06:04:08.839167+0000","last_unstale":"2024-09-17T06:07:51.222343+0000","last_undegraded":"2024-09-17T06:07:51.222343+0000","last_fullsized":"2024-09-17T06:07:51.222343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-09-17T06:06:46.576479+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.576479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:36.143901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:51.222113+0000","last_change":"2024-09-17T06:06:46.022759+0000","last_active":"2024-09-17T06:07:51.222113+0000","last_peered":"2024-09-17T06:07:51.222113+0000","last_clean":"2024-09-17T06:07:51.222113+0000","last_became_active":"2024-09-17T06:04:08.838882+0000","last_became_peered":"2024-09-17T06:04:08.838882+0000","last_unstale":"2024-09-17T06:07:51.222113+0000","last_undegraded":"2024-09-17T06:07:51.222113+0000","last_fullsized":"2024-09-17T06:07:51.222113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-09-17T06:06:46.022447+0000","last_clean_scrub_stamp":"2024-09-17T06:06:46.022447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:52.814300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"81'8","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T06:07:50.842464+0000","last_change":"2024-09-17T06:06:56.620251+0000","last_active":"2024-09-17T06:07:50.842464+0000","last_peered":"2024-09-17T06:07:50.842464+0000","last_clean":"2024-09-17T06:07:50.842464+0000","last_became_active":"2024-09-17T06:04:08.853856+0000","last_became_peered":"2024-09-17T06:04:08.853856+0000","last_unstale":"2024-09-17T06:07:50.842464+0000","last_undegraded":"2024-09-17T06:07:50.842464+0000","last_fullsized":"2024-09-17T06:07:50.842464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-09-17T06:06:56.619933+0000","last_clean_scrub_stamp":"2024-09-17T06:06:56.619933+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:00.010218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37548,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":87,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":75096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509514,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1044480,"data_stored":558879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509515,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":522541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509515,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1605632,"data_stored":1113225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1593344,"data_stored":1113079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509513,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":558467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":64,"seq":274877906990,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":28025,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":1007616,"data_stored":522255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6528,"internal_metadata":28698240},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":999424,"data_stored":522199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542217,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":999424,"data_stored":522219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":36750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3774,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T06:09:45.306 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T06:09:45.503 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 -- 172.21.15.122:0/1005199024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3140c67a0 msgr2=0x7ff31414e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 --2- 172.21.15.122:0/1005199024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3140c67a0 0x7ff31414e9e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff304009840 tx=0x7ff30401f010 comp rx=0 tx=0).stop 2024-09-17T06:09:45.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 -- 172.21.15.122:0/1005199024 shutdown_connections 2024-09-17T06:09:45.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 --2- 172.21.15.122:0/1005199024 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff314072270 0x7ff314072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 --2- 172.21.15.122:0/1005199024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3140c67a0 0x7ff31414e9e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 -- 172.21.15.122:0/1005199024 >> 172.21.15.122:0/1005199024 conn(0x7ff3140746d0 msgr2=0x7ff314074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:45.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 -- 172.21.15.122:0/1005199024 shutdown_connections 2024-09-17T06:09:45.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 -- 172.21.15.122:0/1005199024 wait complete. 2024-09-17T06:09:45.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 Processor -- start 2024-09-17T06:09:45.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 -- start start 2024-09-17T06:09:45.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff314072270 0x7ff3140cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:45.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3140c67a0 0x7ff3140cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:45.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff31415b7b0 0x7ff314146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff314158a70 con 0x7ff314072270 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff314158790 con 0x7ff31415b7b0 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff31a4da640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff314158d50 con 0x7ff3140c67a0 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff313fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff314072270 0x7ff3140cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff313fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff314072270 0x7ff3140cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56546/0 (socket says 172.21.15.122:56546) 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.500+0000 7ff313fff640 1 -- 172.21.15.122:0/188966534 learned_addr learned my addr 172.21.15.122:0/188966534 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff3137fe640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3140c67a0 0x7ff3140cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff318a77640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff31415b7b0 0x7ff314146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff313fff640 1 -- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3140c67a0 msgr2=0x7ff3140cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff313fff640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3140c67a0 0x7ff3140cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff313fff640 1 -- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff31415b7b0 msgr2=0x7ff314146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff313fff640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff31415b7b0 0x7ff314146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff313fff640 1 -- 172.21.15.122:0/188966534 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3140cb280 con 0x7ff314072270 2024-09-17T06:09:45.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff313fff640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff314072270 0x7ff3140cc4d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff304009790 tx=0x7ff304005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:45.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff310ff9640 1 -- 172.21.15.122:0/188966534 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3040be070 con 0x7ff314072270 2024-09-17T06:09:45.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff310ff9640 1 -- 172.21.15.122:0/188966534 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3040052f0 con 0x7ff314072270 2024-09-17T06:09:45.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff31a4da640 1 -- 172.21.15.122:0/188966534 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff314151d40 con 0x7ff314072270 2024-09-17T06:09:45.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff310ff9640 1 -- 172.21.15.122:0/188966534 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3040b5040 con 0x7ff314072270 2024-09-17T06:09:45.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff31a4da640 1 -- 172.21.15.122:0/188966534 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3140ca860 con 0x7ff314072270 2024-09-17T06:09:45.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff31a4da640 1 -- 172.21.15.122:0/188966534 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3140c9f70 con 0x7ff314072270 2024-09-17T06:09:45.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff310ff9640 1 -- 172.21.15.122:0/188966534 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff3040c1070 con 0x7ff314072270 2024-09-17T06:09:45.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff310ff9640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff300073200 0x7ff300075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:45.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff310ff9640 1 -- 172.21.15.122:0/188966534 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6854+0+0 (secure 0 0 0) 0x7ff304131450 con 0x7ff314072270 2024-09-17T06:09:45.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.504+0000 7ff3137fe640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff300073200 0x7ff300075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:45.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.508+0000 7ff3137fe640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff300073200 0x7ff300075710 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff3140c7540 tx=0x7ff308009260 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:45.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.512+0000 7ff310ff9640 1 -- 172.21.15.122:0/188966534 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff304018b70 con 0x7ff314072270 2024-09-17T06:09:45.685 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.680+0000 7ff31a4da640 1 -- 172.21.15.122:0/188966534 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7ff31414dd30 con 0x7ff314072270 2024-09-17T06:09:45.692 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.688+0000 7ff310ff9640 1 -- 172.21.15.122:0/188966534 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v39)=0 v39) ==== 123+0+0 (secure 0 0 0) 0x7ff3040fc080 con 0x7ff314072270 2024-09-17T06:09:45.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.692+0000 7ff31a4da640 1 -- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff300073200 msgr2=0x7ff300075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.692+0000 7ff31a4da640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff300073200 0x7ff300075710 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff3140c7540 tx=0x7ff308009260 comp rx=0 tx=0).stop 2024-09-17T06:09:45.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.692+0000 7ff31a4da640 1 -- 172.21.15.122:0/188966534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff314072270 msgr2=0x7ff3140cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.692+0000 7ff31a4da640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff314072270 0x7ff3140cc4d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff304009790 tx=0x7ff304005db0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.692+0000 7ff31a4da640 1 -- 172.21.15.122:0/188966534 shutdown_connections 2024-09-17T06:09:45.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.692+0000 7ff31a4da640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7ff300073200 0x7ff300075710 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.692+0000 7ff31a4da640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff31415b7b0 0x7ff314146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.692+0000 7ff31a4da640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff3140c67a0 0x7ff3140cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.692+0000 7ff31a4da640 1 --2- 172.21.15.122:0/188966534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff314072270 0x7ff3140cc4d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.692+0000 7ff31a4da640 1 -- 172.21.15.122:0/188966534 >> 172.21.15.122:0/188966534 conn(0x7ff3140746d0 msgr2=0x7ff31415bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:45.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.692+0000 7ff31a4da640 1 -- 172.21.15.122:0/188966534 shutdown_connections 2024-09-17T06:09:45.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.692+0000 7ff31a4da640 1 -- 172.21.15.122:0/188966534 wait complete. 2024-09-17T06:09:45.717 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T06:09:45.717 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T06:09:45.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.868+0000 7f4feae7d640 1 -- 172.21.15.122:0/431935116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fcc003a10 msgr2=0x7f4fcc003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.868+0000 7f4feae7d640 1 --2- 172.21.15.122:0/431935116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fcc003a10 0x7f4fcc003e80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c2e0 tx=0x7f4fe001cf60 comp rx=0 tx=0).stop 2024-09-17T06:09:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.868+0000 7f4fe941a640 1 -- 172.21.15.122:0/431935116 reap_dead start 2024-09-17T06:09:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.868+0000 7f4feae7d640 1 -- 172.21.15.122:0/431935116 shutdown_connections 2024-09-17T06:09:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.868+0000 7f4feae7d640 1 -- 172.21.15.122:0/431935116 >> 172.21.15.122:0/431935116 conn(0x7f4fe40ca380 msgr2=0x7f4fe40ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.868+0000 7f4feae7d640 1 -- 172.21.15.122:0/431935116 shutdown_connections 2024-09-17T06:09:45.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.868+0000 7f4feae7d640 1 -- 172.21.15.122:0/431935116 wait complete. 2024-09-17T06:09:45.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4feae7d640 1 Processor -- start 2024-09-17T06:09:45.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4feae7d640 1 -- start start 2024-09-17T06:09:45.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4feae7d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fcc003a10 0x7f4fe4143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:45.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4feae7d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe4148f20 0x7f4fe40b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:45.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4feae7d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fe4149810 0x7f4fe4149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:45.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4feae7d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe40c9fe0 con 0x7f4fe4148f20 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4feae7d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe40c2cb0 con 0x7f4fcc003a10 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4feae7d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe4152620 con 0x7f4fe4149810 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fdbfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe4148f20 0x7f4fe40b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fdbfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe4148f20 0x7f4fe40b1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56570/0 (socket says 172.21.15.122:56570) 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fdbfff640 1 -- 172.21.15.122:0/1433854036 learned_addr learned my addr 172.21.15.122:0/1433854036 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fe8c19640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fcc003a10 0x7f4fe4143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fdbfff640 1 -- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fe4149810 msgr2=0x7f4fe4149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fe941a640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fe4149810 0x7f4fe4149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fdbfff640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fe4149810 0x7f4fe4149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fdbfff640 1 -- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fcc003a10 msgr2=0x7f4fe4143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fdbfff640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fcc003a10 0x7f4fe4143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fdbfff640 1 -- 172.21.15.122:0/1433854036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe40b23d0 con 0x7f4fe4148f20 2024-09-17T06:09:45.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fe8c19640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fcc003a10 0x7f4fe4143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:09:45.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fdbfff640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe4148f20 0x7f4fe40b1e90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4010a40 tx=0x7f4fd4010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:45.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fd97fa640 1 -- 172.21.15.122:0/1433854036 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400ed20 con 0x7f4fe4148f20 2024-09-17T06:09:45.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fd97fa640 1 -- 172.21.15.122:0/1433854036 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f4fd4004030 con 0x7f4fe4148f20 2024-09-17T06:09:45.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4feae7d640 1 -- 172.21.15.122:0/1433854036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe40c9290 con 0x7f4fe4148f20 2024-09-17T06:09:45.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4fd97fa640 1 -- 172.21.15.122:0/1433854036 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4004480 con 0x7f4fe4148f20 2024-09-17T06:09:45.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4feae7d640 1 -- 172.21.15.122:0/1433854036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe414d180 con 0x7f4fe4148f20 2024-09-17T06:09:45.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.872+0000 7f4feae7d640 1 -- 172.21.15.122:0/1433854036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe4156260 con 0x7f4fe4148f20 2024-09-17T06:09:45.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.876+0000 7f4fd97fa640 1 -- 172.21.15.122:0/1433854036 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4fd4003600 con 0x7f4fe4148f20 2024-09-17T06:09:45.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.876+0000 7f4fd97fa640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4fd0073200 0x7f4fd0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:45.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.876+0000 7f4fd97fa640 1 -- 172.21.15.122:0/1433854036 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6854+0+0 (secure 0 0 0) 0x7f4fd4095430 con 0x7f4fe4148f20 2024-09-17T06:09:45.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.876+0000 7f4fe8c19640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4fd0073200 0x7f4fd0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:45.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.876+0000 7f4fe8c19640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4fd0073200 0x7f4fd0075710 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00ab000 tx=0x7f4fcc005840 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:45.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:45.880+0000 7f4fd97fa640 1 -- 172.21.15.122:0/1433854036 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4fd40600f0 con 0x7f4fe4148f20 2024-09-17T06:09:46.090 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.084+0000 7f4feae7d640 1 -- 172.21.15.122:0/1433854036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fe4155f80 con 0x7f4fe4148f20 2024-09-17T06:09:46.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4fd97fa640 1 -- 172.21.15.122:0/1433854036 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7f4fd405f9f0 con 0x7f4fe4148f20 2024-09-17T06:09:46.092 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:09:46.092 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":9,"btime":"2024-09-17T06:04:32:633995+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1941177833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1941177833},{"type":"v1","addr":"172.21.15.173:6835","nonce":1941177833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3902874091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3902874091},{"type":"v1","addr":"172.21.15.122:6833","nonce":3902874091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2868113442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2868113442},{"type":"v1","addr":"172.21.15.122:6836","nonce":2868113442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1552928786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1552928786},{"type":"v1","addr":"172.21.15.122:6837","nonce":1552928786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4447,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2188047562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2188047562},{"type":"v1","addr":"172.21.15.173:6837","nonce":2188047562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T06:04:08.229792+0000","modified":"2024-09-17T06:04:32.027039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4450":{"gid":4450,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6839/1694851531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":1694851531},{"type":"v1","addr":"172.21.15.173:6839","nonce":1694851531}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4450,"qdb_cluster":[4450]},"id":1}]} 2024-09-17T06:09:46.092 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 9 2024-09-17T06:09:46.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4feae7d640 1 -- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4fd0073200 msgr2=0x7f4fd0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:46.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4feae7d640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4fd0073200 0x7f4fd0075710 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00ab000 tx=0x7f4fcc005840 comp rx=0 tx=0).stop 2024-09-17T06:09:46.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4feae7d640 1 -- 172.21.15.122:0/1433854036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe4148f20 msgr2=0x7f4fe40b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:46.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4feae7d640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe4148f20 0x7f4fe40b1e90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4010a40 tx=0x7f4fd4010f00 comp rx=0 tx=0).stop 2024-09-17T06:09:46.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4feae7d640 1 -- 172.21.15.122:0/1433854036 shutdown_connections 2024-09-17T06:09:46.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4feae7d640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4fe4149810 0x7f4fe4149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4feae7d640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe4148f20 0x7f4fe40b1e90 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4feae7d640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f4fd0073200 0x7f4fd0075710 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.094 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4feae7d640 1 --2- 172.21.15.122:0/1433854036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fcc003a10 0x7f4fe4143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4feae7d640 1 -- 172.21.15.122:0/1433854036 >> 172.21.15.122:0/1433854036 conn(0x7f4fe40ca380 msgr2=0x7f4fe40c3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:46.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4feae7d640 1 -- 172.21.15.122:0/1433854036 shutdown_connections 2024-09-17T06:09:46.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.088+0000 7f4feae7d640 1 -- 172.21.15.122:0/1433854036 wait complete. 2024-09-17T06:09:46.115 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T06:09:46.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.264+0000 7f7fbd538640 1 -- 172.21.15.122:0/2519686163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fb80c2220 msgr2=0x7f7fb8152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:46.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.264+0000 7f7fbd538640 1 --2- 172.21.15.122:0/2519686163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fb80c2220 0x7f7fb8152150 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009840 tx=0x7f7fa801f010 comp rx=0 tx=0).stop 2024-09-17T06:09:46.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.264+0000 7f7fbd538640 1 -- 172.21.15.122:0/2519686163 shutdown_connections 2024-09-17T06:09:46.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.264+0000 7f7fbd538640 1 --2- 172.21.15.122:0/2519686163 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fb806e830 0x7f7fb815b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.264+0000 7f7fbd538640 1 --2- 172.21.15.122:0/2519686163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fb80c2220 0x7f7fb8152150 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.264+0000 7f7fbd538640 1 -- 172.21.15.122:0/2519686163 >> 172.21.15.122:0/2519686163 conn(0x7f7fb8070c10 msgr2=0x7f7fb8072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:46.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.264+0000 7f7fbd538640 1 -- 172.21.15.122:0/2519686163 shutdown_connections 2024-09-17T06:09:46.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.264+0000 7f7fbd538640 1 -- 172.21.15.122:0/2519686163 wait complete. 2024-09-17T06:09:46.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fbd538640 1 Processor -- start 2024-09-17T06:09:46.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fbd538640 1 -- start start 2024-09-17T06:09:46.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fbd538640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fb806e830 0x7f7fb80cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:46.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fbd538640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fb806ec40 0x7f7fb8157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:46.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fbd538640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fb80c2220 0x7f7fb8156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:46.274 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fbd538640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb80c8d30 con 0x7f7fb806e830 2024-09-17T06:09:46.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fbd538640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb8073450 con 0x7f7fb80c2220 2024-09-17T06:09:46.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fbd538640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb815c2d0 con 0x7f7fb806ec40 2024-09-17T06:09:46.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fb6ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fb806e830 0x7f7fb80cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:46.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fb6ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fb806e830 0x7f7fb80cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56582/0 (socket says 172.21.15.122:56582) 2024-09-17T06:09:46.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fb6ffd640 1 -- 172.21.15.122:0/3725336008 learned_addr learned my addr 172.21.15.122:0/3725336008 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:46.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fb67fc640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fb806ec40 0x7f7fb8157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:46.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fb77fe640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fb80c2220 0x7f7fb8156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:46.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fb6ffd640 1 -- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fb806ec40 msgr2=0x7f7fb8157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:46.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fb6ffd640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fb806ec40 0x7f7fb8157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fb6ffd640 1 -- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fb80c2220 msgr2=0x7f7fb8156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:46.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fb6ffd640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fb80c2220 0x7f7fb8156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fb6ffd640 1 -- 172.21.15.122:0/3725336008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb8152150 con 0x7f7fb806e830 2024-09-17T06:09:46.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fb77fe640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fb80c2220 0x7f7fb8156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:09:46.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fb6ffd640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fb806e830 0x7f7fb80cb2c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009790 tx=0x7f7fa80a8ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:46.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7f9f7fe640 1 -- 172.21.15.122:0/3725336008 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80be070 con 0x7f7fb806e830 2024-09-17T06:09:46.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7f9f7fe640 1 -- 172.21.15.122:0/3725336008 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f7fa8005400 con 0x7f7fb806e830 2024-09-17T06:09:46.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7f9f7fe640 1 -- 172.21.15.122:0/3725336008 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80b5040 con 0x7f7fb806e830 2024-09-17T06:09:46.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fbd538640 1 -- 172.21.15.122:0/3725336008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb814e3b0 con 0x7f7fb806e830 2024-09-17T06:09:46.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.268+0000 7f7fbd538640 1 -- 172.21.15.122:0/3725336008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb80cd6f0 con 0x7f7fb806e830 2024-09-17T06:09:46.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.272+0000 7f7fbd538640 1 -- 172.21.15.122:0/3725336008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb81566c0 con 0x7f7fb806e830 2024-09-17T06:09:46.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.272+0000 7f7f9f7fe640 1 -- 172.21.15.122:0/3725336008 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7fa80046d0 con 0x7f7fb806e830 2024-09-17T06:09:46.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.272+0000 7f7f9f7fe640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7fa4073200 0x7f7fa4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:46.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.272+0000 7f7f9f7fe640 1 -- 172.21.15.122:0/3725336008 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6854+0+0 (secure 0 0 0) 0x7f7fa81317b0 con 0x7f7fb806e830 2024-09-17T06:09:46.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.272+0000 7f7fb67fc640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7fa4073200 0x7f7fa4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:46.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.272+0000 7f7fb67fc640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7fa4073200 0x7f7fa4075710 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0058d0 tx=0x7f7fac005860 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:46.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.276+0000 7f7f9f7fe640 1 -- 172.21.15.122:0/3725336008 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7fa8018b70 con 0x7f7fb806e830 2024-09-17T06:09:46.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.480+0000 7f7fbd538640 1 -- 172.21.15.122:0/3725336008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fb806f110 con 0x7f7fb806e830 2024-09-17T06:09:46.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.480+0000 7f7f9f7fe640 1 -- 172.21.15.122:0/3725336008 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6886 (secure 0 0 0) 0x7f7fa80fc3f0 con 0x7f7fb806e830 2024-09-17T06:09:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:09:46.487 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":9,"btime":"2024-09-17T06:04:32:633995+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/1941177833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":1941177833},{"type":"v1","addr":"172.21.15.173:6835","nonce":1941177833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/3902874091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":3902874091},{"type":"v1","addr":"172.21.15.122:6833","nonce":3902874091}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4392,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2868113442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2868113442},{"type":"v1","addr":"172.21.15.122:6836","nonce":2868113442}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4429,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1552928786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1552928786},{"type":"v1","addr":"172.21.15.122:6837","nonce":1552928786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4447,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/2188047562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":2188047562},{"type":"v1","addr":"172.21.15.173:6837","nonce":2188047562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T06:04:08.229792+0000","modified":"2024-09-17T06:04:32.027039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4450":{"gid":4450,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.173:6839/1694851531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":1694851531},{"type":"v1","addr":"172.21.15.173:6839","nonce":1694851531}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4450,"qdb_cluster":[4450]},"id":1}]} 2024-09-17T06:09:46.487 INFO:teuthology.orchestra.run.smithi122.stderr:dumped fsmap epoch 9 2024-09-17T06:09:46.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.484+0000 7f7fbd538640 1 -- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7fa4073200 msgr2=0x7f7fa4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:46.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.484+0000 7f7fbd538640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7fa4073200 0x7f7fa4075710 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0058d0 tx=0x7f7fac005860 comp rx=0 tx=0).stop 2024-09-17T06:09:46.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.484+0000 7f7fbd538640 1 -- 172.21.15.122:0/3725336008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fb806e830 msgr2=0x7f7fb80cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:46.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.484+0000 7f7fbd538640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fb806e830 0x7f7fb80cb2c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009790 tx=0x7f7fa80a8ca0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.484+0000 7f7fbd538640 1 -- 172.21.15.122:0/3725336008 shutdown_connections 2024-09-17T06:09:46.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.484+0000 7f7fbd538640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f7fa4073200 0x7f7fa4075710 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.484+0000 7f7fbd538640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7fb80c2220 0x7f7fb8156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.484+0000 7f7fbd538640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7fb806ec40 0x7f7fb8157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.484+0000 7f7fbd538640 1 --2- 172.21.15.122:0/3725336008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fb806e830 0x7f7fb80cb2c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.484+0000 7f7fbd538640 1 -- 172.21.15.122:0/3725336008 >> 172.21.15.122:0/3725336008 conn(0x7f7fb8070c10 msgr2=0x7f7fb8150f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:46.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.484+0000 7f7fbd538640 1 -- 172.21.15.122:0/3725336008 shutdown_connections 2024-09-17T06:09:46.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.484+0000 7f7fbd538640 1 -- 172.21.15.122:0/3725336008 wait complete. 2024-09-17T06:09:46.510 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T06:09:46.664 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.660+0000 7f5407c81640 1 -- 172.21.15.122:0/3599569274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5400159b30 msgr2=0x7f5400072270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:46.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.660+0000 7f5407c81640 1 --2- 172.21.15.122:0/3599569274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5400159b30 0x7f5400072270 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009840 tx=0x7f53f001f010 comp rx=0 tx=0).stop 2024-09-17T06:09:46.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.660+0000 7f5407c81640 1 -- 172.21.15.122:0/3599569274 shutdown_connections 2024-09-17T06:09:46.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.660+0000 7f5407c81640 1 --2- 172.21.15.122:0/3599569274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5400159b30 0x7f5400072270 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.660+0000 7f5407c81640 1 -- 172.21.15.122:0/3599569274 >> 172.21.15.122:0/3599569274 conn(0x7f54000746d0 msgr2=0x7f5400074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:46.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.660+0000 7f5407c81640 1 -- 172.21.15.122:0/3599569274 shutdown_connections 2024-09-17T06:09:46.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.660+0000 7f5407c81640 1 -- 172.21.15.122:0/3599569274 wait complete. 2024-09-17T06:09:46.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.660+0000 7f5407c81640 1 Processor -- start 2024-09-17T06:09:46.666 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.660+0000 7f5407c81640 1 -- start start 2024-09-17T06:09:46.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f5407c81640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54000727b0 0x7f5400155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:46.669 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f5407c81640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54000c6780 0x7f540014e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:46.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f5407c81640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5400159b30 0x7f5400146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:46.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f5407c81640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f540015d470 con 0x7f54000c6780 2024-09-17T06:09:46.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f5407c81640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f540015c6a0 con 0x7f5400159b30 2024-09-17T06:09:46.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f5407c81640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f5400159f40 con 0x7f54000727b0 2024-09-17T06:09:46.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f540521c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54000c6780 0x7f540014e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:46.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f540521c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54000c6780 0x7f540014e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56586/0 (socket says 172.21.15.122:56586) 2024-09-17T06:09:46.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f540521c640 1 -- 172.21.15.122:0/702478867 learned_addr learned my addr 172.21.15.122:0/702478867 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:46.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f5405a1d640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54000727b0 0x7f5400155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:46.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f540621e640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5400159b30 0x7f5400146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:46.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f540521c640 1 -- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54000727b0 msgr2=0x7f5400155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:46.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f540521c640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54000727b0 0x7f5400155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.670 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f540521c640 1 -- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5400159b30 msgr2=0x7f5400146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:46.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f540521c640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5400159b30 0x7f5400146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f540521c640 1 -- 172.21.15.122:0/702478867 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5400154510 con 0x7f54000c6780 2024-09-17T06:09:46.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f540621e640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5400159b30 0x7f5400146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:09:46.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f540521c640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54000c6780 0x7f540014e340 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f53f001d6c0 tx=0x7f53f00a8d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:46.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f53f67fc640 1 -- 172.21.15.122:0/702478867 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f00bf070 con 0x7f54000c6780 2024-09-17T06:09:46.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f53f67fc640 1 -- 172.21.15.122:0/702478867 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f53f0003a10 con 0x7f54000c6780 2024-09-17T06:09:46.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f5407c81640 1 -- 172.21.15.122:0/702478867 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54001547f0 con 0x7f54000c6780 2024-09-17T06:09:46.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f53f67fc640 1 -- 172.21.15.122:0/702478867 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f00b5040 con 0x7f54000c6780 2024-09-17T06:09:46.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f5407c81640 1 -- 172.21.15.122:0/702478867 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5400155720 con 0x7f54000c6780 2024-09-17T06:09:46.671 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f5407c81640 1 -- 172.21.15.122:0/702478867 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5400072270 con 0x7f54000c6780 2024-09-17T06:09:46.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.664+0000 7f53f67fc640 1 -- 172.21.15.122:0/702478867 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f53f00c2070 con 0x7f54000c6780 2024-09-17T06:09:46.672 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.668+0000 7f53f67fc640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f53e4073200 0x7f53e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:46.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.668+0000 7f53f67fc640 1 -- 172.21.15.122:0/702478867 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6854+0+0 (secure 0 0 0) 0x7f53f0131660 con 0x7f54000c6780 2024-09-17T06:09:46.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.668+0000 7f5405a1d640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f53e4073200 0x7f53e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:46.673 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.668+0000 7f5405a1d640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f53e4073200 0x7f53e4075710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00b810 tx=0x7f53fc008040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:46.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.672+0000 7f53f67fc640 1 -- 172.21.15.122:0/702478867 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f53f0018b70 con 0x7f54000c6780 2024-09-17T06:09:46.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.836+0000 7f5407c81640 1 -- 172.21.15.122:0/702478867 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54000c3650 con 0x7f54000c6780 2024-09-17T06:09:46.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.836+0000 7f53f67fc640 1 -- 172.21.15.122:0/702478867 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+19170 (secure 0 0 0) 0x7f53f00fc400 con 0x7f54000c6780 2024-09-17T06:09:46.842 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-17T06:09:46.842 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":85,"fsid":"5aff0fc3-254a-48aa-be08-0081a34bd09c","created":"2024-09-17T06:03:42.642598+0000","modified":"2024-09-17T06:07:50.679128+0000","last_up_change":"2024-09-17T06:06:01.694374+0000","last_in_change":"2024-09-17T06:03:46.879949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T06:03:57.560955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T06:04:06.110710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T06:04:07.186655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T06:04:10.901448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b8a621d5-9187-4034-ac89-5adb5b22ca7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6825","nonce":776463314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6827","nonce":776463314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6831","nonce":776463314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":776463314},{"type":"v1","addr":"172.21.15.122:6829","nonce":776463314}]},"public_addr":"172.21.15.122:6825/776463314","cluster_addr":"172.21.15.122:6827/776463314","heartbeat_back_addr":"172.21.15.122:6831/776463314","heartbeat_front_addr":"172.21.15.122:6829/776463314","state":["exists","up"]},{"osd":1,"uuid":"992e1af1-06d0-4849-93bf-4be8fc437183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6801","nonce":2272556556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6803","nonce":2272556556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6807","nonce":2272556556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":2272556556},{"type":"v1","addr":"172.21.15.122:6805","nonce":2272556556}]},"public_addr":"172.21.15.122:6801/2272556556","cluster_addr":"172.21.15.122:6803/2272556556","heartbeat_back_addr":"172.21.15.122:6807/2272556556","heartbeat_front_addr":"172.21.15.122:6805/2272556556","state":["exists","up"]},{"osd":2,"uuid":"e3a31b77-d4db-4ee6-af7c-60af7df4bd69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6817","nonce":1205784459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6819","nonce":1205784459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6823","nonce":1205784459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":1205784459},{"type":"v1","addr":"172.21.15.122:6821","nonce":1205784459}]},"public_addr":"172.21.15.122:6817/1205784459","cluster_addr":"172.21.15.122:6819/1205784459","heartbeat_back_addr":"172.21.15.122:6823/1205784459","heartbeat_front_addr":"172.21.15.122:6821/1205784459","state":["exists","up"]},{"osd":3,"uuid":"9f473452-18cd-44a4-803a-e908e21ab405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6809","nonce":3198016774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6811","nonce":3198016774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6815","nonce":3198016774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3198016774},{"type":"v1","addr":"172.21.15.122:6813","nonce":3198016774}]},"public_addr":"172.21.15.122:6809/3198016774","cluster_addr":"172.21.15.122:6811/3198016774","heartbeat_back_addr":"172.21.15.122:6815/3198016774","heartbeat_front_addr":"172.21.15.122:6813/3198016774","state":["exists","up"]},{"osd":4,"uuid":"f11201b3-22f8-4b9e-873c-0ed12835e2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":44,"up_from":64,"up_thru":82,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6811","nonce":1065110369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6813","nonce":1065110369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6817","nonce":1065110369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1065110369},{"type":"v1","addr":"172.21.15.173:6815","nonce":1065110369}]},"public_addr":"172.21.15.173:6811/1065110369","cluster_addr":"172.21.15.173:6813/1065110369","heartbeat_back_addr":"172.21.15.173:6817/1065110369","heartbeat_front_addr":"172.21.15.173:6815/1065110369","state":["exists","up"]},{"osd":5,"uuid":"3f853011-9aea-4f7c-bb97-2c74fba1e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6803","nonce":2576144160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6805","nonce":2576144160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6809","nonce":2576144160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":2576144160},{"type":"v1","addr":"172.21.15.173:6807","nonce":2576144160}]},"public_addr":"172.21.15.173:6803/2576144160","cluster_addr":"172.21.15.173:6805/2576144160","heartbeat_back_addr":"172.21.15.173:6809/2576144160","heartbeat_front_addr":"172.21.15.173:6807/2576144160","state":["exists","up"]},{"osd":6,"uuid":"445606c9-7e18-44b2-997d-68d280a3a37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6819","nonce":1877869793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6821","nonce":1877869793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6825","nonce":1877869793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":1877869793},{"type":"v1","addr":"172.21.15.173:6823","nonce":1877869793}]},"public_addr":"172.21.15.173:6819/1877869793","cluster_addr":"172.21.15.173:6821/1877869793","heartbeat_back_addr":"172.21.15.173:6825/1877869793","heartbeat_front_addr":"172.21.15.173:6823/1877869793","state":["exists","up"]},{"osd":7,"uuid":"ce0b67c6-0618-41b7-87e3-bf2d4c708907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6827","nonce":1719466778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6829","nonce":1719466778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6833","nonce":1719466778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1719466778},{"type":"v1","addr":"172.21.15.173:6831","nonce":1719466778}]},"public_addr":"172.21.15.173:6827/1719466778","cluster_addr":"172.21.15.173:6829/1719466778","heartbeat_back_addr":"172.21.15.173:6833/1719466778","heartbeat_front_addr":"172.21.15.173:6831/1719466778","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.176942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.431303+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.354201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.748604+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.473848+0000","dead_epoch":46},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.458683+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:53.617928+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T06:03:54.088763+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.15","osds":[5,0]}],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":3,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T06:09:46.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.840+0000 7f5407c81640 1 -- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f53e4073200 msgr2=0x7f53e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:46.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.840+0000 7f5407c81640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f53e4073200 0x7f53e4075710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00b810 tx=0x7f53fc008040 comp rx=0 tx=0).stop 2024-09-17T06:09:46.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.840+0000 7f5407c81640 1 -- 172.21.15.122:0/702478867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54000c6780 msgr2=0x7f540014e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:46.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.840+0000 7f5407c81640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54000c6780 0x7f540014e340 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f53f001d6c0 tx=0x7f53f00a8d30 comp rx=0 tx=0).stop 2024-09-17T06:09:46.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.840+0000 7f5407c81640 1 -- 172.21.15.122:0/702478867 shutdown_connections 2024-09-17T06:09:46.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.840+0000 7f5407c81640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f53e4073200 0x7f53e4075710 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.840+0000 7f5407c81640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5400159b30 0x7f5400146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.840+0000 7f5407c81640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54000c6780 0x7f540014e340 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.840+0000 7f5407c81640 1 --2- 172.21.15.122:0/702478867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54000727b0 0x7f5400155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:46.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.840+0000 7f5407c81640 1 -- 172.21.15.122:0/702478867 >> 172.21.15.122:0/702478867 conn(0x7f54000746d0 msgr2=0x7f5400156cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:46.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.840+0000 7f5407c81640 1 -- 172.21.15.122:0/702478867 shutdown_connections 2024-09-17T06:09:46.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:46.840+0000 7f5407c81640 1 -- 172.21.15.122:0/702478867 wait complete. 2024-09-17T06:09:46.864 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T06:09:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.000+0000 7fe0acb24640 1 -- 172.21.15.122:0/2617467968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a80728f0 msgr2=0x7fe0a80c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.000+0000 7fe0acb24640 1 --2- 172.21.15.122:0/2617467968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a80728f0 0x7fe0a80c9b20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8074050 tx=0x7fe09801eff0 comp rx=0 tx=0).stop 2024-09-17T06:09:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 -- 172.21.15.122:0/2617467968 shutdown_connections 2024-09-17T06:09:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 --2- 172.21.15.122:0/2617467968 >> v2:172.21.15.173:3300/0 conn(0x7fe0a80c81c0 0x7fe0a80c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 --2- 172.21.15.122:0/2617467968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a80728f0 0x7fe0a80c9b20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:47.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 -- 172.21.15.122:0/2617467968 >> 172.21.15.122:0/2617467968 conn(0x7fe0a80746d0 msgr2=0x7fe0a8074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:47.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 -- 172.21.15.122:0/2617467968 shutdown_connections 2024-09-17T06:09:47.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 -- 172.21.15.122:0/2617467968 wait complete. 2024-09-17T06:09:47.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 Processor -- start 2024-09-17T06:09:47.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 -- start start 2024-09-17T06:09:47.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a80728f0 0x7fe0a81ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:47.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a80c2ba0 0x7fe0a80cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:47.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a80c81c0 0x7fe0a8145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:47.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a8158db0 con 0x7fe0a80c81c0 2024-09-17T06:09:47.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a815b870 con 0x7fe0a80728f0 2024-09-17T06:09:47.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0acb24640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a80c2fb0 con 0x7fe0a80c2ba0 2024-09-17T06:09:47.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0a6d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a80c81c0 0x7fe0a8145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0a6d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a80c81c0 0x7fe0a8145f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56596/0 (socket says 172.21.15.122:56596) 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0a6d9d640 1 -- 172.21.15.122:0/1540485404 learned_addr learned my addr 172.21.15.122:0/1540485404 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0a5d9b640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a80c2ba0 0x7fe0a80cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0a659c640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a80728f0 0x7fe0a81ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0a6d9d640 1 -- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a80c2ba0 msgr2=0x7fe0a80cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0a6d9d640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a80c2ba0 0x7fe0a80cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0a6d9d640 1 -- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a80728f0 msgr2=0x7fe0a81ee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0a6d9d640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a80728f0 0x7fe0a81ee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0a6d9d640 1 -- 172.21.15.122:0/1540485404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a8152c00 con 0x7fe0a80c81c0 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.004+0000 7fe0a6d9d640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a80c81c0 0x7fe0a8145f80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000cb10 tx=0x7fe0a0007220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.008+0000 7fe09effd640 1 -- 172.21.15.122:0/1540485404 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0007dd0 con 0x7fe0a80c81c0 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.008+0000 7fe09effd640 1 -- 172.21.15.122:0/1540485404 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fe0a0003ad0 con 0x7fe0a80c81c0 2024-09-17T06:09:47.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.008+0000 7fe0acb24640 1 -- 172.21.15.122:0/1540485404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a8152ec0 con 0x7fe0a80c81c0 2024-09-17T06:09:47.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.008+0000 7fe09effd640 1 -- 172.21.15.122:0/1540485404 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0004030 con 0x7fe0a80c81c0 2024-09-17T06:09:47.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.008+0000 7fe0acb24640 1 -- 172.21.15.122:0/1540485404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a8148470 con 0x7fe0a80c81c0 2024-09-17T06:09:47.013 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.008+0000 7fe0acb24640 1 -- 172.21.15.122:0/1540485404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a81580e0 con 0x7fe0a80c81c0 2024-09-17T06:09:47.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.008+0000 7fe09effd640 1 -- 172.21.15.122:0/1540485404 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe0a0004b30 con 0x7fe0a80c81c0 2024-09-17T06:09:47.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.008+0000 7fe09effd640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe088073200 0x7fe088075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:47.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.008+0000 7fe09effd640 1 -- 172.21.15.122:0/1540485404 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6854+0+0 (secure 0 0 0) 0x7fe0a0095410 con 0x7fe0a80c81c0 2024-09-17T06:09:47.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.008+0000 7fe0a659c640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe088073200 0x7fe088075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:47.014 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.008+0000 7fe0a659c640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe088073200 0x7fe088075710 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe0980b2000 tx=0x7fe0980aa040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:47.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.012+0000 7fe09effd640 1 -- 172.21.15.122:0/1540485404 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe0a0014070 con 0x7fe0a80c81c0 2024-09-17T06:09:47.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.204+0000 7fe0acb24640 1 -- 172.21.15.122:0/1540485404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe0a80c6930 con 0x7fe0a80c81c0 2024-09-17T06:09:47.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.208+0000 7fe09effd640 1 -- 172.21.15.122:0/1540485404 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7fe0a0004e20 con 0x7fe0a80c81c0 2024-09-17T06:09:47.211 INFO:teuthology.orchestra.run.smithi122.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T06:09:47.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.208+0000 7fe0acb24640 1 -- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe088073200 msgr2=0x7fe088075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:47.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.208+0000 7fe0acb24640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe088073200 0x7fe088075710 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe0980b2000 tx=0x7fe0980aa040 comp rx=0 tx=0).stop 2024-09-17T06:09:47.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.208+0000 7fe0acb24640 1 -- 172.21.15.122:0/1540485404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a80c81c0 msgr2=0x7fe0a8145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:47.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.208+0000 7fe0acb24640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a80c81c0 0x7fe0a8145f80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000cb10 tx=0x7fe0a0007220 comp rx=0 tx=0).stop 2024-09-17T06:09:47.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.208+0000 7fe0acb24640 1 -- 172.21.15.122:0/1540485404 shutdown_connections 2024-09-17T06:09:47.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.208+0000 7fe0acb24640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0a80c81c0 0x7fe0a8145f80 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:47.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.208+0000 7fe0acb24640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe0a80c2ba0 0x7fe0a80cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:47.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.208+0000 7fe0acb24640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fe088073200 0x7fe088075710 secure :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe0980b2000 tx=0x7fe0980aa040 comp rx=0 tx=0).stop 2024-09-17T06:09:47.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.208+0000 7fe0acb24640 1 --2- 172.21.15.122:0/1540485404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0a80728f0 0x7fe0a81ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:47.214 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.208+0000 7fe0acb24640 1 -- 172.21.15.122:0/1540485404 >> 172.21.15.122:0/1540485404 conn(0x7fe0a80746d0 msgr2=0x7fe0a80c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:47.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.212+0000 7fe0acb24640 1 -- 172.21.15.122:0/1540485404 shutdown_connections 2024-09-17T06:09:47.215 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.212+0000 7fe0acb24640 1 -- 172.21.15.122:0/1540485404 wait complete. 2024-09-17T06:09:47.235 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T06:09:47.323 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2024-09-17T06:09:47.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.384+0000 7f646afc6640 1 -- 172.21.15.122:0/4193149172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6454004e70 msgr2=0x7f64540052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:47.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.384+0000 7f646afc6640 1 --2- 172.21.15.122:0/4193149172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6454004e70 0x7f64540052c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f64640b35d0 tx=0x7f645c01caf0 comp rx=0 tx=0).stop 2024-09-17T06:09:47.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.384+0000 7f6469563640 1 -- 172.21.15.122:0/4193149172 reap_dead start 2024-09-17T06:09:47.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.384+0000 7f646afc6640 1 -- 172.21.15.122:0/4193149172 shutdown_connections 2024-09-17T06:09:47.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.384+0000 7f646afc6640 1 -- 172.21.15.122:0/4193149172 >> 172.21.15.122:0/4193149172 conn(0x7f6464073240 msgr2=0x7f64640cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:47.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.384+0000 7f646afc6640 1 -- 172.21.15.122:0/4193149172 shutdown_connections 2024-09-17T06:09:47.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.384+0000 7f646afc6640 1 -- 172.21.15.122:0/4193149172 wait complete. 2024-09-17T06:09:47.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f646afc6640 1 Processor -- start 2024-09-17T06:09:47.390 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f646afc6640 1 -- start start 2024-09-17T06:09:47.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f646afc6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6454004e70 0x7f646406d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:47.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f646afc6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64641e49f0 0x7f646414d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:47.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f646afc6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64641e4e00 0x7f646414dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:47.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f646afc6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f64640c3670 con 0x7f6454004e70 2024-09-17T06:09:47.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f646afc6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f64640c3130 con 0x7f64641e4e00 2024-09-17T06:09:47.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f646afc6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f64640c7ad0 con 0x7f64641e49f0 2024-09-17T06:09:47.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f6468d62640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6454004e70 0x7f646406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:47.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f6468d62640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6454004e70 0x7f646406d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56606/0 (socket says 172.21.15.122:56606) 2024-09-17T06:09:47.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f6468d62640 1 -- 172.21.15.122:0/2310808859 learned_addr learned my addr 172.21.15.122:0/2310808859 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:47.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f6463fff640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64641e49f0 0x7f646414d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:47.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f6469563640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64641e4e00 0x7f646414dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:47.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f6468d62640 1 -- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64641e49f0 msgr2=0x7f646414d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:47.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f6468d62640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64641e49f0 0x7f646414d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:47.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f6468d62640 1 -- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64641e4e00 msgr2=0x7f646414dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:47.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f6468d62640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64641e4e00 0x7f646414dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:47.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f6468d62640 1 -- 172.21.15.122:0/2310808859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646406dd50 con 0x7f6454004e70 2024-09-17T06:09:47.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f6463fff640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64641e49f0 0x7f646414d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:09:47.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f6468d62640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6454004e70 0x7f646406d810 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f645800f5a0 tx=0x7f645800df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:47.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f64617fa640 1 -- 172.21.15.122:0/2310808859 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458017070 con 0x7f6454004e70 2024-09-17T06:09:47.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f64617fa640 1 -- 172.21.15.122:0/2310808859 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f64580119b0 con 0x7f6454004e70 2024-09-17T06:09:47.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f646afc6640 1 -- 172.21.15.122:0/2310808859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64640b1c80 con 0x7f6454004e70 2024-09-17T06:09:47.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f64617fa640 1 -- 172.21.15.122:0/2310808859 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458011e00 con 0x7f6454004e70 2024-09-17T06:09:47.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f646afc6640 1 -- 172.21.15.122:0/2310808859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64640b2200 con 0x7f6454004e70 2024-09-17T06:09:47.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.388+0000 7f646afc6640 1 -- 172.21.15.122:0/2310808859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f646406f1c0 con 0x7f6454004e70 2024-09-17T06:09:47.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.392+0000 7f64617fa640 1 -- 172.21.15.122:0/2310808859 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f645801a070 con 0x7f6454004e70 2024-09-17T06:09:47.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.392+0000 7f64617fa640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6448073200 0x7f6448075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:47.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.392+0000 7f64617fa640 1 -- 172.21.15.122:0/2310808859 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6940+0+0 (secure 0 0 0) 0x7f64580976e0 con 0x7f6454004e70 2024-09-17T06:09:47.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.392+0000 7f6463fff640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6448073200 0x7f6448075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:47.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.392+0000 7f6463fff640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6448073200 0x7f6448075710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6450005fd0 tx=0x7f6450005ea0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:47.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.396+0000 7f64617fa640 1 -- 172.21.15.122:0/2310808859 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f64580622c0 con 0x7f6454004e70 2024-09-17T06:09:47.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:47.600+0000 7f646afc6640 1 -- 172.21.15.122:0/2310808859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f64640c4a10 con 0x7f6454004e70 2024-09-17T06:09:48.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.220+0000 7f64617fa640 1 -- 172.21.15.122:0/2310808859 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f6458061bc0 con 0x7f6454004e70 2024-09-17T06:09:48.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.224+0000 7f646afc6640 1 -- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6448073200 msgr2=0x7f6448075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:48.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.224+0000 7f646afc6640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6448073200 0x7f6448075710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6450005fd0 tx=0x7f6450005ea0 comp rx=0 tx=0).stop 2024-09-17T06:09:48.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.224+0000 7f646afc6640 1 -- 172.21.15.122:0/2310808859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6454004e70 msgr2=0x7f646406d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:48.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.224+0000 7f646afc6640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6454004e70 0x7f646406d810 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f645800f5a0 tx=0x7f645800df90 comp rx=0 tx=0).stop 2024-09-17T06:09:48.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.224+0000 7f646afc6640 1 -- 172.21.15.122:0/2310808859 shutdown_connections 2024-09-17T06:09:48.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.224+0000 7f646afc6640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f6448073200 0x7f6448075710 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:48.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.224+0000 7f646afc6640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64641e4e00 0x7f646414dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:48.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.224+0000 7f646afc6640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f64641e49f0 0x7f646414d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:48.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.224+0000 7f646afc6640 1 --2- 172.21.15.122:0/2310808859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6454004e70 0x7f646406d810 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:48.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.224+0000 7f646afc6640 1 -- 172.21.15.122:0/2310808859 >> 172.21.15.122:0/2310808859 conn(0x7f6464073240 msgr2=0x7f64641582b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:48.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.224+0000 7f646afc6640 1 -- 172.21.15.122:0/2310808859 shutdown_connections 2024-09-17T06:09:48.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.224+0000 7f646afc6640 1 -- 172.21.15.122:0/2310808859 wait complete. 2024-09-17T06:09:48.252 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T06:09:48.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.408+0000 7f9cedcd4640 1 -- 172.21.15.122:0/3796624079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cd0004810 msgr2=0x7f9cd0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:48.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.408+0000 7f9cedcd4640 1 --2- 172.21.15.122:0/3796624079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cd0004810 0x7f9cd0004c20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009b40 tx=0x7f9cdc01d250 comp rx=0 tx=0).stop 2024-09-17T06:09:48.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.408+0000 7f9cedcd4640 1 -- 172.21.15.122:0/3796624079 shutdown_connections 2024-09-17T06:09:48.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.408+0000 7f9cedcd4640 1 --2- 172.21.15.122:0/3796624079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cd0004810 0x7f9cd0004c20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:48.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.408+0000 7f9cedcd4640 1 -- 172.21.15.122:0/3796624079 >> 172.21.15.122:0/3796624079 conn(0x7f9ce80cb310 msgr2=0x7f9ce80cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:48.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9cedcd4640 1 -- 172.21.15.122:0/3796624079 shutdown_connections 2024-09-17T06:09:48.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9cedcd4640 1 -- 172.21.15.122:0/3796624079 wait complete. 2024-09-17T06:09:48.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9cedcd4640 1 Processor -- start 2024-09-17T06:09:48.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9cedcd4640 1 -- start start 2024-09-17T06:09:48.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9cedcd4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9cd0004810 0x7f9ce806e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:48.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9cedcd4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ce815bb50 0x7f9ce815bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:48.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9cedcd4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce814de00 0x7f9ce814e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:48.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9cedcd4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce8159dc0 con 0x7f9ce814de00 2024-09-17T06:09:48.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9cedcd4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce8159ae0 con 0x7f9ce815bb50 2024-09-17T06:09:48.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9cedcd4640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce80c9280 con 0x7f9cd0004810 2024-09-17T06:09:48.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ce7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce814de00 0x7f9ce814e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:48.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ce7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce814de00 0x7f9ce814e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56622/0 (socket says 172.21.15.122:56622) 2024-09-17T06:09:48.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ce7fff640 1 -- 172.21.15.122:0/712923028 learned_addr learned my addr 172.21.15.122:0/712923028 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:48.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ce77fe640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9cd0004810 0x7f9ce806e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:48.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ce6ffd640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ce815bb50 0x7f9ce815bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:48.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ce7fff640 1 -- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9cd0004810 msgr2=0x7f9ce806e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:48.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ce7fff640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9cd0004810 0x7f9ce806e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:48.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ce7fff640 1 -- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ce815bb50 msgr2=0x7f9ce815bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:48.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ce7fff640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ce815bb50 0x7f9ce815bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:48.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ce7fff640 1 -- 172.21.15.122:0/712923028 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce806ef00 con 0x7f9ce814de00 2024-09-17T06:09:48.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ce6ffd640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ce815bb50 0x7f9ce815bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:09:48.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ce7fff640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce814de00 0x7f9ce814e210 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0001380 tx=0x7f9ce000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:48.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ccffff640 1 -- 172.21.15.122:0/712923028 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0017070 con 0x7f9ce814de00 2024-09-17T06:09:48.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.412+0000 7f9ccffff640 1 -- 172.21.15.122:0/712923028 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f9ce0003d90 con 0x7f9ce814de00 2024-09-17T06:09:48.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.416+0000 7f9ccffff640 1 -- 172.21.15.122:0/712923028 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00052d0 con 0x7f9ce814de00 2024-09-17T06:09:48.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.416+0000 7f9cedcd4640 1 -- 172.21.15.122:0/712923028 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce8070210 con 0x7f9ce814de00 2024-09-17T06:09:48.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.416+0000 7f9cedcd4640 1 -- 172.21.15.122:0/712923028 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce815a2d0 con 0x7f9ce814de00 2024-09-17T06:09:48.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.416+0000 7f9cedcd4640 1 -- 172.21.15.122:0/712923028 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce815b7b0 con 0x7f9ce814de00 2024-09-17T06:09:48.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.416+0000 7f9ccffff640 1 -- 172.21.15.122:0/712923028 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9ce001a070 con 0x7f9ce814de00 2024-09-17T06:09:48.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.416+0000 7f9ccffff640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9cd4073200 0x7f9cd4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:48.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.416+0000 7f9ccffff640 1 -- 172.21.15.122:0/712923028 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6940+0+0 (secure 0 0 0) 0x7f9ce0093fb0 con 0x7f9ce814de00 2024-09-17T06:09:48.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.416+0000 7f9ce77fe640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9cd4073200 0x7f9cd4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:48.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.416+0000 7f9ce77fe640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9cd4073200 0x7f9cd4075710 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8000c10 tx=0x7f9cd8006ab0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:48.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.420+0000 7f9ccffff640 1 -- 172.21.15.122:0/712923028 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9ce005ed00 con 0x7f9ce814de00 2024-09-17T06:09:48.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:48.592+0000 7f9cedcd4640 1 -- 172.21.15.122:0/712923028 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9ce80c5ce0 con 0x7f9ce814de00 2024-09-17T06:09:49.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.224+0000 7f9ccffff640 1 -- 172.21.15.122:0/712923028 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) ==== 181+0+0 (secure 0 0 0) 0x7f9ce005e600 con 0x7f9ce814de00 2024-09-17T06:09:49.227 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_metadata' removed 2024-09-17T06:09:49.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.228+0000 7f9cedcd4640 1 -- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9cd4073200 msgr2=0x7f9cd4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:49.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.228+0000 7f9cedcd4640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9cd4073200 0x7f9cd4075710 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8000c10 tx=0x7f9cd8006ab0 comp rx=0 tx=0).stop 2024-09-17T06:09:49.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.228+0000 7f9cedcd4640 1 -- 172.21.15.122:0/712923028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce814de00 msgr2=0x7f9ce814e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:49.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.228+0000 7f9cedcd4640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce814de00 0x7f9ce814e210 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0001380 tx=0x7f9ce000cc60 comp rx=0 tx=0).stop 2024-09-17T06:09:49.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.228+0000 7f9cedcd4640 1 -- 172.21.15.122:0/712923028 shutdown_connections 2024-09-17T06:09:49.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.228+0000 7f9cedcd4640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce814de00 0x7f9ce814e210 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:49.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.228+0000 7f9cedcd4640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f9cd4073200 0x7f9cd4075710 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:49.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.228+0000 7f9cedcd4640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ce815bb50 0x7f9ce815bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:49.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.228+0000 7f9cedcd4640 1 --2- 172.21.15.122:0/712923028 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9cd0004810 0x7f9ce806e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:49.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.228+0000 7f9cedcd4640 1 -- 172.21.15.122:0/712923028 >> 172.21.15.122:0/712923028 conn(0x7f9ce80cb310 msgr2=0x7f9ce81583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:49.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.228+0000 7f9cedcd4640 1 -- 172.21.15.122:0/712923028 shutdown_connections 2024-09-17T06:09:49.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.228+0000 7f9cedcd4640 1 -- 172.21.15.122:0/712923028 wait complete. 2024-09-17T06:09:49.259 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T06:09:49.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.416+0000 7fa772ffd640 1 -- 172.21.15.122:0/2060903649 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680b08b0 con 0x7fa774159b00 2024-09-17T06:09:49.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.416+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2060903649 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa774159b00 msgr2=0x7fa774072330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:49.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.416+0000 7fa77a9fa640 1 --2- 172.21.15.122:0/2060903649 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa774159b00 0x7fa774072330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa768009900 tx=0x7fa76801f0d0 comp rx=0 tx=0).stop 2024-09-17T06:09:49.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.416+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2060903649 shutdown_connections 2024-09-17T06:09:49.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.416+0000 7fa77a9fa640 1 --2- 172.21.15.122:0/2060903649 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa774159b00 0x7fa774072330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:49.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.416+0000 7fa77a9fa640 1 --2- 172.21.15.122:0/2060903649 >> v2:172.21.15.173:3300/0 conn(0x7fa7740c6780 0x7fa774153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:49.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.416+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2060903649 >> 172.21.15.122:0/2060903649 conn(0x7fa7740746d0 msgr2=0x7fa774074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:49.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.416+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2060903649 shutdown_connections 2024-09-17T06:09:49.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.416+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2060903649 wait complete. 2024-09-17T06:09:49.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa77a9fa640 1 Processor -- start 2024-09-17T06:09:49.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa77a9fa640 1 -- start start 2024-09-17T06:09:49.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa77a9fa640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa774072870 0x7fa7740c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:49.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa77a9fa640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7740c6780 0x7fa77414a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:49.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa77a9fa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa774159b00 0x7fa774147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:49.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa77a9fa640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa77415d470 con 0x7fa774159b00 2024-09-17T06:09:49.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa77a9fa640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa77415d190 con 0x7fa774072870 2024-09-17T06:09:49.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa77a9fa640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa774159f10 con 0x7fa7740c6780 2024-09-17T06:09:49.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa778f97640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa774159b00 0x7fa774147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:49.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa778f97640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa774159b00 0x7fa774147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56634/0 (socket says 172.21.15.122:56634) 2024-09-17T06:09:49.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa778f97640 1 -- 172.21.15.122:0/2966716094 learned_addr learned my addr 172.21.15.122:0/2966716094 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa773fff640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa774072870 0x7fa7740c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa7737fe640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7740c6780 0x7fa77414a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa778f97640 1 -- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7740c6780 msgr2=0x7fa77414a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa778f97640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7740c6780 0x7fa77414a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa778f97640 1 -- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa774072870 msgr2=0x7fa7740c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa778f97640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa774072870 0x7fa7740c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa778f97640 1 -- 172.21.15.122:0/2966716094 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7740c8ce0 con 0x7fa774159b00 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa778f97640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa774159b00 0x7fa774147030 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00c710 tx=0x7fa76c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa770ff9640 1 -- 172.21.15.122:0/2966716094 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c003b80 con 0x7fa774159b00 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa770ff9640 1 -- 172.21.15.122:0/2966716094 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fa76c003d20 con 0x7fa774159b00 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2966716094 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77414ad80 con 0x7fa774159b00 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa770ff9640 1 -- 172.21.15.122:0/2966716094 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c00aa50 con 0x7fa774159b00 2024-09-17T06:09:49.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2966716094 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7740c6ed0 con 0x7fa774159b00 2024-09-17T06:09:49.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.420+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2966716094 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7740b8e20 con 0x7fa774159b00 2024-09-17T06:09:49.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.424+0000 7fa770ff9640 1 -- 172.21.15.122:0/2966716094 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa76c00abf0 con 0x7fa774159b00 2024-09-17T06:09:49.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.424+0000 7fa770ff9640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa760073230 0x7fa760075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:49.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.424+0000 7fa770ff9640 1 -- 172.21.15.122:0/2966716094 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6473+0+0 (secure 0 0 0) 0x7fa76c094e00 con 0x7fa774159b00 2024-09-17T06:09:49.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.424+0000 7fa773fff640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa760073230 0x7fa760075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:49.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.424+0000 7fa773fff640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa760073230 0x7fa760075740 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa764009ad0 tx=0x7fa7640091e0 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:49.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.428+0000 7fa770ff9640 1 -- 172.21.15.122:0/2966716094 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa76c00ce20 con 0x7fa774159b00 2024-09-17T06:09:49.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:49.596+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2966716094 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa77415bf50 con 0x7fa774159b00 2024-09-17T06:09:50.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.232+0000 7fa770ff9640 1 -- 172.21.15.122:0/2966716094 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) ==== 169+0+0 (secure 0 0 0) 0x7fa76c05fc90 con 0x7fa774159b00 2024-09-17T06:09:50.239 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_data' removed 2024-09-17T06:09:50.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.240+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa760073230 msgr2=0x7fa760075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:50.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.240+0000 7fa77a9fa640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa760073230 0x7fa760075740 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa764009ad0 tx=0x7fa7640091e0 comp rx=0 tx=0).stop 2024-09-17T06:09:50.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.240+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2966716094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa774159b00 msgr2=0x7fa774147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:50.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.240+0000 7fa77a9fa640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa774159b00 0x7fa774147030 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00c710 tx=0x7fa76c00cbd0 comp rx=0 tx=0).stop 2024-09-17T06:09:50.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.240+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2966716094 shutdown_connections 2024-09-17T06:09:50.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.240+0000 7fa77a9fa640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa774159b00 0x7fa774147030 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:50.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.240+0000 7fa77a9fa640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa7740c6780 0x7fa77414a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:50.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.240+0000 7fa77a9fa640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7fa760073230 0x7fa760075740 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:50.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.240+0000 7fa77a9fa640 1 --2- 172.21.15.122:0/2966716094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa774072870 0x7fa7740c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:50.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.240+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2966716094 >> 172.21.15.122:0/2966716094 conn(0x7fa7740746d0 msgr2=0x7fa77414dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:50.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.240+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2966716094 shutdown_connections 2024-09-17T06:09:50.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.240+0000 7fa77a9fa640 1 -- 172.21.15.122:0/2966716094 wait complete. 2024-09-17T06:09:50.272 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-17T06:09:50.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.424+0000 7f99ef31d640 1 -- 172.21.15.122:0/2055656862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e8159b10 msgr2=0x7f99e8072350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:50.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.424+0000 7f99ef31d640 1 --2- 172.21.15.122:0/2055656862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e8159b10 0x7f99e8072350 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f99e80b8500 tx=0x7f99d801c8c0 comp rx=0 tx=0).stop 2024-09-17T06:09:50.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.424+0000 7f99ef31d640 1 -- 172.21.15.122:0/2055656862 shutdown_connections 2024-09-17T06:09:50.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.424+0000 7f99ef31d640 1 --2- 172.21.15.122:0/2055656862 >> v2:172.21.15.173:3300/0 conn(0x7f99e80c6780 0x7f99e8072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:50.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.424+0000 7f99ef31d640 1 --2- 172.21.15.122:0/2055656862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e8159b10 0x7f99e8072350 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:50.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.424+0000 7f99ef31d640 1 -- 172.21.15.122:0/2055656862 >> 172.21.15.122:0/2055656862 conn(0x7f99e80746d0 msgr2=0x7f99e8074ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:50.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.424+0000 7f99ef31d640 1 -- 172.21.15.122:0/2055656862 shutdown_connections 2024-09-17T06:09:50.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.424+0000 7f99ef31d640 1 -- 172.21.15.122:0/2055656862 wait complete. 2024-09-17T06:09:50.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ef31d640 1 Processor -- start 2024-09-17T06:09:50.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ef31d640 1 -- start start 2024-09-17T06:09:50.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ef31d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99e80b8ba0 0x7f99e80c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:50.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ef31d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e80c6780 0x7f99e813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:50.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ef31d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e8159b10 0x7f99e813e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:50.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ef31d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f99e8165db0 con 0x7f99e8159b10 2024-09-17T06:09:50.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ef31d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f99e8165c30 con 0x7f99e80c6780 2024-09-17T06:09:50.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ef31d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f99e8165f30 con 0x7f99e80b8ba0 2024-09-17T06:09:50.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ed8ba640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e8159b10 0x7f99e813e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:50.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ed8ba640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e8159b10 0x7f99e813e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:56650/0 (socket says 172.21.15.122:56650) 2024-09-17T06:09:50.435 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ed8ba640 1 -- 172.21.15.122:0/2721130203 learned_addr learned my addr 172.21.15.122:0/2721130203 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ec8b8640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e80c6780 0x7f99e813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ed0b9640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99e80b8ba0 0x7f99e80c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ed8ba640 1 -- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99e80b8ba0 msgr2=0x7f99e80c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ed8ba640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99e80b8ba0 0x7f99e80c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ed8ba640 1 -- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e80c6780 msgr2=0x7f99e813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ed8ba640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e80c6780 0x7f99e813ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ed8ba640 1 -- 172.21.15.122:0/2721130203 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e814d430 con 0x7f99e8159b10 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ed0b9640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99e80b8ba0 0x7f99e80c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ed8ba640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e8159b10 0x7f99e813e340 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f99e000cb00 tx=0x7f99e000a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ddffb640 1 -- 172.21.15.122:0/2721130203 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e0003980 con 0x7f99e8159b10 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ddffb640 1 -- 172.21.15.122:0/2721130203 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f99e0003c50 con 0x7f99e8159b10 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ef31d640 1 -- 172.21.15.122:0/2721130203 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e813b150 con 0x7f99e8159b10 2024-09-17T06:09:50.436 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ddffb640 1 -- 172.21.15.122:0/2721130203 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e0003e60 con 0x7f99e8159b10 2024-09-17T06:09:50.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.428+0000 7f99ef31d640 1 -- 172.21.15.122:0/2721130203 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e8146a80 con 0x7f99e8159b10 2024-09-17T06:09:50.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.432+0000 7f99ef31d640 1 -- 172.21.15.122:0/2721130203 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e814d600 con 0x7f99e8159b10 2024-09-17T06:09:50.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.432+0000 7f99ddffb640 1 -- 172.21.15.122:0/2721130203 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f99e0004290 con 0x7f99e8159b10 2024-09-17T06:09:50.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.432+0000 7f99ddffb640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f99cc073230 0x7f99cc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T06:09:50.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.432+0000 7f99ddffb640 1 -- 172.21.15.122:0/2721130203 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5914+0+0 (secure 0 0 0) 0x7f99e0094b40 con 0x7f99e8159b10 2024-09-17T06:09:50.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.432+0000 7f99ed0b9640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f99cc073230 0x7f99cc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T06:09:50.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.432+0000 7f99ed0b9640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f99cc073230 0x7f99cc075740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f99e4001630 tx=0x7f99e4009040 comp rx=0 tx=0).ready entity=mgr.4120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T06:09:50.441 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.436+0000 7f99ddffb640 1 -- 172.21.15.122:0/2721130203 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f99e0014070 con 0x7f99e8159b10 2024-09-17T06:09:50.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:50.624+0000 7f99ef31d640 1 -- 172.21.15.122:0/2721130203 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f99e814f960 con 0x7f99e8159b10 2024-09-17T06:09:51.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.236+0000 7f99ddffb640 1 -- 172.21.15.122:0/2721130203 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v89) ==== 178+0+0 (secure 0 0 0) 0x7f99e005fb10 con 0x7f99e8159b10 2024-09-17T06:09:51.241 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'cephfs_data_ec' removed 2024-09-17T06:09:51.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.240+0000 7f99ef31d640 1 -- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f99cc073230 msgr2=0x7f99cc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:51.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.240+0000 7f99ef31d640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f99cc073230 0x7f99cc075740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f99e4001630 tx=0x7f99e4009040 comp rx=0 tx=0).stop 2024-09-17T06:09:51.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.240+0000 7f99ef31d640 1 -- 172.21.15.122:0/2721130203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e8159b10 msgr2=0x7f99e813e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T06:09:51.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.240+0000 7f99ef31d640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e8159b10 0x7f99e813e340 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f99e000cb00 tx=0x7f99e000a250 comp rx=0 tx=0).stop 2024-09-17T06:09:51.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.244+0000 7f99ef31d640 1 -- 172.21.15.122:0/2721130203 shutdown_connections 2024-09-17T06:09:51.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.244+0000 7f99ef31d640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e8159b10 0x7f99e813e340 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:51.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.244+0000 7f99ef31d640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:6800/1192300952,v1:172.21.15.173:6801/1192300952] conn(0x7f99cc073230 0x7f99cc075740 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:51.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.244+0000 7f99ef31d640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99e80c6780 0x7f99e813ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:51.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.244+0000 7f99ef31d640 1 --2- 172.21.15.122:0/2721130203 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99e80b8ba0 0x7f99e80c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T06:09:51.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.244+0000 7f99ef31d640 1 -- 172.21.15.122:0/2721130203 >> 172.21.15.122:0/2721130203 conn(0x7f99e80746d0 msgr2=0x7f99e81471a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T06:09:51.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.244+0000 7f99ef31d640 1 -- 172.21.15.122:0/2721130203 shutdown_connections 2024-09-17T06:09:51.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-17T06:09:51.244+0000 7f99ef31d640 1 -- 172.21.15.122:0/2721130203 wait complete. 2024-09-17T06:09:51.273 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T06:09:51.274 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T06:09:51.274 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:51.286 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T06:09:51.286 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T06:09:51.286 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:51.349 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T06:09:51.350 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-17T06:09:51.350 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:51.410 INFO:tasks.ceph.mds.e:Stopped 2024-09-17T06:09:51.410 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T06:09:51.410 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:51.436 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T06:09:51.436 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T06:09:51.436 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:51.496 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T06:09:51.496 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-17T06:09:51.496 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:51.559 INFO:tasks.ceph.mds.f:Stopped 2024-09-17T06:09:51.559 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T06:09:51.559 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T06:09:51.560 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:51.658 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T06:09:51.658 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T06:09:51.658 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:51.726 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T06:09:51.727 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T06:09:51.727 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:51.800 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T06:09:51.800 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T06:09:51.800 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:51.901 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T06:09:51.901 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T06:09:51.902 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:51.979 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T06:09:51.979 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T06:09:51.979 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:52.080 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T06:09:52.080 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T06:09:52.081 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:53.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-17T06:09:58.183 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T06:09:58.183 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T06:09:58.183 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:58.238 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T06:09:58.239 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T06:09:58.239 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T06:09:58.239 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:58.273 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T06:09:58.273 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T06:09:58.273 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:58.305 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T06:09:58.305 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T06:09:58.305 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T06:09:58.305 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:58.333 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T06:09:58.333 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T06:09:58.333 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:58.363 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T06:09:58.363 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T06:09:58.364 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T06:09:58.437 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T06:09:58.437 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T06:09:58.437 DEBUG:teuthology.orchestra.run.smithi122:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v MDS_SLOW_METADATA_IO | egrep -v MDS_TRIM | head -n 1 2024-09-17T06:09:58.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-17T06:09:58.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-17T06:09:58.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-17T06:09:58.466 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T06:09:58.466 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T06:09:58.822 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T06:09:58.823 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T06:09:59.007 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T06:09:59.008 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T06:09:59.199 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T06:09:59.199 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T06:09:59.382 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-17T06:09:59.383 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T06:09:59.858 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-17T06:09:59.858 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T06:10:00.118 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-17T06:10:00.118 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T06:10:00.258 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-17T06:10:00.258 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T06:10:00.400 INFO:tasks.ceph:Archiving mon data... 2024-09-17T06:10:00.401 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652/data/mon.a.tgz 2024-09-17T06:10:00.401 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-09-17T06:10:00.407 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.UUc2ngO2a9 2024-09-17T06:10:00.408 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.UUc2ngO2a9 2024-09-17T06:10:00.556 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.UUc2ngO2a9 2024-09-17T06:10:00.622 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.UUc2ngO2a9 is 422KB 2024-09-17T06:10:00.685 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.UUc2ngO2a9 2024-09-17T06:10:00.690 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652/data/mon.b.tgz 2024-09-17T06:10:00.690 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-09-17T06:10:00.696 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.Jm9jqt1mcE 2024-09-17T06:10:00.697 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Jm9jqt1mcE 2024-09-17T06:10:00.878 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.Jm9jqt1mcE 2024-09-17T06:10:00.944 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.Jm9jqt1mcE is 566KB 2024-09-17T06:10:01.006 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.Jm9jqt1mcE 2024-09-17T06:10:01.012 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652/data/mon.c.tgz 2024-09-17T06:10:01.012 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-09-17T06:10:01.061 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.WTdHu0AERH 2024-09-17T06:10:01.061 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.WTdHu0AERH 2024-09-17T06:10:01.241 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.WTdHu0AERH 2024-09-17T06:10:01.303 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.WTdHu0AERH is 566KB 2024-09-17T06:10:01.366 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.WTdHu0AERH 2024-09-17T06:10:01.373 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T06:10:01.373 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T06:10:01.376 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T06:10:01.435 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T06:10:01.477 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T06:10:01.477 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T06:10:01.479 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652/remote/smithi122/crash 2024-09-17T06:10:01.480 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T06:10:01.492 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652/remote/smithi173/crash 2024-09-17T06:10:01.493 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T06:10:01.531 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T06:10:01.532 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:10:01.544 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T06:10:01.622 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T06:10:01.635 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T06:10:01.647 INFO:tasks.ceph:Compressing logs... 2024-09-17T06:10:01.647 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T06:10:01.680 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T06:10:01.694 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35084.log 2024-09-17T06:10:01.694 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38645.log 2024-09-17T06:10:01.695 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39332.log 2024-09-17T06:10:01.695 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35084.log.gz 2024-09-17T06:10:01.695 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35982.log 2024-09-17T06:10:01.697 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38645.log.gz 2024-09-17T06:10:01.697 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41804.log 2024-09-17T06:10:01.698 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28944.log 2024-09-17T06:10:01.698 INFO:teuthology.orchestra.run.smithi122.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.39332.log.gz 2024-09-17T06:10:01.698 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35982.log.gz 2024-09-17T06:10:01.698 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38725.log 2024-09-17T06:10:01.698 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41804.log.gz 2024-09-17T06:10:01.698 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.28944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36508.log 2024-09-17T06:10:01.698 INFO:teuthology.orchestra.run.smithi122.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.28944.log.gz 2024-09-17T06:10:01.698 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38866.log 2024-09-17T06:10:01.698 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36508.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38725.log.gz 2024-09-17T06:10:01.701 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40301.log 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36508.log.gz 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38354.log 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38866.log.gz 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42263.log 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38354.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40301.log.gz 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40881.log 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38354.log.gz 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41778.log 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42263.log.gz 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39459.log 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40881.log: /var/log/ceph/ceph-client.admin.41778.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40881.log.gz 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T06:10:01.702 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41778.log.gz 2024-09-17T06:10:01.703 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41596.log 2024-09-17T06:10:01.703 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39459.log.gz 2024-09-17T06:10:01.703 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38461.log 2024-09-17T06:10:01.703 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36712.log 2024-09-17T06:10:01.703 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41596.log.gz 2024-09-17T06:10:01.703 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37886.log 2024-09-17T06:10:01.706 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38461.log.gz 2024-09-17T06:10:01.706 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36738.log 2024-09-17T06:10:01.706 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36712.log.gz 2024-09-17T06:10:01.706 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41544.log 2024-09-17T06:10:01.706 INFO:teuthology.orchestra.run.smithi122.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37886.log.gz 2024-09-17T06:10:01.706 INFO:teuthology.orchestra.run.smithi122.stderr:gzip/var/log/ceph/ceph-client.admin.36738.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40195.log 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41544.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36738.log.gz 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40901.log 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41544.log.gz 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40195.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40195.log.gz 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.40901.log: -- /var/log/ceph/ceph-client.admin.35244.log 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.0.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40901.log.gz 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40483.log 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29764.log 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35244.log.gz 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39059.log 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40483.log.gz 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39586.log 2024-09-17T06:10:01.707 INFO:teuthology.orchestra.run.smithi122.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29764.log.gz 2024-09-17T06:10:01.708 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37600.log 2024-09-17T06:10:01.708 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39059.log.gz 2024-09-17T06:10:01.715 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28979.log 2024-09-17T06:10:01.715 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29082.log 2024-09-17T06:10:01.715 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29131.log 2024-09-17T06:10:01.715 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.28979.log: /var/log/ceph/ceph-client.admin.29082.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.36044.log 2024-09-17T06:10:01.716 INFO:teuthology.orchestra.run.smithi173.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28979.log.gz 2024-09-17T06:10:01.716 INFO:teuthology.orchestra.run.smithi173.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29082.log.gz 2024-09-17T06:10:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.29131.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T06:10:01.716 INFO:teuthology.orchestra.run.smithi173.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29131.log.gz 2024-09-17T06:10:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/objectstore_tool.36044.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T06:10:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29034.log 2024-09-17T06:10:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T06:10:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29058.log 2024-09-17T06:10:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.29034.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29003.log 2024-09-17T06:10:01.716 INFO:teuthology.orchestra.run.smithi173.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29034.log.gz 2024-09-17T06:10:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.35096.log 2024-09-17T06:10:01.716 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.29058.log: /var/log/ceph/ceph-client.admin.29003.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T06:10:01.717 INFO:teuthology.orchestra.run.smithi173.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29058.log.gz 2024-09-17T06:10:01.717 INFO:teuthology.orchestra.run.smithi173.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29003.log.gz 2024-09-17T06:10:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/objectstore_tool.35096.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-09-17T06:10:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.34884.log 2024-09-17T06:10:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T06:10:01.721 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/objectstore_tool.34884.log: 94.2% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-09-17T06:10:01.721 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.35300.log 2024-09-17T06:10:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T06:10:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T06:10:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/objectstore_tool.35300.log: 94.0% -- replaced with /var/log/ceph/objectstore_tool.35096.log.gz 2024-09-17T06:10:01.731 INFO:teuthology.orchestra.run.smithi173.stderr: 94.1% -- replaced with /var/log/ceph/objectstore_tool.34884.log.gz 2024-09-17T06:10:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T06:10:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T06:10:01.731 INFO:teuthology.orchestra.run.smithi173.stderr: 93.4% -- replaced with /var/log/ceph/objectstore_tool.36044.log.gz/var/log/ceph/ceph.audit.log: 2024-09-17T06:10:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29106.log 2024-09-17T06:10:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mds.d.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T06:10:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T06:10:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.29106.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29106.log.gz 2024-09-17T06:10:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T06:10:01.740 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mds.b.log: 94.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T06:10:01.740 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T06:10:01.745 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39586.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39586.log.gz 2024-09-17T06:10:01.745 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39866.log 2024-09-17T06:10:01.745 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29168.log 2024-09-17T06:10:01.745 INFO:teuthology.orchestra.run.smithi122.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37600.log.gz 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29175.log 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39866.log.gz 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35930.log 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29168.log.gz 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36062.log 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29175.log.gz 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36894.log 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35930.log: /var/log/ceph/ceph-client.admin.36062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39672.log 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35930.log.gz 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36062.log.gz 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40873.log 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35454.log 2024-09-17T06:10:01.746 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40873.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36894.log.gz 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29184.log 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40873.log.gz 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.39672.log.gz 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37399.log 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39892.log 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29184.log.gz 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37399.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35454.log.gz 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35110.log 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37399.log.gz 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29096.log 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39892.log: /var/log/ceph/ceph-client.admin.35110.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39892.log.gz 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38907.log 2024-09-17T06:10:01.747 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35110.log.gz 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29170.log 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29096.log.gz 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40887.log 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.38907.log.gz 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34996.log 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29170.log.gz 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36764.log 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34996.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40887.log.gz 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42419.log 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34996.log.gz 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34960.log 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36764.log.gz 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T06:10:01.748 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42419.log: /var/log/ceph/ceph-client.admin.34960.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42419.log.gz 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40900.log 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34960.log.gz 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42367.log 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29677.log 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40900.log: /var/log/ceph/ceph-client.admin.42367.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40900.log.gz 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29171.log 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42367.log.gz 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29182.log 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29677.log.gz 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35164.log 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29171.log.gz 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40535.log 2024-09-17T06:10:01.749 INFO:teuthology.orchestra.run.smithi122.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29182.log.gz 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40509.log 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35164.log.gz 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42341.log 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40535.log.gz 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39749.log 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40509.log.gz 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38586.log 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42341.log: /var/log/ceph/ceph-client.admin.39749.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42341.log.gz 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38586.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39749.log.gz 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41908.log 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38586.log.gz 2024-09-17T06:10:01.750 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38253.log 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29153.log 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41908.log.gz 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39748.log 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29153.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38253.log.gz 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41109.log 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29153.log.gz 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29600.log 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37591.log 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39748.log.gz 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41109.log.gz 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42101.log 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29600.log.gz 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36526.log 2024-09-17T06:10:01.751 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37591.log: /var/log/ceph/ceph-client.admin.42101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35192.log 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37591.log.gz 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42101.log.gz 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37211.log 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36526.log: /var/log/ceph/ceph-client.admin.35192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37556.log 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36526.log.gz 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35192.log.gz 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42185.log 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37211.log.gz 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39239.log 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37556.log.gz 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35800.log 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42185.log.gz 2024-09-17T06:10:01.752 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35402.log 2024-09-17T06:10:01.753 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39239.log: /var/log/ceph/ceph-client.admin.35800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40249.log 2024-09-17T06:10:01.753 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35800.log.gz 2024-09-17T06:10:01.753 INFO:teuthology.orchestra.run.smithi122.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.39239.log.gz 2024-09-17T06:10:01.753 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41341.log 2024-09-17T06:10:01.753 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35402.log.gz 2024-09-17T06:10:01.753 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41289.log 2024-09-17T06:10:01.753 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40249.log.gz 2024-09-17T06:10:01.753 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36532.log 2024-09-17T06:10:01.753 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41289.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41341.log.gz 2024-09-17T06:10:01.753 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36320.log 2024-09-17T06:10:01.753 INFO:teuthology.orchestra.run.smithi122.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41289.log.gz 2024-09-17T06:10:01.753 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36324.log 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36532.log: /var/log/ceph/ceph-client.admin.36320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36842.log 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36320.log.gz 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36532.log.gz 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36306.log 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36842.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36324.log.gz 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40686.log 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36842.log.gz 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36955.log 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36306.log: /var/log/ceph/ceph-client.admin.40686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36504.log 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36306.log.gz 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40686.log.gz 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40379.log 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29177.log 2024-09-17T06:10:01.754 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36504.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36955.log.gz 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40379.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36504.log.gz 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37133.log 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40379.log.gz 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35218.log 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29177.log.gz 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28964.log 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37133.log: /var/log/ceph/ceph-client.admin.35218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35324.log 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37133.log.gz 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35218.log.gz 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.28964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35632.log 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.28964.log.gz 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37951.log 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35632.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35324.log.gz 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41081.log 2024-09-17T06:10:01.755 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42393.log 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37951.log.gz 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35774.log 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41081.log.gz 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35350.log 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42393.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.35632.log.gz 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38412.log 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42393.log.gz 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35774.log.gz 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr:gzip/var/log/ceph/ceph-client.admin.35350.log: -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38412.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35350.log.gz 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29107.log 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.3.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39383.log 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38412.log.gz 2024-09-17T06:10:01.756 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29160.log 2024-09-17T06:10:01.757 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29107.log: /var/log/ceph/ceph-client.admin.39383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42156.log 2024-09-17T06:10:01.757 INFO:teuthology.orchestra.run.smithi122.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29107.log.gz 2024-09-17T06:10:01.757 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39383.log.gz 2024-09-17T06:10:01.757 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36309.log 2024-09-17T06:10:01.757 INFO:teuthology.orchestra.run.smithi122.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29160.log.gz 2024-09-17T06:10:01.757 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29144.log 2024-09-17T06:10:01.757 INFO:teuthology.orchestra.run.smithi122.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42156.log.gz 2024-09-17T06:10:01.757 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41097.log 2024-09-17T06:10:01.757 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36309.log: /var/log/ceph/ceph-client.admin.29144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37857.log 2024-09-17T06:10:01.757 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36309.log.gz 2024-09-17T06:10:01.757 INFO:teuthology.orchestra.run.smithi122.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29144.log.gz 2024-09-17T06:10:01.757 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35878.log 2024-09-17T06:10:01.758 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41097.log.gz 2024-09-17T06:10:01.758 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40679.log 2024-09-17T06:10:01.758 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37857.log.gz 2024-09-17T06:10:01.758 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42445.log 2024-09-17T06:10:01.758 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40353.log 2024-09-17T06:10:01.758 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40679.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35878.log.gz 2024-09-17T06:10:01.758 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42445.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.40679.log.gz 2024-09-17T06:10:01.758 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37701.log 2024-09-17T06:10:01.758 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42445.log.gz 2024-09-17T06:10:01.758 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36102.log 2024-09-17T06:10:01.759 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40353.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40353.log.gz 2024-09-17T06:10:01.759 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40223.log 2024-09-17T06:10:01.759 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37440.log 2024-09-17T06:10:01.759 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37701.log.gz 2024-09-17T06:10:01.759 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36102.log.gz 2024-09-17T06:10:01.759 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41700.log 2024-09-17T06:10:01.759 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40223.log.gz 2024-09-17T06:10:01.759 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37440.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T06:10:01.760 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29155.log 2024-09-17T06:10:01.765 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.29155.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29155.log.gz 2024-09-17T06:10:01.772 INFO:teuthology.orchestra.run.smithi173.stderr: 94.1% -- replaced with /var/log/ceph/objectstore_tool.35300.log.gz 2024-09-17T06:10:01.785 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37440.log.gz 2024-09-17T06:10:01.786 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39647.log 2024-09-17T06:10:01.786 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41700.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36322.log 2024-09-17T06:10:01.786 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41700.log.gz 2024-09-17T06:10:01.786 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40457.log 2024-09-17T06:10:01.786 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39647.log.gz 2024-09-17T06:10:01.786 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35691.log 2024-09-17T06:10:01.786 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36322.log.gz 2024-09-17T06:10:01.786 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41107.log 2024-09-17T06:10:01.786 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40457.log: /var/log/ceph/ceph-client.admin.35691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41369.log 2024-09-17T06:10:01.786 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2%/var/log/ceph/ceph-client.admin.41107.log: -- replaced with /var/log/ceph/ceph-client.admin.35691.log.gz 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40457.log.gz 2024-09-17T06:10:01.786 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-17T06:10:01.786 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41107.log.gz 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38096.log 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39992.log 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7%/var/log/ceph/ceph-client.admin.38096.log: -- replaced with /var/log/ceph/ceph-client.admin.41369.log.gz 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41108.log 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.38096.log.gz 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39992.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39992.log.gz 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36305.log 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38548.log 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3%/var/log/ceph/ceph-client.admin.36305.log: -- replaced with /var/log/ceph/ceph-client.admin.41108.log.gz 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40561.log 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36305.log.gz 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38548.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38548.log.gz 2024-09-17T06:10:01.787 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35376.log 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40690.log 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40561.log.gz/var/log/ceph/ceph-client.admin.35376.log: 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41934.log 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35376.log.gz 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40690.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40690.log.gz 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39518.log 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35298.log 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.41934.log.gz 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36116.log 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39518.log.gz 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35298.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35298.log.gz 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37185.log 2024-09-17T06:10:01.788 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41882.log 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36116.log.gz/var/log/ceph/ceph-client.admin.37185.log: 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34752.log 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37185.log.gz 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41882.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41882.log.gz 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41438.log 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38820.log 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.34752.log: /var/log/ceph/ceph-client.admin.41438.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34752.log.gz 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.24066.log 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr: 87.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41096.log 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41438.log.gz 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38820.log: /var/log/ceph/ceph.tmp-client.admin.24066.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.24066.log.gz 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38820.log.gz 2024-09-17T06:10:01.789 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41490.log 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36098.log 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41096.log.gz/var/log/ceph/ceph-client.admin.41490.log: 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36036.log 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41490.log.gz 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36098.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36098.log.gz 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40587.log 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36524.log 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36036.log: /var/log/ceph/ceph-client.admin.40587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39180.log 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36524.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36036.log.gz 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40587.log.gz 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40886.log 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36524.log.gz 2024-09-17T06:10:01.790 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37469.log 2024-09-17T06:10:01.791 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39180.log: /var/log/ceph/ceph-client.admin.40886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37241.log 2024-09-17T06:10:01.791 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37469.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40886.log.gz 89.7% 2024-09-17T06:10:01.791 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39180.log.gz 2024-09-17T06:10:01.791 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35826.log 2024-09-17T06:10:01.791 INFO:teuthology.orchestra.run.smithi122.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37469.log.gz 2024-09-17T06:10:01.791 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36300.log 2024-09-17T06:10:01.791 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37241.log: /var/log/ceph/ceph-client.admin.35826.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T06:10:01.791 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36300.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35826.log.gz 2024-09-17T06:10:01.791 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36300.log.gz 2024-09-17T06:10:01.791 INFO:teuthology.orchestra.run.smithi122.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.37241.log.gz 2024-09-17T06:10:01.791 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42073.log 2024-09-17T06:10:01.791 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36112.log 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.42073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41396.log 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36112.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42073.log.gz 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36112.log.gz 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29624.log 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40164.log 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41396.log: /var/log/ceph/ceph-client.admin.29624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38585.log 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40164.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41396.log.gz 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29624.log.gz 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41726.log 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40164.log.gz 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37279.log 2024-09-17T06:10:01.792 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38585.log: /var/log/ceph/ceph-client.admin.41726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35504.log 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37279.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41726.log.gz 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38585.log.gz 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42315.log 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37279.log.gz 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37159.log 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35504.log.gz 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36790.log 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42315.log: /var/log/ceph/ceph-client.admin.37159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41752.log 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37159.log.gz 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42315.log.gz/var/log/ceph/ceph-client.admin.36790.log: 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36790.log.gz 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38213.log 2024-09-17T06:10:01.793 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42239.log 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41752.log: /var/log/ceph/ceph-client.admin.38213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38182.log 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38213.log.gz/var/log/ceph/ceph-client.admin.42239.log: 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41752.log.gz 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42239.log.gz 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35428.log 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28976.log 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38182.log: /var/log/ceph/ceph-client.admin.35428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38071.log 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.28976.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35428.log.gz 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr: 91.1% 79.6% -- replaced with /var/log/ceph/ceph-client.admin.38182.log.gz -- replaced with /var/log/ceph/ceph-client.admin.28976.log.gz 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42211.log 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41315.log 2024-09-17T06:10:01.794 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38071.log: /var/log/ceph/ceph-client.admin.42211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41090.log 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41315.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38071.log.gz 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42211.log.gz 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40405.log 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41315.log.gz 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36527.log 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41090.log: /var/log/ceph/ceph-client.admin.40405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37281.log 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36527.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41090.log.gz 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40405.log.gz 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36115.log 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36527.log.gz 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41987.log 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37281.log: /var/log/ceph/ceph-client.admin.36115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37657.log 2024-09-17T06:10:01.795 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41987.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36115.log.gz 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37281.log.gz 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41987.log.gz 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35748.log 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38729.log 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37657.log: /var/log/ceph/ceph-client.admin.35748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29000.log 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38729.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35748.log.gz 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37657.log.gz 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38729.log.gz 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41960.log 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39148.log 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29000.log: /var/log/ceph/ceph-client.admin.41960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29162.log 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39148.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41960.log.gz 2024-09-17T06:10:01.796 INFO:teuthology.orchestra.run.smithi122.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29000.log.gz 2024-09-17T06:10:01.804 INFO:teuthology.orchestra.run.smithi173.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T06:10:01.814 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39148.log.gz 2024-09-17T06:10:01.814 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40687.log 2024-09-17T06:10:01.814 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36111.log 2024-09-17T06:10:01.814 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29162.log: /var/log/ceph/ceph-client.admin.40687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36114.log 2024-09-17T06:10:01.814 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36111.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29162.log.gz 2024-09-17T06:10:01.814 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40687.log.gz 2024-09-17T06:10:01.814 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29090.log 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36111.log.gz 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40893.log 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36114.log: /var/log/ceph/ceph-client.admin.29090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41091.log 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr: 86.4%/var/log/ceph/ceph-client.admin.40893.log: -- replaced with /var/log/ceph/ceph-client.admin.29090.log.gz 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36114.log.gz 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40893.log.gz 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35956.log 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41091.log: gzip -5 --verbose/var/log/ceph/ceph.audit.log: -- /var/log/ceph/ceph-mds.c.log 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35956.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41091.log.gz 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42016.log 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35956.log.gz 2024-09-17T06:10:01.815 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mds.c.log: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40137.log 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3%/var/log/ceph/ceph-mds.a.log: -- replaced with /var/log/ceph/ceph-client.admin.42016.log.gz 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40688.log 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36528.log 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40137.log: /var/log/ceph/ceph-client.admin.40688.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40137.log.gz 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40688.log.gz 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35852.log 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39243.log 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36528.log: /var/log/ceph/ceph-client.admin.35852.log: 94.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36528.log.gz 2024-09-17T06:10:01.816 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35852.log.gz 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38320.log 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38956.log 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39243.log.gz 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37519.log 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39484.log 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38320.log.gz 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38956.log: /var/log/ceph/ceph-client.admin.37519.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38956.log.gz 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37519.log.gz 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38001.log 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37080.log 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39484.log.gz/var/log/ceph/ceph-client.admin.38001.log: 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38043.log 2024-09-17T06:10:01.817 INFO:teuthology.orchestra.run.smithi122.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38001.log.gz 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.0.37080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36008.log 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36106.log 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38043.log: /var/log/ceph/ceph-client.admin.36008.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38043.log.gz 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37816.log 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36008.log.gz 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36106.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36106.log.gz 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40613.log 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28988.log 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37816.log: /var/log/ceph/ceph-client.admin.40613.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37816.log.gz 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40613.log.gz 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42471.log 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37729.log 2024-09-17T06:10:01.818 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.28988.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.28988.log.gz 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41570.log 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42471.log.gz 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.37729.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37729.log.gz 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35136.log 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40431.log 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41570.log: /var/log/ceph/ceph-client.admin.35136.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41570.log.gz 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41464.log 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35136.log.gz 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40431.log: 93.6% -- replaced with /var/log/ceph/ceph-client.0.37080.log.gz 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40431.log.gz 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40673.log 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41622.log 2024-09-17T06:10:01.819 INFO:teuthology.orchestra.run.smithi122.stderr: 87.1%/var/log/ceph/ceph-client.admin.40673.log: -- replaced with /var/log/ceph/ceph-client.admin.41464.log.gz 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36816.log 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40673.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40693.log 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41622.log: /var/log/ceph/ceph-client.admin.36816.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41622.log.gz 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36816.log.gz 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38491.log 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41516.log 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40693.log: /var/log/ceph/ceph-client.admin.38491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29167.log 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41516.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40693.log.gz 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38491.log.gz 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38649.log 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41516.log.gz 2024-09-17T06:10:01.820 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29167.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29167.log.gz 2024-09-17T06:10:01.821 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28932.log 2024-09-17T06:10:01.821 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36868.log 2024-09-17T06:10:01.821 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38649.log: /var/log/ceph/ceph-client.admin.28932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42046.log 2024-09-17T06:10:01.821 INFO:teuthology.orchestra.run.smithi122.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.28932.log.gz 2024-09-17T06:10:01.821 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36868.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38649.log.gz 2024-09-17T06:10:01.821 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36868.log.gz 2024-09-17T06:10:01.832 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39417.log 2024-09-17T06:10:01.832 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29178.log 2024-09-17T06:10:01.832 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42046.log: /var/log/ceph/ceph-client.admin.39417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39084.log 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29178.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42046.log.gz 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39417.log.gz 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr: 86.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40639.log 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29178.log.gz 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39937.log 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.39084.log: /var/log/ceph/ceph-client.admin.40639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42289.log 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9%/var/log/ceph/ceph-client.admin.39937.log: -- replaced with /var/log/ceph/ceph-client.admin.40639.log.gz 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.39084.log.gz 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.39937.log.gz 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40689.log 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28889.log 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42289.log: /var/log/ceph/ceph-client.admin.40689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36312.log 2024-09-17T06:10:01.833 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.28889.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42289.log.gz 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.40689.log.gz 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.28889.log.gz 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41830.log 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42129.log 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36312.log: /var/log/ceph/ceph-client.admin.41830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40891.log 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.42129.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36312.log.gz 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41830.log.gz 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29130.log 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42129.log.gz 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40891.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40891.log.gz 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29012.log 2024-09-17T06:10:01.834 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29130.log: /var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40058.log 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr: 86.6%/var/log/ceph/ceph-client.admin.29012.log: -- replaced with /var/log/ceph/ceph-client.admin.29130.log.gz 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29012.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28913.log 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40058.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.40058.log.gz 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41856.log 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr: 94.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38259.log 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.28913.log: /var/log/ceph/ceph-client.admin.41856.log: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.28913.log.gz 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41856.log.gz 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39555.log 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36525.log 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.38259.log: /var/log/ceph/ceph-client.admin.39555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35904.log 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.36525.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39555.log.gz 2024-09-17T06:10:01.835 INFO:teuthology.orchestra.run.smithi122.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38259.log.gz 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36525.log.gz 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40111.log 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35718.log 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35904.log: /var/log/ceph/ceph-client.admin.40111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40275.log 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35718.log: 87.7% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35904.log.gz 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40111.log.gz 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35718.log.gz 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40327.log 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35272.log 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.40275.log: /var/log/ceph/ceph-client.admin.40327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29163.log 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.35272.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40275.log.gz 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40327.log.gz 2024-09-17T06:10:01.836 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35272.log.gz 2024-09-17T06:10:01.837 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41674.log 2024-09-17T06:10:01.837 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39004.log 2024-09-17T06:10:01.837 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29163.log: /var/log/ceph/ceph-client.admin.41674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41648.log 2024-09-17T06:10:01.837 INFO:teuthology.orchestra.run.smithi122.stderr: 86.7%/var/log/ceph/ceph-client.admin.39004.log: -- replaced with /var/log/ceph/ceph-client.admin.29163.log.gz 2024-09-17T06:10:01.837 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41674.log.gz 2024-09-17T06:10:01.837 INFO:teuthology.orchestra.run.smithi122.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39004.log.gz 2024-09-17T06:10:01.837 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.41648.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41648.log.gz 2024-09-17T06:10:01.838 INFO:teuthology.orchestra.run.smithi173.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T06:10:01.901 INFO:teuthology.orchestra.run.smithi173.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T06:10:01.943 INFO:teuthology.orchestra.run.smithi173.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T06:10:02.071 INFO:teuthology.orchestra.run.smithi122.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T06:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T06:10:02.667 INFO:teuthology.orchestra.run.smithi122.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T06:10:02.686 INFO:teuthology.orchestra.run.smithi122.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T06:10:02.691 INFO:teuthology.orchestra.run.smithi173.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T06:10:02.703 INFO:teuthology.orchestra.run.smithi173.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T06:10:02.727 INFO:teuthology.orchestra.run.smithi122.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T06:10:02.734 INFO:teuthology.orchestra.run.smithi173.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T06:10:02.735 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-17T06:10:02.735 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m1.044s 2024-09-17T06:10:02.735 INFO:teuthology.orchestra.run.smithi173.stderr:user 0m4.413s 2024-09-17T06:10:02.736 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m0.187s 2024-09-17T06:10:02.782 INFO:teuthology.orchestra.run.smithi122.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T06:10:02.783 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-17T06:10:02.783 INFO:teuthology.orchestra.run.smithi122.stderr:real 0m1.101s 2024-09-17T06:10:02.783 INFO:teuthology.orchestra.run.smithi122.stderr:user 0m4.432s 2024-09-17T06:10:02.783 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m0.237s 2024-09-17T06:10:02.784 INFO:tasks.ceph:Archiving logs... 2024-09-17T06:10:02.784 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652/remote/smithi122/log 2024-09-17T06:10:02.785 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T06:10:03.448 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-17T06:10:03.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-17T06:10:03.546 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652/remote/smithi173/log 2024-09-17T06:10:03.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T06:10:04.069 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T06:10:04.078 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T06:10:04.078 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T06:10:04.081 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T06:10:04.161 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T06:10:04.170 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T06:10:04.170 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T06:10:04.173 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T06:10:04.185 INFO:teuthology.orchestra.run.smithi122.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T06:10:04.185 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================== 2024-09-17T06:10:04.186 INFO:teuthology.orchestra.run.smithi122.stdout:*hv01.front.sepi 67.205.162.81 3 u 53 64 377 0.073 -1.839 0.955 2024-09-17T06:10:04.186 INFO:teuthology.orchestra.run.smithi122.stdout:+hv02.front.sepi 63.231.80.2 3 u 61 64 377 0.100 -0.654 0.872 2024-09-17T06:10:04.186 INFO:teuthology.orchestra.run.smithi122.stdout:+hv03.front.sepi 74.6.168.72 3 u 54 64 377 0.077 -0.758 0.946 2024-09-17T06:10:04.186 INFO:teuthology.orchestra.run.smithi122.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T06:10:04.187 INFO:teuthology.orchestra.run.smithi173.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T06:10:04.187 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================== 2024-09-17T06:10:04.187 INFO:teuthology.orchestra.run.smithi173.stdout:+hv01.front.sepi 67.205.162.81 3 u 52 64 377 0.078 -1.979 0.851 2024-09-17T06:10:04.187 INFO:teuthology.orchestra.run.smithi173.stdout:+hv02.front.sepi 63.231.80.2 3 u 63 64 377 0.095 -0.091 1.103 2024-09-17T06:10:04.187 INFO:teuthology.orchestra.run.smithi173.stdout:*hv03.front.sepi 74.6.168.72 3 u 57 64 377 0.122 -1.901 0.821 2024-09-17T06:10:04.187 INFO:teuthology.orchestra.run.smithi173.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T06:10:04.187 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T06:10:04.196 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T06:10:04.197 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T06:10:04.205 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T06:10:04.213 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T06:10:04.221 INFO:teuthology.task.internal:Duration was 1037.539424 seconds 2024-09-17T06:10:04.222 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T06:10:04.230 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T06:10:04.230 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T06:10:04.232 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T06:10:04.270 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T06:10:04.270 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-09-17T06:10:04.270 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T06:10:04.320 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-09-17T06:10:04.320 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T06:10:04.330 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T06:10:04.330 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T06:10:04.368 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T06:10:04.398 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T06:10:04.398 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T06:10:04.440 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T06:10:04.505 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T06:10:04.515 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T06:10:04.516 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T06:10:04.528 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T06:10:04.539 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T06:10:04.549 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T06:10:04.571 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T06:10:04.579 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-09-17T06:10:04.599 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-09-17T06:10:04.626 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T06:10:04.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T06:10:04.638 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T06:10:04.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T06:10:04.672 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T06:10:04.683 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T06:10:04.684 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652/remote/smithi122 2024-09-17T06:10:04.684 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T06:10:04.704 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908652/remote/smithi173 2024-09-17T06:10:04.705 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T06:10:04.736 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T06:10:04.736 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T06:10:04.744 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T06:10:04.780 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T06:10:04.794 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T06:10:04.794 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T06:10:04.804 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T06:10:04.804 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T06:10:04.806 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T06:10:04.810 INFO:teuthology.orchestra.run.smithi122.stdout: 658642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 06:10 /home/ubuntu/cephtest 2024-09-17T06:10:04.828 INFO:teuthology.orchestra.run.smithi173.stdout: 658645 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 06:10 /home/ubuntu/cephtest 2024-09-17T06:10:04.829 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T06:10:04.840 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T06:10:04.862 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} duration: 1037.5394241809845 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-17T06:10:04.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T06:10:04.949 INFO:teuthology.run:pass